Senior software engineer llm inference Jobs

Python Developer
Citrine Solution —Mississauga, ON
- $120,000–$135,000 a year
- Full-time
- Hybrid work
- DevOps
- Software development
- APIs
Quick apply
AI / ML Engineer
E Source —Calgary, AB
- $115,000–$145,000 a year
- Full-time
- Remote
- Azure
- Doctoral degree
- Computer Science
- Disability insurance
- Dental care
Quick apply
Associate Director, Lead Quality Engineer
Royal Bank of Canada —Toronto, ON
- Full-time
- Computer Science
- DevOps
- Engineering
11d
Machine Learning Engineer , Amazon Customer Service
Amazon Development Centre Canada ULC —Vancouver, BC
- $114,800–$191,800 a year
- Full-time
- Computer Science
- System design
- Master's degree
- Profit sharing
- Dental care
Senior Applied Research Scientist
ServiceNow —Toronto, ON
- Full-time
- Hybrid work
- APIs
- AI
Quick apply
Applied Scientist, Sales AI
Amazon Development Centre Canada ULC —Toronto, ON
- $149,300–$249,300 a year
- Full-time
- Doctoral degree
- Computer Science
- Java
- Profit sharing
- Dental care
Engineering Tech Lead
TTEC Digital —Toronto, ON
- Full-time
- Remote
- APIs
- AI
- Python
Quick apply
Chief Software Engineering Architect
DataStealth —Mississauga, ON
- Full-time
- Hybrid work
- Azure
- Management
- Java
Quick apply
Manager AI and Applied Research
Thomson Reuters —Toronto, ON
- Full-time
- Hybrid work
- Azure
- Management
- Doctoral degree
- Tuition reimbursement
Senior Backend / AI Systems Engineer
Spellbook —Canada
- $170,000–$220,000 a year
- Full-time
- Remote
- Microsoft Word
- AWS
- APIs
- Paid time off
Fullstack AI Platform Engineer
Kindsight —Canada
- Remote
- Azure
- Schematics
- DevOps

I want to receive the latest job alerts for senior software engineer llm inference

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

senior software engineer llm inference jobs near

Python Developer

Citrine Solution
Mississauga, ON

Quick apply

Job details

Full-time
$120,000–$135,000 a year

Qualifications

Law
React
Full-stack development
DevOps
Microservices
Distributed systems
REST
Software development
APIs
AI
Python

Full job description

Role: Gen AI full stack Engineer

JD:

We are looking for a Senior Full Stack Engineer (8+ years’ experience) to join our AI Engineering Team, focused on building and scaling agentic AI solutions and taking AI systems from concept to production-grade, enterprise-ready platforms.

This role requires deep hands-on experience across frontend, backend, AI integration, and DevOps, with strong ownership of system design, deployment, and operational excellence. You will work closely with ML engineers, business owners and product teams to deliver robust, scalable AI-powered applications.

Key Responsibilities

Full Stack & AI Application Development

Design and build end-to-end AI-powered applications using modern frontend and backend frameworks.

Integrate LLM and agentic AI components into user-facing and system-facing workflows.

Develop APIs and services that support agent orchestration, tool calling, and workflow execution.

Build intuitive UIs for AI-assisted workflows, human-in-the-loop interactions, and monitoring.

Agentic AI & Production Systems

Work with ML/Data teams to operationalize models and agentic systems into production.

Implement RAG pipelines, vector search integration, and AI inference layers.

Handle model lifecycle concerns: versioning, configuration, evaluation hooks, and rollout strategies.

Build safeguards, validations, and fallback mechanisms for AI-driven workflows.

DevOps, Reliability & Scale

Own CI/CD pipelines, containerization, and deployment of AI applications.

Ensure systems meet performance, scalability, security, and reliability requirements.

Implement logging, monitoring, alerting, and cost visibility for AI and application components.

Collaborate with platform and security teams to ensure compliance and operational readiness.

Architecture & Collaboration

Contribute to system and application architecture decisions for AI platforms.

Write clean, maintainable, well-tested code and review contributions from peers.

Mentor engineers and raise the bar on engineering and AI delivery practices.

Partner with product and business teams to translate requirements into technical solutions.

Required Qualifications

7+ years of hands-on experience as a Full Stack Engineer or Senior Software Engineer.

Strong proficiency in backend development Python.

Strong experience with modern frontend frameworks React.

Hands-on experience integrating AI/ML or LLM-based services into applications.

Solid understanding of REST APIs, microservices, and distributed systems.

Design and build end-to-end AI-powered applications using modern frontend and backend frameworks.

Pay: $120,000.00-$135,000.00 per year

Application question(s):

Are you Python certified with a minimum of 3 years of hands-on software development experience?
This role is based in Mississauga, ON, under a hybrid model requiring you to work from the office 3 days per week. Are you able and willing to commute to the Mississauga office 3 days a week?

Work Location: In person

Quick apply

Refine Your Search

Python Developer

AI / ML Engineer

Associate Director, Lead Quality Engineer

Machine Learning Engineer , Amazon Customer Service

Senior Applied Research Scientist

Applied Scientist, Sales AI

Engineering Tech Lead

Chief Software Engineering Architect

Manager AI and Applied Research

Senior Backend / AI Systems Engineer

Fullstack AI Platform Engineer

I want to receive the latest job alerts for senior software engineer llm inference

Explore jobs in more locations

Job seeker tools

Employer Tools

Browse

Stay Connected