toronto, on forward deployed Jobs – 55 Openings This Week

Senior Software Engineer, AI Inference
NVIDIA —Toronto, ON
- $135,000–$220,000 a year
- Full-time
- Hybrid work
- Doctoral degree
- Computer Science
- Engineering
JSOC - Senior Detection Engineer
Questrade Financial Group —Toronto, ON
- $105,000–$116,000 a year
- Full-time
- Hybrid work
- AI
Quick apply
DevOps Administrator
Scene+ —Toronto, ON
- $90,000–$100,000 a year
- Full-time
- Hybrid work
- DevOps
- AWS
- APIs
AI Engineer
GEI Consultants —Vaughan, ON
- $110,000–$150,000 a year
- Full-time
- Hybrid work
- Azure
- SQL
- APIs
- Profit sharing
- Commuter benefits
Quick apply
Solutions Engineer
Owl.co —Toronto, ON
- $150,000–$250,000 a year
- Azure
- AWS
- Project management
- Dental care
- Paid time off
Quick apply
Sr. Consultant, Client Success
Visa Canada Corporation —Toronto, ON
- Full-time
- Hybrid work
- Doctoral degree
- Sales
- Master's degree
Principal Software Engineer
Owl.co —Toronto, ON
- $220,000–$300,000 a year
- Azure
- Computer Science
- Master's degree
- Dental care
- Paid time off
Quick apply
Embedded Systems Engineer
Dominion Dynamics —Toronto, ON
- Full-time
- C++
- JavaScript
- Linux
Applications Engineering, Principal Engineer- 17051
Synopsys —Mississauga, ON
- $159,000–$239,000 a year
- Engineering
- Laboratory experience
- Master's degree
Staff Engineer
Enable —Toronto, ON
- $162,960–$244,440 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- DevOps
- Paid time off
- Life insurance
Quick apply
District Manager, Central Region
Toronto Community Housing —Toronto, ON
- $123,900.46–$148,680.56 a year
- Full-time
- Customer service
- Writing skills
- Maintenance
- Dental care
- Tuition reimbursement
7d
Sr. Software Developer - DMX
TripArc —Toronto, ON
- $110,000–$120,000 a year
- Hybrid work
- Azure
- DevOps
- Databases
Quick apply
Product Manager
SWTCH Energy Inc. —Toronto, ON
- Full-time
- Hybrid work
- Computer Science
- Engineering
- Bachelor's
Quick apply
Senior Data Engineer
Questrade Financial Group —Toronto, ON
- $95,000–$143,000 a year
- Full-time
- Computer Science
- DevOps
- Master's degree
Quick apply
EV Deployment Coordinator
SWTCH Energy Inc. —Toronto, ON
- Full-time
- Remote
- PMP
- Engineering
- Bachelor's
Quick apply
Security Analyst, Managed Security Services
Chisel Solutions —Toronto, ON
- Azure
- Windows
- AWS
Facilities Manager - Scalable FM
CAN ASA-Jones Lang LaSalle Real Estate Services, Inc. —Toronto, ON
- $90,000–$110,000 a year
- Full-time
- Customer service
- Microsoft Office
- Bachelor's
Quick apply
6d
Senior Data Scientist II - AI for Analytics
Instacart —Toronto, ON
- $192,000–$202,500 a year
- Remote
- SQL
- Analysis skills
- Machine learning
Quick apply
5d
Account Director
Forma.ai —Toronto, ON
- Sales
- Disability insurance
- Dental care
Business Operations Manager - Startup
Able Innovations —Toronto, ON
- $70,000–$90,000 a year
- Full-time
- Microsoft Office
- Human resources
- Computer networking
Quick apply

I want to receive the latest job alerts for forward deployed in toronto, on

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

forward deployed jobs near toronto, on

Senior Software Engineer, AI Inference

NVIDIA -
Toronto, ON

Apply Now

Job details

Full-time
$135,000–$220,000 a year

Qualifications

Law
Doctoral degree
Computer Science
Kubernetes
Engineering
Master's degree
OS Kernels
Bachelor's
Computer Engineering
Communication skills
Debugging

Full job description

Help us push the boundaries of AI inference at NVIDIA — where your systems expertise shapes both the technology and the teams building on top of it!

We're looking for a Senior Software Engineer to work at the frontier of large-scale LLM serving, partnering directly with some of the world's most technically demanding customers to unlock the full performance potential of NVIDIA's inference stack. In this role, you'll combine deep systems knowledge with hands-on customer engagement — profiling real deployments, benchmarking across GPU clusters, and turning insights into improvements that ripple across the open-source ecosystem. Do you love digging into performance problems that don't have obvious answers, and want your work to have an impact far beyond a single codebase? We'd love to talk. Unlike traditional customer-facing engineering roles, we expect you to go far deeper — contributing to vLLM, NVIDIA Dynamo, and the tooling that makes every engineer on your team more effective.

What You'll be doing:

Work directly with customer engineering teams through long-term technical partnerships, understanding their LLM serving architectures and performance goals, then designing and implementing end-to-end benchmarking campaigns across Kubernetes and Slurm environments to surface actionable insights.
Set up and operate vLLM serving deployments on GPU clusters, tuning configurations for throughput, latency, and efficiency — and collect Nsight Systems / Nsight Compute profiling traces to identify performance gaps relative to reference frameworks.
Develop detailed performance plans based on profiling findings and collaborate with NVIDIA's kernel engineering and OSS vLLM teams to drive improvements that benefit both your customers and the broader community.
Build internal tools, benchmarking harnesses, and automation pipelines that raise the productivity of your teammates and customers alike — with a multiplier attitude that makes everyone around you more effective.
Document architectures, findings, and recommendations with clarity for technical audiences, and contribute improvements back to vLLM and related open-source projects where appropriate.

What We Need to See:

Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, or equivalent experience.
5+ years of industry experience building and operating complex, production-grade software systems, with strong instincts for how systems behave at scale.
Hands-on experience deploying and operating LLM inference workloads — particularly with vLLM — including configuration, optimization, and debugging in real-world environments.
Proficiency with container orchestration (Kubernetes) and HPC scheduling (Slurm) for running GPU-accelerated workloads.
Solid understanding of LLM serving fundamentals: batching strategies (continuous batching, chunked prefill), KV cache management, and tensor/pipeline parallelism.
Familiarity with GPU performance analysis: memory hierarchy, utilization, roofline modeling, and profiling with Nsight Systems or Nsight Compute.
Strong written and verbal communication skills, with the ability to present technical findings clearly to both engineering teams and leadership — and to navigate ambiguous, open-ended customer problems.

Ways to Stand Out from the Crowd:

Experience with NVIDIA Dynamo or other disaggregated inference serving frameworks.
Contributions to open-source inference or ML systems projects, particularly vLLM or SGLang — please include links to relevant pull requests or artifacts.
Background with ML compilers or GPU kernel development (Triton, CUTLASS, TorchInductor).
Experience building developer tools or internal platforms that meaningfully improved team productivity.
Prior experience in a customer-facing or forward-deployed engineering capacity within a technical product organization.

Widely considered to be one of the technology world's most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 135,000 CAD - 185,000 CAD for Level 3, and 170,000 CAD - 220,000 CAD for Level 4.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until April 14, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Apply Now

Refine Your Search

forward deployed jobs in toronto, on

Senior Software Engineer, AI Inference

JSOC - Senior Detection Engineer

DevOps Administrator

AI Engineer

Solutions Engineer

Sr. Consultant, Client Success

Principal Software Engineer

Embedded Systems Engineer

Applications Engineering, Principal Engineer- 17051

Staff Engineer

District Manager, Central Region

Sr. Software Developer - DMX

Product Manager

Senior Data Engineer

EV Deployment Coordinator

Security Analyst, Managed Security Services

Facilities Manager - Scalable FM

Senior Data Scientist II - AI for Analytics

Account Director

Business Operations Manager - Startup

I want to receive the latest job alerts for forward deployed in toronto, on

Related Searches

Explore jobs in more locations

Job seeker tools

Employer Tools

Browse

Stay Connected