Pareto Jobs

Senior Software Engineer, AI Inference Systems
NVIDIA —Toronto, ON
- $170,000–$220,000 a year
- Full-time
- Hybrid work
- Azure
- Doctoral degree
- Computer Science
Technicien(ne) qualité
Nova Bus —Saint-Eustache, QC
- Temporary
- Bilingual
- English
- Microsoft Office
Technicien Qualité
Eddyfi Technologies —Quebec City, QC
- Full-time
- English
- Microsoft Office
- Quality Control
Quick apply
Test Technician
Woodward Canada Inc. —Peterborough, ON
- From $24 an hour
- Overtime
- Microsoft Excel
- Engineering
- Analysis skills
- Disability insurance
- Dental care
Quick apply
Director of Investor Relations Sales (Canada)
Pareto Publishing - Make The Magic Happen —Canada
- Remote
- Presentation skills
- Travel
- Communication skills
Quick apply
Ingénieur(e) mécanique
VIA Rail Canada —Montréal, QC
- $86,366–$106,687 a year
- Full-time
- Microsoft Office
- Bachelor's
- Continuous improvement
1d
Mechanical Engineer
VIA Rail Canada —Montréal, QC
- $86,366–$106,687 a year
- Full-time
- Engineering
- Microsoft Office
- Bachelor's
1d
Production Support Specialist
Bimeda —Cambridge, ON
- $65,000–$75,000 a year
- Full-time
- Bachelor's
- In-person
- Manufacturing
- Designated paid holidays
- Disability insurance
Quick apply
5d
Conseiller·ère en prévention, Qualité et Environnement (QPE)
Eurovia —Varennes, QC
- Full-time
- Bilingual
- Bachelor's
- Employee assistance program
10d

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Quality and Patient Safety Specialist
Mackenzie Health —Richmond Hill, ON
The Specialist is responsible to facilitate quality improvement initiatives, conduct root cause analysis of patient safety events, support frontline leaders in…
$51.04–$60.61 an hour
Manufacturing Process Engineer
Riverside Natural Foods Ltd. —North York, ON
Continuous improvement: As a learn-as-we-go organization, we rely on each other to continuously improve everything we touch to make it better, more efficient,…
$75,000–$85,000 a year
Quick apply

I want to receive the latest job alerts for pareto

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

pareto jobs near

Technicien Qualité jobs in Saint-Eustache, QC

Senior Software Engineer jobs in Toronto, ON

Ingénieur Mécanique jobs in Montréal, QC

Mechanical Engineer jobs in Montréal, QC

Technicien Qualité jobs in Laval, QC

Technicien Qualité jobs in Quebec Province

Technicien Qualité jobs in Lachine, QC

Technicien Support Informatique jobs in Montréal, QC

Senior Software Engineer jobs in Calgary, AB

Senior Fraud Analyst jobs in Toronto, ON

Senior Software Engineer jobs in Kanata, ON

Electrical Engineer jobs in Halifax, NS

Senior Companionship jobs in Vancouver, BC

Senior Software Engineer jobs in Burlington, ON

Senior Software Engineer jobs in British Columbia

Director jobs in Toronto, ON

Sales Associate jobs in Surrey, BC

Sales Director jobs in Laval, QC

Sales Director jobs in Ottawa, ON

Creative Director jobs in Vancouver, BC

Senior Software Engineer, AI Inference Systems

NVIDIA -
Toronto, ON

Apply Now

Job details

Full-time
$170,000–$220,000 a year

Qualifications

Azure
Rust (programming language)
Go
Node.js
Law
Doctoral degree
Computer Science
Kubernetes
PyTorch
Google Cloud Platform
Master's degree
OS Kernels
AWS
C++
Docker
C
Bachelor's
Distributed systems
Virtualization
GitHub
Linux
AI
Communication skills
Python
Debugging

Full job description

We are seeking highly skilled and motivated software engineers to join us and build AI inference systems that serve large-scale models with extreme efficiency. You’ll architect and implement high-performance inference stacks, optimize GPU kernels and compilers, drive industry benchmarks, and scale workloads across multi-GPU, multi-node, and multi-cloud environments. You’ll collaborate across inference, compiler, scheduling, and performance teams to push the frontier of accelerated computing for AI.

What you’ll be doing:

Contribute features to vLLM that empower the newest models with the latest NVIDIA GPU hardware features; profile and optimize the inference framework (vLLM) with methods like speculative decoding, data/tensor/expert/pipeline-parallelism, prefill-decode disaggregation.
Develop, optimize, and benchmark GPU kernels (hand-tuned and compiler-generated) using techniques such as fusion, autotuning, and memory/layout optimization; build and extend high-level DSLs and compiler infrastructure to boost kernel developer productivity while approaching peak hardware utilization.
Define and build inference benchmarking methodologies and tools; contribute both new benchmark and NVIDIA’s submissions to the industry-leading MLPerf Inference benchmarking suite.
Architect the scheduling and orchestration of containerized large-scale inference deployments on GPU clusters across clouds.
Conduct and publish original research that pushes the pareto frontier for the field of ML Systems; survey recent publications and find a way to integrate research ideas and prototypes into NVIDIA’s software products.

What we need to see:

Bachelor’s degree (or equivalent expeience) in Computer Science (CS), Computer Engineering (CE) or Software Engineering (SE) with 7+ years of experience; alternatively, Master’s degree in CS/CE/SE with 5+ years of experience; or PhD degree with the thesis and top-tier publications in ML Systems, GPU architecture, or high-performance computing.
Strong programming skills in Python and C/C++; experience with Go or Rust is a plus; solid CS fundamentals: algorithms & data structures, operating systems, computer architecture, parallel programming, distributed systems, deep learning theories.
Knowledgeable and passionate about performance engineering in ML frameworks (e.g., PyTorch) and inference engines (e.g., vLLM and SGLang).
Familiarity with GPU programming and performance: CUDA, memory hierarchy, streams, NCCL; proficiency with profiling/debug tools (e.g., Nsight Systems/Compute).
Experience with containers and orchestration (Docker, Kubernetes, Slurm); familiarity with Linux namespaces and cgroups.
Excellent debugging, problem-solving, and communication skills; ability to excel in a fast-paced, multi-functional setting.

Ways to stand out from the crowd

Experience building and optimizing LLM inference engines (e.g., vLLM, SGLang).
Hands-on work with ML compilers and DSLs (e.g., Triton, TorchDynamo/Inductor, MLIR/LLVM, XLA), GPU libraries (e.g., CUTLASS) and features (e.g., CUDA Graph, Tensor Cores).
Experience contributing to containerization/virtualization technologies such as containerd/CRI-O/CRIU.
Experience with cloud platforms (AWS/GCP/Azure), infrastructure as code, CI/CD, and production observability.
Contributions to open-source projects and/or publications; please include links to GitHub pull requests, published papers and artifacts.

At NVIDIA, we believe artificial intelligence (AI) will fundamentally transform how people live and work. Our mission is to advance AI research and development to create groundbreaking technologies that enable anyone to harness the power of AI and benefit from its potential. Our team consists of experts in AI, systems and performance optimization. Our leadership includes world-renowned experts in AI systems who have received multiple academic and industry research awards. If you’re excited to build systems, kernels, and tools that make large-scale AI faster, more efficient, and easier to deploy, we’d love to hear from you.

#LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 170,000 CAD - 220,000 CAD for Level 4, and 225,000 CAD - 275,000 CAD for Level 5.

You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until July 17, 2026.

This posting is for an existing vacancy.

NVIDIA uses AI tools in its recruiting processes.

Apply Now

Refine Your Search

Senior Software Engineer, AI Inference Systems

Technicien(ne) qualité

Technicien Qualité

Test Technician

Director of Investor Relations Sales (Canada)

Ingénieur(e) mécanique

Mechanical Engineer

Production Support Specialist

Conseiller·ère en prévention, Qualité et Environnement (QPE)

Explore jobs in cities nearby

I want to receive the latest job alerts for pareto

Explore jobs in more locations

Job seeker tools

Employer Tools

Browse

Stay Connected