Markham, On Dataset program manager Jobs – 116 Openings This Week

Technical Solutions Architect, Evals & Fine-Tuning
Innodata Inc. —Toronto, ON
- $190,000–$225,000 a year
- Remote
- Computer Science
- Bachelor's
- No university degree
Quick apply
4d
Product Manager, Risk Tech - Claims
Lyft —Toronto, ON
- $108,000–$135,000 a year
- Hybrid work
- Analysis skills
- No university degree
- Product management
- Commuter benefits
- Dental care
Data Team Lead
Redpath Mining —Vaughan, ON
- Overtime
- Azure
- Computer Science
- DevOps
Data Analyst, People Analytics
Lyft —Toronto, ON
- $90,000–$112,500 a year
- Hybrid work
- SQL
- Analysis skills
- Presentation skills
- Commuter benefits
- Dental care
Senior Data Engineer
Samsara —Toronto, ON
- $135,575–$159,500 a year
- Remote
- Azure
- Computer Science
- Master's degree
Data Science Manager, Rider Experience
Lyft —Toronto, ON
- $172,000–$215,000 a year
- Hybrid work
- Management
- Doctoral degree
- Computer Science
- Commuter benefits
- Dental care
Senior Software Engineer, Organizations
Okta —Toronto, ON
- $136,000–$187,000 a year
- Hybrid work
- Azure
- Schematics
- CAD
- Dental care
- Paid time off
Bioinformatics Analyst
DNAstack —Toronto, ON
- $100,000–$150,000 a year
- Full-time
- Remote
- Azure
- Engineering
- Laboratory experience
- Dental care
- Vision care
Quick apply
Applied Data Scientist, Finance AI Evaluation & Datasets
Innodata Inc. —Toronto, ON
- $210,000–$245,000 a year
- Call to connect
- Remote
- Master's degree
- SQL
- No university degree
Quick apply
4d
Senior Software Engineer (Python + Distributed systems)
Scribd, Inc. —Toronto, ON
- $146,500–$228,000 a year
- Full-time
- Computer Science
- AWS
- Bachelor's
- Disability insurance
- Dental care
Engineer, AI & Software Testing
Magna International —Toronto, ON
- $95,000–$145,000 a year
- Full-time
- Hybrid work
- Azure
- Computer Science
- Engineering
Quick apply
Business Information Architect
Genetec —Toronto, ON
- Full-time
- Remote
- Computer science
- Computer Science
- Master's degree
- Tuition reimbursement
Quick apply
IT Auditor
GFL Environmental —Vaughan, ON
- Computer Science
- ERP systems
- AWS
- Profit sharing
- Wellness program
Staff Software Engineer Data - DC Tech Lead
Afresh —Toronto, ON
- $148,000–$242,000 a year
- Full-time
- Remote
- SQL
- Communication skills
- Python
- Dental care
- Paid time off
Data Quality Engineer-Cards Engineering, Transactional Services and Data Services Engineering
Scotiabank —Scarborough, ON
- Azure
- Computer Science
- DevOps
- Tuition reimbursement
Senior Back End Engineer (Data Platform)
Forma.ai —Toronto, ON
- $150,000–$190,000 a year
- Java
- Databases
- SQL
- Disability insurance
- Dental care
Quick apply
Staff Back End Engineer (Data Platform)
Forma.ai —Toronto, ON
- Java
- Databases
- SQL
- Disability insurance
- Dental care
Quick apply

Related jobs to explore

Based on your search for dataset program manager

Geospatial Program Manager
Planview Utility Services —Markham, ON
Ensure “business-as-usual” solution evolution remains stable across the program while proactively mitigating risks, identifying change impacts, and developing…
$90,000–$120,000 a year
Quick apply
6d
HVAC Project Engineer
Hudson Condominium Solutions Inc. —Toronto, ON
Valid Ontario driver’s licence and access to a reliable vehicle. Review and interpret engineering drawings, specifications, equipment schedules, and project…
$63,300.22–$132,717.43 a year
Quick apply
12d

Show more related jobs

Explore jobs in cities nearby

Check out jobs in cities near your current location, Columbus

Data Quality Engineer-Cards Engineering, Transactional Services and Data Services Engineering
Scotiabank —Scarborough, ON
Operating within an Agile delivery model, you will champion system reliability, drive automation-first testing strategies, and ensure that quality is embedded…

I want to receive the latest job alerts for dataset program manager in markham, on

By signing in to your account, you agree to SimplyHired's Terms of Service and consent to our Cookie and Privacy Policy.

Explore jobs in more locations

dataset program manager jobs near markham, on

Technical Solutions Architect, Evals & Fine-Tuning

Innodata Inc. -
Toronto, ON

Quick apply

Job details

Fixed term contract
$190,000–$225,000 a year
4 days ago

Qualifications

Law
Computer Science
PyTorch
Bachelor's
AI
Python

Full job description

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers.

Scope of the Role:

Innodata partners with leading foundation model labs, hyperscalers, and enterprise AI teams to build the data, evaluation, and post-training systems that make modern LLMs trustworthy and production-ready.

As a Technical Solutions Architect for Evals & Fine-Tuning, you are the technical face of Innodata to our most demanding customers. You sit at the intersection of client AI/ML teams, our research scientists and ML engineers, our subject-matter expert workforce, and our platform teams. You translate ambiguous customer goals — "improve factuality on long-context legal QA," "build a safety eval suite for our next model release," "design a DPO pipeline for our coding assistant" — into concrete, scoped, deliverable engagements.

This is a senior individual-contributor role for someone who has done the work: built fine-tuning pipelines, designed eval harnesses, argued with stakeholders about benchmark validity, and earned credibility with sophisticated ML buyers.

What You'll Own:

Lead technical discovery with prospective and existing customers — foundation model labs, frontier AI teams, and large enterprises — to understand model objectives, gaps, and constraints.
Design end-to-end solutions across the post-training stack: SFT data curation, preference data collection for RLHF/DPO, golden datasets, custom benchmarks, LLM-as-judge pipelines, human-in-the-loop evaluation, red teaming, and multimodal eval (text, image, audio, video, long-context).
Architect engagements that combine Innodata's platforms (GenAI Test & Evaluation Platform, Annotation Platform, GenAI Workbench) with our global SME workforce across 85+ languages and domains.
Author technical proposals, SOWs, solution diagrams, and pricing models in partnership with sales, delivery, and finance.
Run technical workshops, POCs, and pilot designs that de-risk larger programs and prove value quickly.
Serve as the ongoing technical advisor during delivery, partnering with applied research scientists, AI/ML research engineers, language data scientists, and program managers to keep solutions aligned with the original intent.
Feed customer signal back into Innodata's R&D and product roadmap — what benchmarks customers actually want, where eval methodology is breaking, what new fine-tuning paradigms are gaining traction.
Stay current on the state of the art in evals (e.g., dynamic and agentic benchmarks, capability vs. safety evals, long-context and tool-use evaluation) and post-training (SFT, RLHF, DPO, RLAIF, rejection sampling, distillation).
Represent Innodata externally — at customer reviews, conferences, and in technical content.

You'll Thrive in This Role If You Have:

7+ years of experience in applied ML, ML engineering, ML research, or technical solutions roles, with at least 2+ years focused specifically on LLM evaluation and/or post-training.
Hands-on experience fine-tuning LLMs (SFT at minimum; preference optimization methods like RLHF, DPO, or KTO strongly preferred) and designing the data pipelines that feed them.
Deep familiarity with LLM evaluation methodology: public benchmarks and their limitations, custom benchmark construction, LLM-as-judge design and its failure modes, inter-annotator agreement, and human eval workflow design.
Strong fluency in Python and the modern LLM toolchain (Hugging Face, PyTorch, vLLM, evaluation frameworks such as lm-evaluation-harness, lighteval, or equivalents).
Excellent technical communication. You can hold your own in a room with research scientists at a frontier lab and, an hour later, brief a non-technical executive on the same engagement.
A consultative mindset: you ask sharp questions, you push back when a customer's stated request won't actually solve their problem, and you are comfortable owning a recommendation.
Bachelor's or advanced degree in computer science, machine learning, computational linguistics, or related field — or equivalent demonstrated experience.

The expected salary range for this position is $190,000 – $225,000 USD per year, based on experience, skills, and qualifications.

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission's guide at https://consumer.ftc.gov/articles/job-scams.

If you believe you've been targeted by a recruitment scam, please report it to Innodata at [email protected] and consider reporting it to the FTC at ReportFraud.ftc.gov.

Quick apply

Refine Your Search

dataset program manager jobs in markham, on

Technical Solutions Architect, Evals & Fine-Tuning

Product Manager, Risk Tech - Claims

Data Team Lead

Data Analyst, People Analytics

Senior Data Engineer

Data Science Manager, Rider Experience

Senior Software Engineer, Organizations

Bioinformatics Analyst

Applied Data Scientist, Finance AI Evaluation & Datasets

Senior Software Engineer (Python + Distributed systems)

Engineer, AI & Software Testing

Business Information Architect

IT Auditor

Staff Software Engineer Data - DC Tech Lead

Data Quality Engineer-Cards Engineering, Transactional Services and Data Services Engineering

Senior Back End Engineer (Data Platform)

Staff Back End Engineer (Data Platform)

Related jobs to explore

Explore jobs in cities nearby

I want to receive the latest job alerts for dataset program manager in markham, on

Related Searches

Explore jobs in more locations

Job seeker tools

Employer Tools

Browse

Stay Connected