Overview
We are seeking a highly skilled and experienced Technical Team Lead – Databricks & Python to join a high-performing team supporting large-scale data transformation initiatives within Canada's financial services sector.
This role is ideal for a hands-on technical leader who enjoys solving complex engineering challenges, mentoring development teams, and delivering enterprise-grade data solutions in highly regulated environments. You will lead a team of experienced engineers while remaining actively involved in architecture, development, code reviews, and technical decision-making
Responsibilities
- Lead technical delivery across Databricks and Python engineering teams.
- Provide technical leadership for enterprise-scale data engineering initiatives.
- Design, develop, and review solutions built using Databricks, PySpark, Spark SQL, and Delta Lake.
- Establish technical standards, architecture best practices, and development governance.
- Conduct code reviews and mentor senior developers to ensure high-quality software delivery.
- Collaborate with Solution Architects, Product Owners, Business Analysts, QA teams, and stakeholders.
- Drive Agile planning, sprint execution, backlog refinement, and release readiness.
- Optimize large-scale data pipelines for performance, scalability, and reliability.
- Identify delivery risks and develop mitigation strategies.
- Support CI/CD implementation and DevOps best practices.
- Ensure production stability and operational excellence across enterprise data platforms.
- Communicate technical progress and project status to senior leadership.
Required Qualifications & Technical Skills
- 10+ years of professional software engineering experience.
- 5+ years of technical leadership or team lead experience.
- 3+ years of hands-on Databricks development.
- Strong expertise in:
- Python
- PySpark
- Spark SQL
- Delta Lake
- Experience building and optimizing enterprise-scale data pipelines.
- Strong understanding of distributed data processing and performance tuning.
- Experience with CI/CD pipelines and DevOps practices.
- Experience performing architecture reviews and code quality governance.
- Excellent troubleshooting and problem-solving skills.
Financial Services Experience (Mandatory)
- Experience delivering technology solutions within banking, financial services, insurance, capital markets, or other regulated financial environments.
- Understanding of enterprise data platforms, governance, compliance, and regulatory reporting is considered a strong asset.
Pay: $90.00 per hour
Work Location: Hybrid remote in Toronto, ON (Toronto District)
