This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer (Azure Databricks / Data Engineering) based in Canada.
We are seeking a highly experienced Senior Data Engineer to design, build, and optimize enterprise-scale data platforms using modern cloud technologies.
This role focuses on Azure Databricks, data engineering frameworks, automation, and scalable data solutions that support critical business operations.
You will contribute to the evolution of cloud-based data ecosystems by improving ingestion, transformation, orchestration, and deployment processes.
The position offers the opportunity to work on complex data initiatives involving millions of records while promoting innovation and engineering excellence.
You will collaborate with technology teams, business stakeholders, and platform partners to deliver reliable, governed, and high-performing solutions.
This is an ideal opportunity for a data engineering expert passionate about cloud platforms, automation, and building reusable solutions that create long-term impact.
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer (Azure Databricks / Data Engineering) based in Canada.
We are seeking a highly experienced Senior Data Engineer to design, build, and optimize enterprise-scale data platforms using modern cloud technologies.
This role focuses on Azure Databricks, data engineering frameworks, automation, and scalable data solutions that support critical business operations.
You will contribute to the evolution of cloud-based data ecosystems by improving ingestion, transformation, orchestration, and deployment processes.
The position offers the opportunity to work on complex data initiatives involving millions of records while promoting innovation and engineering excellence.
You will collaborate with technology teams, business stakeholders, and platform partners to deliver reliable, governed, and high-performing solutions.
This is an ideal opportunity for a data engineering expert passionate about cloud platforms, automation, and building reusable solutions that create long-term impact.
Accountabilities:
- Design, develop, and maintain scalable data engineering solutions using Azure Databricks, Python, SQL, and cloud data platforms.
- Build and optimize automated data ingestion, transformation, notebook execution, job scheduling, and deployment processes across Azure-based environments.
- Develop and maintain data pipelines, API services, orchestration workflows, and reusable engineering frameworks.
- Implement best practices for enterprise-grade software development, automation, and modern data engineering methodologies.
- Partner with operations teams to integrate automated and self-service processes for data pipeline, notebook, and API service releases.
- Drive the adoption of AI-enabled development practices, including reusable prompts, skills, instructions, and agents within the software development lifecycle.
- Act as a subject matter expert and technical leader, promoting platform standards, innovation, and continuous improvement.
- Collaborate with technology and business teams to understand data requirements and deliver solutions aligned with organizational objectives.
- Work with vendors and engineering teams to evaluate emerging technologies, frameworks, and cloud data capabilities.
- Support governance, risk management, compliance initiatives, and enterprise data platform standards.
- Identify opportunities to improve productivity and operational efficiency through automation, reusable components, and scalable processing frameworks.
- Provide technical guidance, knowledge sharing, and mentorship to engineering teams and stakeholders.
- 7+ years of experience in data engineering or related technical roles.
- University degree or postgraduate degree in computer science, engineering, mathematics, or a related discipline.
- Strong hands-on expertise with Azure Databricks, Python notebooks, SQL development, and cloud data engineering.
- Extensive experience with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure SQL, Airflow, Unity Catalog, and Lakeflow.
- Proven experience building and managing scalable data pipelines, orchestration frameworks, and API service layers.
- Strong understanding of enterprise-grade software engineering practices and reusable framework development.
- Experience designing solutions capable of processing multi-million record datasets with reliability, performance, and governance.
- Ability to integrate AI capabilities into software development processes through automation and reusable AI-driven workflows.
- Strong stakeholder management, communication, and facilitation skills across technical and business teams.
- Ability to manage priorities, solve complex problems, and deliver high-quality results in a fast-paced environment.
- Health benefits package.
- Referral program.
- Excellent opportunities for professional growth and career advancement.
- Opportunity to work on large-scale cloud data engineering initiatives.
- Exposure to modern technologies, automation practices, and AI-driven engineering solutions.
- Collaborative environment focused on innovation, quality, and continuous learning.
The Senior Data Engineer will be responsible for developing and enhancing modern data platforms, establishing engineering best practices, and enabling scalable data solutions across the organization. The role requires strong technical expertise, collaboration skills, and the ability to drive innovation in a complex enterprise environment.
Requirements:
The ideal candidate is a senior data engineering professional with extensive experience designing enterprise data solutions and working with Azure cloud technologies. You should have strong technical depth, excellent communication abilities, and experience delivering complex data platforms in large-scale environments.