Job Title or Location

Principal Data Engineer

Arcadia Search - 2 Jobs
Toronto, ON
Posted yesterday
Job Details:
Full-time
Executive

Role: Principal Data Engineer

Hybrid in downtown Toronto - 1-2 days per week

Type: Full-time Permanent

Salary: - $180-210k base + Bonus

A leading data-driven consultancy is hiring a Principal Data Engineer to lead the design, development, and optimization of a modern data platform built on Azure and Databricks. This role is ideal for someone who thrives on architecture-level thinking, hands-on implementation, and mentoring high-performing teams - all while working on enterprise-scale data environments.

What You'll Do

  • Architect and implement scalable data platforms using Azure Data Lake and Databricks
  • Design and maintain incremental ingestion pipelines leveraging ADF, CDC, and Databricks Auto Loader
  • Build and optimize PySpark workflows for both batch and streaming data
  • Manage and refine Delta Lake architecture across Bronze, Silver, and Gold layers
  • Drive performance tuning and cost optimization of Databricks and Azure SQL workloads
  • Implement and enforce enterprise-grade security, access control, and data governance
  • Collaborate with BI, data science, and business teams to deliver end-to-end solutions
  • Mentor engineers and define best practices across the data team
  • What We're Looking For

    • 10+ years of experience in data engineering, with a focus on Azure cloud technologies
    • Deep expertise with Databricks, PySpark, and Delta Lake
    • Proven ability to architect and maintain pipelines using ADF, Azure SQL, and CDC methods
    • Strong grasp of both batch and streaming architectures
    • Advanced SQL performance tuning skills
    • Familiarity with cloud security, compliance, and governance frameworks
    • Experience leading teams in Agile, delivery-oriented environments
  • Nice to Have

    • Experience with Terraform or Infrastructure-as-Code
    • Certifications in Azure Data Engineering, Databricks, or Terraform
    • Previous work in high-scale enterprise data environments
    • Familiarity with Power BI and its integration with Databricks/ADLS
  • Why Apply?

    • Competitive compensation ($180K-$210K CAD base + bonus)
    • Principal-level ownership of modern Azure-based data platforms
    • Work on mission-critical systems with a team of elite data professionals
    • Opportunity to shape architecture and delivery on high-impact, enterprise-scale projects
    • Remote flexibility with a Toronto-based hub and strong engineering culture

    Share This Job: