Senior Azure Databricks Engineer (4 days onsite - Calgary)

Senior Azure Databricks Engineer (Contract)

Location: Calgary, AB (Onsite 4 days/week – downtown)

Term: 3–6 months

Engagement: Contract through a consulting firm delivering data engineering projects for multiple enterprise clients Industry: Oil & Gas (experience a plus, not required)

A leading Canadian consulting firm is seeking an experienced Databricks Engineer to support several high-impact client initiatives. This is a hands-on engineering role focused on designing, building, and optimizing data workloads on Azure Databricks, including large-scale migrations, platform modernization, and AI/ML enablement.

You will work directly with consulting delivery teams and enterprise client stakeholders in a fast-moving, collaborative environment. This role requires Calgary-based candidates who are comfortable being onsite 4 days per week.

Key Responsibilities

• Design and develop Azure Databricks solutions using PySpark and SQL
• Build and optimize batch and streaming data pipelines
• Migrate legacy workloads from Synapse and other platforms into Databricks
• Implement Delta Lake patterns (medallion architecture, CDC, data quality)
• Integrate Databricks with Azure services such as ADLS, ADF, Azure Key Vault, and Azure DevOps/GitHub
• Optimize performance and cost (cluster sizing, job orchestration, query tuning)
• Collaborate with architects, analytics engineers, and client teams
• Contribute to reusable accelerators, internal standards, and best practices
• Support client enablement through documentation and knowledge transfer
• Implement governance models and Unity Catalog (access controls, lineage, security frameworks)

Required Skills & Experience

• 7+ years of data engineering experience
• 4+ years of recent, hands-on Databricks engineering (Delta Lake, Unity Catalog, MLflow)
• Strong experience building production pipelines using PySpark and SQL
• Proven experience with Azure data services: ADLS, ADF, Synapse, Key Vault, Azure DevOps
• Experience leading large-scale data migrations and ETL/ELT workload modernization
• Strong understanding of lakehouse architecture, medallion patterns, and modern ELT/ETL approaches
• Experience implementing CI/CD for data workloads
• Strong understanding of enterprise data governance, security, and compliance
• Excellent communication skills with comfort working directly with client teams
• Previous consulting or professional services experience strongly preferred
• Databricks and Azure certifications considered an asset

Ideal Candidate Profile

A strong, hands-on Azure Databricks engineer who:

• Delivers high-quality, production-ready code
• Understands modern data architecture and platform design
• Communicates clearly with technical and non-technical stakeholders
• Thrives in collaborative, client-facing environments
• Is comfortable being onsite 4 days/week
• Can contribute immediately to high-impact migration and modernization projects

Why This Role Stands Out

• Contract through a delivery-focused consulting firm supporting multiple enterprise clients
• Work on high-impact Oil & Gas data initiatives (migration, modernization, AI/ML enablement)
• Exposure to advanced Databricks features and architecture patterns

Only qualified candidates will be contacted for next steps. Thank you in advance for your interest.