Senior Cloud Data Engineer

The client is seeking a Senior DataOps / Cloud Data Engineer to design, develop, implement, and maintain scalable cloud-based data platforms, pipelines, and integration services. The successful candidate will have strong hands-on experience with Azure Data Services, Azure Data Factory, Databricks, Delta Lake, Databricks SQL, and Medallion Architecture. The role focuses on modern data engineering, DataOps automation, cloud data migration, metadata management, data governance, and enterprise data integration. The candidate will collaborate with data architects, data modellers, governance teams, and technical stakeholders to deliver secure, reliable, and high-performance cloud data solutions.

Key Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines and cloud data platforms.
• Build and manage enterprise data lakes, lakehouses, and data warehouses.
• Implement DataOps practices, CI/CD automation, and data pipeline orchestration.
• Develop automated metadata collection, data quality, and lineage solutions.
• Support cloud data migration, modernization, and enterprise integration initiatives.
• Collaborate with data architects and governance teams to implement data standards and common data models.
• Support cloud-native data architectures and Data as a Service (DaaS), Database as a Service (DBaaS), and Data Warehouse as a Service (DWaaS) solutions.
• Optimize cloud data services for performance, scalability, and reliability.
• Design and execute large-scale data migration and modernization initiatives.
• Migrate very large datasets from OLTP and OLAP environments to cloud platforms.
• Support transitions to SaaS, PaaS, and IaaS environments.

Must-Have Skills

• Strong hands-on experience with Azure Databricks, Delta Lake, and Databricks SQL.
• Solid understanding of Medallion Architecture (Bronze, Silver, Gold).
• Experience with Azure Data Services and Azure Data Factory (ADF).
• Experience with Informatica or equivalent data integration tools.
• Experience operationalizing common data models and metadata repositories.
• Proven experience with ETL/ELT pipelines, DataOps, and CI/CD automation.

Nice-to-Have Skills

• Experience with Microsoft Purview and Microsoft Fabric.
• Previous Ontario Public Service (OPS) or public-sector experience.
• Knowledge of graph technologies and semantic repositories.
• Familiarity with AODA standards and enterprise data governance.