Databricks Developer (Azure)

Client: Big 5 Bank

Location: Downtown Toronto

Hybrid: Every Thursday and 1 Friday of the month (1-2 days a week)

Terms: 6 month contract to hire (conversion to FTE)

FTE Package: Upon conversion - FTE Salary, Bonus, Health Benefits, Perks & more!

Hours/week: 37.5 hours/week

Start date: February/March 2025

Job Summary

We are seeking a skilled Databricks Developer to design, develop, and implement advanced data solutions using Databricks. Along Azure Database Skills, the ideal candidate will have expertise in ETL technologies, data pipelines, and cloud environments to support data-driven decision-making processes. You will work closely with cross-functional teams to transform raw data into actionable insights.

Must Haves:

• Databricks Development

• Azure Database

• Continuous Improvement & Continuous Deployment (CICD)

• Azure Data Factory (ADF)

Key Responsibilities

• Design, develop, and optimize scalable data pipelines and ETL processes using Databricks.

• Collaborate with BA/SME, analysts, and stakeholders to implement DW models and prep the data for advanced analytics.

• Integrate data from various sources, ensuring accuracy, quality, and reliability.

• Develop and maintain workflows for processing structured with various formats.

• Monitor and troubleshoot performance issues in Databricks clusters.

• Adhere to security, compliance, and governance standards for data processing and storage.

• Perform code reviews, testing, and documentation to ensure high-quality deliverables.

• Stay updated on the latest Databricks features and Cloud technologies to propose innovative solutions.

Required Skills and Qualifications

• Proven experience as a Databricks Developer.

• Strong proficiency in Apache Spark and Databricks architecture.

• Expertise in Python, Scala, or SQL for data engineering tasks.

• Hands-on experience with cloud platforms (e.g., Azure).

• Experience in building and maintaining ETL pipelines.

• Familiarity with data lake architectures and distributed systems.

• Strong understanding of data security and compliance standards.

• Excellent problem-solving, communication, and collaboration skills.