Azure Developer (ADF & Databricks)

Apex Systems is a global IT services provider and our consulting practice has an opening for a Azure Developer who has experience with SQL, Azure Data Factory and Databrick (ADLS) to drive the design, the development and maintenance of the solutions for at a Top Five Bank.

Client: Big 5 Canadian Bank

Location: Downtown Toronto - Hybrid (1-2 days a week in office)

Terms: 6 Month Contract, strong possibility of extension

Hours: 37.5 hours/week Monday-Friday

Job Summary:

We are looking for an experienced Azure Developer with over 7 years of expertise in database technologies and ETL tools, and at least 5 years of hands-on experience with Azure Data Factory (ADF) and Databricks integrated with Azure Data Lake Storage (ADLS). The ideal candidate will design and build scalable ETL/ELT processes using ADF's visual tools and connectors, document architecture and data flows, and provide regular monitoring and performance tuning. Proficiency in SQL, Python, and PySpark is essential, along with experience in data migration and ETL with Salesforce. The role involves capturing requirements, conducting impact assessments, ensuring adherence to standards, identifying architectural improvements, and mentoring team members. Experience with Azure API Management, Azure Functions, and OOP concepts is a plus.

Required Skills:

• 7+ years of professional experience with database technologies and ETL tools
• 5+ years of Azure ADF (Azure Data Factory) - Designs and builds data migration solution using Azure Data Factory (ADF) through thorough assessment of data workload and identifies appropriate data integration patterns.
• Azure Developer will use ADF's visual tools and associated built-in connectors to construct ETL or ELT processes that are scalable and maintainable.
• Databricks with Azure Data Lake Storage (ADLS).
• Exposure to Data Migration and ETL with Salesforce
• Document architecture, data flows, and transformation logic, often maintained in a version control system for collaboration and compliance.
• Provides regular monitoring, performance tuning, and updating the data transformation logic as needed for existing integrations.
• SQL knowledge is a must
• 5+ years of hands-on experience on designing and developing scripts for custom ETL processes and automation in Azure data factory, Azure databricks, Python, Pyspark etc.
• Good experience of AZURE Cloud platform services stack - Azure Data Factory, Azure SQL Database, AZURE Data Warehouse, Azure databricks, Azure Blob Storage, HD Insight etc.
• Proficient in working with various REST APIs
• Nice to have experience in Azure API Management & Azure Functions
• Knowledgeable in OOP concepts (class-based design and development)

Roles/Responsibilities:

• Works with development teams and senior designers to capture requirements
• Conduct impact assessment with business in order and determine high level design and size of effort based on requirements.
• Work with team to ensure standards and patterns are followed.
• Identifies opportunities for new architectural initiatives makes recommendations on the increasing scalability and robustness of platforms and solutions.
• Support Azure developers by providing technical assistance troubleshooting and alternative development solutions.
• Playing a key role in mentoring other staff members and a proven track record in knowledge transfer to other team members and departments.
• Identifies necessary changes to current business process.
• Communicates risks and ensures understanding of these risks.
• Responsible for leading the design of prototypes and determining final design to ensure client satisfaction with product

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .