Position: Azure Data Engineer
Location: Toronto - Hybrid
Responsibilities:
- Lead the design and implementation of scalable data architectures using PySpark and Azure Databricks
- Oversee the development and deployment of data pipelines and workflows on Azure
- Provide technical guidance and mentorship to the development team
- Collaborate with cross-functional teams to gather and analyze requirements
- Ensure the performance, security, and reliability of data solutions
- Develop and maintain documentation for data architectures and processes
- Conduct code reviews and ensure adherence to best practices and standards
- Troubleshoot and resolve issues related to data processing and storage
- Optimize data processing workflows for efficiency and scalability
- Stay updated with the latest industry trends and technologies in data engineering
- Contribute to the continuous improvement of data engineering practices within the organization
- Engage with stakeholders to understand business needs and translate them into technical solutions
- Drive innovation and adoption of new technologies to enhance data capabilities
Qualifications
- Must have strong experience in PySpark for data processing and analysis
- Must have extensive experience with Azure Databricks for building and managing data pipelines
- Must have solid understanding of Azure services and their integration
- Nice to have experience with other big data technologies and tools
- Nice to have strong problem-solving skills and ability to troubleshoot complex issues
- Nice to have excellent communication and collaboration skills
Regards
Patrick Fernandez
Talent Acquisition Group - Strategic Recruitment Manager