Seeking a highly skilled and experienced Azure Databricks, Data Factory Developer to join our team of experts in building and deploying data pipelines and data lakes on the Microsoft Azure platform. The successful candidate will have a strong background in Azure Databricks, Data Factory, and related technologies, with experience in designing and implementing data pipelines, data lakes, and data warehouses..
Experience Required
" Minimum 5+ Years of Hands-on experience in Azure DB/DF Developer role.
Key Responsibilities:
" Design, develop, and deploy data pipelines and data lakes on Azure Databricks and Data Factory
" Collaborate with data engineers and data scientists to design and implement data architectures and data pipelines
" Develop and maintain data pipelines using Azure Databricks, Data Factory, and related technologies
" Work with data stakeholders to understand data requirements and develop data pipelines to meet those requirements
" Develop and maintain data lakes and data warehouses on Azure Databricks and Data Factory
" Collaborate with DevOps teams to deploy and monitor data pipelines and data lakes
" Participate in code reviews and ensure that all solutions are aligned with the company's coding standards and best practices
" Stay up-to-date with industry trends and best practices in data engineering and data architecture
Technical Skills:
" 5+ years of experience in data engineering, data architecture, and related technologies
" Strong background in Azure Databricks, Data Factory, and related technologies
" Experience with data pipelines, data lakes, and data warehouses
" Strong understanding of data architecture and data engineering principles
" Experience with data modeling, data governance, and data quality
" Strong programming skills in languages such as Python(Pyspark), Scala, and SQL
" Experience with Azure Databricks, Data Factory, and related technologies
" Bachelor's degree in Computer Science, Information Technology, or related field
Functional Skills
" Strong understanding of data architecture and data engineering principles
" Experience with Azure Databricks, Data Factory, and related technologies
" Strong programming skills in languages such as Python, Scala, and SQL
" Experience with data pipelines, data lakes, and data warehouses
" Strong understanding of data modeling, data governance, and data quality
" Ability to work in a fast-paced environment and prioritize multiple tasks
" Strong analytical and problem-solving skills
Domain experience Banking and Finance domain preferred
Certification/Qualifications Required (If Any) Nice to Have
" Experience with cloud-based data platforms such as Azure Synapse Analytics, Azure Cosmos DB, and Azure Data Lake Storage
" Experience with data science and machine learning frameworks such as scikit-learn, TensorFlow, and PyTorch
" Experience with data visualization tools such as Tableau, Power BI, and D3.js
" Certification in Azure Databricks, Data Factory, or related technologies