Inclusion without Exception:
Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.
TCS is an IT services, consulting, and business solutions organization that has been partnering with many of the world's largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive-powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS operates in 55 countries and employs over 612607,000 of the world's best-trained consultants highly skilled individuals in 55 countries, including more than 10,000 in Canada. The company generated consolidated revenues of US $29 30 billion in the fiscal year ended March 31, 20254 and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4Good Emerging Index.
Key Responsibilities:
• Design and implement scalable data ingestion pipelines using Azure Data Factory (ADF) for batch and real-time data processing.
• Build and optimize ETL workflows using Azure Databricks for transformation and integration of structured and unstructured data.
• Develop and maintain data storage solutions using Azure Data Lake (Gen2).
• Perform data profiling, cleansing, validation, and quality checks as part of the ingestion process.
• Implement CI/CD pipelines for automated data pipeline deployments using Azure DevOps.
• Monitor data pipelines and troubleshoot performance issues, ensuring reliability and accuracy of data ingestion.
• Implement security best practices, including access control and data encryption within Azure ecosystem.
• Create and maintain documentation related to data pipelines, schemas, and data flow diagrams.
• Support UAT and production deployments, ensuring smooth transition and data availability.
Required Skills & Qualifications:
• Good years of experience in data engineering with on Microsoft Azure platform.
• Hands-on expertise in Azure Data Factory (ADF), Azure Databricks, and Azure Data Lake.
• Strong experience in writing Physmark/Scala notebooks in Databricks for ETL/ELT processes.
• Proficient in working with various data formats such as JSON, Parquet and CSV.
• Experience with version control and CI/CD (preferably Azure DevOps).
• Excellent problem-solving skills and ability to work in a fast-paced environment.
Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resources.
Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.