Job Title or Location

Data Engineer

ML OUTSOURCING SERVICES PRIVATE LIMITED
Regina , SK
Posted 2 days ago
Job Details:
Full-time
Experienced

Job Title: Data Engineer

Location: Regina, SK

Duration: 12 months, extension up to 4 years

Note- In Person Interview

Job Description:

In order to be considered - the Data Engineer resource MUST have a minimum of 5 years of recent (in last 7 years) in modern data management principles such as, but not limited to ETL, practical data design, architecture, management, modelling, quality, and analytics experience. The successful candidate will demonstrate a broad and solid understanding of these principles. Successful Data Engineer candidate will have:

Educational & Experience Requirements:

• Degree or Diploma in Computer Science, Engineering, Data Sciences, or a quantitative discipline.

• 5+ years' recent experience in ETL, data design, data architecture, data management, and data modelling.

• Relevant job experience in North America Core.

Technical Skills:

• SQL Server & SSIS: Expert proficiency with SQL Server (on-premises), including stored procedures, and SSIS package-level deployment.

• Data Pipelines: Proven experience designing, creating, and maintaining robust data pipelines and ETL processes.

• Monitoring: Skilled in monitoring and troubleshooting database issues to ensure compliance with policies and regulations.

• Python for ETL: Advanced Python skills applied to developing ETL processes following software development best practices (including automated testing and code reviews).

• Big Data Tools: Proficient in leveraging big data technologies, including PySpark and SparkSQL for large-scale data processing.

• Cloud Expertise: Hands-on experience with cloud-based platforms such as Databricks, Azure Data Factory, and Azure Data Lake. Lakehouse Architecture: Knowledgeable in implementing lakehouse architectures using Delta format and optimization strategies.

• API Integration: Experience working with external third-party APIs as ETL sources, including Microsoft Graph APIs to integrate and automate tasks across Microsoft services.

• Automation & Deployment: Familiar with CI/CD processes and tools-including Databricks asset bundles (DABs) for managing workflows-and proficient with version control systems (e.g., Git) for ETL deployments.

• Data Management & Communication:

• Understanding of data management principles as outlined by DAMA/DMBoK.

• Ability to provide insights on evolving database integration, storage, and utilization needs.

• Overseeing integration from legacy/on-premises systems to new solutions.

• Clear communication of technical information and the ability to train/support staff.

• Knowledge of data privacy and confidentiality regulations (e.g., PIPEDA).

Typical activities in this role include but not limited to:

Work closely with the Enterprise Analytics team to create and maintain ELT processes;

Assemble large, complex datasets that meet functional / non-functional business requirements;

Consulting DT&S and Business leaders on data and information management practices and governance;

Identify, design, and implement internal process improvements:

• automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.;

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and other technologies; Work with stakeholders including the Executive, to assist with data-related technical issues and support their data infrastructure needs.

• Create data tools for analytics and data scientist team members that assist them in building and optimizing our business.

• Work with data and analytics experts to strive for greater functionality in our data systems.

• Championing efforts to improve business performance through enterprise information capabilities, such as master data management (MDM), metadata management, analytics, content management, data integration, and related data management or data infrastructure;

• Provide insight into the changing database integration, storage and utilization requirements for the company and offer suggestions for solutions;

• Monitor and understand Information Management trends and emerging technologies.

Thanks in advance for your time and consideration, please feel free to provide a current version of your resume. I look forward to hearing from you!

Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.

This position is no longer available.

Share This Job: