Lead Data Engineer

Greetings from ITC Infotech!

Role - Lead Data Engineer

Location - Vancouver, BC

Start Date: Immediate

Job Description

As a Data Engineer, you will design and maintain scalable architecture and systems leveraging distributed computing frameworks. You will build integrations between internal systems to support planning, forecasting, and scenario modelling, and operationalize machine learning models for demand forecasting, inventory optimization, and supply chain analytics.

Your role will also involve developing intuitive tools for planners and business users to interact with forecasts, adjust plans, and simulate outcomes. You will establish and maintain CI/CD pipelines using GitLab to automate testing, deployment, and monitoring, while driving agile product development in collaboration with Product, UX, and Planning teams. Additionally, you will mentor engineers and promote best practices in architecture, testing, and DevOps.

Key Responsibilities

• Design and maintain distributed computing frameworks and scalable data architecture.
• Build integrations between internal systems for planning and forecasting.
• Operationalize ML models for demand forecasting, inventory optimization, and supply chain analytics.
• Develop user-friendly tools for planners to interact with forecasts and simulate outcomes.
• Implement and manage CI/CD pipelines using GitLab for automated testing and deployment.
• Drive agile product development and collaborate with cross-functional teams.
• Mentor engineers and champion best practices in architecture, testing, and DevOps.

Champion strong engineering practices, including:

• Test-driven development (TDD)
• Code reviews and pair programming
• Scalable architecture and modular design
• Observability, logging, and performance monitoring

Required Qualifications

• Strong experience in software engineering, with 2+ years in a lead role.
• Proficiency in Python (Pytest), Pandas, and ML libraries (e.g., Prophet, XGBoost, TensorFlow).
• Knowledge of SQL, ETL, data warehousing, and data modelling techniques.
• Experience with Snowflake, Airflow, Postgres, or similar cloud offerings.
• Familiarity with streaming frameworks such as Kafka.
• Proven experience implementing and managing CI/CD pipelines and automated testing frameworks.
• Strong understanding of cloud infrastructure (AWS, GCP, or Azure).
• Excellent communication and cross-functional collaboration skills.
• Strong full-stack development skills with modern frameworks (React, Next.js, Node.js).
• Anaplan model building experience is a plus.

Education

Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).

ITC Infotech is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law. ITC infotech is committed to providing veteran employment opportunities to our service men and women.