Job Title: Transformation Lead (ETL + QE Lead)

Location: Vancouver, BC, Canada (Onsite)

Job type: Full-Time

Job description:

• Validate ETL processes and data pipelines to ensure data accuracy and integrity.
• Perform data quality checks on large datasets before and after transformations.
• Develop and execute test cases, test scripts, and SQL queries for data validation.
• Work with Snowflake to verify data ingestion, transformation, and storage.
• Test Power BI dashboards and reports for data consistency and performance.
• Validate and test data models to ensure they meet business requirements.
• Automate data testing using tools and scripting languages.
• Identify data anomalies, discrepancies, and inconsistencies in datasets.
• Collaborate with data engineers and analysts to resolve data issues.
• Ensure Airflow DAGs execute as expected and handle failures efficiently.
• Validate data mapping, schema changes, and database migrations.
• Perform regression testing to ensure new changes do not impact existing data.
• Monitor data lineage and ensure traceability of data transformations.
• Conduct performance testing on ETL processes to optimize efficiency.
• Develop and maintain data validation frameworks and best practices.
• Verify dimensional and relational data models for accuracy and completeness.
• Ensure compliance with data governance, security, and regulatory requirements.
• Troubleshoot data pipeline failures and work on root cause analysis.
• Participate in agile development cycles, including sprint planning and reviews.
• Continuously improve testing methodologies and automation for data pipelines.