Data Engineer

8 month contract opportunity, high potential to extend

"Hybrid" work environment - 2 times per week in downtown Vancouver office

Seeking a Data Engineer who is passionate about big data technology and delivering data solution to handle terabyte scale data per day.

Role & responsibilities:

• Data engineering activities including data ingestion, data modelling, data processing data governance
• Work with team to improve the data pipeline to process large scale data efficiently
• Be a data steward to educate and promote the data importance and data-driven culture
• Collaborate with the key stakeholders, product owners, external vendors to define solutions for business and technical requirements
• Be responsible for system architecture design and data engineering activities including data ingestion, data modelling, data processing and data governance
• Work as a technical expert and strategic thought leader to the data platform by providing architectural leadership
• Lead, participate, guide and mentor other team members on architecture and design with hands on

Desired skills & experience:

• SQL
• Python
• AWS AND/OR Google Cloud (GCP)
• Spark
• Airflow
• EKS
• Experience working with data infrastructure (understand how spark runs, how airflow works with AWS)
• Architecture design and development of large-scale data platform and data application with simple solutions
• Have deep understanding on data engineering principles and data modeling
• Strong knowledge of SQL (MySQL, PostgreSQL) and preferably experience with NoSQL databases
• Experience with engineering tools such as Airflow, EKS, EMR, Redshift, Kubernetes
• Good Hadoop ecosystem knowledge (e.g. Hadoop, Spark, Kafka, Hive, Presto)
• Experience on large-scale multi-tier cloud applications and environments
• Hands-on experience of high availability systems and API design
• Experience with CICD tools such as GitHub Actions
• Familiar with Agile/Scrum software development methodologies

$70 - $80 per hour for an INC consultant

If you're interested, please apply with resume

If you are a strong fit, I will be in contact quickly to discuss additional details and next steps

Best regards,