Skill: Senior Data Engineer

Location: Toronto, Ontario, Canada(Onsite Mon - Fri)

W2/ FT

Job Overview

This is a great opportunity to learn, grow and become a SME in data management and database optimization in cloud technology, becoming a key player on our infrastructure team. Join our growing organization and you will get the chance to be in the driver seat of innovation and change here at Payfare as we think about new ways to better leverage data in support of our increasing mandate.

As a data engineer, you will be joining a team of mixed background technologists. Our mandate is to provide flexible and stable platform solutions that empower our feature development teams to create the highest quality services for our customers. On an ongoing basis, we expand our developing, testing, and deploying reliability and resiliency features. All of this continues to require a strong backbone of database solution and design facilitating data ingestion / extraction in the most optimized way, while also ensuring data protection, integration, and ensuring data availability.

Responsibilities and Duties

• Strong MySQL experience enabling platform growth and scale.
• Advanced expertise and experience on schema design improvements with both tactical and strategic lens to ensure data ingestion / extraction for our warehouse database, supporting current data functions team, external reports, and operations teams.
• Experience working in collaboration with development teams to optimize schema and queries for new features before they go out into production.
• ETL and Data Lakehouse management expertise required.
• Knowledge and experience related to migrations from MySQL to PostgreSQL would be a definite plus.
• Python highly desirable, to support current ETL ingestion scripts.
• Proactively identify improvements to continually improve platform and data resiliency.
• Analyze system problems including root cause determination and manage any needed recovery process to ensure a quick restoration of service without loss of data.
• Strong attention to detail in all daily activities.

Qualifications and Skills

• Degree in Computer Science, Software Engineering or similar
• 5+ years of relevant work experience
• Experience in the following areas of expertise: database administration, data engineering, ETL data load and ingestion, data classification and normalization, SQL and schema optimization.
• Experience in building fault-tolerant, high performant, scalable, data pipelines, in a large and complex environment, e.g. in financial services.
• Strong expertise in Snowflake, including its various features.
• Experience with various AWS services such as Lambda, Redshift, DMS
• Experience with various Apache tools such as Airflow, Superset, Kafka
• Expertise in Linux system administration, web servers, and networking would be an asset.
• Kubernetes experience would be an asset.
• Experience with implementation of database security hardening best practices, including collaboration among cross-functional teams to encourage safe and zero-trust access.
• Experience with other cloud vendors with similar technologies is a plus
• A deep curiosity that motivates you to keep on top of technical trends and informs your ability to suggest tools and approaches to interesting problems.
• The ability to empathize with and communicate clearly to all the other parts of the business.