AWS Data Engineer

Toronto, Ontario, Canada

Fulltime

Job Description:

•Must Have Skills Proficiency in containerization technologies such as Python & Terraform, Docker and Kubernetes.

•Experience in infrastructure as code (Isa) using Terraform, particularly with AWS provider

•Strong Coding skills in Python, Java or Scala for data processing tasks.

•Proficient in integrating Single Sign-On (SSO) with Microsoft Azure AD using OAuth, OpenID Connect (OIDC) and SAML protocols.

•Solid Understanding of relational and NoSQL database, such as PostgreSQL, MySQL, DynamoDB or MongoDB.

•Familiarity with data pipelines orchestration tools such as Airflow or Flask.

•Proficiency in data transformation and ETL process, including tools like Apache Spark or Glue.

•Strong experience with cloud platforms, especially AWS, including services like Lambda, S3, RDS and Glue

•Familiarity with big data technologies, including Hadoop, Hive or Redshift

•Experience with user authentication and authorization using AWS Cognito.

•Expertise in API development, security and implementing best practices for scalable solutions.

•Experience with monitoring and logging tools, such as Prometheus, Grafana or ELK Stack to ensure system reliability and application performance.

•Strong understanding of DevOps principles, CI/CD pipelines and best practices.

•Experience with core AWS technologies such as EC2, ELB, Auto Scaling, S3, EFS, Lambda, API Gateway, Step Functions, CloudWatch, VPC, Route 53, ACM.

•Experience with BI tools like Tableau, AWS Quick Sight