Role: Developer Analyst AWS/Cloud Operations Engineer with a focus on AWS CloudOps

Location: Canada/Remote

Duration: 6+ Months

Job Description:

Monitor, troubleshoot, and resolve issues within our AWS data infrastructure, ensuring high availability, performance, and security.

Oversee and optimize AWS cloud infrastructure for data processing, employing services like S3, Lambda, Glue, Lake Formation, DynamoDB, and EC2 to manage batch and real-time data pipelines.

Implement and manage cloud infrastructure as code (IaC) using tools such as AWS CloudFormation or Terraform, ensuring scalable, repeatable, and secure environments.

Advocate for and implement best practices in cloud operations, data security, and compliance, adhering to healthcare industry standards and regulations.

Participate in the development of infrastructure automation and continuous integration/continuous deployment (CI/CD) pipelines to streamline data operations and development workflows.

Collaborate with the data engineering team to maintain and enhance PySpark-based pipelines.

Exceptional problem-solving abilities and a detail-oriented approach to managing complex cloud environments.

Excellent communication skills, capable of collaborating effectively across multidisciplinary teams.

Strong background in AWS CloudOps, with proven experience in managing data infrastructure and services in a cloud environment.

Experience with Infrastructure as Code (IaC) tools (e.g., AWS CloudFormation, CDK, Terraform) and understanding of CI/CD pipelines.

Adaptability and a keenness to learn new technologies and tools, with a willingness to grow into roles that may involve more direct work on data pipelines.

Familiarity with data processing technologies (e.g., PySpark, SQL, Amazon Athena), sufficient to support troubleshooting efforts or to identify points of failure in data pipelines.

Experience with data lake technologies, including table formats (e.g., Iceberg, Hudi, Delta Lake) and AWS Lake Formation, is highly valued.

Interest in or experience with streaming technologies (e.g., Apache Flink, Google Cloud Dataflow/Beam), to support future contributions to real-time data processing initiatives.

Understanding of the FHIR standard and experience with healthcare data management, which would be beneficial in ensuring compliance and effectiveness of data solutions within the healthcare domain.