Data & Analytics Engineer

DescriptionThis role will be part of the core team to support the new Data platform, foundational to the new Single Solution platform. The Data & Analytics Engineer will be responsible in collaborating with all stakeholders to maintain the data platform. This platform will aggregate and ingest data from various sources to ensure the data can be accessed efficiently by the organization and applications. This platform will have great visibility across the organization as it continues grow and scale.
In this role, the Analytics Engineer will need to have an excellent understanding of development concepts, be able to manage work throughout the full system design lifecycle process and be an excellent communicator to ensure full transparency throughout the organization.
The successful candidate will play a key role in our data team and execute a team-first approach where the deliverables and goals of the organization supersede the goals of each individual department, and so the successful candidate will be an advocate for teamwork, openness, inclusiveness, and enterprise-goal driven management. If you are looking to grow your experience learning from highly skilled data experts and embark your journey into data analytics and engineering, this role is for you. You will be part of an upcoming team that tackles a complex data challenge, and you will get first-hand experience solving complex challenges using data.
Key Responsibilities

• Perform end to end automation of ETL/ELT process for various datasets that are being ingested into the Data Platform.
• Design, develop and maintain data ingestion pipelines.
• Create Spark jobs for data transformation and aggregation.
• Develop, enhance, and manage conceptual, enterprise logical (LDM) and physical data models (PDM) to ensure the information models can meet end user and developer needs.
• Understand and apply logical entity-relational design concepts.
• Recommend opportunities for reuse of data models in the new environments.
• Develop dimensional models and views needed for data analytics and reporting.
• Optimize and update logical and physical data models to support new and existing projects.
• Leads the development of creative new data integrations, modifications to existing software, and/or makes decisions regarding integrating software applications data in accordance with agreed upon specifications.
• Serve as a subject matter expert of our solutions and address to a business or technical audience.
• Collaborate with Analysts, Architects and Developers to establish and maintain the Data Platform framework.
• Prepare and maintain technical documentation.

Skills, Knowledge and Expertise

• Bachelor's degree in a technical field such as computer science, computer engineering or related field
• 4+ years' experience with Data Modelling.
• 4+ years' experience with Python programming language
• 4+ years' experience with Apache Spark streaming and batch framework
• 4+ years' experience developing data lake
• 2+ years experience of Databricks
• Knowledge of Microsoft Azure Platform
• Strong understanding and experience of relational/non-relational database, including design and implementation
• Strong communication skills required to communicate effectively with business and other stake holders
• Strong Analytical and Problem-Solving Skills
• Excellent Time Management Skills