Role: Data Integrator (Power BI)

Major Responsibilities:

• Design and Develop ETL Processes: Architect and implement ETL workflows to extract data from diverse sources, transform it into a usable format, and load it into a data warehouse or data mart.
• Data Pipeline Management: Manage and maintain the ETL pipelines, ensuring data integrity and consistency. Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend, SnowSQL and SnowPipe) to develop data pipeline solutions to ingest and exploit new and existing data sources.
• Database Design and Management: Design and manage database structures, including tables, views, and indexes, to support ETL processes. Experience designing and developing Enterprise Data Warehouse solutions.
• Data Modeling: Develop and maintain data models to ensure data quality and consistency within the BI system. Proficient writing SQL and Python queries and programming including stored procedures and reverse engineering existing process.
• Data Visualization:Create clear and concise visualizations (charts, graphs, dashboards) to communicate data insights effectively.
• Documentation: ability to create well documented tech specs and user guides of existing dashboards.
• Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of the transformed data.
• Performance Tuning: Optimize ETL processes for performance, scalability, and efficiency.
• Scheduling: Setting up Tidal jobs.

Skills:

• 5+ years - Enterprise Data Management
• Expertise in developing and maintaining Azure data factory pipelines.
• 2+ years of hands-on experience with Databricks.
• 5+ years - SQL Server based development of large datasets
• 3+ years with Data Architecture
• 3+ years' experience in Finance / Banking industry - some understanding of Securities and Banking products and their data footprints
• 3+ years Python coding experience.
• Proficient with Power BI or other data visualization tools
• Hands-on experience with Snowflake utilities such as SnowSQL and SnowPipe
• Working knowledge of MS Azure configuration items with respect to Snowflake.
• Hands-on experience with Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
• Previous experience contributing to an enterprise-wide Cloud Data Platform migration
• Experience with Cloud based data architectures, messaging, analytics