Scope
- The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer to help build a new data warehouse/lakehouse and deliver the reporting MVP (minimum viable product).
Assignment Deliverables
As a member of the data team, you will be responsible to help define the MVP for reporting, build the new data warehouse/lakehouse and deliver the required reporting. A high-level list of deliverables for the data migration team follows:
- Data Warehouse Design: analyze business requirements and design an efficient data warehouse/lakehouse/golden layer on Microsoft Azure
- Data Integration and ETL: help develop and automate ETL processes to load data from Dynamics 365 CE and F&O into the new data warehouse/lakehouse (bronze/silver/golden layers). Help integrate data from diverse sources into the new data warehouse.
- Data Modeling: create logical and physical data models that align with the project's reporting and analytical needs.
- Data Security and Governance: implement appropriate security controls to protect sensitive data within the data warehouse.
- Reporting and Visualization: develop reports, dashboards and visualizations as per reporting MVP. Ensure the quality, accuracy and integrity of reports.
- Performance Optimization: fine-tune the data warehouse and reporting processes to optimize query performance and overall system efficiency.
- Other duties as assigned.
The Vendor's Personnel will also be required to:
- Complete work and achieve milestones within the assigned deadlines.
- Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
- Submit Deliverables for the Cluster/Ministry approval as they are completed.
- Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
- Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
- Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
- Provide knowledge and skill transfer to a designated Cluster/Ministry staff; and
- Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.
Requirements
Experience and Skillset Requirements
Mandatory Requirements
- Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards and utilizing advanced features.
- Demonstrated experience with data analytics and reporting from Dynamics 365 CE and/or F&O.
- Data Warehouse/Lakehouse Concepts: Strong understanding of data warehousing principles, including data modeling, ETL processes, data integration, and data governance.
Nice to Have Requirements
- Azure cloud certifications (e.g. Azure fundamentals, Azure Power BI Data Analyst Associate)
- Experience with PowerApps platform, Power Automate, Dynamics CE and F&O
Desired Skills and Experience
- Data Warehouse/Lakehouse Concepts: Strong understanding of data warehousing principles, including data modeling, ETL processes, data integration, and data governance.
- Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards, configuring data gateways, and utilizing advanced features such as DAX and Power Query.
- Knowledge of technologies commonly used with Dynamics 365, such as DataVerse / Common Data Service (CDS), Data Entities, and APIs.
- SQL and Query Optimization: Strong SQL skills for writing complex queries, optimizing database performance, and troubleshooting query performance issues. Understanding of indexing, partitioning, and query execution plans.
- Data Modeling and Design: Proficiency in designing logical and physical data models, understanding relationships, defining hierarchies, and ensuring efficient data storage and retrieval.
- Data Visualization: Ability to create visually appealing and informative reports and dashboards using Power BI, understanding best practices for data visualization, and storytelling with data.
- Data Security and Governance: Knowledge of data security principles, data governance practices, data quality management, and data lifecycle management.
- Analytical and Problem-Solving Skills: Strong analytical thinking and problem-solving abilities to identify business requirements, analyze data, and provide meaningful insights to stakeholders.
- Communication and Collaboration: Effective communication skills to interact with stakeholders, gather requirements, and present findings. Collaboration skills to work with cross-functional teams, such as data engineers, data analysts, and business stakeholders.
- Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
- Experience with SQL Server Management Studio, Azure data management tools, data modeling tools
- Experience with SSIS, SSRS
Resumes Evaluation/Criteria:
Criteria 1: Data Warehouse - 25 Points
- Demonstrated experience developing reports in a Data Warehouse/ Lakehouse. Experience with supporting a data warehouse in a production environment
- Demonstrated experience working with Azure Synapse workspaces, including knowledge of pipeline creation, data flows, integration runtimes, triggers, and monitoring.
- Demonstrated experience with data warehousing modelling concepts such as star and snowflake schemas and data modelling tools.
Criteria 2: PowerBI - 25 Points
- Demonstrated experience working Power BI, creating interactive reports and dashboards, configuring data gateways, utilizing advanced features such as DAX and Power Query.
Criteria 3: SQL / DB - 20 Points
- Demonstrated experience with data manipulation languages (T-SQL, PL/SQL), data definition languages, query performance analysis & tuning
- Demonstrated experience with SQL Server, Oracle, Azure SQL Databases
- Experience with SSIS, SSRS
Criteria 4: Dynamics 365 - 20 Points
- Strong understanding of the Dynamics 365 data model, entities, and relationships.
- Experience developing reports from source data from Dynamics 365 CE or F&O.
- Familiarity with Dataverse and Power Platform application development.
Criteria 5: Azure Platform - 10 Points
- Experience with Azure Data Factory (ADF) and Synapse Workspaces
- Demonstrated experience Azure data management tools, DevOps,
- Azure cloud certifications
Knowledge Transfer
What needs to be KT
- Document the tasks executed and in process of execution as a member of the data migration team using the approach and tools required by the project manager.
To whom
- Project Manager / Team members
When
- 1:1 meetings / team meetings / documentation in DevOps Wiki and boards throughout the duration of the project life cycle.
Must haves:
- Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards, and utilizing advanced features.
- Demonstrated experience with data analytics and reporting from Dynamics 365 CE and/or F&O.
- Data Warehouse/Lakehouse Concepts: Strong understanding of data warehousing principles, including data modeling, ETL processes, data integration, and data governance.
Nice To have:
- Azure cloud certifications (e.g. Azure fundamentals, Azure Power BI Data Analyst Associate)
- Experience with PowerApps platform, Power Automate, Dynamics CE and F&O