RQ11301 - Software Developer - ETL - Senior

Responsibilities:

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
  
• Required to translate technical systems specifications into working, tested applications.
  
• This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
  
• Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
  

General Skills:

• Experience in programming and analysis; specialized software package support at the specified experience level
  
• Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
  
• Experience in structured methodologies for the development, design, implementation and maintenance of applications
  
• Experience in design, code, test, debug and document applications
  
• Experience in the use of object and/or third generation language development tools
  
• Experience in one or more programming languages
  
• Experience in application design, latest design patters, deployment and troubleshooting
  
• Experience with relational and hierarchical database technologies
  
• Experience in the use of information retrieval packages using query languages
  
• Experience with one or more communications protocols
  
• Experience in structured methodologies for the design, development, implementation and maintenance of applications
  
• Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts
  
• Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
  
• A team player with a track record for meeting deadlines
  

ETL Skills:

• Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that's geared towards the needs of end users
  
• Knowledge and experience maintaining and improving already existing processes.
  
• Knowledge and experience ensuring that the data architecture is scalable and maintainable
  
• Knowledge and experience working with the business in designing and delivering correct, high quality data
  
• Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
  
• Experience preparing detailed documentation for further reference
  

Desirable Skills:

• Knowledge and experience with programming Internet-ready applications
  
• Knowledge and experience in rapid application development (RAD) methodologies
  
• Knowledge and understanding of Information Management principles, concepts, policies and practices
  
• Experience with middleware and gateways
  
• Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging
  
• Ability to provide post-implementation support and resolve any post-implementation technical issues
  
• Experience conducting design walkthrough sessions with project team
  
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
  
• Ability to provide user and system documentation as required
  

Experience and Skill Set Requirements:

Must Haves:

• Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
  

Skill Set Requirements:

ETL Development-Data Integration:

• Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
  
• Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including:
  

• Self-Hosted Integration Runtime
  
• Data movement, ETL pipelines
  
• Performance tuning on large data volumes
  
• Complex data transformations
  
• ADF Debugger to validate data transformation.
  
• Azure Roles
  

• Experience with Informatica, including:
  

• Workflow Manager
  
• Repository Manager
  
• Designer
  
• Workflow Monitor
  

• Experience with developing solutions using Logic App and Function App
  
• Experience in rapid application development (RAD) methodologies.
  
• Experience in maintaining and improving existing ETL processes.
  
• Experience in investigating data to identify potential issues within ETL pipelines.
  
• Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
  

Azure Technologies:

• Experience with CI/CD (DevOps) pipelines and concepts, including:
  

• Azure Resource Management
  
• GitHub Repo
  
• Source code version control
  
• Branching, pull requests, build, release, multiple parallel development repositories merge.
  

• Experience with Azure DevOps, including:
  

• Azure Boards
  
• Azure Test Plans
  
• Azure Pipelines
  
• Azure Repos
  
• Azure Artefacts
  

Oracle PL/SQL Development:

• Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.
  

Database Technologies:

• Experience with Oracle, Microsoft SQL Server database and tools.
  
• Experience with relational and hierarchical database technologies.
  
• Extensive knowledge of Azure SQL DB and Synapse platforms, including:
  

• Performance tuning on large data volume