Big Data Architect

Full time

Mississauga- Hybrid

Knowledge & Experience:

• 5+ years application development experience in Hadoop, Spark and Java.
• 7+ years application development experience
• 10+ years of full development life cycle experience, from architecture through test and deployment and cross platform skills

Key Accountabilities

• Architect, design and implement solutions that meet the stakeholder's needs
• Participate actively in requirements gathering, data modelling and design sessions
• Prepare high level and detailed technical specifications for the projects in accordance with PLC, security and architecture documentation objectives
• Communicates standards and defends technology and scoping decisions to information technology management and development teams
• Assists in resolving problems with software functionality and suggesting improvements
• Provide input and coordinates with Database Analyst in creating new and modifying existing database structures using different types of databases
• Conceive, design and test logical structures for solving technical problems
• Perform performance tuning to improve performance over multiple functions
• Provides consulting services on new and existing initiatives
• Participate in walkthrough reviews of all technical specifications, programs and unit test plans

Primary Skills

• Experience in developing and optimizing Big Data applications using Java and Spark.
• Experience in developing/designing micro-service architecture.
• Cloud certified/experience.
• Ability to seek improvements to all aspects of development process
• Provide consulting services on new initiatives (small to large of varying complexity).
• Explore new emerging technologies and how they best suit our applications
• Develop, code, document and execute unit test, system, integration, and acceptance test using different languages and testing tools for functions of high complexity.
• Ensure adequate technical documentation and training.
• Optimize spark jobs and java applications.