Role : PySpark Developer Location: Toronto Senior PySpark Developer to create a reporting platform to extract Capital Markets Surveillance reports from Enterprise data lake .
Skill Set:
Relevant Experience(in yrs) 8+ Years
Technical/Functional Skills
- Big Data: Spark, Scala, Pyspark, SparkSQL, HDFS
- Microsoft Stack: T-SQL, Good to have -- SSIS, PowerShell
- Scripting Languages: Batch Script, Shell Script, Python
Additional Skills:
- Agile, Scrum, Jira, Git, SVN, Liquibase