Title: Databricks Engineer

Location: Toronto/ Montreal , Canada (Onsite)

Long-term Contract.

Job Description:

CN Rail Experience

• Spark Streaming solutions creation for data from PUBSUB.

• Run jobs in synchronous and asynchronous fashion to Integrate Azure Data Factory and Databricks

• Machine Learning Model Input preparation

• Ingest data from different sources by GCP Logging Bucket, KAFKA, ADF, Databricks, SQL Server in Delta format

• Work independently with customer and define/ modify the necessary architecture

• The capabilities of Databricks developer apart from above listed specific area.