Lead Data Engineer (Azure Databricks, PySpark & Spark Optimization) - Canada (Remote)

Role: Lead Data Engineer (Azure Databricks, PySpark & Spark Optimization) Remote (Canada) Job Type: Contract Role Summary: We are looking for a hands-on Lead Data Engineer to support a proof of concept in Azure Databricks. The role focuses on converting complex SQL stored procedures into optimized Python and PySpark code. The objective is to demonstrate that the platform can process 100,000 simulation years in minutes rather than hours, while maintaining accurate results. Key Responsibilities: …