Databricks & Python Engineer| 12 month agency contract

Key Responsibilities: Develop and maintain data processing solutions using Databricks and Python. Design and implement real-time data processing pipelines using Apache Spark Structured Streaming. Develop efficient and scalable data processing logic using strong Python programming fundamentals and data structures. Troubleshoot and optimize streaming jobs and data processing workflows. Work with large volumes of data and ensure reliable, scalable, and efficient processing. Monitor and resolve iss…