Lead Software Engineer - Python, Databricks, AWS

Salary: £62,000 - 102,000 per year Requirements: Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience with data lake platforms such as Databricks, Apache Spark, or similar. Experience with AWS cloud services such as S3, ECS, SNS/SQS, Lambda, and related tools. Strong understanding of data quality, security, and lineage best pr…