Senior Data Engineer (AWS & Databricks) | Contract

Key Responsibilities Design, develop and maintain scalable batch and streaming data pipelines across AWS and Databricks. Build and manage lakehouse architectures using Apache Spark, PySpark and Delta Lake, including Bronze, Silver and Gold data layers. Integrate data from databases, APIs, files and event streams using incremental ingestion and change data capture. Implement data quality checks, schema validation, reconciliation, metadata management and data lineage. Develop automated workflows …