Software Engineer III

Responsibilities Implement resilient batch, streaming, and CDC ingestion from AWS sources into Databricks. Build maintainable data pipelines using Delta Live Tables or Databricks Jobs with testing and documentation. Productionize workloads through Databricks Workflows and Jobs with retries, checkpointing, idempotency, and safe reruns. Implement data governance and security controls covering least privilege, PII classification, auditing, lineage, metadata, and controlled data sharing. Tune Spark…