Principal Big Data Engineer (Contract Role)

Key Responsibilities Lead the architecture and development of scalable data warehouses and batch and real-time data pipelines (e.g. Flink-based streaming and Hive/HDFS-based batch processing). Own the end-to-end design and operation of a big data development platform, including multi-cluster resource management (e.g. YARN), access and permission controls, audit trails and unified authentication. Build and maintain real-time user-facing data services, such as transaction, billing and profit-and-…