26 to 27 of 27 CI/CD Jobs in Essex

ensuring high performance and scalability. Key responsibilities include developing data pipelines using Python and PySpark, working with AWS services, and implementing CI / CD pipelines. Strong experience in AWS Data Engineering and knowledge of data quality frameworks are essential. #J-18808-Ljbffr ...

highquality data across the ecosystem Key Responsibilities Contribute to the design and implementation of Lakehouse integration architectures including data flows process flows and ELT / ETL patterns Build optimize and maintain scalable data pipelines for ingestion processing and storage across data lake and Lakehouse layers Implement and uphold data … Experience with both batch StreamSets and streaming Kafka data solutions Familiarity with data modelling concepts Inmon Kimball Data Vault etc Exposure to CICD or Infrastructure a scode Terraform or any other is a plus Application Performance Monitoring Framework experience is a plus Knowledge of data quality and security best practices ...