4 of 4 Data Pipeline Jobs in Essex

client, a prominent entity in the Defence and Security sector, is currently seeking a dedicated Data Engineer to join their team in a permanent capacity. Key Responsibilities: Build, configure, and maintain a modern cloud-based data platform in alignment with architectural blueprints and design standards. Develop … robust data pipelines that ingest, transform, and publish data from multiple source systems into trusted reporting layers. Ensure solutions support financial reporting requirements including accuracy, completeness, auditability, and traceability. Collaboration & Technical Input: Work closely with Data Architects to refine designs, challenge assumptions, and contribute ...

observability and cloud infrastructure across the organisation Lead architecture across metrics, logs, and tracing systems Design and optimise high-throughput data pipelines and storage layers Implement strategies such as sampling, aggregation, and down-sampling Extend and enhance open-source observability tools at scale Partner with engineering teams ...

Overview We are seeking an experienced Data Platform Solution Architect to lead the design and implementation of scalable, cloud-native data platforms in Basildon . This role will focus on building modern lakehouse architectures leveraging AWS and Snowflake, ensuring high performance, reliability, and governance across enterprise … data ecosystems. Key Responsibilities Design and deliver end-to-end data platform architecture using Snowflake, AWS, and modern lakehouse principles Produce high-quality Architecture Design Documents (ADDs) and technical blueprints Architect and optimise data pipelines using Airflow/MWAA and dbt Define and implement ...

devices in the field. Key Responsibilities Develop and maintain scalable backend services using Python (Django) and AWS Design and build robust APIs and data models for both internal and customer-facing applications Work with IoT communication protocols (e.g. MQTT, HTTP) to integrate with field devices Contribute … development of frontend interfaces using React Build and optimise pipelines for ingesting and querying large-scale time-series data Collaborate with cross-functional teams including hardware and edge engineering Troubleshoot and resolve production issues in a fast-paced environment Contribute to system design, architecture discussions, and technical decision ...