3 of 3 Contract Data Pipeline Jobs in East Anglia

DevOps practices to deliver reliable, high quality, and timely data for analytics, reporting, and business applications. Your Responsibilities 1. Data Pipeline Development & Maintenance Design, build, and maintain automated, scalable data pipelines (batch & real time) Optimize ETL/ELT jobs for performance, reliability … platform operations using DataOps/DevOps practices Ensure high availability and reliability of data platforms (cloud or on prem) Troubleshoot pipeline failures and perform root cause analysis (RCA) 3. Automation & CI/CD Implement CI/CD pipelines for data workflows Automate testing ...

require a minimum of 3 days per week on site in central Cambridge. The key experience required for this Bioinformatician position is: CRISPR Data pipelines Python or R Support lab scientists If you do have the relevant skills for this Bioinformatician Engineer contract position, please do apply. ...

Implement monitoring using CloudWatch, Grafana, Prometheus, or OpenTelemetry. Enforce integration security practices: Authentication/Authorization IAM policies Encryption at rest/in transit Data governance & lineage Ensure solutions meet RPO, RTO, resiliency, disaster recovery, and failover requirements. Establish observability using tracing, logging, alerting, and dashboards. Collaborate with product … consumer groups Kafka Streams, ksqlDB Schema Registry & Avro/JSON/Protobuf Kafka Connect connectors Deep expertise in AWS streaming & messaging: Amazon Kinesis Data Streams, Firehose EventBridge (rules, event buses, routing) SQS/SNS with dead letter queues AWS Lambda event-based integrations Experience designing event-driven ...