26 to 50 of 65 Data Pipeline Jobs in the East of England

adoption across product lines. You will work in an agile Scrum setting, mentor junior developers, and help drive end-to-end features, data pipelines, and orchestration layers with a strong emphasis on reliability, security, and scalable software growth. #J-18808-Ljbffr ...

Qureight Ltd. is hiring a Senior Clinical Data Engineer to transform incoming clinical trial data into standardised, analysis-ready datasets. You will build reproducible data pipelines that save Data Scientists time, ensuring traceable inputs, code, and parameters. You’ll collaborate with Data Scientists and the Data Engineering team to align with common standards and best practices. The role focuses on developing end-to-end data infrastructure in a regulated, GxP environment, leveraging #J-18808-Ljbffr ...

product portfolio, leading development of operational intelligence systems, real-time monitoring tools, decision-support platforms and customer-facing experiences. Working embedded with operational, data science, and commercial stakeholders, you'll translate complex requirements into production … ready systems that drive efficiency, safety, and service quality in a live operational environment. Key responsibilities and accountabilities: Drive technical architecture across the product pipeline - from real-time data processing and predictive analytics through to automated operations and intelligent alerting. Lead delivery of production ML/ ...

Agile/Scrum environment, mentor junior developers, and partner with cross-functional teams to deliver end-to-end AI solutions across data pipelines, orchestration layers, and service APIs. #J-18808-Ljbffr ...

frontend work with Angular within an Agile team. You will mentor teammates, contribute to design reviews, and ensure secure, production-grade software across data pipelines and services. #J-18808-Ljbffr ...

Roche Products Ltd. in Welwyn, United Kingdom seeks a Principal Data Architect to shape the enterprise data ecosystem, bridging business strategy and technical execution across cloud platforms, data platforms, and analytics. You will champion data democratization, mentor staff, and align cross-functional … teams on standards. As a senior leader, you will drive taxonomy, ontologies, and data models, orchestrate complex migrations, and design scalable, secure data pipelines while partnering with #J-18808-Ljbffr ...

cloud-native. Join an agile Scrum team delivering production-grade AI capabilities, mentor junior engineers, and help uphold engineering best practices across data pipelines and service APIs. #J-18808-Ljbffr ...

with a startup mindset. Key responsibilities include building scalable Azure services, refining APIs and SDKs with ASP.NET Core and C#, and collaborating across data pipelines and #J-18808-Ljbffr ...

month fixed-term contract with potential for extension Start Date: ASAP Join an early-stage AI startup founded by a recognised leader in data science. Our client is building a new predictive intelligence platform that combines machine learning, real-world sensor data, geospatial information and engineering … principles to predict asset condition and emerging risk. You'll work closely with the Founder - a highly regarded data science leader and Cambridge and Oxford alumnus - at a stage where the fundamental technology and architecture are still being shaped. This isn't a role where you'll inherit ...

photonics and building the hub that connects chip designers, IP providers and foundries. Behind the product sits a serious compute and data pipeline, and it now needs someone to own it. We are seeking a highly motivated and enthusiastic Infrastructure Engineer to join our team and contribute … heavy jobs without needing to understand the machinery underneath. Observability – Monitoring and alerting that tells you something is wrong before a user does. Data infrastructure – Reliable, well‐organised storage and access for large scientific datasets, with backups you can trust. Security – Making sure our environment is secure (RBAC ...

experience working as a Software Engineer, ideally with strong foundations in object-oriented programming, databases, and microservice architectures. Experience delivering complex web systems, data pipelines, or internal platforms from development through to production. A proactive approach to problem-solving and a passion for modern engineering best practices. Proximity ...

bodies and academia can share resources and knowledge, to codevelop and grow businesses, fast. We support technology-focused start ups, each with unique data management challenges, and are seeking an experienced Storage Architect to help them design, deploy and maintain high-performance storage systems for their … data-driven workloads. The successful candidate will combine deep experience architecting and managing distributed, cloud, and tiered storage solutions with strong Linux and automation skills. In this role you will: Design, implement, and maintain storage platforms that support large-scale AI and data pipelines Manage distributed ...

Overview: We are looking for an EDA Optimisation Engineer to support the data-driven optimisation, analysis and maintenance of Arm’s engineering platforms. This role will work as part of a team effort to improve system utilisation/efficiency/cost-performance and touch on forecasting accuracy … infrastructure strategy. Working within the Productivity Engineering group, there will be a focus on metrics, automation, data-engineering and problem-solving where applicable to efficiency topics, in a metrics-first/data-driven-decisions environment. We expect this work to drive scalability and vendor strategy across ...

Consulting Limited is seeking a highly skilled Data Lakehouse Engineer for a hybrid contract role based in Basildon, UK. The successful candidate will design and implement modern data lakehouse architectures, ensuring high performance and scalability. Key responsibilities include developing data pipelines using Python … PySpark, working with AWS services, and implementing CI/CD pipelines. Strong experience in AWS Data Engineering and knowledge of data quality frameworks are essential. #J-18808-Ljbffr ...

Costa Coffee is looking for a Data Scientist to turn complex data into meaningful business insights. You’ll build predictive models, create data pipelines and deliver dashboards that influence commercial and operational decisions. Join a flexible, collaborative team moving toward a new UK-based … Support Centre in St Albans. You’ll work with Python, PySpark, SQL, Azure and Databricks in a modern data environment, communicating clearly with both technical and non-technical colleagues to drive value. #J-18808-Ljbffr ...

Apple Inc. is seeking a Senior Data Science Manager to lead strategic data solutions in Cambridge, MA. The role oversees analytics engineering and experimentation, driving data integrity and scalable data pipelines across multiple sources. You will guide teams in data storytelling, performance optimization, and collaboration with cross-functional leaders to align analytics with strategic objectives, while promoting an inclusive data-driven culture. #J-18808-Ljbffr ...

design, build, and scale AI/ML systems for drug discovery. The role collaborates with scientists, product managers, and DevOps to deliver data-driven solutions on a Kubernetes-based stack. You'll apply ML theory, optimize performance, and contribute to data infrastructure, data pipelines ...

European market leader in customs services, operating across 15 countries. CSG is owned by private equity and a fast-growing, dynamic, data-driven company, dedicated to expanding its presence through strong organic growth and strategic acquisitions. Its key priorities include digital transformation, operational excellence and customer experience … against a baseline, and demonstrably better than what it replaced. By month twelve: There is a working evaluation process others can use, a ranked pipeline of next opportunities, and at least two colleagues outside IT operating what you have built without you in the room. What We Offer ...

production, taking ownership of code quality, performance, and system reliability. Partner with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration layers, and service APIs. Embed robust security controls, identity management, and privacy-by-design practices across all AI services. Actively contribute to design … Kubernetes. Deep understanding of RESTful API design, versioning, testing, and full lifecycle management. Strong knowledge of securing APIs (OAuth2, OIDC, RBAC) and implementing data privacy best practices. Proficiency in using modern AI-assisted development tools (e.g., GitHub Copilot) to accelerate daily engineering workflows. Strong problem-solving abilities, with ...

consumption by internal and external developers using ASP.NET Core and C#. Collaborate with cross‐functional teams to deliver end‐to‐end solutions across data pipelines, orchestration, and service APIs. Embed robust security controls to protect sensitive data and ensure secure access to AI services. Participate … technologies a plus. Solid understanding of RESTful API design, versioning, testing, and lifecycle management. Proficient in securing APIs, managing authentication/authorization and data privacy practices. Practical experience deploying and debugging scalable cloud‐native services using PaaS, Docker, and Kubernetes. Excellent problem‐solving skills, with the ability ...

consumption by internal and external developers using ASP.NET Core and C#. Collaborate with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration, and service APIs. Embed robust security controls to protect sensitive data and ensure secure access to AI services. Participate … technologies a plus. Solid understanding of RESTful API design, versioning, testing, and lifecycle management. Proficient in securing APIs, managing authentication/authorization and data privacy practices. Practical experience deploying and debugging scalable cloud-native services using PaaS, Docker, and Kubernetes. Excellent problem-solving skills, with the ability ...

public APIs and SDKs for consumption by internal and external developers. Collaborate with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration, and service APIs. Embed robust security controls to protect sensitive data and ensure secure access to AI services. Lead … deployments in Kubernetes. Strong expertise in RESTful API design, versioning, testing, and lifecycle management. Proficient in securing APIs, managing authentication/authorization and data privacy practices. Fluent in developing code using AI Tools such as GitHub Copilot. Must be able to use prompt engineering to carry out multiple ...

hands-on experience building, training, evaluating and deploying LLMs or multimodal models end to end. The role will focus primarily on model development, data pipelines and system performance. What You'll Do Design and implement end-to-end LLM training pipelines Source and, where appropriate, preprocess datasets … evaluation Fine-tune and optimise open weight models (LLMs, vision or traditional ML) Build evaluation frameworks and define performance metrics Develop and maintain data pipelines and training workflows Analyse training pipelines and optimise for latency, cost and scalability Implement monitoring, logging and feedback loops for continuous improvement Experiment ...

evaluation Fine‐tune and optimise open weight models (LLMs, vision or traditional ML) Build evaluation frameworks and define performance metrics Develop and maintain data pipelines and training workflows Analyse training pipelines and optimise for latency, cost and scalability Implement monitoring, logging and feedback loops for continuous improvement Experiment … multimodal models (not just consuming APIs) A solid understanding of model evaluation and validation, overfitting and bias/variance trade‐offs, and data quality and feature engineering Proficiency in Python and ML frameworks such as PyTorch or TensorFlow Experience building and maintaining ML pipelines in production Familiarity with ...

production, taking ownership of code quality, performance, and system reliability. Partner with cross-functional teams to deliver end-to-end solutions across data pipelines, orchestration layers, and service APIs. Embed robust security controls, identity management, and privacy-by-design practices across all AI services. Actively contribute to design … Kubernetes. Deep understanding of RESTful API design, versioning, testing, and full lifecycle management. Strong knowledge of securing APIs (OAuth2, OIDC, RBAC) and implementing data privacy best practices. Proficiency in using modern AI-assisted development tools (e.g., GitHub Copilot) to accelerate daily engineering workflows. Strong problem-solving abilities, with ...