876 to 900 of 1,802 Data Pipeline Jobs in England

platform is ready for production. Work closely with the existing data engineering team to support implementation and integration. Establish best practices for pipeline development, monitoring and maintenance. Document technical processes, configurations and deployment procedures. Train and upskill the wider engineering team to enable them … platform independently. Essential Experience Proven hands-on experience implementing and deploying Astronomer (Astro). Strong knowledge of Apache Airflow, including workflow orchestration and pipeline scheduling. Experience building, deploying and managing data pipelines. Experience with dbt and Snowflake. Strong technical troubleshooting and problem-solving skills. Ability to take ...

into the hands of users. Our ML team works end-to-end, from R&D to deployment, across traditional ML, deep learning, data engineering, foundation models and LLM/agentic systems. We are now hiring across a broad range of ML skills, including model training, evaluation, optimisation, infrastructure … systems that solve complex problems with real-world impact. Our work is broad, spanning edge and embedded deployment, model evaluation, performance optimisation, data pipelines, large-scale training and ML infrastructure all focused on bringing useful AI capability to edge and embedded environments. We are building a team with ...

ASOS is hiring a Senior Data Engineer to join the Data Science Platform team. You will build and evolve Azure-based data infrastructure enabling data scientists, ML engineers and analysts across forecasting, recommendations, pricing, marketing and customer domains to develop and operate … data-driven products at scale. You will design high-performance data pipelines, own platform components, and work across teams to deliver scalable, reliable data solutions that create business value for ASOS. #J-18808-Ljbffr ...

Platform Software Engineer to build the shared platform layer that underpins our AI solution suite in London. You will create frameworks, services, data pipelines and APIs in Python, enabling high-volume product development and reliable integrations. This on-site role offers the chance to influence security, observability ...

Morgan Stanley UK Ltd is seeking a Data Engineering Specialist in Manchester to join the Architecture & Modernization team. You will build and maintain data infrastructure for Data AI platforms, developing data pipelines and collaborating with stakeholders to deliver data-driven … insights. This role requires a self-starter with strong execution skills and the ability to work independently. The position is in the Data & Analytics Engineering scope at Director level, focusing on specialist data #J-18808-Ljbffr ...

Bristol, North Somerset and South Gloucestershire Integrated Care Board is seeking a Senior Data Engineer to provide technical leadership and hands-on expertise for secure data pipelines and research datasets in the Southwest Secure Data Environment. Role requires advanced SQL/Python skills, data modelling and data integration experience, with flexible regional/home working and travel to partner organisations as required. #J-18808-Ljbffr ...

pipelines while delivering features at scale. Join a fast-growing fintech platform backed by top investors. You will influence backend services, data pipelines, and deployment stacks, collaborating with founders and growth teams to shape a generational #J-18808-Ljbffr ...

Staff Software Engineer-AI to design, implement, and lead production-grade AI platforms in a cloud environment. You will own backend services, APIs, data pipelines, and AI inference workflows, guiding teams through design reviews and hands-on coding. You will work across AWS/Azure/GCP, apply ...

adoption across product lines. You will work in an agile Scrum setting, mentor junior developers, and help drive end-to-end features, data pipelines, and orchestration layers with a strong emphasis on reliability, security, and scalable software growth. #J-18808-Ljbffr ...

Python experience along with AI and ML development skills to create scalable, high-performance applications that integrate various AI technologies. Responsibilities include developing data pipelines, optimizing performance, and utilizing cloud platforms. Ideal candidates will exhibit a robust understanding of API development and database systems, complemented by strong problem ...

Evaluation & observability: Practical experience instrumenting tracing (LangSmith, Arize) and building CI/CD pipelines built specifically for LLMs. Engineering foundations: Distributed systems, scalable data pipelines (Kafka, SQL), and cloud-native infrastructure. Cloud-native deployment: Deep familiarity with shipping agentic workloads into production environments, ideally leveraging Kubernetes for enterprise ...

experiences What will the Senior Product Engineer bring? Strong backend development expertise with Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building ...

applications, operating systems, networks, and hardware interfaces. Customer platform integration. Bridge customer-built systems and SPAICE’s products through APIs, middleware, communication protocols, data pipelines, and custom software components. Deployment and field testing. Configure and validate systems on embedded computers and edge AI hardware, support flight and field ...

contractual security obligations. Key Responsibilities Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

contractual security obligations. Key Responsibilities Zero Trust implementation: Apply ZTA principles across defence cloud and hybrid infrastructure, covering identities, devices, networks and data. Pipeline security: Embed automated compliance checks, container scanning and vulnerability assessments in CI/CD pipelines. Identity and access: Enforce IAM, MFA, RBAC, ABAC ...

different technical leads, giving you both variety and continuity. The environment values curiosity, evidence-based thinking, and the confidence to question assumptions constructively. Data scientists work within established delivery frameworks and collaborate closely with engineers, analysts and product-focused teams. Learning happens through doing, supported by an experienced … inclusive data science community. What You'll Be Doing - Contribute to the design, analysis and build of data science solutions addressing real business and operational problems - Apply statistical, mathematical and scientific approaches to explore data, test hypotheses and support decision-making - Write and maintain ...

Methods is seeking a Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role is mainly remote, with flexibility to travel to client sites and offices in London, Sheffield, and Bristol. You will build data pipelines, improve data quality and governance, and partner with architects and stakeholders to deliver scalable data foundations for complex engagements across procurement, workforce and finance data. UK-wide travel may be required. #J-18808-Ljbffr ...

core EMEA markets, establishing data integrations, structuring revenue-share agreements, and turning each partner’s existing client base into a qualified pipeline source for Canoe Identify new downstream reporting, fund accounting, and portfolio monitoring platforms serving EMEA-based LPs, asset servicers, family offices and wealth managers whose … Approach, negotiate, and close technical integration agreements with target downstream platforms, working with product and engineering to scope what a joint data pipeline looks like Achieve quarterly goal of generating qualified sales opportunities from channel partners Conduct high-level discovery conversations and meetings with partners and prospective ...

Hiring: Lead Data Engineer (Java) Locations: Newcastle, Glasgow, Manchester, or London Clearance: Active SC Clearance is highly preferred (SC eligible candidates will be considered) Contract Duration: 13+ months Are you an expert Data Engineer with strong Java programming skills? Join our AI & Data team … design, build, and optimize innovative data solutions and pipelines for a major public safety initiative! What you'll do: Design, develop, and maintain robust data pipelines and ETL processes. Act as a Subject Matter Expert (SME), guiding and mentoring junior team members. Drive key technical decisions ...

Their primary focus is on execution within defined parameters, applying modern engineering practices including CI/CD, automated testing, code quality, observability and data quality controls. They may also be accountable for regular reporting or process administration within the squad. Working in partnership with more experienced staff, their … practical, well-engineered technical solutions. Build production-ready solutions using modern engineering practices, including CI/CD, automated testing, code quality, observability and data quality controls. Support data quality, monitoring, reporting and process administration activities to help ensure accurate and consistent outcomes. Identify and resolve technical ...

business value. Build prototypes and experiments with production scalability, maintainability and integration in mind. Work closely with business stakeholders to understand workflows, decisions, data and operational challenges. Develop and integrate AI solutions using APIs, GraphQL, enterprise data platforms and related technologies. Contribute to the technical strategy … modelling. Experience taking experimental technologies beyond prototypes towards scalable production solutions. Good understanding of APIs, cloud platforms and enterprise integration. Some understanding of data engineering, data pipelines and data architecture. Experience working in Trading, Supply, commodities, energy trading, financial markets, supply chain ...

Description:Lead Engineer (Group Data)From £75,000 - £94,000 (neg. depending on experience) + benefits, including up to 25% bonus + £6K Car AllowanceLondon (EC2R 7HJ) or Salford (M50 3SP)Hybrid working - 2 days per week in the officePermanentFull-time, 35 hours per weekWe make health happenWorking … world.The Lead Engineer is a senior, hands-on technical leader with overall accountability for designing, building and governing Group Products (the ”Products”):Group Data: Advanced Analytics. A self-serve, cloud‐native analytics product built on Google Cloud Platform (GCP). We support our stakeholders to utilise GCP tooling ...

Design, train, and optimise machine learning models focused on user personalisation, encompassing recommendation engines, ranking algorithms, user segmentation, and content analysis. Data Pipeline Engineering: Construct and maintain robust and scalable data pipelines for feature engineering and model training utilising both structured and unstructured large-scale ...

Qureight Ltd. is hiring a Senior Clinical Data Engineer to transform incoming clinical trial data into standardised, analysis-ready datasets. You will build reproducible data pipelines that save Data Scientists time, ensuring traceable inputs, code, and parameters. You’ll collaborate with Data Scientists and the Data Engineering team to align with common standards and best practices. The role focuses on developing end-to-end data infrastructure in a regulated, GxP environment, leveraging #J-18808-Ljbffr ...

other exceptionally talented teammates. Our industry changes constantly, and our job is to create user-facing products supported by our best-in-class data, allowing us to adapt to those rapid changes and bring maximal value to our customers. We're looking for a Staff Data Scientist to join our Research and Intelligence organisation in London. You'll work across flexible, cross-functional squads within the Data Science team, leading analytical, statistical, and machine-learning work across both UTXO and EVM blockchains. The team develops behavioural heuristics, graph algorithms, statistical models ...