1,376 to 1,400 of 1,826 Data Pipeline Jobs in England

applications on AWS . Integrate Large Language Models (LLMs), vector databases, and modern AI frameworks into production systems. Build secure, reliable, and performant data pipelines to power AI applications. Collaborate with product managers, engineers, and stakeholders throughout the deployment lifecycle. Optimize AI solutions for performance, reliability, and cost. … developing Generative AI applications using modern LLMs. Strong understanding of AI application architecture, APIs, and distributed systems. Experience working with structured and unstructured data . Ability to rapidly prototype solutions and iterate in fast-moving customer environments. Excellent problem-solving and debugging skills. Strong communication skills with ...

standards for latency, scale, monitoring, SLOs, playbooks, and operational excellence. Partner closely with — and raise the technical bar for — ML engineers, product engineers, data scientists, and platform teams across DoorDash, Wolt, and Deliveroo to turn emerging GenAI capabilities into durable platform primitives. Set technical direction for the future … experience in software engineering Deep backend engineering fundamentals, especially in Python and distributed systems. Track record of designing and owning production services, APIs, data pipelines, or ML infrastructure at scale. Experience operating systems in production, including observability, debugging, reliability, incident response, and performance/cost optimization. Deep hands ...

tackle real‐world problems, particularly in automating complex, manual processes in a range of real‐world verticals. Optimize and Scale: Build scalable data pipelines, optimize models for performance and accuracy, and prepare them for production. Monitor and maintain deployed models to ensure they continue delivering value across various … practices. You Might Thrive In This Role If You: Hold a BSc/Master’s/PhD degree in Computer Science, Machine Learning, Data Science, or a related field. Have experience building GenAI‐focused applications with the latest technologies, including but not limited to Agents, reasoning models ...

safely trigger network actions.* Support deployment and operation of AI platforms such as Vertex AI or similar.* Integrate with vector databases, graph APIs, data pipelines, MCP servers, and automation backends.* Support Kubernetes-based deployment of automation services, agent services, APIs, and microservices.* Implement infrastructure-as-code for platform … pipelines.* REST APIs, Graph APIs, TMF Open APIs.* NETCONF/RESTCONF, gRPC, vendor APIs.* API management and orchestration.* Intent-to-configuration workflows.* Data pipelines.* Vector databases and graph APIs.* MCP integration.* Security frameworks and compliance controls.* Observability and logging.**Preferred Certifications*** Kubernetes CKA/CKAD.* Terraform Associate. ...

consultative problem‐solving skills. This individual must be comfortable navigating complex enterprise environments, engaging with C‐suite leaders, and collaborating with engineers, data scientists, and delivery teams to craft compelling, high‐value AI solutions. Responsibilities Strategic Pre‐Sales & Deal Support Serve as the senior technical‐sales advisor … that resonate with non‐technical leaders. Facilitate strategy workshops, use‐case prioritization sessions, and AI roadmapping discussions. Solution Design & Technical Credibility Collaborate with data science, engineering, and architecture teams to design viable, scalable solution approaches. Validate feasibility, scope, and risks, and required capabilities for proposed AI solutions. Bring ...

innovate, make decisions, and improve performance on and off the track. We're looking for experienced Python Software Engineers to join our Software & Data Science team on a fixed-term contract basis and help deliver Factory Flow, one of the most significant technology and business transformation programmes … inventory management and race operations. You'll work closely with engineers, product teams and business stakeholders to develop scalable Python services, APIs and data solutions that replace legacy systems and improve the flow of information across the business. This role offers the opportunity to make a tangible impact ...

solutions , including smart tooling, vision systems, automation and real-time machine monitoring. Design solutions for device connectivity, sensor integration and industrial data management . Work with manufacturing teams to identify opportunities for new digital technologies and take solutions from concept through to deployment. Support existing automation, IoT, machine … communication skills. A relevant technical degree, such as Computer Engineering or Electrical & Electronic Engineering , or equivalent. Great if you also have Experience with data pipelines, databases, AI/machine learning, AWS, Azure, Grafana, Node-RED, statistical analysis, Digital Twins or Lean Six Sigma would be an advantage. ...

Artis Recruitment is seeking a Data Engineering Lead for a leading Professional Services organisation in Bristol. The role combines hands-on data engineering with team leadership to modernise the data platform and Databricks environment. You will mentor engineers, design scalable data pipelines … collaborate with BI and data science teams, and help drive cloud adoption while operating in a hybrid model (3 days on-site). #J-18808-Ljbffr ...

Principle HR in London is seeking a Data Engineer to join a leading global technology company. The role focuses on data infrastructure, analytics and security reporting. Hybrid work with three days onsite. The ideal candidate has strong SQL and Python skills, experience building … data pipelines, and can turn complex datasets into business insights. You will own independent engineering projects and contribute to critical metrics. #J-18808-Ljbffr ...

Overview: We are looking for a mid/senior-level AI Testing & Engineering Specialist with strong Python expertise and solid experience in AI, Data Engineering, or Test Automation. The role is focused on building and evolving a next-generation testing framework for generative AI agents, including evaluation pipelines … synthetic data generation, observability layers, and quality metrics for LLM-based systems. You will work across AI engineering, data pipelines, and quality automation, contributing both to architecture design and hands‐on implementation of scalable testing and evaluation systems. This role is suited for someone ...

Somerset Bridge Group is modernising its data platform to enable analytics, reporting, and AI initiatives across Pricing, Underwriting and Claims. You will design and build scalable data pipelines on Azure Databricks and Delta Lake, with governance, security, and real-time processing at scale. The role sits … Enterprise Data Team and requires strong SQL and PySpark, plus experience with cloud-native data platforms. Hybrid working available, with 2 days in the office and 3 days from home. #J-18808-Ljbffr ...

Bamford Excavators Ltd (JCB) is seeking a Data & Analytics Engineer to own the design, build, and optimization of data pipelines and analytics datasets on the Databricks Lakehouse. You will transform raw data into BI-ready gold models, ensure data quality, and enable ...

Genesis AI in London seeks an experienced data infrastructure engineer to design, build and maintain large-scale data pipelines for robotics foundation model training and evaluation at petabyte scale. You will own data models, storage, ingestion, transformations and orchestration, standardize data across ...

KDB+/q and Python Developer with 3-5 years of commercial experience to join a technology team developing and supporting high-performance, data-driven applications. Responsibilities: * Develop and maintain applications using KDB+/q and Python. * Build and optimise data pipelines and time-series data solutions. * Improve query performance, data processing and system efficiency. * Troubleshoot technical issues and support application development. * Collaborate with technical teams to deliver robust, scalable solutions. Skills & Experience: * 3-5 years of hands-on KDB+/q development experience. * Strong Python development skills. * Experience working with large ...

KDB+/q and Python Developer with 3-5 years of commercial experience to join a technology team developing and supporting high-performance, data-driven applications. Responsibilities: * Develop and maintain applications using KDB+/q and Python. * Build and optimise data pipelines and time-series data solutions. * Improve query performance, data processing and system efficiency. * Troubleshoot technical issues and support application development. * Collaborate with technical teams to deliver robust, scalable solutions. Skills & Experience: * 3-5 years of hands-on KDB+/q development experience. * Strong Python development skills. * Experience working with large ...

Very is seeking a hands-on senior data engineer to shape and scale our data pipelines and cloud-based platform. You will mentor others, influence engineering standards, and partner with product teams to deliver measurable outcomes for a data-driven business. You’ll work … with modern cloud technologies, build scalable data solutions, and help define how we serve millions of customers with faster, more reliable data-driven decisions. #J-18808-Ljbffr ...

bonus and benefits. Contact email: othorne@vertuspartners.com Job ref: PE/OT 2109_1789995235 Startdate: 1-3 Months Python Engineer | Financial Markets Trading Data | Buy-Side Business London-based | Competitive base salary + performance-related buy side bonus Python | SQL | Distributed Systems | Data Quality | CI/… Financial Markets The Role: This is a hands-on engineering position within a well-established buy-side business, building reliable data services that sit close to investment and operational workflows. You will take ownership of systems used across the front and middle office, improving how complex financial data ...

This is an opportunity to join a digital consultancy at the intersection of marketing, data, and technology. You'll build innovative products, automation solutions, and AI-driven tools that support both internal teams and enterprise clients. If you enjoy solving complex business challenges with modern engineering practices, this … They are a well-established digital and marketing consultancy working with a diverse portfolio of clients across multiple sectors. Combining expertise in technology, data, and digital marketing, they help organisations improve performance through innovative solutions. Their teams operate globally and collaborate across a range of disciplines including analytics ...

Group is seeking an experienced data/engineering professional to design and maintain Informatica Customer 360 (MDM/CDM) and Treasure Data AI (CDP). You will model data, ensure quality, and build robust data pipelines, with integrations to CRM and data warehouse. You will collaborate with architects and stakeholders to deliver scalable, globally consistent data platforms, monitor production, and drive governance and security improvements. #J-18808-Ljbffr ...

troubleshooting of the SOC’s technology stack(hardware and software). The engineer will also assist with the continueddevelopment and maintenance of data pipelines and signature updates and theprofessional development of the system engineering team. Tasks: Perform systemadministration on specific cyber defence applications and systems to includeinstallation, configuration … reported system incidents, problems, and events to ensure continuingoperability. Coordinatewith Cyber Defence and CTI Analysts in the management and administration theupdating of ingested data flows, cyber use cases and signatures for specialisedcyber defence applications in response to new or observed threats. Manage the compilation,cataloguing, distribution, and retrieval ...

modern stacks). Build out high-performance, well-documented RESTful and GraphQL API pipelines to serve responsive mobile and desktop client interfaces. Database & Data Infrastructure: Architect, index, and optimize relational and non-relational database layers (e.g., PostgreSQL, MongoDB, Redis). Build and fine-tune caching systems, intricate data … transaction logic, automated split-payout loops, and programmatic subscription management structures to support our commercial monetization branches. System Compliance, Security & Performance: Enforce ironclad data protection layers matching UK GDPR and Data Protection Act 2018 standards. Set up OAuth2, JWT mechanisms, role-based access control profiles, continuous ...

Airedale Group is expanding its Lighthouse IoT platform for commercial kitchens across the UK. We seek a Senior IoT Data & AI Engineer to turn analysis into running systems, building data pipelines, predictive models, and automated reporting. You will collaborate with the CTO and an IoT data analyst to deliver early failure detection and robust insights in a small team. You will implement end-to-end data solutions, ensure customer data isolation, and industrialize reporting for scale while #J-18808-Ljbffr ...

Morson Edge is partnering with a leading investment management firm to hire a Principal Data Engineer in Manchester. The role combines hands-on engineering with technical leadership to shape the organisation’s strategic data platform, centered on Snowflake with a growing data tech ecosystem. … role focuses on designing scalable data solutions, building robust data pipelines, governance practices and enabling advanced analytics and AI capabilities, while emphasising security, privacy and #J-18808-Ljbffr ...

Leonardo Bristol is seeking a Senior Data Engineer to design, build and optimize secure data platforms across hybrid environments. You will own data pipelines, work with SQL Server and cloud services, and mentor junior engineers to deliver scalable data solutions for defence … government and commercial customers. The role blends on-site and remote work, requiring collaboration with cross-functional teams and stakeholders to deliver reliable data-driven insights. #J-18808-Ljbffr ...

Drive down wall-clock time to convergence by profiling and eliminating bottlenecks across the foundation model training stack stack, from data pipelines to GPU kernels Design, build, and optimize distributed training systems (PyTorch) for multi-node GPU clusters, ensuring scalability, robustness, and high utilization Implement efficient low-level … interactions, data movement, and kernel optimization Scaling at the frontier: experience with PyTorch and training jobs using data, context, pipeline, and model parallelism System-level mindset with a track record of tuning hardware-software interactions for maximum utilization #J-18808-Ljbffr ...