376 to 400 of 525 Data Pipeline Jobs in England

partnering with a leading business in the West Midlands to recruit a Senior Data Engineer for a newly created permanent position. The role offers a salary of up to £75,000 plus a bonus of up to 15%. This is a hybrid role, requiring attendance … office on average twice per month, with flexibility to come in as needed. The Role We are for Senior Data Engineers with strong Databricks experience to join a newly established data function wihin a global organisation. You will play a key role in the implementation ...

implement scalable, reliable, and performant backend systems. Develop and maintain microservices, containerized applications, and supporting infrastructure. Solve complex problems with practical solutions and data-driven approaches. Contribute to architecture discussions, code reviews, and testing strategies. Identify performance or reliability bottlenecks and propose improvements. Required Qualifications & Experience Strong experience … system design and desire to build elegant, maintainable solutions. General understanding of supporting infrastructure: git, microservices, containers, etc. Comfortable working with numbers and data, with or without prior trading/finance experience. Experience with writing unit and integration tests and maintaining CI/CD pipelines. Preferred Qualifications & Experience ...

ensure solutions work in real-world environments. Key Responsibilities: Deploy and configure software solutions in client environments Integrate systems across cloud, APIs, and data pipelines Troubleshoot and resolve technical issues on-site or remotely Collaborate with product and engineering teams to improve deployments Support rollout projects and large … system integration, and microservices Client-facing experience or delivery-focused roles Strong problem-solving and communication skills Desirable: Exposure to AI, ML, or data platforms DevOps, CI/CD, or infrastructure as code experience Consulting or technical delivery background Location: UK Hybrid, with occasional client visits ...

Lead Data Engineer London | Full-time £120,000 - £140,000 + Bonus + Equity 5 Days a week in Victoria Join a fast-growing AI startup building an intelligent platform to automate operations at scale. Backed by experienced founders and early customer traction, the business is tackling … multi-billion-pound market undergoing rapid transformation through automation. The Role Own and build the data infrastructure powering AI products — from real-time pipelines to ML workflows and vector databases. As the first senior data hire, you’ll define architecture, tooling, and standards, working closely with ...

looking for a talented and versatile developer to join us and manage our technology stack end to end — from custom development and data engineering through to platform management across our SaaS ecosystem. We are based in Bath and meet once/twice a week in the office, working … Role description We are looking for a well-rounded technologist who thrives on variety and can move fluidly between writing code, digging into data and managing our wider platform ecosystem. You must be all over the latest in AI opportunities, including the adoption of AI-supported code editors ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Clearance Required Overview This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

role in maintaining, improving and supporting the Bullhorn CRM platform across the business. They will be responsible for day to day configuration, data structure management, reporting development (including Power BI), and workflow optimisation, ensuring the CRM operates efficiently, compliantly, and in alignment with business needs. While the role … Front End development or API engineering role. Instead, the emphasis is on configuration, SQL reporting, Power BI dashboard development, data quality management, Bullhorn Automation, and system support. Reporting to the Head of IT, the CRM Configuration Specialist works with delivery teams, leaders and operational stakeholders to translate business ...

Role/Job Title: Data Ops Engineer Work Location: Norwich 3 Days (Flexible) Duration of Assignment: 06 Months The Role A Data Ops Engineer is responsible for designing, automating, and optimizing data pipelines and ensuring smooth data flow across the organization. … role bridges data engineering, operations, and DevOps practices to deliver reliable, high quality, and timely data for analytics, reporti click apply for full job details ...

environment is stable but under-optimised, with a "vanilla" ERP setup and multiple integrations creating unnecessary complexity. This role will focus on simplifying data flows, improving system connectivity, and unlocking more value from operational and financial data. You'll play a key role in strengthening the organisation … data posture while laying the foundations for future reporting and ERP optimisation. Responsibilities : Improve data extraction, usability, and connectivity from a Syspro ERP environment Design and deliver custom applications and data transfer solutions using middleware (e.g. Dataswitch) Build workflows and automation within Syspro ...

models, and scalable API platforms. Key Responsibilities Own the technical strategy and execution across the company’s core products, including real-time APIs, data pipelines, and LLM-powered analytics. Collaborate closely with Product and Data Science to deliver a forward-thinking technology roadmap. Lead, mentor … high-performing engineering team (currently ~10), nurturing a culture of ownership, speed, and technical excellence. Make key architectural decisions, ensuring system scalability and data infrastructure performance. Maintain high engineering standards while remaining close to critical technical choices. Recruit top talent and build a strong, inclusive team culture. Oversee ...

Were seeking a Data Platform Engineer to design and build a modern enterprise data platform using Microsoft Fabric. Youll play a key role in architecting a secure, scalable and high-performance cloud environment that enables advanced analytics and data-driven decision making. This … hybrid role with 1 day a week in the Milton Keynes office. You will - Design and deliver a cloud-native data platform in Microsoft Fabric. Build and optimise data pipelines, lakehouse/warehouse solutions and semantic models. Implement Platform as Code (terraform) and CI/ ...

Software Engineer Gloucester, United Kingdom Reporting to: Practice Lead Company: Akkodis is a global leader in engineering, technology and R&D, harnessing connected data to drive digital transformation and innovation. With over 50,000 engineers and digital specialists across 30 countries, Akkodis supports organisations from concept through … enhances engineering workflows. In addition to core software development, you will integrate AI and machine learning components into engineering tools, contributing to scalable, data-driven systems deployed in production environments. Key Responsibilities: Lead software development activities and support engineering standards for scalable, maintainable codebases Design, build, test ...

reconciliation. Designing and implementing API integrations across internal and third‐party systems. Developing in‐house solutions to replace outsourced or legacy technology. Creating data pipelines that improve reporting and analytics for portfolio managers. Owning projects end‐to‐end — from gathering requirements through to deployment. What you’ll need … Front‐end experience with Vue.js , React , or Angular . Experience with databases such as SQL Server, Databricks, or Azure SQL. Strong understanding of data structures, automation, and workflow optimisation . Familiarity with Git/CI/CD pipelines . Ability to operate independently in a fast‐moving, high ...

Build You’ll work across a range of applied AI use cases, typically involving: Document intelligence systems Extracting, structuring, and reasoning over unstructured data (PDFs, emails, reports) using LLMs and ML Agentic AI workflows Systems that can take actions, make decisions, and continuously improve with human … built for production environments with real users. Tech Environment Languages: Python, TypeScript, Node.js AI/ML: LLMs, applied machine learning, RAG architectures Data: Structured + unstructured data pipelines Infrastructure: AWS and modern cloud environments Responsibilities Design and build production-grade AI systems end-to-end Develop ...

Role In this role, you will define the architectural blueprint and technology foundations for AI driven solutions that transform how customers in dynamic, data intensive industries operate, scale, and innovate. You will design robust, future ready AI architectures that enable automation, advanced analytics, and intelligent decision making across … complex digital transformation programmes. With access to cutting edge AI frameworks, high performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end to end AI ecosystems ...

NATO. Key skills Dynamics 365 Finance & Operations (F&O) - customisation, configuration, and support X and C# development for extensions and integrations Data Entities and Data Management Framework (DMF) Power Platform - Power Automate, Power Apps, Dataverse Integration design - RESTful APIs, virtual tables, external systems Finance and procurement … build integrations between F&O and external systems Develop automated workflows and approval processes to support compliance and efficiency Manage and optimise data entities and data pipelines for reporting and synchronisation Extend system functionality using X and C# following best practices Support full life cycle implementations ...

highly skilled AI Architect who defines the architectural blueprint and technology foundations for AI-driven solutions that transform how customers in dynamic, data-intensive industries operate, scale, and innovate. You will design robust, future-ready AI architectures that enable automation, advanced analytics, and intelligent decision-making across complex … digital transformation programmes. With access to cutting-edge AI frameworks, high-performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end-to-end AI ecosystemsaccelerating delivery ...

Location: Oxford/London – Hybrid I’m currently working with a highly ambitious organisation building large-scale data platforms to power the next generation of scientific discovery. They are looking for Data Engineers with a background in genomics or bioinformatics to work directly alongside scientists … researchers, turning complex biological data into reliable, scalable datasets that can power AI and machine learning models. This role sits at the intersection of data engineering, genomics, and applied research - ideal for engineers who enjoy collaborating closely with scientists and building systems that enable real-world ...

environment that both supports and includes them. Your Role: We are seeking a highly capable Applied AI/Automation Engineer to join our Data Science team, on a 12-month fixed-term contract. This role will focus on designing and building an intelligent reporting platform to support … Fund Administration team. The role reports directly to the Head of Data Science and will partner closely with a designated Product Manager within the Fund Administration team, to deliver measurable efficiency gains and scalable operational improvements. Day-to-day priorities will be operationally aligned in partnership with ...

they work, with an open culture that values pragmatism, trust, and delivery over hierarchy. The Role You will sit within the Data Science function, reporting directly to the Head of Data Science and working closely with senior stakeholders across the business. Responsibilities include: Owning … delivery of an automated LAV and NAV calculation platform Automating the ingestion of structured and unstructured data from multiple sources including reports, internal systems, APIs, Excel files, and PDFs Designing and implementing robust data pipelines and workflows Building and maintaining SQL based data models ...

Security (NatSec) domain. This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

join a growing advanced analytics and AI capability. This is a hands-on engineering role building and deploying ML solutions in highly secure, data-rich environments , where work directly contributes to national-level outcomes. Why this role? This is an opportunity to work on real-world, high-impact … environments Working with large, complex datasets in secure infrastructures Supporting the development of AI-driven capabilities for mission-critical systems Collaborating with engineers, data scientists, and security specialists Contributing to the full ML lifecycle from data prep to deployment What you’ll be doing Develop ...