401 to 425 of 556 Data Pipeline Jobs in England

work on cutting‐edge AI initiatives as organisations accelerate their adoption of artificial intelligence across industries. You will collaborate with experienced engineers and data scientists, leveraging modern AI, machine learning, and Generative AI technologies to build scalable, production‐ready solutions while continuously learning and experimenting with emerging tools … approaches. Your responsibilities: Assist in designing, building, and maintaining scalable data pipelines for structured and unstructured data. Develop, train, and evaluate machine learning and deep learning models, including neural networks. Work with Large Language Models (LLMs) for tasks such as text generation, summarisation, and semantic analysis. Contribute ...

totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion … Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills ...

Data Engineer Location: Surrey Salary: £50k - £60k + Benefits Type: Full-time/Permanent - Hybrid Data Engineer Overview I am hiring for my financial services client in Surrey who are looking for a Data Engineer to design, build, and support data solutions … reporting systems. You'll work closely with business stakeholders to deliver high-quality data pipelines, SQL solutions, and Power B click apply for full job details ...

partnering with a leading business in the West Midlands to recruit a Senior Data Engineer for a newly created permanent position. The role offers a salary of up to £75,000 plus a bonus of up to 15%. This is a hybrid role, requiring attendance … office on average twice per month, with flexibility to come in as needed. The Role We are for Senior Data Engineers with strong Databricks experience to join a newly established data function wihin a global organisation. You will play a key role in the implementation ...

implement scalable, reliable, and performant backend systems. Develop and maintain microservices, containerized applications, and supporting infrastructure. Solve complex problems with practical solutions and data-driven approaches. Contribute to architecture discussions, code reviews, and testing strategies. Identify performance or reliability bottlenecks and propose improvements. Required Qualifications & Experience Strong experience … system design and desire to build elegant, maintainable solutions. General understanding of supporting infrastructure: git, microservices, containers, etc. Comfortable working with numbers and data, with or without prior trading/finance experience. Experience with writing unit and integration tests and maintaining CI/CD pipelines. Preferred Qualifications & Experience ...

ensure solutions work in real-world environments. Key Responsibilities: Deploy and configure software solutions in client environments Integrate systems across cloud, APIs, and data pipelines Troubleshoot and resolve technical issues on-site or remotely Collaborate with product and engineering teams to improve deployments Support rollout projects and large … system integration, and microservices Client-facing experience or delivery-focused roles Strong problem-solving and communication skills Desirable: Exposure to AI, ML, or data platforms DevOps, CI/CD, or infrastructure as code experience Consulting or technical delivery background Location: UK Hybrid, with occasional client visits ...

Lead Data Engineer London | Full-time £120,000 - £140,000 + Bonus + Equity 5 Days a week in Victoria Join a fast-growing AI startup building an intelligent platform to automate operations at scale. Backed by experienced founders and early customer traction, the business is tackling … multi-billion-pound market undergoing rapid transformation through automation. The Role Own and build the data infrastructure powering AI products — from real-time pipelines to ML workflows and vector databases. As the first senior data hire, you’ll define architecture, tooling, and standards, working closely with ...

looking for a talented and versatile developer to join us and manage our technology stack end to end — from custom development and data engineering through to platform management across our SaaS ecosystem. We are based in Bath and meet once/twice a week in the office, working … Role description We are looking for a well-rounded technologist who thrives on variety and can move fluidly between writing code, digging into data and managing our wider platform ecosystem. You must be all over the latest in AI opportunities, including the adoption of AI-supported code editors ...

event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. Introduce caching, rate limiting, and queuing to meet performance budgets and latency … including streaming responses, async inference jobs, and robust error/retry semantics. Palantir Foundry Integration Work with Palantir Foundry to build and maintain data pipelines, ontologies, and integrations that connect backend services to Foundry-based analytics and workflows. Leverage Foundry's APIs and tooling to support data ...

Clearance Required Overview This is a hands-on leadership role combining architecture, software engineering, and team leadership, with a focus on Software, AI, data platforms, and cloud-native systems. Key Responsibilities Lead and mentor Agile engineering teams, driving high-quality, rapid delivery (DevSecOps) Own solution architecture, designing … secure and constrained environments. Lead the implementation of the "underpinning tech" for AI, including data pipelines. Act as a trusted advisor to UK Government stakeholders. Define technical roadmaps and support cloud transformation (AWS/Azure) Core Skills Background in UK National Security/Defence/Government. Strong leadership ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor … products and services Design solutions for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs ...

role in maintaining, improving and supporting the Bullhorn CRM platform across the business. They will be responsible for day to day configuration, data structure management, reporting development (including Power BI), and workflow optimisation, ensuring the CRM operates efficiently, compliantly, and in alignment with business needs. While the role … Front End development or API engineering role. Instead, the emphasis is on configuration, SQL reporting, Power BI dashboard development, data quality management, Bullhorn Automation, and system support. Reporting to the Head of IT, the CRM Configuration Specialist works with delivery teams, leaders and operational stakeholders to translate business ...

Role/Job Title: Data Ops Engineer Work Location: Norwich 3 Days (Flexible) Duration of Assignment: 06 Months The Role A Data Ops Engineer is responsible for designing, automating, and optimizing data pipelines and ensuring smooth data flow across the organization. … role bridges data engineering, operations, and DevOps practices to deliver reliable, high quality, and timely data for analytics, reporti click apply for full job details ...

environment is stable but under-optimised, with a "vanilla" ERP setup and multiple integrations creating unnecessary complexity. This role will focus on simplifying data flows, improving system connectivity, and unlocking more value from operational and financial data. You'll play a key role in strengthening the organisation … data posture while laying the foundations for future reporting and ERP optimisation. Responsibilities : Improve data extraction, usability, and connectivity from a Syspro ERP environment Design and deliver custom applications and data transfer solutions using middleware (e.g. Dataswitch) Build workflows and automation within Syspro ...

models, and scalable API platforms. Key Responsibilities Own the technical strategy and execution across the company’s core products, including real-time APIs, data pipelines, and LLM-powered analytics. Collaborate closely with Product and Data Science to deliver a forward-thinking technology roadmap. Lead, mentor … high-performing engineering team (currently ~10), nurturing a culture of ownership, speed, and technical excellence. Make key architectural decisions, ensuring system scalability and data infrastructure performance. Maintain high engineering standards while remaining close to critical technical choices. Recruit top talent and build a strong, inclusive team culture. Oversee ...

Were seeking a Data Platform Engineer to design and build a modern enterprise data platform using Microsoft Fabric. Youll play a key role in architecting a secure, scalable and high-performance cloud environment that enables advanced analytics and data-driven decision making. This … hybrid role with 1 day a week in the Milton Keynes office. You will - Design and deliver a cloud-native data platform in Microsoft Fabric. Build and optimise data pipelines, lakehouse/warehouse solutions and semantic models. Implement Platform as Code (terraform) and CI/ ...

Software Engineer Gloucester, United Kingdom Reporting to: Practice Lead Company: Akkodis is a global leader in engineering, technology and R&D, harnessing connected data to drive digital transformation and innovation. With over 50,000 engineers and digital specialists across 30 countries, Akkodis supports organisations from concept through … enhances engineering workflows. In addition to core software development, you will integrate AI and machine learning components into engineering tools, contributing to scalable, data-driven systems deployed in production environments. Key Responsibilities: Lead software development activities and support engineering standards for scalable, maintainable codebases Design, build, test ...

reconciliation. Designing and implementing API integrations across internal and third‐party systems. Developing in‐house solutions to replace outsourced or legacy technology. Creating data pipelines that improve reporting and analytics for portfolio managers. Owning projects end‐to‐end — from gathering requirements through to deployment. What you’ll need … Front‐end experience with Vue.js , React , or Angular . Experience with databases such as SQL Server, Databricks, or Azure SQL. Strong understanding of data structures, automation, and workflow optimisation . Familiarity with Git/CI/CD pipelines . Ability to operate independently in a fast‐moving, high ...

Build You’ll work across a range of applied AI use cases, typically involving: Document intelligence systems Extracting, structuring, and reasoning over unstructured data (PDFs, emails, reports) using LLMs and ML Agentic AI workflows Systems that can take actions, make decisions, and continuously improve with human … built for production environments with real users. Tech Environment Languages: Python, TypeScript, Node.js AI/ML: LLMs, applied machine learning, RAG architectures Data: Structured + unstructured data pipelines Infrastructure: AWS and modern cloud environments Responsibilities Design and build production-grade AI systems end-to-end Develop ...

Role In this role, you will define the architectural blueprint and technology foundations for AI driven solutions that transform how customers in dynamic, data intensive industries operate, scale, and innovate. You will design robust, future ready AI architectures that enable automation, advanced analytics, and intelligent decision making across … complex digital transformation programmes. With access to cutting edge AI frameworks, high performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end to end AI ecosystems ...

NATO. Key skills Dynamics 365 Finance & Operations (F&O) - customisation, configuration, and support X and C# development for extensions and integrations Data Entities and Data Management Framework (DMF) Power Platform - Power Automate, Power Apps, Dataverse Integration design - RESTful APIs, virtual tables, external systems Finance and procurement … build integrations between F&O and external systems Develop automated workflows and approval processes to support compliance and efficiency Manage and optimise data entities and data pipelines for reporting and synchronisation Extend system functionality using X and C# following best practices Support full life cycle implementations ...

highly skilled AI Architect who defines the architectural blueprint and technology foundations for AI-driven solutions that transform how customers in dynamic, data-intensive industries operate, scale, and innovate. You will design robust, future-ready AI architectures that enable automation, advanced analytics, and intelligent decision-making across complex … digital transformation programmes. With access to cutting-edge AI frameworks, high-performance computing environments, and modern data platforms, you will guide engineering and data science teams in building secure, scalable, and ethical AI systems. This role empowers you to shape end-to-end AI ecosystemsaccelerating delivery ...

Location: Oxford/London – Hybrid I’m currently working with a highly ambitious organisation building large-scale data platforms to power the next generation of scientific discovery. They are looking for Data Engineers with a background in genomics or bioinformatics to work directly alongside scientists … researchers, turning complex biological data into reliable, scalable datasets that can power AI and machine learning models. This role sits at the intersection of data engineering, genomics, and applied research - ideal for engineers who enjoy collaborating closely with scientists and building systems that enable real-world ...

environment that both supports and includes them. Your Role: We are seeking a highly capable Applied AI/Automation Engineer to join our Data Science team, on a 12-month fixed-term contract. This role will focus on designing and building an intelligent reporting platform to support … Fund Administration team. The role reports directly to the Head of Data Science and will partner closely with a designated Product Manager within the Fund Administration team, to deliver measurable efficiency gains and scalable operational improvements. Day-to-day priorities will be operationally aligned in partnership with ...