826 to 850 of 1,061 Data Pipeline Jobs in England

Senior Data Engineer - Commodities - 140,000k + bonuses You don’t need any prior buy-side experience to join this firm, where you’ll join this new team within this established firm whose mission is to bridge the gap across technology and trading. This global energy and commodities firm is seeking an experienced Senior Data Engineer … the business users to understand what they need, before building out the application. You’ll see the impact you’re having, daily. Key responsibilities include building and optimising data pipelines, managing cloud-based storage and processing systems, and partnering with analysts and data scientists to deliver production-ready data solutions. They are looking for … an experience data engineer with strong skills in Python, SQL, and modern cloud technologies to take a leading role in a forward-thinking, data-driven organisation. No up-to-date CV required. More ❯

to humanity's enduring challenges. We are looking for a Senior DevSecOps Engineer to join the Pathogen Programme at EIT. In this role, you'll help ensure our data platform is built to the highest standards, with a strong emphasis on automation across the development lifecycle. You'll work closely with engineers to deploy data pipelines … their workflows. You'll be responsible for maintaining infrastructure, designing secure automation pipelines, managing cloud environments, and ensuring security and compliance. You'll collaborate with cross-functional teams, data engineers, backend, and full-stack developers, to build robust, automated deployment pipelines across our environments. Key Responsibilities Design, implement, and maintain secure cloud infrastructure using Oracle Cloud Infrastructure (OCI … tools like Terraform to enable secure, repeatable deployments. Implement and manage CI/CD pipelines, focusing on automated security testing, deployment, and monitoring. Ensure all aspects of the data platform OCI infrastructure, data ingest pipelines, tool deployments, access controls, and monitoring are developed, tested, and deployed using automation best practices. Support bioinformaticians in building pipelines that More ❯

Must be a British Citizen** Join one of the UK’s leading technology and defence engineering consultancies — a team trusted by government and security clients to deliver advanced data, software, and AI-driven solutions that protect the country’s most critical systems. They’re expanding their Gloucester engineering function by 30+ people before Q1 next year, with opportunities … Python Engineers to work on projects that genuinely make a difference. What you’ll be doing Building secure, high-performance software underpinning security and defence operations Developing complex data pipelines, APIs, and AI tooling in modern Python environments Working in agile, multi-disciplinary teams alongside experts in software, data, and machine learning Delivering production-grade solutions … required Strong hands-on Python development (FastAPI, Flask, Django or similar) Solid understanding of CI/CD pipelines, automated testing, and modern DevOps practices Experience in secure systems, data engineering, or AI-focused environments UK Citizen – must be eligible and willing to undergo DV Clearance The Package Up to £70,000 + excellent benefits Hybrid model based from More ❯

You will: Identify high-impact opportunities to embed AI, ML, and agentic systems across a global SaaS platform Build prototypes, MVPs, and proofs-of-concept using real production data Experiment with LLMs, automation frameworks, advanced ML models, and emerging AI tooling Evaluate and integrate third-party APIs and open-source frameworks Develop reusable components and reference architectures Collaborate … from: Academic routes PhD or research background in AI, ML, or Computer Science Ready to apply deep expertise in a commercial SaaS setting Industry routes Senior or Lead Data/AI Engineer with strong applied experience Comfortable shipping AI features or automation products Essential skills: Strong experience with Machine Learning, LLMs, NLP and Data Science Proven … track record of building and deploying AI models (Python, TensorFlow, PyTorch, LangChain) Hands-on with cloud platforms (preferably Azure, or AWS, GCP) Good understanding of APIs, microservices, and data pipelines Able to prototype quickly and communicate findings clearly Why this role matters This is a career-defining opportunity to help shape the future of AI in education. The More ❯

You will: Identify high-impact opportunities to embed AI, ML, and agentic systems across a global SaaS platform Build prototypes, MVPs, and proofs-of-concept using real production data Experiment with LLMs, automation frameworks, advanced ML models, and emerging AI tooling Evaluate and integrate third-party APIs and open-source frameworks Develop reusable components and reference architectures Collaborate … from: Academic routes PhD or research background in AI, ML, or Computer Science Ready to apply deep expertise in a commercial SaaS setting Industry routes Senior or Lead Data/AI Engineer with strong applied experience Comfortable shipping AI features or automation products Essential skills: Strong experience with Machine Learning, LLMs, NLP and Data Science Proven … track record of building and deploying AI models (Python, TensorFlow, PyTorch, LangChain) Hands-on with cloud platforms (preferably Azure, or AWS, GCP) Good understanding of APIs, microservices, and data pipelines Able to prototype quickly and communicate findings clearly Why this role matters This is a career-defining opportunity to help shape the future of AI in education. The More ❯

Engineer - London (Hybrid) - Up to £90k A well funded start up who are revolutionising real estate transactions through cutting-edge technology combining sophisticated AI capabilities with robust financial data systems are looking for a Senior Full Stack Engineer to join their team. What will I be doing: Design, develop, test, deploy, and maintain robust and scalable backend systems … Work with databases to design schemas, write efficient queries, and ensure optimal performance Contribute to overall system architecture, ensuring scalability, reliability, and security Integrate various platform components, including data pipelines and AI-driven features Mentor junior engineers and contribute to improving our engineering practices and processes What are we looking for: At least 5+ years in professional full … stack software development Strong proficiency in Python for backend development Experience with modern frontend frameworks (React, Vue, Angular) Solid understanding of database technologies (PostgreSQL, MySQL) and data modeling Experience designing and building RESTful APIs Experience with cloud platforms (AWS, GCP, Azure) and containerisation (Docker) Bonus: Experience with financial concepts, real estate data, or startup environments What More ❯

Engineer - London (Hybrid) - Up to £90k A well funded start up who are revolutionising real estate transactions through cutting-edge technology combining sophisticated AI capabilities with robust financial data systems are looking for a Senior Full Stack Engineer to join their team. What will I be doing: Design, develop, test, deploy, and maintain robust and scalable backend systems … Work with databases to design schemas, write efficient queries, and ensure optimal performance Contribute to overall system architecture, ensuring scalability, reliability, and security Integrate various platform components, including data pipelines and AI-driven features Mentor junior engineers and contribute to improving our engineering practices and processes What are we looking for: At least 5+ years in professional full … stack software development Strong proficiency in Python for backend development Experience with modern frontend frameworks (React, Vue, Angular) Solid understanding of database technologies (PostgreSQL, MySQL) and data modeling Experience designing and building RESTful APIs Experience with cloud platforms (AWS, GCP, Azure) and containerisation (Docker) Bonus: Experience with financial concepts, real estate data, or startup environments What More ❯

of our next-generation agentic platform, we're doubling down on our supply chain roots while laying the groundwork to expand into new industries. Designed to handle messy data, fragmented systems, and people-intensive workflows, our platform is already proving its versatility. Customers in finance demonstrate how these same capabilities translate seamlessly into finance, insurance, and beyond, validating … in a fast-moving environment where AI is applied in the real world. What You'll Do: Drive Complex, Fast-Moving Programs Coordinate multiple workstreams with internal engineers, data scientists, and external customer teams. Keep everyone aligned — proactively communicate updates, risks, and next steps across functions and time zones. Unblock issues quickly by finding creative paths forward using … people, and information available. Lead short-term technical projects to deploy and integrate our AI platform within enterprise environments. Debug and troubleshoot customer issues in real time — from data ingestion to model inference and API integrations. Rapidly prototype or configure creative solutions using our existing tools, SDKs, and APIs. Collaborate with Product and Engineering to identify feature gaps More ❯

Tech Scale-Up, where you’ll lead QA strategy, build automation frameworks, and embed quality practices across the entire software development lifecycle. You’ll work closely with engineering, data science, and product teams to make quality a core part of how we build and ship software. What You’ll Do Define and lead the QA strategy, methodology, and … quality metrics to assess release readiness. Design and execute manual and automated tests for functional, performance, and regression testing. Test the unique aspects of computer vision systems — from data pipelines to inference performance and model accuracy. Partner with engineering and product teams to ensure testable requirements and smooth release management. Mentor engineers on QA best practices and contribute … . Solid understanding of SDLC and Agile development. Excellent communication skills with both technical and non-technical teams. Bonus Skills: Experience testing Machine Learning or Artificial Intelligence systems (data quality, model metrics, inference latency). Familiarity with Cloud, Docker, Kubernetes , and CI/CD tools (e.g. GitLab CI). Experience with hardware simulation. Background in retail tech or More ❯

innovation and deliver measurable business value. Your Responsibilities: Full Stack Development: Design, develop, and maintain end-to-end AI solutions, including front-end interfaces, back-end services, and data pipelines. AI System Development: Implement and optimize AI models, ensuring they are scalable, maintainable, and production-ready. Work on GenAI, Agentic AI, and classic ML solutions. Enterprise Integration: Integrate … AI solutions with existing enterprise systems and ensure seamless operation within the client's technology stack. Collaboration: Work closely with cross-functional teams, including data scientists, software engineers, and business stakeholders, to identify opportunities and deliver robust AI solutions. Technical Leadership: Provide technical guidance and mentorship to junior engineers. Lead the implementation of best practices in AI/ More ❯

innovation and deliver measurable business value. Your Responsibilities: Full Stack Development: Design, develop, and maintain end-to-end AI solutions, including front-end interfaces, back-end services, and data pipelines. AI System Development: Implement and optimize AI models, ensuring they are scalable, maintainable, and production-ready. Work on GenAI, Agentic AI, and classic ML solutions. Enterprise Integration: Integrate … AI solutions with existing enterprise systems and ensure seamless operation within the client's technology stack. Collaboration: Work closely with cross-functional teams, including data scientists, software engineers, and business stakeholders, to identify opportunities and deliver robust AI solutions. Technical Leadership: Provide technical guidance and mentorship to junior engineers. Lead the implementation of best practices in AI/ More ❯

be doing: Lead the design and deployment of next-generation AI systems across Generative AI, Computer Vision, Forecasting, and Optimisation. Build and lead a world-class team of data scientists and ML engineers, setting technical direction and best practices across the company. Oversee the full AI lifecycle from experimentation and model development to robust ML deployment on Azure. … learning to enhance decision-making and automation. Translate complex research into tangible business outcomes, driving measurable value and competitive advantage. About you: Proven track record leading AI or data science teams in production supply chain or logistics environments. Deep expertise in Computer Vision and Generative AI, with strong understanding of modern ML architectures, model training, and deployment techniques. … 7+ years’ experience in applied ML, data science, or AI, including senior or leadership roles. Expert in Python, proficient with frameworks such as PyTorch, TensorFlow, FastAI, and experience with scikit-learn, MLflow, or ONNX. Solid engineering background—experienced in deploying and maintaining ML systems on Azure, including Azure Machine Learning, Azure Functions, Databricks, Docker, and Kubernetes. Experience with More ❯

be doing: Lead the design and deployment of next-generation AI systems across Generative AI, Computer Vision, Forecasting, and Optimisation. Build and lead a world-class team of data scientists and ML engineers, setting technical direction and best practices across the company. Oversee the full AI lifecycle from experimentation and model development to robust ML deployment on Azure. … learning to enhance decision-making and automation. Translate complex research into tangible business outcomes, driving measurable value and competitive advantage. About you: Proven track record leading AI or data science teams in production supply chain or logistics environments. Deep expertise in Computer Vision and Generative AI, with strong understanding of modern ML architectures, model training, and deployment techniques. … 7+ years’ experience in applied ML, data science, or AI, including senior or leadership roles. Expert in Python, proficient with frameworks such as PyTorch, TensorFlow, FastAI, and experience with scikit-learn, MLflow, or ONNX. Solid engineering background—experienced in deploying and maintaining ML systems on Azure, including Azure Machine Learning, Azure Functions, Databricks, Docker, and Kubernetes. Experience with More ❯

delivering high-quality, scalable, and integrated solutions. This role combines technical leadership, systems thinking, and people management, with a strong focus on interoperability between built and bought systems, data protection, and sustainable delivery. Key Responsibilities: Lead, mentor, and support a cross-functional team of engineers, fostering a high-performance and inclusive engineering culture. Provide architectural oversight across the … ensuring they meet enterprise and operational standards. Oversee the design, build, testing, and long-term management of integrations between in-house and vendor platforms. Ensure responsible stewardship of data—maintaining data quality, access controls, protection, and lifecycle management. Collaborate with product leaders and business stakeholders to shape technical delivery plans that support strategic goals. Drive engineering … or SaaS systems within a broader IT estate. Strong understanding of non-functional requirements and architectural principles for distributed, cloud-native systems. Experience building and maintaining robust APIs, data pipelines, and secure system integrations. Knowledge of DevOps practices, CI/CD, infrastructure-as-code, and cloud platforms (preferably Azure). Excellent communication, influencing, and stakeholder management skills. Ability More ❯

that this is a fully on site role, and candidates for this role are required to hold an active DV security clearance. Hexegic are looking for technically minded data and software engineers to work on an intriguing and exciting project, building and maintaining data pipelines and platforms for our customers in a military setting. Our growing … team ensure data driven projects can be rapidly prototyped and delivered in line with customer needs. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career. Core Responsibilities Liaise closely with … Strong python proficiency, or familiarity with similar languages API awareness for data retrieval and integration into processing pipelines Experience of stakeholder management and requirements capture Understanding of pipeline scheduling and health checks What’s in it for you? Base salary of £50,000-£70,000 £5000 a year professional development budget Wellness program 25 days annual leave More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of … their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + bonus More ❯

Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey OB have partnered with a leading scale-up business in the AdTech space, where Data is at the forefront of everything they do, and they are currently hiring for a Lead Data Engineer to join their team and work on the development of … their Data platform. This will be a hands-on role but you will line manage a small team of 3 Engineers, where the long-term plan of this team is to grow and this is a great opportunity to progress in a scaling business. This role requires candidates to come with hands on experience working in Data heavy environments, with Real-Time Data Pipelines, Distributed Streaming Pipelines and strong knowledge of Cloud Environments. Lead Data Engineer - Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Key Skills and Experience: Python, SQL, GCP, Kubernetes, DBT, Airflow and BigQurey Prior experience working as a Lead Engineer or Tech Lead Pays £100k-£130k + bonus More ❯

Position: Data EngineerLocation: Central London or Bristol (3 days per week onsite)Salary: £600 to £650 p.d inside IR35Security Clearance: SC Clearance Required About the Role A leading IT consultancy delivering innovative solutions to the UK public sector is seeking an experienced Data Engineer to support a high-profile programme. You'll collaborate with cross-functional … teams to build scalable data pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance optimisation Contribute to … Docker/Kubernetes) - experience in this area is desirable, not essential Operate within Agile teams and support DevOps practices What We're Looking For Proven experience as a Data Engineer in complex environments Strong proficiency in PostgreSQL and either Airflow or Spark Solid understanding of Node.js or React for integration and tooling Familiarity with containerisation technologies (Docker/ More ❯

Position: Data Engineer Location: Central London or Bristol (3 days per week onsite) Salary: £600 to £650 p.d inside IR35 Security Clearance: SC Clearance Required About the Role A leading IT consultancy delivering innovative solutions to the UK public sector is seeking an experienced Data Engineer to support a high-profile programme. You'll collaborate with … cross-functional teams to build scalable data pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance optimisation … Docker/Kubernetes) - experience in this area is desirable, not essential Operate within Agile teams and support DevOps practices What We're Looking For Proven experience as a Data Engineer in complex environments Strong proficiency in PostgreSQL and either Airflow or Spark Solid understanding of Node.js or React for integration and tooling Familiarity with containerisation technologies (Docker/ More ❯

and over £20M in annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal for someone who enjoys building … the ground up, solving real-world problems, and owning architecture decisions in a fast-moving environment. You’ll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What You’ll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation Lead the design and implementation … of scalable, microservices-based systems Own and evolve their core platform architecture, including APIs, internal tools, and data pipelines Work with large, varied data sets from third-party sources (e.g. partner platforms, supply chains, operational data) Help turn data into insights and recommendations using AI/ML tooling Tackle technical debt and More ❯

and over £20M in annual sales, they're now investing heavily in their technology to unlock the next phase: scaling from 150 sites to 5,000+, powered by data, AI, and automation. The Role You'll be a foundational member of their engineering team. This is a high-impact individual contributor role, ideal for someone who enjoys building … the ground up, solving real-world problems, and owning architecture decisions in a fast-moving environment. You’ll work across the stack, with a focus on backend systems, data infrastructure, and internal tools. What You’ll Be Doing Implementing AI tooling across all their products focusing on data ingestion and aggregation Lead the design and implementation … of scalable, microservices-based systems Own and evolve their core platform architecture, including APIs, internal tools, and data pipelines Work with large, varied data sets from third-party sources (e.g. partner platforms, supply chains, operational data) Help turn data into insights and recommendations using AI/ML tooling Tackle technical debt and More ❯

systems (TMS), and mobile measurement platforms (MMPs). Campaign Enablement & Optimization Oversee deployment and optimization of digital campaigns through technologies like DCO, SPO, and MMP. Drive efficiency through data-informed testing, measurement frameworks, and performance optimization techniques. Tagging, Pixel & Tech Implementation Own onsite tagging strategies and data accuracy across web and mobile environments. Partner with developers … Analytics & Reporting Use tools like GA4 and Adobe Analytics to create actionable insights and stakeholder dashboards. Collaborate with regions to drive visibility, consistency, and readiness across reporting outputs. Data Governance & Compliance Enforce policies that safeguard data privacy, accuracy, and platform compliance. Implement and optimize Conversion APIs and data pipelines that support attribution and decision … Google Tag Manager, Adobe Launch). Proficient in web analytics tools (e.g., GA4, Adobe Analytics). Hands-on experience with DCO, MMPs (AppsFlyer, Kochava), SPO, Conversion APIs, and data c lean rooms. Familiarity with CDPs, CMPs, DSPs, and social/search activation platforms (e.g., Meta, Google Ads). Strong knowledge of data governance, privacy frameworks , and More ❯

Scala Developer A leading Data & Analytics company seek a Scala Developer to build high-performance data systems that power real insight and innovation. What You’ll Do: Design, build, and optimise data pipelines and distributed systems in Scala. Collaborate with data scientists, engineers, and analysts to turn complex data challenges … into elegant, scalable solutions. Work with modern data technologies (e.g. Spark, Kafka, AWS/GCP, Docker, Kubernetes). Contribute to a culture of technical excellence, knowledge sharing, and continuous improvement. What We’re Looking For: Strong experience with Scala (and ideally the wider JVM ecosystem). Background in data engineering, backend development, or distributed systems. Familiarity More ❯

Scala Developer A leading Data & Analytics company seek a Scala Developer to build high-performance data systems that power real insight and innovation. What You’ll Do: Design, build, and optimise data pipelines and distributed systems in Scala. Collaborate with data scientists, engineers, and analysts to turn complex data challenges … into elegant, scalable solutions. Work with modern data technologies (e.g. Spark, Kafka, AWS/GCP, Docker, Kubernetes). Contribute to a culture of technical excellence, knowledge sharing, and continuous improvement. What We’re Looking For: Strong experience with Scala (and ideally the wider JVM ecosystem). Background in data engineering, backend development, or distributed systems. Familiarity More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Product Engineer (Backend & Data) with good commercial experience in Python for backend engineering. Alongside building microservices & API's using Python & TypeScript, the ideal candidate will also … have experience building data pipelines, although this is highly desirable. Role Information: Salary : Up to £65,000 (DOE) + Equity Location : Fully remote (UK only) Stack : Python, TypeScript, GCP, Pub/Sub, SQL & NoSQL, IaC (Terraform), CI/CD (GitHub Actions), Observability tools, AI tooling You’ll join a remote first, high-trust engineering team working with a … commercial impact. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Build event-driven solutions in GCP with Pub/Sub & Cloud Run Integrate APIs, enrich Data, and deliver robust, scalable Data pipelines Implement modern IaC practices for deployment and automation Leverage AI and tooling of your choice to boost workflow efficiency and deliver More ❯