576 to 600 of 1,061 Data Pipeline Jobs in England

Senior Data Engineer | Up to £110,000 | Remote (2 days/quarter in London) We’re partnering with a fast-growing, product-led organisation building industry-leading digital platforms used globally. They’re scaling their data function and seeking a Senior Data Engineer to help shape the next generation of their data products and infrastructure. You’ll work in a modern, cloud-first environment with real autonomy — designing and building data pipelines, improving infrastructure, and driving innovation across the data platform. Tech Stack: 🔹 Snowflake 🔹 Python (FastAPI, Pydantic) 🔹 Airflow/Dagster 🔹 AWS + Terraform 🔹 CI/CD (GitHub Actions) (Bonus: Kafka, dbt/SQLMesh, data … quarter in London (travel covered) 🌴 Paid festive office closure between Christmas & New Year ⚡ Huge scope for progression in a fast-moving global business If you’re an experienced Data Engineer who loves building modern data platforms and wants true ownership in a forward-thinking environment, we’d love to hear from you. More ❯

Data Analyst: Global Customer Success (10-Month Contract) Are you an 8+ year Data Analyst ready to drive global customer success for an industry leader in financial software? We're looking for a highly motivated Data Analyst to join the Global Customer Success Data Science Team in London, UK. This is a … critical 10-month contract role focused on establishing reliable data foundations and enabling actionable insights across multiple international markets. What You'll Do: Build the Foundation: Collaborate on data pipelines, improve integrity, and establish metric definitions tailored for non-US markets. Automate & Visualize: Create scalable, user-friendly dashboards to track core KPIs (tNPS, AHT, repeat contacts … improve the customer journey. Experiment: Support A/B testing and digital experience evaluations by analyzing performance and quantifying business impact. What You'll Bring: 8+ years in Data Analytics/Science. Expertise in SQL and dashboarding tools ( Tableau/Qlik ). Familiarity with big data tools ( Snowflake, Databricks ) and ETL . Experience with A/ More ❯

Data Engineer Watford | £85,000 + Excellent Benefits | Office-Based The Opportunity An excellent opportunity for a talented Data Engineer to join a well-established and growing financial services organisation based in Watford . Offering a salary of £85,000 plus a superb benefits package , this role is ideal for someone seeking a technically hands-on … position within a forward-thinking and data-driven environment. The company has been operating successfully for over 20 years, employs more than 300 staff, and is recognised as a market leader in specialist financial services. You'll be joining a collaborative data team where innovation, accuracy, and analytical thinking are highly valued. Duties & Responsibilities Design, build … and maintain robust data pipelines and reporting solutions using modern cloud technologies. Work closely with senior leadership to shape data and reporting strategies. Develop and enhance MI & BI reports, ensuring accuracy and integrity across all data outputs. Collaborate with Product Owners, Developers, and other technical teams to support business goals. Mentor junior members of More ❯

functions empower these teams to execute, and together, we're working toward one bold goal: a world with zero accidents and enhanced well-being for all. Team Our data platform team is working on accelerating autonomous driving by providing access to petabytes of data collected by our fleet of autonomous and non-autonomous vehicles. Efficient, fast … and cost-effective access to data at large scale is key to tackle the hardest problems in AD/ADAS, from developing the Machine Learning (ML) models for perception and prediction of human driving patterns, to increasing the sophistication of our validation and simulation by identifying rare and interesting real-world driving situations. The data ecosystem … that will impact millions of customers. "Our ML and Data pipelines combine open source technologies with custom Woven data processing, all deployed to AWS.". Pipeline code is written in Python & Java.. We use SQS and Kafka to automate data connections and leverage BigQuery and ElasticSearch for data storage. We believe More ❯

we do that matters–it's how we do it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus. As a Senior Data Analyst you will play an integral role in all operational aspects of onboarding, managing and maintaining various datasets used by traders and quantitative researchers. You will work closely with … a variety of stakeholders, including technology, front office, operations, research, and risk management. You should be comfortable investigating complex data support issues and develop sustainable solutions to address root causes What you will do in this role Help verify, clean, and ensure data is accurate and consistent across systems used for research and analysis by the … teams globally Analyse datasets in order to draw conclusions and provide insight to address stakeholder or project-related questions Collect metrics and analyse datasets across different dimensions of data quality including; completeness, validity, accuracy, timeliness, and consistency Perform preliminary root cause analysis and make recommendations for modifications in data pipelines to increase data quality More ❯

Overview We are seeking an experienced Data Engineer (Python Enterprise Developer) to design, develop, and optimize data-driven solutions within enterprise environments. The ideal candidate will have deep expertise in Python programming, strong SQL skills, and hands-on experience with modern data platforms and cloud technologies. Key Responsibilities: Develop, test, and deploy scalable data engineering solutions using Python . Build and maintain data pipelines leveraging libraries such as NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, and Requests . Write and optimize complex SQL queries and manage databases including PostgreSQL . Integrate and automate workflows using DevOps tools (e.g., CI/CD, Jenkins, Git ). Collaborate on cloud-based data initiatives … Mentor team members and foster a positive, results-driven work environment. Qualifications: 8+ years of professional experience in Python development and scripting. Proven ability to design and implement data solutions within enterprise environments. Strong problem-solving, communication, and leadership skills. Familiarity with modern data engineering best practices and tools. If you believe this job description aligns More ❯

Overview We are seeking an experienced Data Engineer (Python Enterprise Developer) to design, develop, and optimize data-driven solutions within enterprise environments. The ideal candidate will have deep expertise in Python programming, strong SQL skills, and hands-on experience with modern data platforms and cloud technologies. Key Responsibilities: Develop, test, and deploy scalable data engineering solutions using Python . Build and maintain data pipelines leveraging libraries such as NumPy, pandas, BeautifulSoup, Selenium, pdfplumber, and Requests . Write and optimize complex SQL queries and manage databases including PostgreSQL . Integrate and automate workflows using DevOps tools (e.g., CI/CD, Jenkins, Git ). Collaborate on cloud-based data initiatives … Mentor team members and foster a positive, results-driven work environment. Qualifications: 8+ years of professional experience in Python development and scripting. Proven ability to design and implement data solutions within enterprise environments. Strong problem-solving, communication, and leadership skills. Familiarity with modern data engineering best practices and tools. If you believe this job description aligns More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

integrate easily into a collaborative, outspoken team culture. Key Responsibilities: Develop automation solutions using Python, PowerShell, or similar scripting languages Work with Kafka or similar streaming platforms for data pipelines and real-time processing Build and maintain CI/CD pipelines using Bamboo/Jenkins and BitBucket/GitLab Create Ansible Tower runbooks and playbooks for infrastructure automation More ❯

key technical initiatives. Establish engineering best practices across performance, reliability, and security. Oversee the design and implementation of AI-driven systems — including multi-agent orchestration, LLM integration, and data pipelines (LangChain, LangSmith, vector databases). Drive continuous improvement in CI/CD, cloud infrastructure, and deployment processes (Docker, Kubernetes, AWS). Mentor engineers, recruit top talent, and help More ❯

day (inside IR35) Location: Hybrid – London (2–3 days onsite) Key Responsibilities Collaborate with Quant Researchers to productionise models and analytical tools. Develop and maintain scalable systems and data pipelines for pricing, risk, and performance analysis. Work closely with front-office teams to optimise existing code and improve efficiency. Implement best practices for testing, deployment, and version control. More ❯

day (inside IR35) Location: Hybrid – London (2–3 days onsite) Key Responsibilities Collaborate with Quant Researchers to productionise models and analytical tools. Develop and maintain scalable systems and data pipelines for pricing, risk, and performance analysis. Work closely with front-office teams to optimise existing code and improve efficiency. Implement best practices for testing, deployment, and version control. More ❯

Job Title: BE/Data Engineer (AI/ML) Location: UK/Remote Position Type: Full-time/Permanent Our team is changing the way Travel Arrangers and Corporate Travelers book travel by offering a powerful, easy-to-use, full 360 solution that encompasses all aspects of the Traveler’s journey from initial search to final destination. We … are seeking a highly skilled data engineer with a strong foundation in Machine Learning (ML) and Artificial Intelligence (AI). This hybrid role is ideal for someone who is passionate about solving complex problems through building scalable global solutions that effectively leverage data pipelines combined with AI/ML technologies. About Us: CTM is an award … to deliver a return on investment to our customers. Headquartered in Australia, we provide local services solutions to clients across the globe. How You Will Have an Impact Data Engineering/Analytics with a Machine Learning & AI Focus: Design, develop, and deploy ML models and data pipelines to solve business problems. Work with large datasets to More ❯

RAG), agentic AI, or automated decision-making to drive the development of our core product: Dragonfly's tool stack recommender engine. This role sits at the intersection of data science, product engineering, and systems design. You'll work closely with our engineers, designer, and leadership team to evolve the intelligence layer of our platform — shaping models, experimenting with … LLMs, building scalable data pipelines, and pushing the boundaries of what's possible with applied AI. What You'll Be Doing: Owning and evolving the intelligence layer of our recommender system. Designing and implementing AI/ML systems that scale gracefully. Applying and iterating on LLMs and data-driven approaches to improve recommendations. Rapidly experimenting with … bootstrapped quickly is a must. Core AI & Machine Learning Python Vertex AI/Hugging Face LangChain/BAML — LLM frameworks Langfuse, LangSmith — Observability Pandas, NumPy, scikit-learn, PyTorch — Data & ML stack Data & Infrastructure BigQuery — Cloud data warehouse PostgreSQL — Application data Pulumi — Infrastructure as Code (TypeScript) Google Cloud Platform (GCP) — Cloud provider GitHub More ❯

Data Scientist - New Applications Hybrid in London, United Kingdom The company Imagine a world where every small business has the power to thrive. That's the world we're building at iwoca. Small businesses aren't just statistics – they're the heartbeat of our communities, the character of our high streets, and the engine of our economy. Since … leading fintech innovators. But we're just getting started. Our mission? To empower one million businesses with the financial tools they deserve. We combine cutting-edge technology and data science with genuine human understanding to make finance feel less like a barrier and more like a superpower. Whether a business is managing cash flow or seizing unexpected opportunities … we ensure they get the funds they need – often within minutes. The function iwoca's Data Scientists specialise in supervised machine learning, statistical inference and exploratory data analysis, focusing on tabular and time series data. Our work emphasises quantitative predictions through the analysis of conditional probabilities and expectations, using medium-sized datasets. The team The New More ❯

Job Title: Azure Data Engineer Location: Warwick, UK (Office Based) Job Type: Contract (Inside IR35) Duration: 6 months Job Summary: Join Tata Consultancy Services (TCS) as an Azure Data Engineer and play a key role in delivering innovative data solutions for some of the largest brands in the UK and worldwide. You will leverage … your expertise in Azure, ADF, and modern data platforms to support high-impact, data-driven projects that make a meaningful difference to our clients and communities. Key Responsibilities: Apply in-depth knowledge of Azure and SQL to develop and maintain robust data solutions. Utilize strong debugging skills to resolve issues efficiently. Design, build, and … manage data pipelines using Azure Data Factory (ADF) . Collaborate effectively with stakeholders, ensuring clear communication throughout project lifecycles. Skills, Experience, and Abilities Required: Essential: Expert-level experience with Azure Data Factory (ADF) Hands-on experience with Snowflake and Databricks Proficiency in Python programming Strong Azure and SQL knowledge Excellent debugging and troubleshooting abilities More ❯

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and … reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive … advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance our service offerings. Qualifications: Bachelor's degree in Computer Science, Data Science, or a related field. Strong foundation in data engineering, including experience with ETL processes, data modeling, and database management, as well as SQL. Knowledge More ❯

Job Title: Gen AI Consultant Location: Fully Remote Job Type: Contract/Contract-to-hire Responsibilities: Data Engineering: Collaborate with cross-functional teams to design and implement data pipelines, ensuring efficient extraction, transformation, and loading (ETL) processes. Work with diverse healthcare datasets, integrating and cleaning data from various sources to create a unified and … reliable data infrastructure. Develop and maintain databases, ensuring data quality, integrity, and security. AI Integration in Healthcare: Assist in the development and implementation of AI solutions tailored to healthcare challenges. Collaborate with data scientists and machine learning engineers to deploy models into production environments. Utilize genomics, clinical, and administrative data to derive … advancements in genomics, healthcare, and AI technologies. Contribute to the development of new methodologies and tools to enhance our service offerings. Qualifications: Bachelor's degree in Computer Science, Data Science, or a related field. Strong foundation in data engineering, including experience with ETL processes, data modeling, and database management, as well as SQL. Knowledge More ❯

Senior Data Engineer Orbition Group are delighted to be working with a dynamic, PE-backed event with over 20 years of strong, organic growth. They have scaled from one event to 28 and expanding globally. This is a company that deliver award-winning events across multiple industries and have big ambitions for the next few years! This company … is bringing their data platform fully in-house and are looking for a Senior Data Engineer to take the lead on this transformation. A BRAND NEW ROLE with huge scope and visibility, where you will rebuild and modernise their data systems and setting the foundations for their next stage of growth. You will be … the technical owner of data engineering, leading from the front, selecting the right tools and building the best in class infrastructure! What will you be doing? Taking ownership of the data engineering programme from day one - analysing the existing set up and designing the transition plan Work closely with the Insights team to enable Power BI More ❯

Senior Data Engineer Orbition Group are delighted to be working with a dynamic, PE-backed event with over 20 years of strong, organic growth. They have scaled from one event to 28 and expanding globally. This is a company that deliver award-winning events across multiple industries and have big ambitions for the next few years! This company … is bringing their data platform fully in-house and are looking for a Senior Data Engineer to take the lead on this transformation. A BRAND NEW ROLE with huge scope and visibility, where you will rebuild and modernise their data systems and setting the foundations for their next stage of growth. You will be … the technical owner of data engineering, leading from the front, selecting the right tools and building the best in class infrastructure! What will you be doing? Taking ownership of the data engineering programme from day one - analysing the existing set up and designing the transition plan Work closely with the Insights team to enable Power BI More ❯

Senior/Lead Data Engineer 📍 Cheshire (Office Based - free Gym, parking and lunch) 💰 Up to £110,000 + Private Medical + 8% Pension + up to 3 x pay rises per year!! Are you a passionate Data Engineer ready to architect a world-class data infrastructure in a fast-growing SaaS company? Loop Recruitment … is seeking a talented Senior/Lead Data Engineer to drive innovation, champion best practices, and shape the future of data-driven decision-making. What You’ll Bring 🔥2+ years as a Senior/Lead Data Engineer (managing re-architecture projects) ⚙️Expertise in SQL, Python, and data engineering best practices (testing, CI …/CD) 🚀Hands-on experience building scalable data pipelines in a modern cloud environment (dbt, AWS Glue, Lake Formation, Spark, Redshift) 💡Firm understanding of data modelling, ELT design patterns, governance & security 📈Ability to thrive independently, taking ownership of complex, ambiguous problems 🗣️Excellent communication to build strong relationships and align stakeholders 🤓 A genuine enthusiasm for data More ❯

Senior/Lead Data Engineer 📍 Cheshire (Office Based - free Gym, parking and lunch) 💰 Up to £110,000 + Private Medical + 8% Pension + up to 3 x pay rises per year!! Are you a passionate Data Engineer ready to architect a world-class data infrastructure in a fast-growing SaaS company? Loop Recruitment … is seeking a talented Senior/Lead Data Engineer to drive innovation, champion best practices, and shape the future of data-driven decision-making. What You’ll Bring 🔥2+ years as a Senior/Lead Data Engineer (managing re-architecture projects) ⚙️Expertise in SQL, Python, and data engineering best practices (testing, CI …/CD) 🚀Hands-on experience building scalable data pipelines in a modern cloud environment (dbt, AWS Glue, Lake Formation, Spark, Redshift) 💡Firm understanding of data modelling, ELT design patterns, governance & security 📈Ability to thrive independently, taking ownership of complex, ambiguous problems 🗣️Excellent communication to build strong relationships and align stakeholders 🤓 A genuine enthusiasm for data More ❯

Chief Data Officer - Your chance to lead every aspect of data, and value creation from data for a Insight solutions provider in the Media Industry. Your role will have responsibility particularly for data pipelines within the company, ensuring robust data governance and excellent data quality within the company. … In the first 2 years you will also take ultimate responsibility for a project team within the company focused on designing & delivering fresh and innovative data products to the market - particularly focusing on delivering products for major consumer brands driven by unique mobile data. You will be part of the companies leadership team, giving you an input into … overall strategic direction of the company, and report into the CEO. Contact us now to discuss this Chief Data Officer role in more detail. More ❯

are looking for a Support Engineer with expertise in ITIL processes, AWS cloud services, and DevOps tools to join our support team. This role involves managing and troubleshooting data pipelines, handling deployment workflows, and ensuring smooth operations across cloud and on-prem environments. The ideal candidate will also have strong communication skills and experience working with ServiceNow for … incident and change management. An in-person interview will be required as part of the interview process. Key responsibilities Provide advanced support for ETL workflows and data pipeline issues across various environments. Monitor, troubleshoot, and optimize AWS services including S3, EC2, Lambda, RDS, Glue, and CloudWatch. Manage and maintain CI/CD pipelines using Jenkins; troubleshoot build More ❯

ML Infra Engineer London (hybrid) £100-150k base + equity Built a GPU training stack from scratch before? Designed large-scale data pipelines end-to-end? Happy owning infra + ML systems in a fast, early startup? We’re an early-stage generative AI company developing state-of-the-art diffusion transformer models for 3D generation. We … re training from scratch, at scale. Backed by top-tier investors and fresh off a $7M seed, we’re now hiring an ML Infrastructure Engineer to build our data … and training stack from the ground up. Our customers include global companies in autonomous driving and robotics. The role Design and own the end-to-end data pipeline powering large-scale 3D pretraining: ingestion, storage, preprocessing, and streaming. Implement infrastructure-as-code, observability, CI/CD, and scalable deployment practices. Enable fast experimentation for diffusion transformer training More ❯