Data Pipeline Jobs in England

751 to 775 of 1,061 Data Pipeline Jobs in England

Python Engineer

Bristol, Avon, South West, United Kingdom
IO Associates
Title: Python Engineer Salary: Up to £75,000 Location: Bristol (On-site) Are you a Python Engineer looking to work on complex, high-impact data problems in a fast-moving and innovative sector? I'm working with a market-leading trading firm at the heart of the UK's energy transition. They use advanced forecasting and trading technology … the UK's decarbonisation efforts. This is a small, highly skilled team where technology and trading go hand in hand. You'll be building and optimising the internal data infrastructure that powers critical trading decisions. This is a hands-on role with real impact, and your work will be used daily by traders and data scientists. … What they're looking for: Strong skills in Python and SQL Experience building end-to-end data pipelines (streaming or batch) Solid understanding of AWS (EC2, ECS, RDS, S3) 2+ years of relevant experience in data engineering Great communication skills - comfortable collaborating with traders, devs, and data scientists Happy to work onsite in central More ❯
Employment Type: Permanent
Salary: £75,000
Posted:

Artificial Intelligence Engineer

City of London, London, United Kingdom
Hybrid/Remote Options
SR2 | Socially Responsible Recruitment | Certified B Corporation™
opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function . You’ll build and scale … AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to … power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI integration best practices. Partner with cross-functional teams to identify and deliver high-value AI applications. Mentor engineers and shape the company’s approach to internal AI enablement. What You’ll Bring 7+ More ❯
Posted:

Artificial Intelligence Engineer

London Area, United Kingdom
Hybrid/Remote Options
SR2 | Socially Responsible Recruitment | Certified B Corporation™
opportunity to take on a high-impact, hands-on leadership role within a scaling global SaaS company that’s using AI to reinvent how internal business systems and data work together. As a Staff Software Engineer (AI/ML) , you’ll be the technical lead for a newly formed AI Engineering function . You’ll build and scale … AI-powered backend systems that connect enterprise data platforms (CRM, analytics, and communication tools) with large language models — creating intelligent tools and insights that enhance the way teams operate. What You’ll Do Lead the design, architecture, and implementation of internal AI/ML systems for business intelligence. Build robust APIs, microservices, and data pipelines to … power intelligent, data-driven tools. Develop retrieval-augmented generation (RAG) systems using vector databases for contextual AI. Set the technical direction for backend and AI integration best practices. Partner with cross-functional teams to identify and deliver high-value AI applications. Mentor engineers and shape the company’s approach to internal AI enablement. What You’ll Bring 7+ More ❯
Posted:

Senior Full-Stack Cloud Developer

london, south east england, united kingdom
TP ICAP
a world leading provider of market infrastructure. Our purpose is to provide clients with access to global financial and commodities markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our people and technology, we connect clients to superior liquidity and data solutions. The Group is home to a stable of … TP ICAP is the largest interdealer broker in the world by revenue, the number one Energy & Commodities broker in the world, the world's leading provider of OTC data, and an award winning all-to-all trading platform. Founded in London in 1866, the Group operates from more than 60 offices in 27 countries. We are … people strong. We work as one to achieve our vision of being the world's most trusted, innovative, liquidity and data solutions specialist. Role Overview We're looking for a Senior Full Stack Developer who thrives on solving complex problems and building scalable, high-performance solutions. This is a hands-on role covering multiple layers of the stack More ❯
Posted:

Data Engineer

London Area, United Kingdom
Propel
Hiring: Data Engineer | Mission-Driven Fintech | Remote (UK based) 🚀 Propel are proud to be partnering with a rapidly scaling global fintech that’s transforming financial access for immigrants and international communities across the world. 📈 As their lending business continues to grow, they're looking for a Data Engineer to help scale the data infrastructure … that powers smarter, fairer credit decisions. 🧠 If you're passionate about building robust data pipelines, enabling real-time underwriting, and turning complex datasets into production-ready insights — this is your chance to work at the heart of a mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending … Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone you know? 📩 Drop me a message or apply directly – I’d love to tell you more More ❯
Posted:

Data Engineer

City of London, London, United Kingdom
Propel
Hiring: Data Engineer | Mission-Driven Fintech | Remote (UK based) 🚀 Propel are proud to be partnering with a rapidly scaling global fintech that’s transforming financial access for immigrants and international communities across the world. 📈 As their lending business continues to grow, they're looking for a Data Engineer to help scale the data infrastructure … that powers smarter, fairer credit decisions. 🧠 If you're passionate about building robust data pipelines, enabling real-time underwriting, and turning complex datasets into production-ready insights — this is your chance to work at the heart of a mission-driven business. ✅ What you'll bring: - 4+ years as a Data Engineer (ideally in fintech/lending … Strong SQL, Python, Snowflake, dbt, Dagster - Experience with credit bureau data, open banking APIs - A love for clean, scalable data systems in fast-moving environments Sound like you or someone you know? 📩 Drop me a message or apply directly – I’d love to tell you more More ❯
Posted:

Contract Software Engineer

london, south east england, united kingdom
Hybrid/Remote Options
YLD
department and the wider company Requirements You'll have the following skills and experience: Experience with modern frameworks across the stack (FastAPI, Gin, Express, etc.) Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar); Experience working with data lakes; experience with Spark or Databrick; Comprehensive testing experience … unit, integration, e2e, security) and performance optimization Scalable system design patterns, load balancing, and high-availability architectures Database design and Data modelling (both relational and NoSQL) Understanding of common data transformation and storage formats, e.g. Apache Parquet API development (REST, GraphQL, gRPC) and event-driven architectures Caching strategies and message queue systems (Redis, Kafka, RabbitMQ) Cloud More ❯
Posted:

Test Analyst - Data Analytics

London Area, United Kingdom
RED Global
RED Global are currently looking for a Test Analyst to join our customer Data Analytics team to assure the development of new Data Analytics products data pipelines datasets reports and dashboards. This position is going to be a hybrid role expecting 2-3 days on site per week in London and this will also … be a contract opportunity starting at 6 months + extensions. We are looking for skills in the following: ETL Concepts QuerySurge ANSI-SQL Data Testing Python for Data If this sounds like something that could be of interest then please share your CV and someone from the team will be in touch to discuss the requirement More ❯
Posted:

Test Analyst - Data Analytics

City of London, London, United Kingdom
RED Global
RED Global are currently looking for a Test Analyst to join our customer Data Analytics team to assure the development of new Data Analytics products data pipelines datasets reports and dashboards. This position is going to be a hybrid role expecting 2-3 days on site per week in London and this will also … be a contract opportunity starting at 6 months + extensions. We are looking for skills in the following: ETL Concepts QuerySurge ANSI-SQL Data Testing Python for Data If this sounds like something that could be of interest then please share your CV and someone from the team will be in touch to discuss the requirement More ❯
Posted:

Generative AI Data Scientist

London, United Kingdom
Careerwise
About the Role We are seeking an innovative and highly skilled Generative AI Data Scientist to join our AI System Design team. This individual will play a key role in bridging business needs with advanced AI-driven solutions. The ideal candidate will have experience in end-to-end AI experiment life cycle management , architecture design, and the ability … to translate business KPIs into measurable AI outcomes. A strong background in data management (preferably on Databricks ), along with proficiency in modern Generative AI frameworks , is essential. This role demands both technical depth and excellent communication skills to engage with business stakeholders, design scalable AI systems, and ensure reliable model deployment using Azure and Databricks. Key Responsibilities Lead … business stakeholders to define success metrics, KPIs, and measurable outcomes for AI applications. Translate business requirements into detailed AI solution designs, including: Business Value definition AI solution design (Data Flow, AI component selection, Prompt Engineering, AP, I, and AI integration planning) Automated model evaluation and monitoring frameworks Design, build, and scale data pipelines and AI workflows More ❯
Employment Type: Contract
Rate: GBP 450 Daily
Posted:

Software Engineer

London, United Kingdom
Experis UK
this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. For further information More ❯
Employment Type: Permanent
Posted:

Quantitative Developer

London, South East, England, United Kingdom
Robert Half
a Quantitative Developer on a contract basis A leading hedge fund with a strong track record in systematic and quantitative trading. The firm combines advanced research, technology, and data to deliver market-leading performance across multiple asset classes. They are seeking a Quantitative Developer on a 6-month contract to support the ongoing development of research tools, trading … within their core systematic strategies team. Role The Quantitative Developer will collaborate with researchers to implement, test, and deploy quantitative trading strategies and risk models. Build and enhance data pipelines and backtesting frameworks for large-scale market data. Integrate new data sources and ensure data quality and reliability across research environments. Refactor and optimise … as a Quantitative Developer within a hedge fund, prop trading, or systematic trading environment. Strong programming expertise in Python (C++ or Java also advantageous). Excellent understanding of data structures, algorithms, and numerical computing. Experience with time-series data, backtesting, and quantitative research workflows. Familiarity with financial markets and trading systems. Strong communication skills with the More ❯
Employment Type: Contractor
Rate: Salary negotiable
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid/Remote Options
Peaple Talent
Are you a Data Engineer who loves solving real-world data problems and building scalable solutions from the ground up? We’re supporting a well-established business in the digital transformation space, and they’re looking for someone to help drive data platform development across multiple business areas and tech environments. Data Engineer £55,000-£65,000 per annum London based 2 days a week The role: You’ll work closely with technical and non-technical teams, owning data pipelines, improving performance, and getting involved in projects that span cloud, automation, and AI-readiness This role is perfect for someone who enjoys building and optimising data … moving environment, and wants to work across a variety of platforms and challenges. What you'll need: Solid hands-on experience with Python and SQL Strong knowledge of data pipelines, cloud infrastructure (AWS & Azure), and integration tools Familiarity with tools like Airflow and version control, GIT. Confident working with structured and unstructured datasets Comfortable contributing to both technical More ❯
Posted:

Data Engineer

London Area, United Kingdom
Hybrid/Remote Options
Peaple Talent
Are you a Data Engineer who loves solving real-world data problems and building scalable solutions from the ground up? We’re supporting a well-established business in the digital transformation space, and they’re looking for someone to help drive data platform development across multiple business areas and tech environments. Data Engineer £55,000-£65,000 per annum London based 2 days a week The role: You’ll work closely with technical and non-technical teams, owning data pipelines, improving performance, and getting involved in projects that span cloud, automation, and AI-readiness This role is perfect for someone who enjoys building and optimising data … moving environment, and wants to work across a variety of platforms and challenges. What you'll need: Solid hands-on experience with Python and SQL Strong knowledge of data pipelines, cloud infrastructure (AWS & Azure), and integration tools Familiarity with tools like Airflow and version control, GIT. Confident working with structured and unstructured datasets Comfortable contributing to both technical More ❯
Posted:

Senior Data Engineer (GenAI) - Leading Tech Company!

City of London, London, United Kingdom
Hybrid/Remote Options
Robert Half
Senior Data Engineer (GenAI) - Leading Tech Company | London (Hybrid) Hybrid: 1 day in the office/4 days WFH Permanent role only Represented by Robert Half Limited Please note: No visa sponsorship on offer, No B2B,B2C, Fully remote workers or contractors on offer. The Opportunity We're looking for a Senior Data Engineer with hands … on GenAI experience to join a forward-thinking technology business that's building data-driven solutions with real-world impact. This is a highly visible, senior-level role where you'll take ownership of data pipelines, architecture, and GenAI operational frameworks - helping shape the next generation of AI-driven products and analytics. If you enjoy combining … engineering rigor with AI innovation, this role gives you the platform, freedom, and backing to make it happen. Key Responsibilities Design, build, and maintain scalable data pipelines across modern cloud platforms Drive the implementation of GenAI frameworks, including model deployment, monitoring, and lifecycle management ('GenAI Ops') Develop robust ETL/ELT workflows and optimise performance within Snowflake Collaborate More ❯
Employment Type: Permanent, Work From Home
Posted:

Data Engineer (Azure)

London Area, United Kingdom
Vallum Associates
Banking or Financial Services are a must in recent years. We're hiring a Data Engineer to build and maintain robust data pipelines, deliver actionable insights, and develop ML models for business impact. The role involves ensuring data quality, security, and system health, while championing client needs and uncovering value in marketing datasets. Requirements … Bachelor’s in Engineering, Computer Science, Math, or Marketing Hands-on data engineering (event streaming, real-time analytics, graph processing, computational grids) Skilled in Python and Scala; familiar with MLFlow and machine learning (preferred) Databricks certification is a plus Strong communicator and technical writer Track record with high-quality, stable, and high-performance data pipelines in More ❯
Posted:

Data Engineer (Azure)

City of London, London, United Kingdom
Vallum Associates
Banking or Financial Services are a must in recent years. We're hiring a Data Engineer to build and maintain robust data pipelines, deliver actionable insights, and develop ML models for business impact. The role involves ensuring data quality, security, and system health, while championing client needs and uncovering value in marketing datasets. Requirements … Bachelor’s in Engineering, Computer Science, Math, or Marketing Hands-on data engineering (event streaming, real-time analytics, graph processing, computational grids) Skilled in Python and Scala; familiar with MLFlow and machine learning (preferred) Databricks certification is a plus Strong communicator and technical writer Track record with high-quality, stable, and high-performance data pipelines in More ❯
Posted:

Data Software Engineer

City of London, London, United Kingdom
Searchability®
Data Software Engineer Opportunity for a Data Software Engineer to join a market leading Software House company in London Salary up to £120,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Data Software Engineer, you’ll help design and build an AI-powered data migration and integration platform from the ground up. You’ll own the development of scalable data pipelines, cloud-based architecture, and custom software components, working closely with senior engineers to deliver reliable, high-performance systems that power AI-driven insights. WHO … traction as an emerging player bringing efficiency and innovation to a traditionally outdated space. OUR BENEFITS: Private medical insurance Life insurance Share options Exciting growth opportunities And More.. DATA SOFTWARE ENGINEER – ESSTENTIAL SKILLS • Strong foundation in Python • Hands-on experience with Spark or Databricks • Ability to lead projects autonomously and prioritise effectively • Experience developing bespoke software components for More ❯
Posted:

Data Software Engineer

London Area, United Kingdom
Searchability®
Data Software Engineer Opportunity for a Data Software Engineer to join a market leading Software House company in London Salary up to £120,000 + fantastic benefits including our share options, collaborative working culture and exciting growth opportunities and more Apply online or contact Chelsea Hackett via Chelsea.hackett@searchability.com WHAT WILL YOU BE DOING? As a … Data Software Engineer, you’ll help design and build an AI-powered data migration and integration platform from the ground up. You’ll own the development of scalable data pipelines, cloud-based architecture, and custom software components, working closely with senior engineers to deliver reliable, high-performance systems that power AI-driven insights. WHO … traction as an emerging player bringing efficiency and innovation to a traditionally outdated space. OUR BENEFITS: Private medical insurance Life insurance Share options Exciting growth opportunities And More.. DATA SOFTWARE ENGINEER – ESSTENTIAL SKILLS • Strong foundation in Python • Hands-on experience with Spark or Databricks • Ability to lead projects autonomously and prioritise effectively • Experience developing bespoke software components for More ❯
Posted:

Senior Python Engineer

London Area, United Kingdom
Experis UK
We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯
Posted:

Senior Python Engineer

City of London, London, United Kingdom
Experis UK
We’re partnering with a high-growth AI startup that’s building intelligent automation systems designed to simplify complex, real-world operations. Their platform is already redefining how data, workflow, and human decision-making come together — and they’re scaling fast. If you’re excited by the idea of joining an elite engineering team tackling deep technical problems … intelligent features into production — solving high-impact problems with clean, scalable code. Responsibilities: Architect, design, and build robust backend systems and APIs using Python. Collaborate with AI and data teams to integrate models into production environments. Optimise and scale distributed systems and data pipelines for performance and reliability. Contribute to overall technical strategy, code reviews, and … control, CI/CD workflows, and containerised development. Excellent communication and problem-solving skills. Bonus Points For: Experience in AI-driven or automation-heavy environments. Exposure to PropTech, data-heavy SaaS platforms, or real-world workflow automation. Familiarity with microservices and orchestration tools (Docker, Kubernetes). What’s on Offer: Competitive salary + equity options. The opportunity to More ❯
Posted:

AI Product Manager / AI Specialist – London

London Area, United Kingdom
Everet Marsh
teams and portfolio company management to identify high-impact use cases for AI tools. Oversee AI/ML model development, deployment, and monitoring, ensuring scalability and robustness. Conduct data analysis, experimentation, and validation to continuously improve AI systems and outcomes. Stay up-to-date on AI/ML trends and emerging technologies to guide innovation within the firm … portfolio. Mentor and collaborate with technical teams, fostering a culture of excellence and learning. What We’re Looking For Minimum 3–8 years’ experience in AI/ML, data science, or AI product management, ideally in technology or high-growth environments. Strong technical background with a STEM degree (Computer Science, Engineering, Data Science, or related discipline … Hands-on experience building, deploying, and managing AI/ML models and internal AI tools. Experience with Python, TensorFlow, PyTorch, cloud platforms (AWS/GCP/Azure), and data pipelines. Excellent problem-solving, analytical, and strategic thinking skills. Strong communication skills and the ability to collaborate across technical and business teams. Previous experience in growth-stage or technology More ❯
Posted:

AI Product Manager / AI Specialist – London

City of London, London, United Kingdom
Everet Marsh
teams and portfolio company management to identify high-impact use cases for AI tools. Oversee AI/ML model development, deployment, and monitoring, ensuring scalability and robustness. Conduct data analysis, experimentation, and validation to continuously improve AI systems and outcomes. Stay up-to-date on AI/ML trends and emerging technologies to guide innovation within the firm … portfolio. Mentor and collaborate with technical teams, fostering a culture of excellence and learning. What We’re Looking For Minimum 3–8 years’ experience in AI/ML, data science, or AI product management, ideally in technology or high-growth environments. Strong technical background with a STEM degree (Computer Science, Engineering, Data Science, or related discipline … Hands-on experience building, deploying, and managing AI/ML models and internal AI tools. Experience with Python, TensorFlow, PyTorch, cloud platforms (AWS/GCP/Azure), and data pipelines. Excellent problem-solving, analytical, and strategic thinking skills. Strong communication skills and the ability to collaborate across technical and business teams. Previous experience in growth-stage or technology More ❯
Posted:

Privacy Engineer, PrivacyTech Consulting Engineer

London, United Kingdom
Hybrid/Remote Options
Staffworx Limited
legal/regulatory requirements into clear technical stories and testable acceptance criteria. Integrate privacy controls and automated assurance checks into CI/CD pipelines. technical depth - software and data engineering, web/mobile SDK, client/server tracking and content and data streaming, data pipelines. Cross-Functional Collaboration Work closely with Product, Architecture, Security … to ensure privacy alignment with technical and business objectives. Help evolve privacy engineering frameworks and best practices across the organisation. Experience & Skills Technical Background Experience in software/data engineering or similar technical role. Familiarity with data pipelines, APIs, SDKs, client-server tracking, consent tech, event-driven systems. Knowledge of cloud environments, modern data …/SAFe Delivery Experience embedding NFRs and BDD into agile delivery. Comfortable in PI planning, system demos and Inspect-and-Adapt sessions. Systems & Risk Understanding Strong grasp of data flows, system interdependencies and third-party risk. Ability to surface cross-platform privacy impacts and technical dependencies. Nice to Have Previous privacy engineering/data protection assurance More ❯
Employment Type: Contract, Work From Home
Posted:

CTO (5-10% equity)

England, United Kingdom
Emerge Protocol
Emerge is building the personalisation layer for consumer ai. All the data that truly understands us, what we search, watch, buy, and explore is trapped inside Big Tech's walls. This isn't just inefficient; it stops other apps from using it to create better experiences and keeps users powerless over their own data. Emerge changes that. Our … API lets apps and AI agents access real data that people choose to share from places like Google, Meta, TikTok, and Amazon. All in a fully consented, privacy-first way. We're unlocking the open data economy so data can drive human progress while putting users in control. Team of stellar engineers, backed by … seeing early traction. Tasks Own the evolution of Emerge's infrastructure from prototype to product-market fit. Build the systems, team, and technical culture that make user-consented data accessible, reliable, and intelligent. Architect and scale a data platform and enrichment engine Align the technical roadmap tightly with customer use cases and feedback Lead hands on More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Data Pipeline
England
10th Percentile
£44,375
25th Percentile
£55,000
Median
£70,000
75th Percentile
£85,500
90th Percentile
£113,750