Data Pipeline Jobs in the UK

601 to 625 of 920 Data Pipeline Jobs in the UK

Business Intelligence Developer

London, United Kingdom
Tenth Revolution Group
An established business in the construction space are looking for a Business Intelligence Analyst/Developer to join their growing Data team as they look to become increasingly data-driven. You'll be aligned to their Central London office, spending 3 days per week in the office to collaborate with your team and business stakeholders. You … ll work across the full data lifecycle - from data transformation and SQL-based data modelling to semantic modelling - to enable the development of robust business intelligence solutions. Leveraging tools such as Azure Data Factory and Databricks, you'll design and manage data pipelines that deliver high-quality, analysis-ready datasets … and then go onto develop interactive and insightful reports in Power BI to support data-driven decision-making. Whilst it's a very technical hands-on role, it also involves a lot of stakeholder engagement and interaction, would suit someone who enjoys being people-facing. This is a brilliant opportunity for someone who has a flair for data More ❯
Employment Type: Permanent
Salary: £45000 - £55000/annum
Posted:

Data Scientist

London, United Kingdom
Sneak Peek Tech
We are looking for a junior or medior data science engineer to complement our data science team working with many of our industrial customers from various sectors, including (petro-) chemical, paper and pulp, automotive, metallurgy, telecom and food-and beverage. You will use various ML/AI/data science libraries and work on … use various state of the art technologies including Elastic, Kafka, Kubernetes and Luigi. Finally, you will have the opportunity to look behind the scenes of many domains and data . What are your responsibilities? You Will Typically Work Together With a More Senior Member Of The Team On Projects And Your Day Job Typically Consists Of In this … job, you will use and extend a broad set of data science and software skills. Help build and improve the algorithms in scalable manner for AI-based anomaly detection and predictive modelling Apply and sometimes (co-)invent and implement AI/ML algorithms for processing various types of data (timeseries, tabular etc) Development of computer models More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Paid Search Optimization Manager (Viator)

London, United Kingdom
TripAdvisor LLC
crucial role in shaping the future success of the company. In this role you will join the Search Engine Marketing (SEM) bidding team, who own and manage the data-led systems that ensure we're making the most out of our paid search advertising spend. Your role will be to ensure seamless operation of critical data … and develop our SEM program to deliver incremental revenue. This position combines expertise in SEM with an understanding of martech systems and database management. You will collaborate with data engineers, platform teams, and SEM analysts to maintain system reliability, identify opportunities for optimization, and drive innovation in our paid search infrastructure. This is a hands-on role requiring … problem-solving ability, and strategic thinking to support a multi-million-dollar paid search program. Examples of What You'll Do Manage the day-to-day functionality of data integrations between internal platforms and search tools like Google Ads, SA360 and Big Query. Monitor daily operations to ensure all data pipelines and integrations are functioning correctly More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Software Engineer (Data)

Belfast, United Kingdom
Hybrid / WFH Options
VanRath
Senior Software Engineer (Data) Location - Belfast Hybrid Working Salary - Negotiable A unique opportunity to join this Belfast based client to work on their Engineering team in a role that combines both Software and Data Engineering. This role combines development both Software engineering primarily in .Net/C# along with Data Engineering, of which responsibilities … include aspects of Data Modelling, Message & Data Pipelines and Data Infrastructure. Experience required Strong programming experience with C# and .NET Core. Solid understanding of Microsoft SQL Server Experience working with cloud platforms Exposure to enterprise messaging systems (e.g. RabbitMQ etc) If you are interested in this role or would be keen to see what More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist

City of London, London, United Kingdom
Harnham
Data Scientist (PropTech) London - Hybrid (3 days in office) Up to £70,000 About the Role An established data-led business is looking for a commercially-minded Data Scientist to join their growing London team. You’ll collaborate with cross-functional teams to design, build, and implement data science solutions that directly … into core product offerings. This is an exciting opportunity to apply ML and statistical techniques to real-world problems, while also developing in areas such as software engineering, data pipelines, and ethical product delivery. Key Responsibilities Collaborate with product teams to identify opportunities for ML and data science integration Build and maintain data pipelines … learning models in production environments Present insights and results to technical and non-technical stakeholders Apply statistical methods and model validation techniques to reach accurate conclusions Work with data engineers to ensure clean, usable datasets Contribute to ethical, privacy-aware, and user-centric data products Stay curious, research new methods, and continually build your technical capability More ❯
Posted:

Data Scientist

London Area, United Kingdom
Harnham
Data Scientist (PropTech) London - Hybrid (3 days in office) Up to £70,000 About the Role An established data-led business is looking for a commercially-minded Data Scientist to join their growing London team. You’ll collaborate with cross-functional teams to design, build, and implement data science solutions that directly … into core product offerings. This is an exciting opportunity to apply ML and statistical techniques to real-world problems, while also developing in areas such as software engineering, data pipelines, and ethical product delivery. Key Responsibilities Collaborate with product teams to identify opportunities for ML and data science integration Build and maintain data pipelines … learning models in production environments Present insights and results to technical and non-technical stakeholders Apply statistical methods and model validation techniques to reach accurate conclusions Work with data engineers to ensure clean, usable datasets Contribute to ethical, privacy-aware, and user-centric data products Stay curious, research new methods, and continually build your technical capability More ❯
Posted:

Data Visualisation Engineer

Wellington, Telford, Shropshire, England, United Kingdom
Hybrid / WFH Options
eTeam Inc
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Title: Data Visualisation Engineer Clearance required: Must hold an Active SC Clearance Location: Telford/Hybrid 6 months contract Job description: Purpose: This project seeks to streamline that experience by delivering a … a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS Platform including IDP. Key Responsibilities: Design, development, and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with … cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data More ❯
Employment Type: Contractor
Rate: Salary negotiable
Posted:

1x Backend Python - Mid-level Software Engineer

London, United Kingdom
Contilio
and testing backend, analytics engine, database and integrations Cloud deployment and performance optimization Tracking development and product KPIs Participatingin and contributing tocode reviews andlearning sessions Identify data, pipeline, and/or operational bottlenecks, come up with improvements, and implement scalable solutions in an agile manner Mentor more junior team members and interns as you grow within the … is aplus: Start-up/scaleup experiencein AI, computer vision or enterprise software space PhD in Computer Science, Math, or other related fields Experience withvision, AI or big data applications Experience with Terraform and IaC Familiarity with BIM or construction scheduling tools (Autodesk, Primavera etc.) Hybrid Role: with 2 days/weekin our cool London Shoreditch office How More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Airflow Optimization Specialist Azure Data Platform

London, United Kingdom
InfinityQuest Ltd,
with workload orchestration and autoscaling using KEDA (Kubernetes-based Event Driven Autoscaler), and familiarity with Celery for distributed task execution and background job processing, particularly in data pipeline or microservices environments Hands-on experience with Azure cloud services, especially Azure Data Factory, Azure Databricks, Azure Storage, and Azure Synapse. Proficiency in designing and deploying CI More ❯
Employment Type: Contract
Rate: £550 per day
Posted:

Lead Engineer UK-Remote

United Kingdom
Hybrid / WFH Options
PLOS GmbH
using and improving agile software development and related design practices. Deep understanding and experience of at least one server-side language. Expertise in cloud-native architectures. Expertise in data pipelines and event-driven architectures preferred. Expertise in machine learning and machine learning pipelines preferred. Expertise in workflow or actor frameworks preferred (e.g. Temporal, Akka) preferred. Solid foundation in More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist

Basingstoke, Hampshire, South East, United Kingdom
Franklin Bates Limited
Are you a talented Data Scientist looking for a new challenge? Be part of the 'engine room team within an established business with the financial support of a FTSE listed organisation. Our client is a leading IT solutions provider who are going through exciting and promising times, and this Data Scientist role will allow you to … become a key contributor to future business changes. You will receive coaching and mentorship within an established, growing Data team to support your growth, so that you can perform at your best. In this Data Scientist role, you will be analsying and identifying insights working alongside Senior and Lead Data Scientists, developing and deploying … data-driven solutions, and building and maintaining data pipelines. The key skills required for the Data Scientist role are: A strong education foundation from a Bachelors or Masters degree in Engineering/Statistics/Mathematics/Computer Science/Finance Experience of working in a Data Scientist role for 1+ years Experience More ❯
Employment Type: Permanent
Salary: £55,000
Posted:

Data Engineer

London, South East, England, United Kingdom
Franklin Bates
Data Engineer Contract to Permanent Skills: Python, Pandas Hybrid London Rate: c400/day (outside) & 70k Transform Sustainability with Smart Data Simulations. Ready to code for a cleaner future? A cutting-edge sustainability start-up based in Central London is seeking an experienced Data Engineer to help transform how businesses reduce their carbon footprint. … If you're fluent in Python, a master of Pandas, and passionate about building analytical models with customer data, this role offers you purpose and impact. What you’ll be doing Designing and implementing robust data pipelines Building simulations to model complex real-world customer behaviours Working with large and intricate data sets to … uncover actionable insights Collaborating with analysts, scientists, and product teams to turn data into sustainable solutions What we’re looking for Proven experience with Python and Pandas, especially in data analysis and simulation building A keen eye for data accuracy and insight generation Passion for sustainability and applying data to drive environmental More ❯
Employment Type: Full-Time
Salary: £62,000 - £70,000 per annum
Posted:

Data Scientist

London Area, United Kingdom
Hybrid / WFH Options
Vertical Advantage
We’re working with a market research business within the FMCG space. They’re now hiring a Data Scientist to shape and execute … the company’s data strategy and develop AI-driven features that elevate their platform. The Role You’ll lead on the full data lifecycle - from pipeline development to deploying machine learning models. Working closely with product and commercial teams, you’ll drive innovation through LLMs and advanced analytics, while mentoring a small team and aligning … data solutions with business growth. Key Responsibilities Build and optimise data pipelines and infrastructure Design and deploy ML models, including LLM-powered features Mentor junior data scientists and foster team development Align data science with product and business strategy Identify opportunities for automation and platform enhancements About You Strong experience delivering end More ❯
Posted:

Data Scientist

City of London, London, United Kingdom
Hybrid / WFH Options
Vertical Advantage
We’re working with a market research business within the FMCG space. They’re now hiring a Data Scientist to shape and execute … the company’s data strategy and develop AI-driven features that elevate their platform. The Role You’ll lead on the full data lifecycle - from pipeline development to deploying machine learning models. Working closely with product and commercial teams, you’ll drive innovation through LLMs and advanced analytics, while mentoring a small team and aligning … data solutions with business growth. Key Responsibilities Build and optimise data pipelines and infrastructure Design and deploy ML models, including LLM-powered features Mentor junior data scientists and foster team development Align data science with product and business strategy Identify opportunities for automation and platform enhancements About You Strong experience delivering end More ❯
Posted:

Data Specialist (Belfast)

Belfast, Northern Ireland, United Kingdom
Morgan McKinley
Markets Program Execution & Transformation – Data Acquisition Team Belfast (Hybrid) - Essential | Approx. £415pd PAYE + Holiday (PAYE) The Markets Program Execution & Transformation team partners with all Global Markets businesses and various functions—including Legal, Compliance, Finance, and Operations & Technology—to identify, mobilize, and deliver regulatory and cross-business transformation initiatives. The team's core mission is to design and … implement integrated solutions that are efficient, scalable, and client-focused. This role sits within the Data Acquisition Team , playing a critical part in supporting multiple projects and workstreams. The focus is on assessing and delivering robust data solutions and managing changes that impact diverse stakeholder groups in response to regulatory rulemaking, supervisory requirements, and discretionary transformation … programs. Key Responsibilities: Develop PySpark and SQL queries to analyze, reconcile, and interrogate data. Provide actionable recommendations to improve reporting processes—e.g., enhancing data quality, streamlining workflows, and optimizing query performance. Contribute to architecture and design discussions in a Hadoop-based environment. Translate high-level architecture and requirements into detailed design and code. Lead and guide complex, high More ❯
Posted:

Data Scientist - Customer Behavioural, Churn, CLV - London

London, United Kingdom
Hybrid / WFH Options
Salt Digital Recruitment
Senior Data Scientist - Customer & Behavioural Analytics £70,000 - £80,000 + Bonus + Benefits Hybrid Working - 1 day in the office circa every 2 weeks. Role Summary We are seeking a commercially minded Senior Data Scientist to lead the development of advanced analytics and machine learning solutions focused on customer behavior, personalization, and lifecycle management. Your … work will directly impact customer retention, engagement, and lifetime value, helping the business make smarter, data-driven decisions at scale. Key Responsibilities Lead customer-centric analytics projects across retention, segmentation, churn prediction, product usage, and personalization Build and maintain predictive models (e.g. churn, CLV, next-best action, recommendation systems) and translate insights into business value Conduct deep-dive … end-to-end lifecycle of models: from problem framing to deployment and monitoring Present analytical findings and strategies to stakeholders in a compelling and actionable way Mentor junior data scientists and contribute to the evolution of data science standards and practices Key Skills & Technologies Technical: Strong in Python (pandas, scikit-learn, XGBoost, LightGBM, etc.) Proficient in More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer

London, Victoria, United Kingdom
Hybrid / WFH Options
Boston Hale
Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their … London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver … actionable insights and support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with More ❯
Employment Type: Permanent
Salary: £65000 - £75000/annum 2 days in office
Posted:

Lead Data Engineer

London, South East, England, United Kingdom
Hybrid / WFH Options
Boston Hale
Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their … London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver … actionable insights and support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with More ❯
Employment Type: Full-Time
Salary: £65,000 - £75,000 per annum
Posted:

Technical Product Manager

United Kingdom
Hybrid / WFH Options
Ascent Software
We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions, machine learning … DevOps optimization, and modernization of applications, data, and platforms. We work with incredible clients in all types of industries such as smart home devices, space exploration, beer manufacturing, finance, ecology, and logistics. We work with some of the sharpest minds in the brightest businesses and we employ the sharpest minds too! At Ascent, we also believe in fostering … About Us We are Ascent! and we help our customers solve problems, elevate, and do existing things better. We are on a mission to help our customers connect data, software, and purpose to create extraordinary outcomes. You could say we are a digital transformation business. We specialize in software product development, analytics, data science, IoT solutions More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Data Engineer in London - VivaCity

London, United Kingdom
Golang Works
AWS, Kubernetes, and Docker Proficiency in Unix systems, ideally Linux (Ubuntu) Strong communication skills and experience mentoring engineers Responsibilities Your main responsibilities will involve working on: Data pipeline and underlying infrastructure, especially Apache Kafka and PostgreSQL database Technologies like Kubernetes, Vault, Go microservices, and other cloud services On-premise infrastructure Your technical expertise will play a crucial More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Software Engineer, Python

London, United Kingdom
Hybrid / WFH Options
Cedar Cares, Inc
candidate has: Solid Python knowledge A commitment to writing testable, maintainable code. Familiarity with more advanced SQL techniques. Strong Linux knowledge Basic, but broad, knowledge of algorithms and data structures. Degree in Computer Science or related field preferred. Highly preferred: Experience with TDD, BDD or other testing methodologies Preferred: Familiarity with PostgreSQL … and Snowflake Preferred: Familiarity with Web Frameworks such as Django, Flask or FastAPI Preferred: Familiarity with event streaming platforms such as Apache Kafka Preferred: Familiarity with data pipeline platforms such as Apache Airflow Preferred: Familiarity with Java Preferred: Experience in one or more relevant financial areas (market data, order management, algorithmic trading, financial systems integration More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Engineer-SAS

United Kingdom
Hybrid / WFH Options
eTeam
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you. Job Title: Data Engineer-SAS Clearance required: SC is required, Must hold SC Duration: 6 months Location: Telford/Hybrid Rate: 537GBP/day(Inside IR35) Job description: Key Responsibilities: Design, development … and deployment of data integration and transformation solutions using Pentaho, Denodo, Talend, and SAS. Architect and implement scalable data pipelines and services that support business intelligence and analytics platforms. Collaborate with cross-functional teams to gather requirements, define technical specifications, and deliver robust data solutions. Champion Agile and Scrum methodologies, ensuring timely delivery of … sprints and continuous improvement. Drive DevOps practices for CI/CD, automated testing, and deployment of data services. Mentor and guide junior engineers, fostering a culture of technical excellence and innovation. Ensure data quality, governance, and security standards are upheld across all solutions. Troubleshoot and resolve complex data issues and performance bottlenecks. Key Skills More ❯
Posted:

Python Developer 9 Months £400 - £450 Per Day Outside IR35 Fully Remote

London, South East, England, United Kingdom
Hybrid / WFH Options
Opus Recruitment Solutions Ltd
IR35, pays £400 - £450 per day and requires no onsite work.The successful candidate will be responsible for enhancing, designing, and deploying ongoing improvements to our bespoke data pipeline and associated API services. Key Requirements 5+ years of Python experience with frameworks like Flask, FastAPI, and Django. Strong command orchestration tools (e.g. Prefect, Airflow), Docker, and AWS infrastructure … . Solid understanding of API services, authentication methods (JWT, SSO), and clear, pragmatic communication skills. Maintain, upgrade, and improve existing systems and custom ETL pipelines. Collaborate with developers, data scientists, and QA teams to enhance tooling, processes, and documentation. Guide best practices and governance for web applications and services. What you need to do now If you feel More ❯
Employment Type: Contractor
Rate: £1 - £450 per day
Posted:

Trading Data Engineer

London, United Kingdom
Octopus Group
join us on this journey, bringing a diversity of experience and ideas to shape a more efficient, flexible, and sustainable energy system. We're looking for a Trading Data Engineer (f/m/d) to join our German and Western European intraday trading team. You should have strong Python skills, know how to manage Redis cache, AWS … bring experience in the German or European power market. You'll work in a fast-paced, tech-driven environment and collaborate closely with traders and developers to turn data into real trading decisions. What You'll Do Build and maintain models to forecast power demand, renewable generation, and prices in the German and Western European intraday markets Develop … robust data pipelines to collect, clean and combine internal and external data (e.g. grid, weather, or market data) Analyse market data and derive insights to optimise trading strategies Help build tools for automated trading and market analytics Contribute to models predicting local grid congestion and identifying flexibility opportunities Collaborate closely with our More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Scientist - Customer Behavioural, Churn, CLV - London

London, South East, England, United Kingdom
Hybrid / WFH Options
Salt Search
Senior Data Scientist - Customer & Behavioural Analytics £70,000 - £80,000 + Bonus + Benefits Hybrid Working - 1 day in the office circa every 2 weeks. Role Summary We are seeking a commercially minded Senior Data Scientist to lead the development of advanced analytics and machine learning solutions focused on customer behavior, personalization, and lifecycle management. Your … work will directly impact customer retention, engagement, and lifetime value, helping the business make smarter, data-driven decisions at scale. Key Responsibilities Lead customer-centric analytics projects across retention, segmentation, churn prediction, product usage, and personalization Build and maintain predictive models (e.g. churn, CLV, next-best action, recommendation systems) and translate insights into business value Conduct deep-dive … end-to-end lifecycle of models: from problem framing to deployment and monitoring Present analytical findings and strategies to stakeholders in a compelling and actionable way Mentor junior data scientists and contribute to the evolution of data science standards and practices Key Skills & Technologies Technical: Strong in Python (pandas, scikit-learn, XGBoost, LightGBM, etc.) Proficient in More ❯
Employment Type: Full-Time
Salary: £60,000 - £80,000 per annum
Posted:
Data Pipeline
10th Percentile
£45,000
25th Percentile
£52,500
Median
£67,500
75th Percentile
£90,250
90th Percentile
£108,375