176 to 200 of 338 Data Pipeline Jobs in the UK excluding London

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Backend Python Developer, you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we're building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you'll More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO , we're on a mission to … Backend Python Developer, you won’t just write code - you’ll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO , part of Modo25, we’re building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you’ll More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Backend Python Developer, you won’t just write code - you’ll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we’re building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you’ll More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Backend Python Developer, you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we're building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you'll More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Backend Python Developer, you won’t just write code - you’ll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we’re building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you’ll More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. This role is ideal for someone experienced in backend API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to … Backend Python Developer, you won’t just write code - you’ll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is … of profits donated to 1moreChild orphanage yearly Markets: Marketing & eCommerce Agencies. eCommerce retailers. Your Expertise: Highly experienced Developer with experience of backend API development and working with modern data infrastructure. At ASK BOSCO® , part of Modo25, we’re building a smarter, faster, people-first marketing tech business. We're entering a phase of accelerated growth, and you’ll More ❯

Job Title: Data Engineer Salary: £40k - £60k + Excellent Benefits Package Location: Huddersfield (Hybrid) Key Skills: SQL, PowerBI, Airflow Summary A new role has opened up for a Data Engineering with SQL, BI, Cloud and Airflow DAG to join a media-focused business. The role has opened up as the company are heavily investing, and have … exciting plans for their data team. i This a permanent position being offered on a hybrid basis with 2 days onsite from their Huddersfield office. The Company You would be joining a highly-regarded business with over 20 years' experience in their field. Their mission is to provide their impressive client-base with the tools to run their … an employee you will have access to retail discounts, flexitime, health and wellbeing programs, and company pension schemes. The Role You will play a key role in transforming data sets to access insights to access the company, and their client base. Your responsibilities will cover: Develop data models to support company Business Intelligence Write and optimize More ❯

Data Engineer (Databricks) – Fully remote - £50,000 - £55,000 This is a superb opportunity for a Data Engineer with Databricks experience to join a fast-growing Insurtech scale-up. You will be working in a high-performing data and development team with the best cloud-native, serverless tech. The company have invested heavily to … environment where you will be encouraged to have an input into the way things are done. Some of the work you will be doing will include: Build the data analytics platform on Databricks Build data pipelines and managed data platforms on AWS Ensuring quality of the ETL processes Automating their Databricks AWS environment Performance … fine SQL Python The company have taken a remote-first approach to work and this role can be done on a fully work from home basis. As a Data Engineer, some of the other benefits you can expect include: 26 days holiday & holiday purchase (up to 5 extra days) 12 days for technical self-development Fully remote work More ❯

Data Integration Engineer - Investment Banking My client, a top-tier investment bank, is seeking a Data Integration Engineer to join their growing data team. This is a hands-on engineering role focused on PL/SQL , Databricks , and Azure-based data lakehouse environments . You'll play a key role in building … and maintaining robust ETL pipelines , supporting data migration efforts, and collaborating closely with DBAs and Technical Leads . While prior experience in banking or regulatory reporting is a plus, it's not a requirement. Key Skills & Experience: Essential: Strong hands-on experience with PL/SQL and T-SQL Proven expertise in Databricks (on-prem and cloud) Solid … background in ETL development , data pipelines , and data migration Familiarity with Azure Storage and Data Lakehouse architecture Experience with SQL Server and Oracle databases Proficiency with ETL tools such as SSIS , DataStage , or Alteryx Strong collaboration skills with DBAs and Tech Leads Excellent problem-solving and communication abilities Desirable: Exposure to AQR Reporting for More ❯

We are seeking a Senior Backend Python Developer to support the development of our AI-driven marketing platform, with a strong focus on performance, scalability, and data pipeline architecture. The experience expected from applicants, as well as additional skills and qualifications needed for this job are listed below. This role is ideal for someone experienced in backend … API development and working with modern data infrastructure. At Ask BOSCO® , we're on a mission to help brands spend smarter with our award-winning predictive analytics platform. As our Senior Backend Python Developer, you won't just write code - you'll shape the future of a high-growth MarTech product, lead technical strategy, and work directly with … founders, data scientists, and clients to deliver impactful, intelligent solutions. If you're excited by ownership, innovation, and the chance to make a real mark in a scaling business, this is your opportunity. If you're looking for a role where your voice matters, your technical brilliance is valued, and your work directly influences product growth and innovation More ❯

version control systems like Azure DevOps is a strong plus. Your Responsibilities Design, develop, and deploy applications using Google Cloud Functions (Python or Node.js). Implement and optimize data pipelines using Google Cloud Dataflow. Manage and query relational databases using Cloud SQL (PostgreSQL/MySQL). Handle file operations and trigger-based workflows using Google Cloud Storage. Configure More ❯

Senior Data Engineer ESM Contract: 6 months Rate: £500 £550 per day (inside IR35) Location: Glasgow (3 days onsite per week) Start date: ASAP Our client, a large global consultancy, is seeking a Senior Data Engineer to join a Enterprise Systems Management (ESM) team on a contract basis. ESM plays a critical role in developing and … agile squads and contributing to technology solutions that support more than 10,000 developers and production engineers worldwide. Key Responsibilities: Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management. Build and support self-service portals, incident/change management, and capacity management tools. Develop event management solutions, including monitoring, log-collection, correlation, and … large-scale distributed systems. Collaborate with cross-functional teams to design scalable and reliable ETL processes using Python and Databricks. Develop and deploy ETL jobs, extracting and transforming data from multiple sources. Take ownership of the full engineering lifecycle: data extraction, cleansing, transformation, and loading. Create and manage data pipelines with robust error handling More ❯

Cyber Insights Analyst City of London (Hybrid) Up to £55,000 + 20% Bonus Are you passionate about using data to solve complex problems and deliver real business impact? A global leader within Insurtech are looking for a Cyber Insights Analyst to join their global Cyber Insights & Analytics team. This is a hands-on role where you’ll … transform diverse data sources. Ranging from policy and claims to cyber threat intelligence and incident response, into actionable insights that strengthen our underwriting decisions and frameworks. With their data strategy making strong progress, this is an exciting opportunity for someone with a few years’ experience in analytics or data science to take the next … manage reporting for underwriting class and product leaders. • Investigate underwriting performance queries and provide actionable insights. • Design, develop, and validate predictive models to inform underwriting decisions. • Work with data engineering teams to design and maintain Azure Databricks pipelines. • Support the automation of data-driven deliverables for proactive services. • Identify and resolve data issues, recommending More ❯

Cyber Insights Analyst City of London (Hybrid) Up to £55,000 20% Bonus Are you passionate about using data to solve complex problems and deliver real business impact? A global leader within Insurtech are looking for a Cyber Insights Analyst to join their global Cyber Insights & Analytics team. Please make an application promptly if you are a good … match for this role due to high levels of interest. This is a hands-on role where you'll transform diverse data sources. Ranging from policy and claims to cyber threat intelligence and incident response, into actionable insights that strengthen our underwriting decisions and frameworks. With their data strategy making strong progress, this is an exciting … opportunity for someone with a few years' experience in analytics or data science to take the next step in their career. What you'll do • Build and maintain dashboards and MI to monitor underwriting controls and support audits. • Automate and manage reporting for underwriting class and product leaders. • Investigate underwriting performance queries and provide actionable insights. • Design, develop More ❯

IR35) We're working with a fully remote, boutique AI consultancy and Palantir services partner. They help organisations in energy, healthcare, financial services, media, and recruitment use modern data and AI platforms to solve complex business challenges. They are building a Palantir Foundry practice led by ex-Palantir leadership. Thanks to these relationships, they're trusted with high … to see their work make an immediate impact. What You'll Do Work closely with clients to solve their toughest challenges using Palantir Foundry and modern AI/data tools. Design and deploy scalable data pipelines, workflows, and applications. Model complex datasets and create APIs that deliver real business value. Collaborate with technical and non-technical … data platforms such as: Snowflake, Databricks, AWS Glue/Redshift, Google BigQuery Software engineering skills in Python, Java, or TypeScript/React. Strong data modelling, pipeline development, and API design experience. Excellent problem-solving and communication skills. Why This Role Stands Out Impactful work at the intersection of AI, data, and business transformation. More ❯

Data Engineer (Snowflake & Asset Management) 6 Month Contract London (Hybrid) Via Umbrella Our UK leading Life Insurance client are looking for a Data Engineer to join their team on an initial 6-month contract. Key skills/knowledge required: Proficiency in Python and SQL for data engineering and application development Experience building data pipelines and ETL processes for capital markets data Hands-on experience with AWS cloud services and Snowflake data platform Experience with cloud-native development patterns and AWS services (Lambda, S3, RDS, etc.) Hands-on experience integrating with OMS platforms (Aladdin, Murex, Charles River, etc.) including data extraction, transformation, and real-time feeds … into technical solutions Strong collaboration and communication skills, with ability to work effectively in cross-functional teams Understanding of trading workflows, trade lifecycle, and settlement processes Knowledge of data engineering workflows, pipelines, and integration patterns Awareness of regulatory and compliance considerations in capital markets delivery Familiarity with agile principles and team-based delivery Desirable: Familiarity with agile delivery More ❯

are to drive a modern digital government, by: joining up public sector services harnessing the power of AI for the public good strengthening and extending our digital and data public infrastructure elevating leadership and investing in talent funding for outcomes and procuring for growth and innovation committing to transparency and driving accountability We are home to the Incubator … for Artificial Intelligence (I.AI), the world-leading GOV.UK and at the forefront of coordinating the UK's geospatial strategy and activity. We lead the Government Digital and Data function and champion the work of digital teams across government. We're part of the Department for Science, Innovation and Technology (DSIT) and employ more than 1,000 people all … difference across the UK. You'll solve some of the nation's highest-priority digital challenges, helping millions of people access services they need. The GDS IDEA (Insight, Data Science, Economics, and Analysis) Unit is looking for talented data scientists to join our dynamic, high-impact, multidisciplinary team. We combine cutting-edge AI, advanced data More ❯

are to drive a modern digital government, by: joining up public sector services harnessing the power of AI for the public good strengthening and extending our digital and data public infrastructure elevating leadership and investing in talent funding for outcomes and procuring for growth and innovation committing to transparency and driving accountability We are home to the Incubator … for Artificial Intelligence (I.AI), the world-leading GOV.UK and at the forefront of coordinating the UK's geospatial strategy and activity. We lead the Government Digital and Data function and champion the work of digital teams across government. We're part of the Department for Science, Innovation and Technology (DSIT) and employ more than 1,000 people all … difference across the UK. You'll solve some of the nation's highest-priority digital challenges, helping millions of people access services they need. The GDS IDEA (Insight, Data Science, Economics, and Analysis) Unit is looking for talented data scientists to join our dynamic, high-impact, multidisciplinary team. We combine cutting-edge AI, advanced data More ❯

We are looking for a talented Data Engineer , specialising in designing and optimising scalable data pipelines, and cloud-based data solutions. This position requires expertise in Python, SQL, dpt and experience with Snowflake. If you have industry experience working with Retail and CPG this could be the role for you! Our client is the … leading collaborative commerce platform that connects CPG brands to real-time sales and inventory data from 40+ retailers and distributors. We serve 7,000+ brands representing over $2.5T in retail sales across 250K+ stores, working with industry leaders like Nestlé, and KraftHeinz. This business believes that teamwork drives innovation. By uniting talented, motivated creators from diverse backgrounds, they … and efficient. If youre passionate about solving meaningful problems while building a company youll be proud of, wed love to hear from you. About the position As a Data Engineer, youll play a vital role in turning complex, messy datasets into reliable, actionable insights that drive smarter decisions for our customers. Youll design and optimise scalable data More ❯

templates, Bicep, Terraform) Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions Integrate monitoring and alerting via Azure Monitor, Log Analytics, and Application Insights Data Provisioning & Governance: Optimise data pipelines and storage solutions (e.g., Azure Data Factory, Synapse, Blob Storage) for cost and performance Ensure compliance with data governance policies including RBAC, encryption, and audit logging Collaborate with data engineering teams to streamline provisioning and reduce overhead Stakeholder Engagement: Liaise with DBT’s platform, data, and finance teams to align technical decisions with business objectives Present cost-saving recommendations and technical roadmaps to senior stakeholders Document architecture decisions and maintain technical artefacts … Code (ARM, Bicep, Terraform) Hands-on experience with Azure cost management tools and FinOps principles Familiarity with Azure networking, security, and identity (VNETs, NSGs, Azure AD) Experience with data services such as Azure Data Factory, Synapse, and Storage Accounts Excellent communication and stakeholder management skills Proven ability to lead technical teams and mentor junior engineers Desirable More ❯

Primesource Consulting LLP seeks a talented Data Scientist to join their team. This role involves leveraging data science to design and develop machine learning models to address real-world business challenges. The candidate should possess a strong foundation in data science, machine learning, and cloud-based data systems. In this role you … can expect to have the responsibilities: Apply various data science techniques and tools to business problems. Design and deliver data science products aligned with organizational objectives. Collaborate with cross-functional experts to achieve organizational goals. Communicate insights for management and operational efficiency. Ensure data ethics and preparation are integral to projects. Develop machine learning … models and algorithms for complex challenges. Code in R or Python, utilizing libraries like numpy, scipy, and pandas. Conduct exploratory data analysis, model development, and evaluation. Work with both RDBMS and distributed datasets, demonstrating strong SQL skills. Design cloud-based data pipelines for scalable and reliable solutions. This role comes with the following benefits: Competitive salary More ❯

Palantir Foundry Consultant – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner with one of the UK … s leading Palantir consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Palantir Foundry Consultant to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Palantir Foundry Consultant, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Palantir Foundry Consultant – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner with one of the UK … s leading Palantir consultancies, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Palantir Foundry Consultant to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of … operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Palantir Foundry Consultant, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities More ❯

Location: Fully Remote (UK-based role) Contract Length: Outside IR35 (initial 6 months, with extension potential) Start Date: Immediate Overview We are seeking a Data Product Manager to help a growing financial services firm mature its data function. Accuracy and reliability of data are critical due to the highly sensitive and regulated environment, where … default probability risk is high. You will work closely with the Head of Data and Head of Product to shape strategy, improve data accessibility, and raise the capability of a junior team spanning India and Kenya. This is a hands-on role focused on strategy, communication, and stakeholder alignment , rather than coding - but you will need … to understand data engineering principles and be able to guide teams in the right direction. Key Responsibilities Define and deliver the Data Product Roadmap , aligned with business priorities and risk management needs. Improve the accuracy, availability, and accessibility of data across systems, dashboards, and reporting. Guide a junior international data team (BI More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … through training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯