826 to 850 of 1,184 Data Pipeline Jobs in the UK excluding London

world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are seeking a skilled and hands-on AWS Data Engineer with strong coding expertise and deep experience in building scalable data solutions using AWS services. The ideal candidate will have a solid background in data engineering, Python development, and cloud-native architecture. YOUR PROFILE Design, develop, and maintain robust data pipelines and ETL workflows using AWS services. Implement scalable data processing solutions using PySpark and AWS Glue. Build and manage infrastructure as code using CloudFormation. Develop and deploy serverless applications using AWS Lambda, Step Functions, and S3. Perform data querying and analysis using Athena. Collaborate with Data Scientists to operationalize models using SageMaker. Ensure secure and compliant data handling using IAM, KMS, and VPC configurations. Containerize applications using ECS for scalable deployment. Write clean, testable code in Python, with a strong emphasis on unit testing. Use GitLab for version control, CI/CD More ❯

achieve this through positivity, action, professionalism, customer service and industry knowledge. What you will do to be successful in this role as Technical Consultant Key Responsibilities Provide all data related activity of Technical Consultancy Services across several Products to Civica customers Develop and deliver new approaches to Technical delivery to continuously enhance the level of service provided. To … deliver data migration and data consultancy for Civica software following Civica project documentation, implementation guidelines and quality standards. Act as the lead point of contact for their Projects for the areas of Data, interfacing and Technical delivery. Define and document data conversion and Load scope and perform data loading in … reports via a range of industry standard reporting tools To promote Civica, its products and practices in a professional manner. Create SQL scripts to view and report on data Creation of SQL Stored Procedures, Functions and Triggers. Development of back office tools and data pipelines Migration of SSIS packages and legacy SQL approaches to Azure environments More ❯

Data Engineer x3 Telford 2 days a week 55,000 - 65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services … and deliver secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements … and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

Data Engineer x3 Telford 2 days a week £55,000 - £65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services … and deliver secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements … and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building core capabilities that power our data and AI infrastructure—enabling scalable, resilient, and intelligent systems to support enterprise-scale Business Planning Software solutions. Your Impact Design, build, and operate platform capabilities supporting batch, streaming, and … systems using Apache Kafka, Flink, Pulsar, and cloud-native technologies Collaborate with AI/ML teams to deploy models and enable generative AI use cases Implement integrations with data lakes and event stores to enable real-time data flow Contribute fullstack features, including React-based frontends and backend services in Java and Python Ensure code quality … software engineering, especially in platform/backend systems Expert-level skills in Java and strong proficiency in Python Experience with Apache Kafka, Flink, and Pulsar for building distributed data pipelines Familiarity with scalable data storage and data lake integrations Proven ability to integrate AI/ML models and work with prompt-based applications Fullstack More ❯

the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building core capabilities that power our data and AI infrastructure—enabling scalable, resilient, and intelligent systems to support enterprise-scale Business Planning Software solutions. Your Impact Design, build, and operate platform capabilities supporting batch, streaming, and … systems using Apache Kafka, Flink, Pulsar, and cloud-native technologies Collaborate with AI/ML teams to deploy models and enable generative AI use cases Implement integrations with data lakes and event stores to enable real-time data flow Contribute fullstack features, including React-based frontends and backend services in Java and Python Ensure code quality … software engineering, especially in platform/backend systems Expert-level skills in Java and strong proficiency in Python Experience with Apache Kafka, Flink, and Pulsar for building distributed data pipelines Familiarity with scalable data storage and data lake integrations Proven ability to integrate AI/ML models and work with prompt-based applications Fullstack More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Role Title: Sr.Databricks Engineer Location: Glasgow Days on site: 2-3 Pay Rate: £405 per day MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role focused on designing … building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: . Lead the migration of existing AWS-based data pipelines to Databricks. . Design and implement scalable data engineering solutions using Apache Spark on Databricks. . Collaborate with cross-functional teams to understand data requirements and translate them into efficient … pipelines. . Optimize performance and cost-efficiency of Databricks workloads. . Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. . Ensure data quality and reliability through robust unit testing and validation frameworks. . Implement best practices for data governance, security, and access control within Databricks. . Provide technical mentorship and More ❯

boundaries of applied AI at scale. You’ll be working in one of Europe’s best-resourced AI environments, collaborating with experienced researchers and engineers to design the data platforms and tools that power model training and deployment. Why this role? Build data systems that enable cutting-edge machine learning at scale Work in a high … calibre team alongside ML researchers and engineers Competitive compensation that matches or exceeds top industry benchmarks Your responsibilities Designing and implementing scalable, high-performance data pipelines to support model training and experimentation Collaborating with machine learning researchers and software engineers to ensure robust integration of data into ML workflows Writing clean, production-level code to support … large-scale model development and deployment Optimising storage, retrieval, and processing for complex datasets, including text-heavy/NLP data Evaluating and adopting new technologies to enhance machine learning infrastructure What you bring Strong software engineering experience, with a focus on writing high-quality, scalable code Experience in data engineering or data-intensive systems More ❯

boundaries of applied AI at scale. You’ll be working in one of Europe’s best-resourced AI environments, collaborating with experienced researchers and engineers to design the data platforms and tools that power model training and deployment. Why this role? Build data systems that enable cutting-edge machine learning at scale Work in a high … calibre team alongside ML researchers and engineers Competitive compensation that matches or exceeds top industry benchmarks Your responsibilities Designing and implementing scalable, high-performance data pipelines to support model training and experimentation Collaborating with machine learning researchers and software engineers to ensure robust integration of data into ML workflows Writing clean, production-level code to support … large-scale model development and deployment Optimising storage, retrieval, and processing for complex datasets, including text-heavy/NLP data Evaluating and adopting new technologies to enhance machine learning infrastructure What you bring Strong software engineering experience, with a focus on writing high-quality, scalable code Experience in data engineering or data-intensive systems More ❯

minimum two days per week) Type: Full time, Permanent SC Eligibility Required Joining Our Mission Shape the future. Make an impact. At QuantSpark, pioneering the strategic application of data, analytics, and AI is at the heart of our work. We empower businesses and government to thrive, not just for profits, but for measurable human and societal benefit. This … Driving technological transformation and efficiency across verticals. The Role In this role, you'll be responsible for designing, developing, and maintaining scalable AI systems using machine learning and data-driven approaches. You'll integrate ML models into production-ready AI solutions while collaborating closely with data scientists, software engineers, and product teams. Monitor and optimise model … version control and scalable code design. You bring practical experience designing, training, and evaluating machine learning models, including deep learning and statistical optimisation. You are proficient in developing data pipelines for large, complex datasets using Python, SQL, NoSQL, and big data tools, preferably on AWS or Azure. You have hands-on experience with LLM operations and More ❯

AI Tech Start Up - Junior Data Scientist - Remote Based London £30,000 - £50,000 Robret Half have partnered with an early stage high potential AI focused Tech Start-Up who aree looking for a Junior Data Scientist to join their growing team and help develop advanced machine learning models that predict and prevent equipment failures in … large-scale industrial operations. This is an exciting opportunity to apply data science to real-world engineering challenges , using rich, high-frequency data from complex machinery. Their AI-driven predictive maintenance platform is built on years of operational data and designed to help clients reduce downtime, improve efficiency, and make data-backed … early stage which is uniquely positioned for rapid growth! What You'll Do Build, validate, and monitor machine learning models for anomaly detection and failure prediction. Analyze sensor data and operational logs to support predictive maintenance strategies. Develop and maintain data pipelines using tools like Apache Airflow for efficient workflows. Use MLflow for experiment tracking, model More ❯

the bar for technical excellence Balance agility, scalability, and reliability in a fast-moving environment Tech youll work with: Go, Kubernetes, ElasticSearch, SQL Server, MongoDB, GitOps (Argo CD), data pipelines, and emerging AI tools for smarter engineering. Join a collaborative, forward-thinking team where youll have the autonomy to innovate and the opportunity to impact millions of users More ❯

bar for technical excellence Balance agility, scalability, and reliability in a fast-moving environment Tech you’ll work with: Go, Kubernetes, ElasticSearch, SQL Server, MongoDB, GitOps (Argo CD), data pipelines, and emerging AI tools for smarter engineering. Join a collaborative, forward-thinking team where you’ll have the autonomy to innovate — and the opportunity to impact millions of More ❯

Role Title: ETRM Data Modeler Work mode: Hybrid, 3 days WFO Contract duration: 12 Months Location: London Key Accountabilities: Knowledge and experience in global energy markets with the ability to identify and prioritize fundamental and quantitative analysis/modelling that provides commercial insights to the trading organization. Strong communication skills with the ability to communicate analytics to necessary … Excellent problem-solving skills. Experience using a coding language to develop models and analytical tools. Experience manipulating and analyzing large, complex datasets. Desirable Experience & Skills Practical knowledge of data engineering practices (designing and building robust data pipelines) Knowledge of python and core libraries applicable to data science (e.g., pandas, numpy, statsmodel More ❯

through internships, placements, or commercial projects — to join our hybrid-working team in London . You’ll help design, build, and deploy intelligent systems that drive innovation and data-driven decision-making across the organisation. This is an exciting opportunity to join a global technology and analytics team , working alongside experienced engineers, data scientists, and AI … of intelligent finance. In this role, you’ll: 🧠 Develop, train, and optimise machine learning and deep learning models for real-world applications ⚙ Build and support AI pipelines — from data preprocessing to model deployment and monitoring 💬 Collaborate with cross-functional teams to integrate AI solutions into production environments 🔍 Explore use cases in NLP, computer vision, and generative AI using … Performance-based bonus, private medical insurance, generous pension scheme, 30 days’ annual leave, and extensive wellbeing benefits. What We’re Looking For: 🎓 Degree in Computer Science, Artificial Intelligence, Data Science, Mathematics, or a related field (Master’s preferred) 💼 Some proven industry experience applying AI or machine learning (internship, placement, or full-time role) 🐍 Strong programming skills in Python More ❯

through internships, placements, or commercial projects — to join our hybrid-working team in London . You’ll help design, build, and deploy intelligent systems that drive innovation and data-driven decision-making across the organisation. This is an exciting opportunity to join a global technology and analytics team , working alongside experienced engineers, data scientists, and AI … of intelligent finance. In this role, you’ll: 🧠 Develop, train, and optimise machine learning and deep learning models for real-world applications ⚙ Build and support AI pipelines — from data preprocessing to model deployment and monitoring 💬 Collaborate with cross-functional teams to integrate AI solutions into production environments 🔍 Explore use cases in NLP, computer vision, and generative AI using … Performance-based bonus, private medical insurance, generous pension scheme, 30 days’ annual leave, and extensive wellbeing benefits. What We’re Looking For: 🎓 Degree in Computer Science, Artificial Intelligence, Data Science, Mathematics, or a related field (Master’s preferred) 💼 Some proven industry experience applying AI or machine learning (internship, placement, or full-time role) 🐍 Strong programming skills in Python More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

a Technical Business Analyst with deep knowledge of insurance pricing and underwriting systems to bridge the gap between actuarial, product and engineering teams. You’ll gather requirements, design data flows, and help implement pricing models, APIs and analytical capabilities that drive better underwriting decisions. Key Responsibilities: Define and document requirements for pricing system integrations, model deployment and API … workflows. Translate pricing models (Excel/Python/R) into technical specifications for developers and data engineers. Collaborate with underwriters and actuaries to improve model governance, version control and reporting. Support UAT, model validation and release testing. Deliver insights and metrics around model performance, quote success and underwriting efficiency. Partner with insurers and MGAs to streamline pricing and … a Business Analyst or Technical Analyst role within insurance, reinsurance or InsurTech. Experience with pricing or rating systems, underwriting workflows or model integration projects. Strong understanding of insurance data structures, rating factors and model governance. Skilled in SQL and BI tools (Power BI, Tableau, Looker). Comfortable working with APIs, data pipelines and collaborating with developers. More ❯

Multiple Data Engineers/Scientists/Engineers Needed 📍 Location: London - Remote First but there will be travel to client sites and onboarding will be done in London. 💸 Salary: £55,000 – £100,000 + Bonus + Equity Options 🛡️ Security Cleared or Clearable Candidates Only Areti Group is working with one of the UK's fastest-growing, well-funded tech … start-ups, is hiring Multiple Data Engineers/Data Scientists/ML Analysts to join our cutting-edge team in London. We're on a mission to scale rapidly – with plans to grow by 40 heads this year – and this is your chance to be a part of something big from the ground up. We are … working on high-impact, mission-critical projects across the public sector, defence, and government organisations , delivering real-world innovation powered by data and technology . 🔧 Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies ✅ Ideal Candidate: Already More ❯

Multiple Data Engineers/Scientists/Engineers Needed 📍 Location: London - Remote First but there will be travel to client sites and onboarding will be done in London. 💸 Salary: £55,000 – £100,000 + Bonus + Equity Options 🛡️ Security Cleared or Clearable Candidates Only Areti Group is working with one of the UK's fastest-growing, well-funded tech … start-ups, is hiring Multiple Data Engineers/Data Scientists/ML Analysts to join our cutting-edge team in London. We're on a mission to scale rapidly – with plans to grow by 40 heads this year – and this is your chance to be a part of something big from the ground up. We are … working on high-impact, mission-critical projects across the public sector, defence, and government organisations , delivering real-world innovation powered by data and technology . 🔧 Tech Stack & Skills We're Looking For: Palantir Azure Databricks Microsoft Azure Python Docker & Kubernetes Linux Apache Tools Data Pipelines IoT (Internet of Things) Scrum/Agile Methodologies ✅ Ideal Candidate: Already More ❯