101 to 125 of 141 Data Pipeline Jobs in the South East

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microsoft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Fabric Consultant Location: Hybrid in London Salary: Up to £90,000 + Benefits Are you passionate about data engineering? Join a leading Microosft partnered consultancy delivering cutting-edge solutions with Azure, Power BI, and Microsoft Fabric. This is your chance to work on exciting projects, design robust data architectures, and help organisations unlock the full potential … of their data. Key Responsibilities: Build and optimise data pipelines and ETL workflows using Microsoft Fabric and Azure Synapse or Databricks. Implement scalable solutions for data ingestion, storage, and transformation. Develop clean, reusable Python code for data engineering tasks. Research and integrate the latest cloud-based technologies. Requirements: Proven experience in data engineering with Azure tools (Synapse, Data Factory, Databricks). Experience with Microsoft Fabric. Strong Python programming skills. Knowledge of data modelling and Kimball methodology. Excellent communication and problem-solving skills. Fabric certifications are highly desirable Benefits: Competitive salary and bonus scheme Private medical cover, life assurance, and pension. Hybrid working. And more More ❯

Senior Data Engineer – Hybrid London £75K - £95K Salary: £65,000 – £85,000 Location: London (Hybrid – 2 days per week in office) ECOM Recruitment are working with a growing digital consultancy that delivers data and technology solutions for some of the UK’s best-known brands. We’re looking for a Senior Data Engineer to … join their growing data team. You’ll be working with a talented group of engineers to design and build modern, cloud-based data platforms and pipelines that make a real impact. This is a great opportunity to get hands-on with the latest tools and technologies within a business that truly values collaboration, innovation, and quality. … The Role As a senior member of the team, you’ll be responsible for building and maintaining scalable data pipelines that drive insights and decision-making for clients in fast-moving industries including the gambling sector, so it’s important you’re comfortable working in that space. You’ll work closely with other engineers, analysts, and client stakeholders More ❯

and maintain backend control software for advanced scientific systems. Collaborate with scientists, hardware, and systems engineers to architect and optimise performance. Develop tools and interfaces to manage experiments, data pipelines, and control sequences. Apply strong software hygiene, testing and CI/CD practices. Contribute to design reviews and mentor junior engineers. Tech Environment Languages: Python (core), Rust (or More ❯

deploying scientific software using common CI and containerization solutions. Enjoy staying up to date with current software development best practices and tools, e.g. AI coding assistants or modern data pipelines and scheduling solutions. Enjoy diving into new problems with a continuous learning attitude, absorbing relevant domain knowledge. Additional experience with scientific C++ and Fortran libraries, HPC technologies, cloud More ❯

youll design and build intelligent systems that think, reason and act helping enterprises evolve from AI-enabled to truly AI-native. Were solving hard problems at scale, integrating data, AI and automation to create self-improving systems that deliver measurable business value. Youll work with as part of a Data and AI hands-on engineering team … thats turning Agentic AI from concept to production reality. If you're ready to embrace the power of data to transform our business and embark on an epic data adventure, then join us at Kyndryl. Together, let's redefine what's possible and unleash your potential. Why this role matters Youll be part of a fast … moving group shaping Kyndryls Agentic AI Framework an open, modular system that connects data pipelines, LLMs, reasoning engines and orchestration layers to power autonomous solutions across industries. Were not just imagining the future of AI transformation were building it. Startup inside Kyndryl: Low hierarchy and high accountability. Youll own delivery from concept to code to production Cross-stack More ❯

a team that values innovation, collaboration, and growth. Essential: DP-600 and/or DP-700 certifications (must commit to completing both during probation) Expertise in Azure Synapse, Data Factory, or Databricks Strong data modelling and problem-solving skills Python proficiency and a passion for data science What you'll do: Design and optimise … high-performance data pipelines Build scalable solutions using Azure and Fabric Collaborate with data scientists and stakeholders to deliver strategic insights Drive innovation with the latest cloud technologies What's on offer: Work with Microsoft Fabric, cutting-edge cloud tech, and AI Hybrid flexibility £85,000 package + great benefits Ready to make an impact? Apply More ❯

AI Tech Start Up - Junior Data Scientist - Remote Based London £30,000 - £50,000 Robret Half have partnered with an early stage high potential AI focused Tech Start-Up who aree looking for a Junior Data Scientist to join their growing team and help develop advanced machine learning models that predict and prevent equipment failures in … large-scale industrial operations. This is an exciting opportunity to apply data science to real-world engineering challenges , using rich, high-frequency data from complex machinery. Their AI-driven predictive maintenance platform is built on years of operational data and designed to help clients reduce downtime, improve efficiency, and make data-backed … early stage which is uniquely positioned for rapid growth! What You'll Do Build, validate, and monitor machine learning models for anomaly detection and failure prediction. Analyze sensor data and operational logs to support predictive maintenance strategies. Develop and maintain data pipelines using tools like Apache Airflow for efficient workflows. Use MLflow for experiment tracking, model More ❯

Role Title: ETRM Data Modeler Work mode: Hybrid, 3 days WFO Contract duration: 12 Months Location: London Key Accountabilities: Knowledge and experience in global energy markets with the ability to identify and prioritize fundamental and quantitative analysis/modelling that provides commercial insights to the trading organization. Strong communication skills with the ability to communicate analytics to necessary … Excellent problem-solving skills. Experience using a coding language to develop models and analytical tools. Experience manipulating and analyzing large, complex datasets. Desirable Experience & Skills Practical knowledge of data engineering practices (designing and building robust data pipelines) Knowledge of python and core libraries applicable to data science (e.g., pandas, numpy, statsmodel More ❯

Data Engineer x3 Worthing 2 days a week £55,000 - £65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services … and deliver secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time).Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs.Collaborate with product teams and client stakeholders to refine requirements and align … analysts and business teams.WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling.Essential skills and experience:Strong SQL and hands-on More ❯

Data Engineer x3 Worthing 2 days a week 55,000 - 65,000 A Leading consultancy organisation based in is looking to expand their team of Data Engineers to join a specific public sector client. This is a pivotal role, where you will contribute to data acquisition, preparation and management projects, helping to modernise services … and deliver secure, reliable data products at scale. WHAT YOU'LL DO Design and implement robust, secure and performance data integration solutions (batch and/or near-real-time). Build, operate and improve data pipelines (ingestion, transformation, curation) with monitoring, alerting and SLAs. Collaborate with product teams and client stakeholders to refine requirements … and business teams. WHAT YOU'LL BRING Our team delivers solutions across a wide range of technologies, and so we are looking for candidates with strong knowledge in data engineering fundamentals, with ability to operate at all stages of the delivery lifecycle, with an interest in learning and cross-skilling. Essential skills and experience: Strong SQL and hands More ❯

brands. Kantar Media is a wholly owned but operationally independent part of the Kantar Group. Job Details As people increasingly move across channels and platforms, Kantar Media's data and audience measurement, targeting, analytics and advertising intelligence services unlock insights to inform powerful decision-making. Working with panel and first-party data in over 80 countries … s leading organisations succeed and grow. Job Title: Junior Product Owner Location: London, Grays Inn Road Full time/Permanent/Hybrid Role Description Atria is the core data processing engine at Kantar Media, powering cross-media measurement solutions for clients worldwide. It ingests and processes data from multiple media panels—including traditional TV and online … and client needs. This is an ideal opportunity for someone early in their product career who is eager to learn, grow, and develop their skills in a dynamic, data-driven, and agile environment. Role Requirements Product Delivery Support Assist Product team in managing and prioritising the team backlog based on business value and technical feasibility. Support in defining More ❯

a Quantitative Developer on a contract basis A leading hedge fund with a strong track record in systematic and quantitative trading. The firm combines advanced research, technology, and data to deliver market-leading performance across multiple asset classes. They are seeking a Quantitative Developer on a 6-month contract to support the ongoing development of research tools, trading … within their core systematic strategies team. Role The Quantitative Developer will collaborate with researchers to implement, test, and deploy quantitative trading strategies and risk models. Build and enhance data pipelines and backtesting frameworks for large-scale market data. Integrate new data sources and ensure data quality and reliability across research environments. Refactor and optimise … as a Quantitative Developer within a hedge fund, prop trading, or systematic trading environment. Strong programming expertise in Python (C++ or Java also advantageous). Excellent understanding of data structures, algorithms, and numerical computing. Experience with time-series data, backtesting, and quantitative research workflows. Familiarity with financial markets and trading systems. Strong communication skills with the More ❯

to humanity's enduring challenges. We are looking for a Senior DevSecOps Engineer to join the Pathogen Programme at EIT. In this role, you'll help ensure our data platform is built to the highest standards, with a strong emphasis on automation across the development lifecycle. You'll work closely with engineers to deploy data pipelines … their workflows. You'll be responsible for maintaining infrastructure, designing secure automation pipelines, managing cloud environments, and ensuring security and compliance. You'll collaborate with cross-functional teams, data engineers, backend, and full-stack developers, to build robust, automated deployment pipelines across our environments. Key Responsibilities Design, implement, and maintain secure cloud infrastructure using Oracle Cloud Infrastructure (OCI … tools like Terraform to enable secure, repeatable deployments. Implement and manage CI/CD pipelines, focusing on automated security testing, deployment, and monitoring. Ensure all aspects of the data platform OCI infrastructure, data ingest pipelines, tool deployments, access controls, and monitoring are developed, tested, and deployed using automation best practices. Support bioinformaticians in building pipelines that More ❯

Position: Data EngineerLocation: Central London or Bristol (3 days per week onsite)Salary: £600 to £650 p.d inside IR35Security Clearance: SC Clearance Required About the Role A leading IT consultancy delivering innovative solutions to the UK public sector is seeking an experienced Data Engineer to support a high-profile programme. You'll collaborate with cross-functional … teams to build scalable data pipelines and contribute to digital transformation initiatives across government departments. Key Responsibilities Design, develop and maintain robust data pipelines using PostgreSQL and Airflow or Apache Spark Collaborate with frontend/backend developers using Node.js or React Implement best practices in data modelling, ETL processes and performance optimisation Contribute to … Docker/Kubernetes) - experience in this area is desirable, not essential Operate within Agile teams and support DevOps practices What We're Looking For Proven experience as a Data Engineer in complex environments Strong proficiency in PostgreSQL and either Airflow or Spark Solid understanding of Node.js or React for integration and tooling Familiarity with containerisation technologies (Docker/ More ❯

Python - ML - LLM Data Pipelines and ETL - API Integration Familiar with .NET technologies Lead AI Engineer Location: Slough (Hybrid, two days per week in the office) Salary: £80,000 to £100,000 plus benefits Type: Full time About the Organisation We are developing an advanced AI driven insight and decision platform used within industrial and manufacturing environments. The … platform connects to maintenance, inventory and procurement systems and is designed to turn complex operational data into predictive insight and automated decision making. Our aim is to help factories and large operational teams move from manual processes to intelligent and automated workflows. The Opportunity We are looking for a Lead AI Engineer to take ownership of the AI … reduce costs and automate routine procurement activity. A key focus of the role is building agent driven ordering systems. This includes developing AI agents that can gather price data from public sources, compare supplier options, validate stock requirements and place orders on behalf of users with the correct safety checks and approval flows. Key Responsibilities Design and build More ❯

will be joining a community of Graduates and Apprentices across the business. On joining, you will be assigned to start in one of the following roles. Insights and Data (I&D) Build secure, scalable data pipelines using modern tools and cloud platforms. Create dashboards, automate testing, and support data governance. Work on cloud migration … by its clients to address the entire breadth of their business needs, from strategy and design to operations, fueled by the fast evolving and innovative world of cloud, data, AI, connectivity, software, digital engineering and platforms. Get the Future You Want More ❯

A rapidly growing B2B SaaS company is looking for a Forward Deployed Data Engineer to join their expanding team in London (hybrid working - 2-3 days a week in their vibrant Soho office). logy and delivery - adapting and deploying the platform for new clients, building custom data pipelines, and creating scalable AI workflows that bring … real business impact. What you'll do: Deploy and customise a powerful data platform for global clients Build and optimise pipelines using PySpark, Python, and SQL Design scalable AI workflows with tools like Palantir Collaborate with client teams to deliver data-driven outcomes What we're looking for: 2-4 years' experience in data More ❯

DOE An exciting opportunity for a Software Engineer to join a growing tech company developing a cloud platform used to manage autonomous robotic inspections and transform sensor data into actionable insights for industrial clients. The Role: Youll work across backend, frontend, and data services, contributing to new features, improving existing systems, and supporting integrations with robotics … years experience who wants to develop full-stack skills and work with cutting-edge technologies. Key Responsibilities: Develop features across backend and frontend systems Build and maintain APIs, data pipelines, and UI components Write clean, maintainable code following best practices Support cloud deployment (AWS experience beneficial) Build dashboards and tools for processing inspection data Collaborate with … engineering fundamentals Ability to learn new technologies quickly Good communication and teamwork skills Desirable: AWS or cloud deployment familiarity Interest in robotics, embedded systems, or IoT Experience with data visualisation or real-time data Exposure to AI/ML or computer vision More ❯

DOE An exciting opportunity for a Software Engineer to join a growing tech company developing a cloud platform used to manage autonomous robotic inspections and transform sensor data into actionable insights for industrial clients. The Role: You’ll work across backend, frontend, and data services, contributing to new features, improving existing systems, and supporting integrations with … years’ experience who wants to develop full-stack skills and work with cutting-edge technologies. Key Responsibilities: Develop features across backend and frontend systems Build and maintain APIs, data pipelines, and UI components Write clean, maintainable code following best practices Support cloud deployment (AWS experience beneficial) Build dashboards and tools for processing inspection data Collaborate with … engineering fundamentals Ability to learn new technologies quickly Good communication and teamwork skills Desirable: AWS or cloud deployment familiarity Interest in robotics, embedded systems, or IoT Experience with data visualisation or real-time data Exposure to AI/ML or computer vision More ❯

React) Desirable: AWS familiarity We are a growing technology company building a platform that supports fleets of autonomous inspection robots and turns large volumes of sensor and image data into clear, actionable intelligence. Our software helps major industrial and energy organisations monitor critical infrastructure safely and efficiently. This role sits in the team developing the cloud platform and … user interfaces that operators use to run missions, view inspection data, manage alerts, and interact with AI analysis tools. The Opportunity We’re looking for a software engineer with solid foundations and roughly 2–3 years of professional experience. You’ll join a small, experienced team and work across back end, front end, and robotics-related data services. You’ll help deliver new platform features, improve our existing services, and have the chance to broaden your skills across multiple domains: cloud, data processing, UI development, and embedded/robotics integration. This is a role for someone curious, adaptable, and willing to learn. Why Join Us? Work at the intersection of cloud software, robotics More ❯

AI driven insight and decision platform used within industrial and manufacturing environments. The platform connects to maintenance, inventory and procurement systems and is designed to turn complex operational data into predictive insight and automated decision making. Our aim is to help factories and large operational teams move from manual processes to intelligent and automated workflows. The Opportunity We … reduce costs and automate routine procurement activity. A key focus of the role is building agent driven ordering systems. This includes developing AI agents that can gather price data from public sources, compare supplier options, validate stock requirements and place orders on behalf of users with the correct safety checks and approval flows. Key Responsibilities Design and build … AI powered features including intelligent search, agent driven ordering, predictive stock recommendations and automated procurement workflows Develop autonomous agents that can collect price data, assess supplier choices and initiate or complete ordering actions through APIs or connected systems Build retrieval augmented generation pipelines and vector search capabilities to support accurate and grounded decision making Integrate AI functionality with More ❯

We are a high-growth scale-up building a cloud SaaS platform that enables industrial and energy clients to manage fleets of autonomous systems and turn vast inspection data into actionable intelligence. Our platform is becoming the “mission control” for critical infrastructure monitoring, combining dashboards, anomaly detection, rules/alerts, and predictive analytics into one solution. Already working … and architecture of a SaaS platform Deliver across backend (Java) and frontend (Angular) systems Build secure, scalable cloud infrastructure (AWS) Implement APIs, authentication (SSO/LDAP), and secure data pipelines Develop dashboards and data visualisations to transform complex datasets into actionable insights Partner with leadership to define the technical vision and roadmap Scale into a leadership … SaaS products Hands-on expertise with Java (backend) and Angular (frontend) Skilled in AWS cloud services Solid understanding of APIs, authentication, and security protocols (SSO, LDAP) Experience with data visualisation and analytics platforms Proven ability to design and deliver scalable, secure architectures Entrepreneurial mindset: comfortable working in fast-paced, scale-up environments Nice-to-Haves: Knowledge of machine More ❯

real ownership come together to shape the future of ad-fraud prevention. The Opportunity In this role, you'll help shape a platform that processes large volumes of data and safeguards digital advertising integrity. You'll design simple, effective solutions, write maintainable Python code, and ensure reliability through testing and observability practices. The work spans implementation, documentation, and … team responsible for building and scaling the backend systems that power a machine-learning driven ad-fraud prevention platform. You'll work extensively with Python and large-scale data sets, supporting model training on billions of data points, delivering features to data science teams, and helping launch new models, tracking capabilities, and integration's … across major ad platforms. The work spans everything from developing big-data pipelines on cloud infrastructure (AWS, Redshift, or equivalent) to supporting greenfield projects like new affiliate products and upcoming channel integration's. You'll contribute to a fast-paced engineering environment that deploys to production twice a week, where processes exist but can evolve and where autonomy More ❯