51 to 75 of 106 Data Pipeline Jobs in the South East

Senior Data Engineer Up to £95,000 + benefits | Hybrid (3 days a week in City of London) A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team. You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus … on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements. This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability. Key responsibilities Design and build … Python and AWS services Own and maintain Airflow workflows Ensure high data quality through rigorous testing and validation Analyse and understand complex data sets before pipeline design Collaborate with stakeholders to translate business requirements into data solutions Monitor and improve pipeline performance and reliability Maintain documentation of systems, workflows, and configs Tech More ❯

Data Engineer (1 Braham Street, London, United Kingdom) Available locations: Belfast, Birmingham, Glasgow, Leeds, Bristol, Manchester or London Working Style: 3 days a week in office, 2 days anywhere Why this job matters Data is a vital part of our business and with your help, we can improve the services that we provide to our customers … through engineering excellence of our data products. You’ll be working on exciting data products which support TV, Broadband, Digital Voice and market leading technologies like Unbreakable Wifi. We deliver these critical services using the latest cloud technologies on AWS, GCP and Cloudera. We are hiring 2* Lead Data Engineers to join our brilliant … team. When you join us as a Lead Data Engineer, you’ll have the opportunity to be part of our Data & AI Enablement Team where you will help to design, build, and support high quality engineering products from our extensive data sources and multi-cloud environment. As a team we believe in the agile More ❯

My Financial Services client is seeking to recruit an Oracle Data Warehouse Architect on an initial 6 month contract for a Financial Services client based in London. It is hybrid and will require 3x days onsite per week. You will design, optimize, and maintain Oracle-based data warehouse solutions to ensure high performance, scalability, and alignment … with business intelligence and analytics needs. This role requires the individual to design and optimize Oracle-based data warehouse systems, ensuring they are scalable, high-performing, and aligned with business analytics needs. They will collaborate closely with the head of the data team and .NET developers, applying advanced data modelling, performance tuning, and problem … insights into clear, actionable recommendations for both technical and non-technical stakeholders. Skills Required: Strong experience in designing and developing efficient ETL processes to support enterprise-scale Oracle Data Warehouse environments. Proven ability to optimize and tune complex SQL and PL/SQL scripts for performance, while guiding development teams on best practices for data modelling More ❯

Data Engineer (Microsoft Fabric) – Remote, UK-Based | £60K–£70K Join a high-impact, low-ego tech team building cutting-edge SaaS tools for global investment clients. We’re working … with a fast-growing software company that builds cloud-native data and analytics platforms for the asset management sector. With major clients onboard and more in the pipeline, they’re now hiring a Microsoft Fabric–focused Data Engineer to support their next phase of growth. THE ROLE Deliver advanced BI and analytics solutions using Microsoft … role in designing scalable data workflows as the business transitions further into SaaS KEY REQUIREMENTS Hands-on experience with Microsoft Fabric – understanding lakehouse concepts, medallion architecture, and pipeline orchestration Strong SQL skills and cloud-native data engineering experience Confidence working with Power BI, Azure Data Factory, and enterprise data models Comfortable More ❯

Power Platform & Azure Data Developer Are you a data-driven developer with a passion for automation, analytics, and AI? We're working with a forward-thinking organisation that's investing heavily in digital transformation - and they're looking for a Power Platform & Azure Data Developer to join their growing team. This is a fantastic … opportunity to work on cutting-edge projects that blend Power Platform , Azure Data Services , and AI technologies to deliver intelligent, scalable solutions across the business. This is a hybrid role, with 2 days per week in their Central London office to collaborate with your team and business stakeholders. What You'll Be Doing: Power Platform Development : Build and … maintain Power Automate flows, Power Apps, and Power BI dashboards. Azure Data Engineering : Design and manage robust data pipelines using Azure Data Factory. AI & Advanced Analytics : Collaborate on AI/ML projects, integrating models into Power BI and Azure services. Collaboration & Documentation : Work closely with stakeholders to gather requirements and document technical solutions. What More ❯

Power Platform & Azure Data Developer Are you a data-driven developer with a passion for automation, analytics, and AI? We're working with a forward-thinking organisation that's investing heavily in digital transformation - and they're looking for a Power Platform & Azure Data Developer to join their growing team. This is a fantastic … opportunity to work on cutting-edge projects that blend Power Platform , Azure Data Services , and AI technologies to deliver intelligent, scalable solutions across the business. This is a hybrid role, with 2 days per week in their Central London office to collaborate with your team and business stakeholders. What You'll Be Doing: Power Platform Development : Build and … maintain Power Automate flows, Power Apps, and Power BI dashboards. Azure Data Engineering : Design and manage robust data pipelines using Azure Data Factory. AI & Advanced Analytics : Collaborate on AI/ML projects, integrating models into Power BI and Azure services. Collaboration & Documentation : Work closely with stakeholders to gather requirements and document technical solutions. What More ❯

Our client, a respected Lloyd's managing agent, is looking for a Senior Data Engineer to join their IT & Change team. This is a key role in delivering their enterprise data strategy and building a modern data platform that powers smarter decisions, better insights, and streamlined operations.Key skills and responsibilities * Proven experience in data engineering and data platform development * Strong programming skills in Python, Java, Scala, or similar * Advanced SQL and deep knowledge of relational databases * Hands-on experience with ETL tools and building robust data pipelines * Familiarity with data science, AI/ML integration, and cloud platforms (AWS, Azure, GCP) * Strong knowledge of Power BI … Tableau, or similar tools * Understanding of data architecture, governance, and complex systems * Insurance or financial services experience (Lloyd's/London Market preferred More ❯

Azure Data Engineer – FinTech | Azure | Data |12-month FTC London – Remote in office 4 times in a fortnight (flexible) Salary & Benefits – Up to £75,000 + 8 to 12% Pension, Life Assurance, Health & Dental Insurance, 25+ days annual leave + other flexible benefits Azure Data factory | Logic Apps | Azure Batch | Azure Functions | Azure DevOps … I’m working with a pioneering organisation in the UK fintech landscape who are on the hunt for an experienced Azure Data Engineer to join their fast-moving Intelligent Automation Team.This isn’t your average data gig. You’ll be building and scaling Azure-native pipelines that power the next phase of AI-led transformation in … financial services. If you're passionate about clean architecture, impactful automation, and cutting through the noise with robust cloud data solutions — you’ll thrive here.This role is a 12 month FTC and would suite someone who wants to dive into a new challenge for the next year or so.Role as an Azure Data Engineer: Crafting and More ❯

week in Surrey office 8 Month Contract Upto £340 p/day Inside IR35 About the Role We are looking for a commercially minded and technically capable Senior Data Analyst to join our growing analytics team. This high-impact role involves delivering insights across digital, commercial, and operational areas by working with a variety of customer, sales, behavioural … and market data. You’ll work cross-functionally with stakeholders in Marketing, UX, Product, Logistics, and Finance, as well as with Data Engineers to enable scalable, data-driven decision making across the organisation. Key Responsibilities Analyse data from multiple internal systems including sales platforms, customer data sources, logistics, and financial planning tools … digital marketing strategy, sales trends, stock movement, and operational efficiency Support UX and behavioural analysis using tools that provide heatmaps, session replays, and user journey insights Collaborate with Data Engineers to access data via APIs, define requirements, and help shape data pipelines and modelling Build and maintain clear, user-friendly dashboards and reports in More ❯

innovation and collaboration. We are committed to cultivating a community of excellence through trust, innovation, and resilience, valuing diverse experiences and expertise. Requirements The Role: We seek a Data Engineer to develop and deploy a data platform supporting AI initiatives at EIT. You will be responsible for building scalable data infrastructure and pipelines, collaborating … with multidisciplinary teams. Key Responsibilities: Design and implement scalable data pipelines and infrastructure Develop data processing systems using cloud technologies Optimize data storage and retrieval for AI applications Support AI/ML model development and deployment Evaluate and adopt new data technologies Collaborate with scientists, researchers, and operational teams Qualifications & Experience: Extensive … Python programming experience in enterprise environments Knowledge of data modeling, ETL, data warehousing, and SQL Cloud computing experience Strong communication skills Innovative mindset and ability to solve challenges creatively Ability to work in a fast-paced, startup-like environment Nice to have: Familiarity with AI/ML workflows Experience with Docker/Kubernetes Knowledge of Git More ❯

Principal Data Engineer Up to £107,500 + Bonus + Benefits London - Hybrid Are you a hands-on data engineering leader who thrives on building robust platforms and driving technical excellence? I'm partnering with a well-loved consumer tech business that brings joy and storytelling into people's lives-and they're now scaling their … data and ML platform to support the next phase of growth. This is a chance to be at the forefront of a data transformation journey-owning architectural direction, mentoring engineers, and shaping a decentralised data model that will serve marketing, product, finance, and AI functions across the group. Why Join? Up to … base salary Hybrid working with a London base (flexibility offered) High-impact role with a growing, values-driven data team Platform-focused, mission-led engineering Work with a modern cloud-native stack (Snowflake, DBT, Airflow, Terraform, AWS) What You'll Be Doing Serve as the technical lead for cross-functional data initiatives Define and champion best More ❯

Data Platform EngineerLondon - Hybrid£80,000-£90,0000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company offering … further progression!This company are a bleeding-edge technology business driving innovation across the global financial services sector. Their platform processes vast amounts of real-time and batch data, supporting business critical reporting and analytics. With a strong culture rooted in integrity, creativity, and technical excellence, they've become a trusted partner across a wide range of businesses.In … of large-scale date pipelines built on AWS, Apache Flink, Kafka, and Python. You'll play a key role in diagnosing incidents, optimising system behaviour, and ensuring reporting data is delivered on time and without failure.The ideal candidate will have a strong experience working with streaming and batch data systems, a solid understanding of monitoring a More ❯

Job title Operations Data & Insight Analyst Ref 41277 Division Asset Operations & Capital Delivery Location Hybrid - Kemble Court - RG2 6AD Contract type Permanent Full/Part-time Full-time Salary Competitive salary up to £45,000 per annum, depending on skills & experience. Job grade B Closing date 11/08/2025 We're looking for an experienced operations … data and insight analyst to join us who can support the team as we put into action new tools, technologies and techniques to meet Thames Water's current and future challenges. The successful analyst will support the delivery of insight and analysis within the UK's largest Water and Wastewater Company. For the right person, this is a … fantastic opportunity to progress your career by testing your skills, supporting colleagues and applying your knowledge of data to solve practical problems. What you'll be doing as an Operations Data & Insight Analyst Typical tasks in this role include building logic, automating processes, reporting, providing analysis and insights, and working with tools such as SQL, Power More ❯

About the role: We're looking for a Senior Data Engineer to join the Data & Analytics team at Holland & Barrett. This is a high-impact, mid-seniority role within our growing data function, where you'll design, build, and scale modern data solutions on AWS. You'll work closely with cross-functional … teams including Data Science, BI, and Product Analytics to develop cloud-native, scalable data infrastructure powering advanced analytics and machine learning. As a Senior Engineer, you'll not only deliver code — you'll take ownership, lead small teams, mentor others, and contribute to shaping our engineering culture and best practices. You'll join a team of … Data Engineers, reporting to the Senior Data Engineering Manager. You'll work alongside Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI More ❯

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start Role: Senior Data Engineer Location: This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow. Start Date: Must be able to start mid-August. Salary: £80k-£90k (Senior) | £90k-£95k (Lead) About The Role … Our partner is looking for a Senior Data Engineer to join a high-impact engineering team delivering scalable data solutions for complex marketing and customer insight use cases. This is an opportunity to work on cutting-edge data pipelines, cloud-native platforms and real-time data flows in a collaborative, forward-thinking … with cross-functional teams including Data Science, Software Engineering and Product. Champion best practices in data governance, observability and compliance. Contribute to CI/CD pipeline development and infrastructure automation (Terraform, AWS DevOps). Provide input into technical decisions, peer reviews and solution design. Requirements Proven experience as a Data Engineer in cloud More ❯

Data Manager (BI) A specialty insurer is looking for a Data Manager (BI) to help shape and drive the next phase of their enterprise data platform. This is a hands-on role that also carries leadership responsibilities, sitting right at the intersection of data engineering, BI architecture, and business strategy.You'll work … closely with senior stakeholders and technical teams to deliver scalable data solutions, build and manage data pipelines, and turn complex requirements into meaningful, actionable insights - all within the Microsoft tech stack.What we're looking for:Strong experience across the Microsoft BI stack - SQL Server, Power BI, SSAS, SSIS Good knowledge of data engineering principles More ❯

Data Scientist - GCP 500- 550 per day (Inside IR35) 2 Days Onsite - Isleworth, West London 6-Month Contract (Extendable) 83zero are partnered with a global leader in media and broadcasting, looking for an experienced Data Scientist to support a business-critical project. You'll be joining a collaborative team of data scientists and engineers … to build and refine machine learning models that deliver genuine commercial impact. What You'll Be Doing: Work closely with fellow data scientists to explore how AI/ML can unlock insights and improve decision-making. Perform advanced analysis on large, complex datasets using statistical and modelling techniques. Build, test, and tune ML models (especially NLP or computer … ML libraries, all within Google Cloud Platform (GCP) . Optimise models for accuracy and performance, ready for product integration. Stay up-to-date with the latest developments in data science and AI to drive innovation. Present insights, results, and model performance clearly to both technical and non-technical stakeholders. Ensure your workflows are reproducible and well-documented, including More ❯

Job Title: Lead Data Engineer Location: London (Hybrid) Type: Full-time Agency: Representing a leading digital media group We're representing a forward-thinking digital media organisation with a growing portfolio of high-traffic content brands. As they continue to scale their data capabilities, they're seeking a Lead Data Engineer to join their … London-based team. Key Responsibilities: Design and maintain scalable data pipelines across diverse sources including CMS, analytics, ad tech, and social platforms. Lead engineering efforts to automate workflows using tools like Airflow, dbt, and Spark. Build robust data models to support dashboards, A/B testing, and revenue analytics. Collaborate with cross-functional teams to deliver … actionable insights and support strategic initiatives. Drive cloud-based data infrastructure projects, particularly on GCP. Manage and mentor a Data Engineer, fostering growth and technical excellence. Requirements: Advanced SQL skills and experience with relational/non-relational databases. Proficiency in Python and/or Java for data services and API integration. Proven experience with More ❯

Principal Data Engineer (Contract) Hybrid (London-based) | £450-£650/day A leading scientific and cultural institution is seeking a Principal Data Engineer to design and scale cloud-native data infrastructure powering biodiversity research, digitisation, and AI workflows. Key Responsibilities Architect and build scalable data pipelines for ingestion, transformation, enrichment, and publication. … Integrate AI/ML workflows, including training data pipelines and inference outputs. Lead AWS-based data engineering using services like S3, Lambda, Glue, and Athena. Ensure interoperability with global research infrastructures (e.g. DiSSCo UK, RECODE, DToL). Define best practices in data quality, metadata, and reproducibility. Collaborate with cross-functional teams (science, software, product … . Mentor engineers and contribute to institutional data strategy and standards. Tech Requirements Strong Python skills; experience with Airflow, Luigi, or Spark. Proven track record building robust, scalable ETL/ELT systems. Experience with scientific, semi-structured, or biodiversity data. Familiarity with semantic web standards (e.g. Darwin Core, JSON-LD, Linked Data). Knowledge of NoSQL More ❯

Data Engineer - Award-Winning AI SaaS platform We're partnered with a pioneering SaaS company that's transforming their industry through cutting-edge AI and data technology. With a multi-award-winning platform and a client base that includes global household names, this is a rare opportunity to join a high-growth tech business that blends … startup agility with enterprise stability. We're looking for a passionate Data Engineer who is experienced with AI tooling - including building Gen AI agents in-product - to join their growing Data Engineering ream. Why You'll Love This Role: Tech at Scale : Work with hundreds of millions of data points daily, using distributed systems … office if you prefer Exceptional Benefits : From unlimited holiday and private healthcare to stock options and paid parental leave. What You'll Be Doing: Build and maintain scalable data pipelines using Spark with Scala and Java, and support tooling in Python Design low-latency APIs and asynchronous processes for high-volume data. Collaborate with Data Science More ❯

Senior Data Scientist - Customer & Behavioural Analytics £70,000 - £80,000 + Bonus + Benefits Hybrid Working - 1 day in the office circa every 2 weeks. Role Summary We are seeking a commercially minded Senior Data Scientist to lead the development of advanced analytics and machine learning solutions focused on customer behavior, personalization, and lifecycle management. Your … work will directly impact customer retention, engagement, and lifetime value, helping the business make smarter, data-driven decisions at scale. Key Responsibilities Lead customer-centric analytics projects across retention, segmentation, churn prediction, product usage, and personalization Build and maintain predictive models (e.g. churn, CLV, next-best action, recommendation systems) and translate insights into business value Conduct deep-dive … end-to-end lifecycle of models: from problem framing to deployment and monitoring Present analytical findings and strategies to stakeholders in a compelling and actionable way Mentor junior data scientists and contribute to the evolution of data science standards and practices Key Skills & Technologies Technical: Strong in Python (pandas, scikit-learn, XGBoost, LightGBM, etc.) Proficient in More ❯

Creative Assembly is looking for a PowerBI and SQL ninja with deep knowledge of games and our products to come and support our Game Data Analytics & Insights. As part of the Analytics & Insights team, you'll report to the Analytics & Insights Manager and work across all our projects in the studio. It's a critical role that will … tooling and automation Build and maintain dashboards using PowerBI and Databricks SQL Produce analysis and insights for our Launch Report and Key Player Metrics processes Work with our data engineers to design, build and maintain reporting data pipelines Produce ad-hoc analysis on everything from player preferences, balancing, sentiment, title ownership and beyond Be able to … independently, managing multiple responsibilities and demands at once. From time to time, you may: Be asked to produce analysis, insights, or viz/dashboarding for our Production Intelligence data The stack you'll work with is: Power BI Databricks Knowledge, Skill and Experience Love video games and are highly motivated by the chance to play a key role More ❯

Data Engineer - Energy Consultancy £45,000 DOE | Full-Time, Permanent | Hybrid (Southampton) Join a company driving the UK's journey to net zero. We're hiring a Data Engineer for a purpose-led energy consultancy helping organisations reduce energy consumption, lower carbon emissions, and cut costs through innovative solutions and expert guidance. This is a fantastic … opportunity to join a tech-forward team committed to sustainability, professional development, and a collaborative working culture. The Role As a Data Engineer , you'll work as part of the dedicated Data Team to support internal reporting and external customer platforms. You'll design and maintain scalable pipelines using modern cloud technologies and help build a … robust new data platform for real-time analytics. Key Responsibilities: Own and deliver assigned data projects and BAU tasks Maintain data pipelines using Azure ADF and Synapse Analytics Transform raw CRM data into structured, curated datasets Develop event-driven data processes for internal and external use Contribute to best-practice More ❯

Creative Assembly is looking for a PowerBI and SQL ninja with deep knowledge of games and our products to come and support our Game Data Analytics & Insights. As part of the Analytics & Insights team, you'll report to the Analytics & Insights Manager and work across all our projects in the studio. It's a critical role that will … tooling and automation Build and maintain dashboards using PowerBI and Databricks SQL Produce analysis and insights for our Launch Report and Key Player Metrics processes Work with our data engineers to design, build and maintain reporting data pipelines Produce ad-hoc analysis on everything from player preferences, balancing, sentiment, title ownership and beyond Be able to … independently, managing multiple responsibilities and demands at once. From time to time, you may: Be asked to produce analysis, insights, or viz/dashboarding for our Production Intelligence data The stack you'll work with is: Power BI Databricks Knowledge, Skill and Experience Essential Love video games and are highly motivated by the chance to play a key More ❯

Cambridge, Gatwick, Milton Keynes, Reading Business Line Enabling Functions Job Type Permanent/FTC Date published 10-Jun-2025 19366 Connect to your Industry Are you passionate about data science and AI? Do you want to apply your skills and knowledge to help shape the future of Deloitte? If so, we have an exciting opportunity for you to … join our Enabling Functions team as an AI Architect & Data Scientist. You be part of an exciting innovative team that delivers cutting edge GenAI solutions. As an AI Architect & Data Scientist, you will work on innovative projects that leverage data and AI to enhance our internal capabilities and deliver value to our employees. You … values lead every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity As an AI Architect & Data Scientist, you will be expected to: Design and build Agentic AI and GenAI solutions, from PoC to production, using agile methodologies and best practices. Apply advanced analytical techniques, such More ❯