1 to 25 of 140 Data Pipeline Jobs in the South East

Position: Analytics Engineer Location: London (hybrid 3 times a week)Department: ITType: 3 months rolling contractOutside IR35 The client is seeking an experienced Analytics Engineer to join its Data & Analytics team. The role focuses on building scalable data pipelines, transforming raw data into clean, reusable datasets, and enabling data-driven decision-making. … Key Responsibilities Design and build data products, with proficiency throughout the data lifecycle. Develop robust data models through close collaboration with business users and the engineering team. Partner with senior management, operational leads, and other stakeholders, coaching and supporting a data-driven culture, including KPI definition and reporting frameworks. Accountable for data extraction, transforming JSON & XML, utlising high experience within metadata management. Collaborate with data engineers to develop data, enrich product design and integrate data for predictive models or machine learning. Deliver well-defined, transformed, tested, documented, and code-reviewed datasets for analysis. Evaluate and recommend improvements in data flow, influencing and More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

If you are a natural collaborator and a creative problem solver - this position might be for you! We are looking for a Senior Data Engineer to join our Data team and be a part of Nest's transformation to use its data and insight to drive decision making.You’ll work closely with stakeholders to … develop, test, and maintain data products and solutions that align with their requirements. You’ll be helping to develop and maintain a cloud-based data and analytics platform on Azure and help end-users of every level integrate their workflows between this and other platforms, including AWS-based solutions.You’ll combine data from different … sources, and build data pipelines to transform and organise raw data into formats and structures that can be easily used for business intelligence, visualisations and dashboards, deep dive analysis, and long term forecasting/modelling. To be successful in this positions you will have the following skills, competencies and experience: You’re a natural collaborator and More ❯

COSTAR GROUP - SENIOR DATA ENGINEER ONTHEMARKET TECHNOLOGY - LONDON OVERVIEW CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index and the NASDAQ 100, CoStar Group is on a mission to digitize the worlds real estate, empowering all people to discover properties … content, imagery, design and functionality. The OnTheMarket product will support home buyers, sellers, and agents better than ever! Learn more about OnTheMarket . ROLE DESCRIPTION The role ofSenior Data Engineerwill be a key role within the OTM Data team, reporting to the Head of Data and working closely with the CTO. The Data team is responsible for data acquisition, data loading, data quality, data processing, data delivery, and data support for OnTheMarket. This role will provide focus on delivering value to our customers, by leveraging data to improve the OTM users and agents experience. This role would More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Engineer, Data Engineer, Data Platform Engineer, Data Architect, Data Infrastructure Engineer, Cloud Data Engineer, DataOps Engineer, Data Pipeline Engineer, Devops Engineer or in a similar role. Proven experience with Azure cloud platforms and related architecture. Highly skilled in Python for data engineering, scripting, and automation. More ❯

We’re looking for an innovative Data Architect to lead the creation and rollout of a comprehensive Data Governance Strategy, alongside the implementation of a data platform. This role will be instrumental in ensuring organizational data is accurate, secure, compliant, and strategically utilized to unlock business value. This is a new role … created due to growth, offering an exciting opportunity to shape and lead our data governance and platform strategy from the ground up. Key responsibilities Design and implement a comprehensive data governance framework. Define and maintain data governance policies, standards, and procedures. Establish and lead a cross-functional Data Governance Council. Collaborate with … data owners, stewards, and custodians across departments to ensure alignment and accountability. Develop and enforce data quality standards, metrics, and monitoring processes. Ensure compliance with data protection regulations such as GDPR, CCPA, and other relevant standards. Evaluate, select, and implement data governance tools (e.g. data catalogues, data quality More ❯

plans at any time. The Opportunity This position will play a critical role in supporting the Production Finance team and key cross-functional partners across a range of data-related projects. The ideal candidate thrives in a fast-paced, collaborative environment, has strong data skills, and is passionate about innovation. Responsibilities include delivering rapid, high-profile … analyses using show-level data to support Public Relations & Government Relations teams in EMEA and globally, as well as providing guidance and support to non-technical stakeholders. The position involves quick-turnaround analysis, occasional longer-term strategic projects, and will dual-report to the Production Finance team in the UK and the Production Finance Operations & Innovation team in … Los Angeles. Responsibilities Data Extraction & Transformation: Extract, clean, and transform data from core systems such as the Global Spend Report (GSR) data model, Payroll Accounting Systems (PAS), and the Netflix Production Finance HUB. Aggregate and correlate data to accurately report on job counts, vendor spend, and location spend across multiple EMEA markets. More ❯

Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern … software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that supports Computacenters combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to … deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. What youll do As a Senior Data Consultant, you will play a key role in shaping and delivering data solutions that support business strategy. You will lead More ❯

We are looking for an experienced Data Engineer with broad technical skills and ability to work with large amounts of data. You will collaborate with the Game and Product[1] teams to implement data strategies and develop complex ETL pipelines that support dashboards for promoting deeper understanding of our games. You will have experience developing and … establishing scalable, efficient, automated processes for large-scale data analyses. You will also stay informed of the latest trends and research on all aspects of data engineering and analytics. You will work with leaders from an internal Game Studio, providing them with data for understanding game and player insights and report to the Technical … at least one of the programming languages like Python, C++[2] , Java ● Experience with version control and code review tools such as Git ● Knowledge of latest data pipeline orchestration tools such as Airflow ● Experience with cloud platforms (AWS, GCP, or Azure) and infrastructure-as-code tools (e.g., Docker, Terraform, CloudFormation). ● Familiarity with data quality More ❯

Data Engineer – SC Cleared - AWS Our client is establishing a new Data Team and requires a Data Engineer to design and implement the foundational data infrastructure. Current data is dispersed across multiple systems with inconsistent structures and limited automation. You will play a key role in creating scalable, secure data … that enable reliable ingestion, transformation, and delivery across the organisation.Due to the nature of the work, active SC clearance is required. Key Responsibilities Design, build, and maintain scalable data pipelines across AWS and Azure environments to ingest, transform, and store data from multiple sources. Develop and manage data models, schemas, and metadata to support … monitoring, alerting, and automated checks. Optimise data workflows for performance, cost-efficiency, and maintainability , using platforms such as Azure Data Factory, AWS Data Pipeline, Glue, Lambda, Databricks, and Apache Spark. Support the integration of transformed data into visualisation and analytical platforms , including Power BI, ServiceNow, and Amazon QuickSight. Ensure compliance with More ❯

Data Architect (Azure) 6 Month Contract UK Based Via Umbrella Our UK leading life and pensions client are looking for a Data Architect to joun their team on an initial 6 month contract. Key Responsibilities Data Architecture & Design Define and maintain enterprise data architecture standards, models, and frameworks. Design data solutions leveraging Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Data Integration & ETL Develop and optimize data pipelines for ingestion, transformation, and storage using Azure Data Factory and Databricks. Governance & Security Implement data governance, security … and compliance practices aligned with financial services regulations (e.g., GDPR, PCI DSS). Performance & Scalability Ensure data solutions are optimized for performance and scalability across large datasets. Collaboration Work closely with data engineers, analysts, and business stakeholders to deliver robust data platforms. Innovation Stay current with emerging Azure technologies and best practices in data More ❯

Lead Data Engineer Lead Data Engineer required to join my Client’s Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform. You will play a pivotal role in designing and maintaining a modern, cloud-based data architecture. Working closely with product, technology … and wider business stakeholders, you will be crucial in developing scalable data pipelines, improving reliability, and enabling smarter, data-driven insights and decisions. You will have a direct voice in how we design, build, and evolve our platform and the technologies we adopt! We are looking for a pragmatic, innovative, and self-motivated problem solver who … Architecture Specialist: Design and develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with cross-functional teams to More ❯

Job Description: Data Engineer (with Tableau Specialism) Responsibilities: * Design, develop, and manage data models, schemas, and metadata to support advanced analytics and reporting requirements. * Work closely with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability across the organisation. * Implement data quality checks … integrity and reliability. * Optimise data workflows for performance, cost-efficiency, and maintainability using tools such as Azure Data Factory, AWS Data Pipeline, Databricks, or Apache Spark . * Integrate and prepare data for Tableau dashboards and reports , ensuring optimal performance and alignment with business needs. * Collaborate with visualisation teams to … develop, maintain, and enhance Tableau data sources (including Extracts, Hyper files, and live connections) and to support self-service analytics. * Ensure compliance with data governance, security, and privacy policies , maintaining adherence to organisational standards. * Document data architecture, pipelines, and Tableau data models to promote transparency, maintainability, and knowledge sharing. * Contribute to the More ❯

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. … This opportunity is offered on a remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: Leading the design and implementation of innovative cloud … using Azure, AWS, or exceptional on-premise design expertise. At least 5 years in data engineering or business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, we’re always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector – we are always in search of the best … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

Robert Half have partnered with a market leading property development organisation for an experienced Azure Data Engineer to join their data and analytics team, on an initial 3-6 month contract based out of their London office The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines in … the Azure cloud environment, with hands-on experience in modern data platforms and ETL frameworks. Key Responsibilities: Design, develop, and maintain data pipelines and data integration solutions using Azure Data Factory, Synapse Analytics, and related services. Build and optimise data models to support reporting, analytics, and machine learning use cases. … Implement robust data quality, governance, and security practices across the data ecosystem. Collaborate with analysts, data scientists, and business stakeholders to understand data needs and translate them into technical solutions. Work with structured and unstructured data sources, ensuring scalability, reliability, and performance. Monitor and troubleshoot data workflows, ensuring More ❯

Pay: £450 - £550 per day Location - London (Hybrid) | Python | ETL | Impact-Driven Team We are partnering with a leading client seeking an Azure Data Engineer to join their team on an initial 6-month contract . This hybrid role requires 2 days per week onsite , offering the opportunity to design, build, and maintain cutting-edge data platforms.Data Engineering & Architecture: Design, build, and maintain scalable data pipelines and ETL/ELT processes using Azure services. Develop and optimize data lake and data warehouse solutions (eg, Azure Data Lake Storage, Azure Synapse Analytics). Implement best practices in data modelling, partitioning, and performance optimization. Support Real … Time and batch data processing workloads. Data Quality, Governance & Security Implement data validation, monitoring, and quality frameworks to ensure clean and trustworthy data. Work with the data governance team to ensure compliance with standards, policies, and privacy regulations. Maintain metadata, lineage, and documentation for all data solutions. Collaboration & Stakeholder Support More ❯

On behalf of our prestigious financial services client, we are seeking an experienced and strategicData Architect to lead the development and delivery of enterprise-wide data governance and architecture initiatives. This is a high-impact role that will shape the organisation's approach to data management, compliance, and innovation. Key Responsibilities: Strategic Framework & Governance Development Design … and implement a robust data governance framework, including policies, standards, and procedures. Define data ownership models and appoint data stewards across key domains. Introduce and manage a metadata catalogue to enhance data discoverability and transparency. Establish clear retention, access, and usage policies for various data types. Governance Leadership Set up … and lead a Data Governance Council to oversee governance strategy and execution. Collaborate with data owners, stewards, and custodians across departments to ensure consistency and accountability. Data Quality & Compliance Develop and maintain data quality standards and performance metrics. Ensure full compliance with data protection regulations, including GDPR and CCPA. Technology More ❯

Data Engineer Salary: Up to £75,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking to bring on a Data Engineer to help design … and deliver impactful data solutions using Azure. This is a hands-on role where you will work across the full data stack, collaborating with architects, analysts, and stakeholders to build a future-ready platform that drives insight and decision-making. In this role, you will be responsible for: Building and managing data pipelines using … Azure Data Factory and related services. Building and maintaining data lakes, data warehouses, and ETL/ELT processes. Designing scalable data solutions and models for reporting in Power BI. Supporting data migration from legacy systems into the new platform. Ensuring data models are optimised for performance and reusability. More ❯

Data Engineer Salary: Up to £75,000 I am working with a forward-thinking organisation that is modernising its data platform to support scalable analytics and business intelligence across the Group. With a strong focus on Microsoft technologies and cloud-first architecture, they are looking to bring on a Data Engineer to help design … and deliver impactful data solutions using Azure. This is a hands-on role where you will work across the full data stack, collaborating with architects, analysts, and stakeholders to build a future-ready platform that drives insight and decision-making. In this role, you will be responsible for: Building and managing data pipelines using … Azure Data Factory and related services. Building and maintaining data lakes, data warehouses, and ETL/ELT processes. Designing scalable data solutions and models for reporting in Power BI. Supporting data migration from legacy systems into the new platform. Ensuring data models are optimised for performance and reusability. More ❯

Head of Data Engineering Hybrid - Kent (3 Days per Week) Up to £130,000 + 30% Bonus + Benefits Are you an experienced data leader ready to take ownership of a large-scale data transformation? We’re working with a leading UK financial services group that’s on a major journey to modernise its … data estate — and they’re looking for a Head of Data Engineering to lead the migration from on-premise to a modern, Azure-based cloud platform. This is a high-impact leadership role, ideal for someone who combines strategic vision with hands-on technical credibility and thrives on building, scaling, and delivering enterprise-grade data … solutions. 💡 Why this role? Lead the migration of legacy on-premise systems to Azure , driving one of the organisation’s most strategic technology programmes. Shape and execute the data engineering roadmap , delivering scalable, secure, and compliant data solutions. Build and mentor a high-performing engineering team , embedding modern cloud-first practices. Hybrid flexibility: 3 days per More ❯

Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and commercial experience working with Microsoft Data Services to help our clients optimise their costs and maximise the benefits from their investments in these technologies. Coeo have a strong emphasis on consulting skills, and we expect … been established for over 17 years and has exclusively focused on Microsoft technologies. Our mission is to “ help our clients predict their future ” through the better use of data, technology, people and processes. To do this our business has always focused on Managed Services Data Platform Consultancy Analytics Consultancy Adoption and Change Management There has never … data solutions. Optimize database performance and troubleshoot any issues related to data warehousing, ETL and reporting tools. Provide ongoing support for the data pipeline and reporting systems, ensuring high availability and performance. Continuously evaluate and implement best practices for data management, reporting, and analytics. Required Skills and Qualifications: In-depth knowledge More ❯

AWS Data Engineer | £ 75 ,000 - £90,000 | Central London (Hybrid - 3 days on-site) We're proud to partner with a high-growth fintech on the lookout for an AWS Data Engineer to join their fast-paced, data-driven organisation. This role is a great opportunity for someone who's eager to make an … impact and get hands-on with modern tools. You'll design, build, and optimise scalable data pipelines and warehouse solutions while collaborating across teams to ensure reliable, secure, and efficient data infrastructure for the organisation. What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs and services Optimise data pipelines for performance, scalability, and reliability Collaborate with data scientists, analysts, and engineering teams to More ❯

Head of Data Engineering Hybrid - Kent (3 Days per Week) Up to £130,000 + 30% Bonus + Benefits Are you an experienced data leader ready to take ownership of a large-scale data transformation? We're working with a leading UK financial services group that's on a major journey to modernise its … data estate - and they're looking for a Head of Data Engineering to lead the migration from on-premise to a modern, Azure-based cloud platform. This is a high-impact leadership role, ideal for someone who combines strategic vision with hands-on technical credibility and thrives on building, scaling, and delivering enterprise-grade data … solutions. Why this role? Lead the migration of legacy on-premise systems to Azure , driving one of the organisation's most strategic technology programmes. Shape and execute the data engineering roadmap , delivering scalable, secure, and compliant data solutions. Build and mentor a high-performing engineering team , embedding modern cloud-first practices. Hybrid flexibility: 3 days per More ❯

Robert Half Technology are assisting a market leading real estate organisation to recruit a Data Engineer on a contract basis - Hybrid Working - London based - Outside IR35 In this role, you will manage and optimise the data infrastructure, driving insights and supporting our decision-making processes. Your expertise will be crucial in contributing to our organisation's … data-driven success. As a key member of our team, you will have the opportunity to work on exciting projects and make a significant impact on our business Role The Data Engineer will design, develop, and maintain data infrastructure to ensure reliability, scalability, and performance. Collaborate with data scientists and analysts to … integrity. Implement efficient data models and schemas for storage and retrieval. Optimise data processes for improved performance and efficiency. Troubleshoot and resolve data pipeline issues swiftly and effectively. Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills and knowledge. Profile The Data More ❯