1 to 25 of 214 Data Pipeline Jobs in the South East

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Team Leadership Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Team Leadership Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

Radius is seeking a highly talented Data Architect and Governance lead for my client going through a digital transformation. Team Leadership Data Strategy Define and lead enterprise wide data strategy Design and maintain a scalable, secure data architecture Deep understanding of Data Governance, Modern data platforms: Cloud Data quality Management, metadata, lineage and data modelling Experience with Data integration, master data management (MDM) and designing scalable data pipelines Data Privacy, regulatory compliance, and security best practises BI Tools Power BI, Tableau, Looker proficient in data modelling, SQL, and cloud platforms - Azure, AWS, GCP and … their Data services Key Responsibilities Define and implement data architecture strategies in line with the Customer Journey programme Guide the data-driven decision-making process, ensuring that data is effectively utilised to inform business strategies and initiatives. Develop data plan to address data quality issues in line with More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data … driven business insights, Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models … using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data … driven business insights, Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models … using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You … ll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and … Guide: Provide technical leadership to data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You'll Be Responsible For: The More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Project Manager - Data Pipeline & Migration Location: South London (mainly remote with office travel 1-2 times p/month) The Role We're looking for an experienced Project Manager to take ownership of a high-profile project: building a new data pipeline and managing associated migration activities . You'll work closely with our … Data Engineering and Corporate Markets technology teams, collaborating with stakeholders, creating roadmaps, managing budgets, and ensuring delivery of quality outcomes on time. This is a hands-on role where you'll bring structure, clarity, and momentum to complex projects, ensuring they align with business goals and add real value. What You'll Be Doing Leading projects that deliver … teams to solve problems and keep delivery on track. Providing governance and reporting to ensure standards are met. What We're Looking For Proven experience managing data pipeline or data migration projects. Good knowledge of Agile methods, SDLC, Jira, Confluence, and project management tools. Strong planning and organisational skills with the ability to juggle competing More ❯

Azure Data Engineer Up to £74,000 + Benefits International Law Firm – London (Hybrid) I’m working with a highly respected international law firm that’s looking for a skilled and proactive Azure Data Engineer to join their forward-thinking Data team. This role is a great fit for someone who thrives on solving … complex data challenges and wants to directly influence how a global legal business uses its data to make smarter decisions. As part of the Strategy, Transformation & Project Delivery function, you’ll be instrumental in designing, developing, and optimising the firm’s Azure-based data infrastructure, from building scalable data pipelines to ensuring … data integrity, security, and compliance. The Role Data Infrastructure Development – Build and maintain scalable Azure data pipelines (following Senior Data Architect designs) using tools such as Azure Data Factory and Tray.io. Implement and manage data lakes and warehouses (Azure Synapse, Azure Data Fabric, etc.). Integration More ❯

Azure Data Engineer Up to £74,000 + Benefits International Law Firm – London (Hybrid) I’m working with a highly respected international law firm that’s looking for a skilled and proactive Azure Data Engineer to join their forward-thinking Data team. This role is a great fit for someone who thrives on solving … complex data challenges and wants to directly influence how a global legal business uses its data to make smarter decisions. As part of the Strategy, Transformation & Project Delivery function, you’ll be instrumental in designing, developing, and optimising the firm’s Azure-based data infrastructure, from building scalable data pipelines to ensuring … data integrity, security, and compliance. The Role Data Infrastructure Development – Build and maintain scalable Azure data pipelines (following Senior Data Architect designs) using tools such as Azure Data Factory and Tray.io. Implement and manage data lakes and warehouses (Azure Synapse, Azure Data Fabric, etc.). Integration More ❯

health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This … role offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health … impact. Key Responsibilities: Ensure data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and More ❯

We are looking for a Senior Data Engineer (m/f/d), based in London/Munich. Your Team The Pricing Data Engineering & Automation team is part of the Global Pricing department at Allianz Commercial and is responsible for driving the development of data solutions within Pricing across Allianz Commercial globally. You will … join an international department located across London, Munich, Bucharest, Chicago and New York. The Impact You Will Have Our global Pricing Data Engineering & Automation team is seeking an experienced Senior Data Engineer for a role within the Pricing Function. In this role, you will work closely with the Head of Pricing Data Engineering & Automation … level in a Numerical field, preferably with a strong focus on Computer Science or Data Engineering, or qualified by experience You have experience in data pipeline/ETL (Extract Transform Load) development, cleaning and bringing together multiple sources into a single production warehouse You have experience in analysing, debugging and solving highly complex problems You More ❯

Role: Head of Data Location: Milton Keynes (Hybrid 2 Days On-site Weekly) Salary: £50,000 - £60,000 Benefits: Bonus, Company Cars, Flexible Benefit Package Network IT is recruiting for a Head of Data to join a leading automotive brand's UK IT function. In this senior role, youll lead a high-performing data management team, drive technical delivery across enterprise data platforms, and ensure compliance, scalability, and performance within a global standards-based ecosystem. Reporting to the Head of IT, youll take ownership of operational excellence, stakeholder engagement, and vendor performance across a broad data estate including Azure Data Factory and Data Lake … Strong experience in IT service management, strategy planning, and business process alignment. Hands-on knowledge of Azure Data Factory, Data Lake , and data pipeline architecture. Proven experience managing data security, access, and regulatory compliance. Familiarity with automation tools (AI, RPA) and Agile project delivery (e.g. Scrum, Kanban). Demonstrated ability to More ❯

Senior Data Engineer Start - ASAP Duration - 3 months Rates - TBC Location - Chancery Lane Hybrid - 3 days onsite/2 days remote We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting … building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also. As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimising data workflows, and ensuring data … quality for production technology. The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key More ❯

Senior Data Engineer Start - ASAP Duration - 3 months Rates - TBC Location - Chancery Lane Hybrid - 3 days onsite/2 days remote We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting … building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also. As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimising data workflows, and ensuring data … quality for production technology. The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key More ❯

Senior Data Engineer Start - ASAP Duration - 3 months Rates - TBC Location - Chancery Lane Hybrid - 3 days onsite/2 days remote We are seeking a proactive and self-motivated Senior Data Engineer with a proven track record in building scalable cloud-based data solutions across multiple cloud platforms to support our work in architecting … building and maintaining the data infrastructure. The specific focus for this role will start with GCP however we require experience with Snowflake and Databricks also. As a senior member within the data engineering space, you will play a pivotal role in designing scalable data pipelines, optimising data workflows, and ensuring data … quality for production technology. The ideal candidate brings deep technical expertise in AWS, GCP and/or Databricks alongside essential hands-on experience building pipelines in Python, analysing data requirements with SQL, and modern data engineering practices. Your ability to work across business and technology functions, drive strategic initiatives, and independently problem solve will be key More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data infrastructure on Azure Data Lakes and Data Warehouses; create robust data transformation processes that ensure data quality, consistency and security and implement automation workflows. You will help to maintain compliance with ISO27001 and ISO13485 requirements for healthcare data management and ensure that security first practices are employed in More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Responsibilities: Design, develop, and maintain robust and scalable ETL/ELT pipelines using Snowflake as the data warehouse. Implement data transformations and build analytical data models using dbt (data build tool). Develop and optimize complex SQL queries for data extraction, transformation, and loading in Snowflake. Orchestrate and schedule data workflows using Apache Airflow, including developing custom Python operators and DAGs. Write efficient and maintainable Python scripts for data processing, automation, and integration with various data sources and APIs. Ensure data quality, integrity, and governance throughout the data lifecycle. Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver data solutions. Implement and maintain CI/CD pipelines for data engineering processes, including version control with Git. Monitor data pipelines, troubleshoot issues, and optimize performance for efficiency and cost-effectiveness. Qualifications: Strong More ❯

Join us as a Data Platform Engineer for our client. At Peregrine, were always seeking Specialist Talent that have the ideal mix of skills, experience, and attitude, to place with our vast array of clients. From Business Analysts in large government organisations to Software Developers in the private sector we are always in search of the best talent … you will be deployed across our portfolio of clients as a specialist consultant, working on a wide array of complex projects across multiple industries. The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while … enabling efficient access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance … with over 3 years of relevant experience in data engineering, platform engineering, or a related field, with demonstrated hands-on expertise in NiFi and data pipeline design in regulated environments. Responsibilities: Design, develop, and maintain robust and secure data pipelines using NiFi and related big data technologies. Troubleshoot and optimize NiFi More ❯

Month Contract Outside IR35 UK Based Candidates Only We are a dynamic and rapidly growing start-up company based in the UK, specialising in data visualisation, data engineering, digital transformation and AI. As we continue to expand our operations, we are looking for a motivated and talented Fabric data analyst to join our team … projects. This is an exciting opportunity for an ambitious individual to contribute to our success while gaining valuable experience in a fast-paced and innovative environment. Responsibilities: - Implement data modelling and ETL processes to integrate data from different sources into fabric data lake/data warehouse. - Collaborate with the data and analytics team to design, develop, and maintain Power BI reports and dashboards. - Analyse and interpret data to provide actionable insights and visualisations for various business stakeholders. - Work closely with other teams to gather requirements, understand data needs, and ensure the accuracy and relevance of reports. - Proactively identify data quality issues and More ❯

Month Contract Outside IR35 UK Based Candidates Only We are a dynamic and rapidly growing start-up company based in the UK, specialising in data visualisation, data engineering, digital transformation and AI. As we continue to expand our operations, we are looking for a motivated and talented Fabric data analyst to join our team … projects. This is an exciting opportunity for an ambitious individual to contribute to our success while gaining valuable experience in a fast-paced and innovative environment. Responsibilities: - Implement data modelling and ETL processes to integrate data from different sources into fabric data lake/data warehouse. - Collaborate with the data and analytics team to design, develop, and maintain Power BI reports and dashboards. - Analyse and interpret data to provide actionable insights and visualisations for various business stakeholders. - Work closely with other teams to gather requirements, understand data needs, and ensure the accuracy and relevance of reports. - Proactively identify data quality issues and More ❯