1 to 25 of 540 Permanent Data Pipeline Jobs in the South East

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

Role Title: Senior Data Engineer Department: IT and Business Change Reports To: Lead Stack Azure BI Developer Contract Type: Permanent Working Arrangements/Pattern: Full Time, 35 hours Working Location: FatFace HQ, Havant Who are we? For over 30 years, we’ve travelled, we’ve laughed, we’ve grown. We believe life is for living and more fun … environment free from prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary This role requires an experienced and technically skilled Senior Data Engineer to play a key role in our Data & Reporting team and drive the transformation of reporting services and data infrastructure, whilst acting as a … data into useful, actionable information. Key Contacts and Relationships: Data & Reporting Team : Collaborate closely with team members to support ETL processes, troubleshoot data pipeline issues, and improve data architecture. Internal Stakeholders : Work with various departments (e.g., finance, operations, marketing) to understand data requirements and provide fit-for-purpose analytical More ❯

Role Title: Senior Data Engineer Department: IT and Business Change Reports To: Lead Stack Azure BI Developer Contract Type: Permanent Working Arrangements/Pattern: Full Time, 35 hours Working Location: FatFace HQ, Havant Who are we? For over 30 years, we’ve travelled, we’ve laughed, we’ve grown. We believe life is for living and more fun … environment free from prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary This role requires an experienced and technically skilled Senior Data Engineer to play a key role in our Data & Reporting team and drive the transformation of reporting services and data infrastructure, whilst acting as a … data into useful, actionable information. Key Contacts and Relationships: Data & Reporting Team : Collaborate closely with team members to support ETL processes, troubleshoot data pipeline issues, and improve data architecture. Internal Stakeholders : Work with various departments (e.g., finance, operations, marketing) to understand data requirements and provide fit-for-purpose analytical More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the team optimize … workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will work closely … warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in designing and implementing data pipelines (ETL/ELT/streaming) for robust data ingestion, transformation, and distribution, ensuring access to More ❯

Job description Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the … team optimize workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will … warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in designing and implementing data pipelines (ETL/ELT/streaming) for robust data ingestion, transformation, and distribution, ensuring access to More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. Our solutions range from data strategy and … governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will play … a pivotal role in shaping our cloud data strategy, driving innovation, and mentoring teams to deliver enterprise-grade data architectures that enable advanced analytics and business intelligence for our clients. Key Responsibilities Architecture & Design Design end-to-end cloud data architectures using AWS and Snowflake, ensuring scalability, security, and performance. Define and promote best More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern … software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that supports Computacenters combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to … deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. What youll do As a Senior Data Consultant, you will play a key role in shaping and delivering data solutions that support business strategy. You will lead More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … across every area of the business — from supply chain and logistics to marketing, customer sales and in-store operations. As part of this journey, they are expanding their Data Engineering team and looking for a Senior Data Engineer (Azure) to help shape and scale the next generation of data products and pipelines. The Role … As a Senior Data Engineer, you’ll play a key role in designing, building, and optimising scalable data pipelines and solutions on Microsoft Azure. You’ll work closely with Data Architects, Analysts, and stakeholders in the business to expand the current data platform — which already powers sales and performance dashboards — into a More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … across every area of the business — from supply chain and logistics to marketing, customer sales and in-store operations. As part of this journey, they are expanding their Data Engineering team and looking for a Senior Data Engineer (Azure) to help shape and scale the next generation of data products and pipelines. The Role … As a Senior Data Engineer, you’ll play a key role in designing, building, and optimising scalable data pipelines and solutions on Microsoft Azure. You’ll work closely with Data Architects, Analysts, and stakeholders in the business to expand the current data platform — which already powers sales and performance dashboards — into a More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000–£100,000 Sector: Fintech We’re looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who … began their career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You’ll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines … and models that support decision-making across the business. This is a hands-on, collaborative role, suited to someone who’s confident communicating with data, product, and engineering teams, not a “heads-down coder” type. Top 4 Core Skills Python — workflow automation, data processing, and ETL/ELT development. Snowflake — scalable data architecture, performance More ❯

Data Engineer (with Data Analytics Background) Location: City of London Employment Type: Full-time Salary: £90,000–£100,000 Sector: Fintech We’re looking for a well-rounded, communicative Data Engineer with a strong background in data analytics and experience within the Fintech sector . This role is ideal for someone who … began their career as a Data Analyst and has since transitioned into a more engineering-focused position, someone who enjoys understanding the business context just as much as building the data solutions behind it. You’ll work extensively with Python , Snowflake , SQL , and dbt to design, build, and maintain scalable, high-quality data pipelines … and models that support decision-making across the business. This is a hands-on, collaborative role, suited to someone who’s confident communicating with data, product, and engineering teams, not a “heads-down coder” type. Top 4 Core Skills Python — workflow automation, data processing, and ETL/ELT development. Snowflake — scalable data architecture, performance More ❯

Contract Role – Data AWS Engineer – Northampton/Hybrid – 6 months – Inside IR35 7+ years of experienced in designing, building, and maintaining data pipelines and architectures on the Amazon Web Services (AWS) cloud platform. Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis. This involves … designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements Role Overview: Job Title: Data AWS Engineer Location: Northampton (hybrid: 2-3 days in office) Contract Type: Contract Duration: 6 months Key Responsibilities: Designing and Building Data Pipelines: Creating and implementing data pipelines … to move data between different systems and applications on AWS. Data Warehouse Management: Designing, building, and maintaining data warehouses using AWS services like Redshift. ETL Process Development: Developing and maintaining Extract, Transform, Load (ETL) processes to move and transform data. Data Governance and Security: Implementing data governance and security policies More ❯

Data Engineer – Python | SQL | Azure | Microsoft Fabric Location: London Salary: £90,000 + benefits Financial Services Are you a skilled Data Engineer with strong coding expertise and a passion for building scalable data solutions? We’re looking for a talented professional to join our team and play a key role in designing, developing, and … optimising modern data platforms on Azure Cloud — with a focus on an exciting Microsoft Fabric implementation. What you’ll do Design and build robust data pipelines and ETL processes using Python and SQL. Contribute to the rollout and optimisation of Microsoft Fabric, shaping the next-generation data platform. Work across Azure services (Data Factory, Synapse, Databricks, Data Lake, Functions) to deliver secure and scalable data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Collaborate with analysts, data scientists, and business stakeholders to ensure high-quality, trusted data is available for decision-making. Implement best practices for data More ❯