1 to 25 of 893 Permanent Data Pipeline Jobs in the UK excluding London

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data … technical solutions. Communicate technical concepts effectively to both technical and non-technical audiences. Participate in code reviews and knowledge sharing sessions. Automation & DevOps: Implement automation for data pipeline deployments and other data engineering tasks. Work with DevOps teams to implement and Build CI/CD pipelines, for environmental deployments. Promote and implement DevOps best practices. … Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance More ❯

Head of Data Engineering - Preston A Head of Data Engineering/Data Engineering Manager to lead the design, development, and enhancement of the data infrastructure and pipelines is required by a leading company based in Preston. The role offers Hybrid working, so 2 - 3 days in the office a week. You must … solutions for delivering high-quality care. The ideal candidate will lead the design and execution of cloud-based based scalable data storage solutions, oversee ETL pipeline development and optimisation, establish and manage data schemas and dictionaries, develop data integration solutions, and lead data cleansing, validation, and enrichment processes. Duties … You'll be on the lookout for performance bottlenecks and working to optimise data processing and query performance. This will help make sure your data pipeline is scalable and ready to handle big loads. You'll also be setting up monitoring frameworks to keep an eye on how your data pipeline is More ❯

Role Title: Senior Data Engineer Department: IT and Business Change Reports To: Lead Stack Azure BI Developer Contract Type: Permanent Working Arrangements/Pattern: Full Time, 35 hours Working Location: FatFace HQ, Havant Who are we? For over 30 years, we’ve travelled, we’ve laughed, we’ve grown. We believe life is for living and more fun … environment free from prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary This role requires an experienced and technically skilled Senior Data Engineer to play a key role in our Data & Reporting team and drive the transformation of reporting services and data infrastructure, whilst acting as a … data into useful, actionable information. Key Contacts and Relationships: Data & Reporting Team : Collaborate closely with team members to support ETL processes, troubleshoot data pipeline issues, and improve data architecture. Internal Stakeholders : Work with various departments (e.g., finance, operations, marketing) to understand data requirements and provide fit-for-purpose analytical More ❯

Role Title: Senior Data Engineer Department: IT and Business Change Reports To: Lead Stack Azure BI Developer Contract Type: Permanent Working Arrangements/Pattern: Full Time, 35 hours Working Location: FatFace HQ, Havant Who are we? For over 30 years, we’ve travelled, we’ve laughed, we’ve grown. We believe life is for living and more fun … environment free from prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary This role requires an experienced and technically skilled Senior Data Engineer to play a key role in our Data & Reporting team and drive the transformation of reporting services and data infrastructure, whilst acting as a … data into useful, actionable information. Key Contacts and Relationships: Data & Reporting Team : Collaborate closely with team members to support ETL processes, troubleshoot data pipeline issues, and improve data architecture. Internal Stakeholders : Work with various departments (e.g., finance, operations, marketing) to understand data requirements and provide fit-for-purpose analytical More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior Data Engineer will take ownership of developing and integrating data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and More ❯

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an excellent opportunity for a Senior Data Engineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior Data Engineer will take ownership of developing and integrating … data pipelines across the business, supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

drive the accelerated digitalization of our talent. As the D&A Technical Lead for Smart Factories (Global), you will play a pivotal role in shaping and executing the Data Strategy for Smart Factory within Pet Nutrition Division. You will collaborate with cross-functional and cross-regional teams to develop, implement, and optimize Smart Factories strategies that align with … promotional opportunity with Mars before December 31, 2026. What are we looking for? 10+ years’ experience working in this space, with particular focus on working with Manufacturing, CPG data At least 5 years’ experience in a senior data/architecture/leadership role with demonstrable thought leadership abilities Experience in Architecture as a code approach. Experience … such as: Azure Stack \ Data Bricks \ Python (inc. Django framework) Manufacturing data platform tools like Thingworx, Litmus is a plus Experience in data pipeline architecture. Knowledge of containerisation/microservices (Kubernetes/docker). Knowledge of API architecture REST, Webhooks, SOAP. Experience working in a multi-business unit or multi-client environment that More ❯

Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the team optimize … workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will work closely … warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in designing and implementing data pipelines (ETL/ELT/streaming) for robust data ingestion, transformation, and distribution, ensuring access to More ❯

Job description Purpose of the Role We are looking for a world-class Data Architect to drive the data flows and analysis that powers F1. As a Lead Data Architect, you will be responsible for partnering with systems architects and business users to understand data management and integration requirements, which help the … team optimize workflows and feature delivery. You will also partner with software engineers to ensure that data integration, database architectures, and analytics capabilities are world championship material. You will partner with business functions and platform engineering to ensure the highest standards of operational excellence for our data platforms including monitoring, alerting, and problem resolution, and will … warehouse, data lake) systems. Ability to partner with less technical business users to understand, document, and optimize data flows between systems. Data Pipeline Design and Implementation: Experienced in designing and implementing data pipelines (ETL/ELT/streaming) for robust data ingestion, transformation, and distribution, ensuring access to More ❯

skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage, processing, and … analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and … load it into the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing More ❯

Job Title: Data Engineer Location: York (once a week) Department: Data & Business Intelligence Salary: £55,000 - 60,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Data Engineer, you will help shape and deliver the future of data … pipelines and high-quality data assets in line with designs, with progress updated via JIRA and any blockers identified and escalated. Ensure all data pipeline and quality issues are tracked with recommendations made for strategic improvements where there are repeated or high impacting issues Promote standards and best practices within the data More ❯

Job Title: Data Engineer Location: York (once a week) Department: Data & Business Intelligence Salary: £55,000 - 60,000 + Excellent Benefits Type: Full-Time, Permanent About the Role: WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Data Engineer to join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As a Data Engineer, you will help shape and deliver the future of data … pipelines and high-quality data assets in line with designs, with progress updated via JIRA and any blockers identified and escalated. Ensure all data pipeline and quality issues are tracked with recommendations made for strategic improvements where there are repeated or high impacting issues Promote standards and best practices within the data More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Job Title: Manager - Cloud Data Architect (AWS & Snowflake) Protiviti's UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. Our solutions range from data strategy and … governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms to lead the design and implementation of scalable, secure, and high-performance data solutions. You will play … a pivotal role in shaping our cloud data strategy, driving innovation, and mentoring teams to deliver enterprise-grade data architectures that enable advanced analytics and business intelligence for our clients. Key Responsibilities Architecture & Design Design end-to-end cloud data architectures using AWS and Snowflake, ensuring scalability, security, and performance. Define and promote best More ❯

Purpose of the Job: Design, build, and maintain robust data systems and pipelines that support data storage, processing, and analysis on the Cloud. Work with large datasets, ensuring data quality, scalability, and performance, while collaborating. closely with data scientists, analysts, and other engineering teams to understand their data needs and … provide them with high-quality, accessible data. They are responsible for ensuring that the underlying data infrastructure supports the organizations broader data and business goals, enabling more effective data-driven decision-making. Key Accountabilities: Design and implement scalable, efficient, and secure data architectures, ensuring optimal data flow across systems in … and process across the team along with BI lead. Influence the evolution of business and system requirements and contribute to the design of technical solutions to feed a delivery pipeline that increasingly employs Agile methods such as SCRUM and Kanban You will be required to develop unit tested code and then support test cycles including post implementation validation. You More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Overview We are seeking a highly skilled and detail-oriented Python Data Engineer to join our dynamic audit and risk technology team. Based fully onsite in our Birmingham office , you will play a critical role in designing, developing, and maintaining data … governance standards and regulatory requirements. Maintain accurate data dictionaries, metadata , and workflow documentation for transparency and team collaboration. Optimization & Best Practices Optimize dashboard and data pipeline performance through best practices in data visualization and coding standards . Contribute to the evolution of internal audit data strategy by integrating new technologies and More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯