26 to 50 of 964 Data Pipeline Jobs in the UK excluding London

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Rate : £600 to £650 per day outside IR35 Duration: 6 months Location: one day a week on site in London Security Clearance: Active SC The Data Architect will have the following responsibilities: Collaborate with business and technology stakeholders to translate business problems into scalable data architecture solutions. Design, document, and maintain enterprise and solution-level data architectures across multiple platforms and domains. Define and enforce data standards, principles, and governance frameworks to ensure consistency and quality. Develop conceptual, logical, and physical data models aligned with business needs and organisational strategy. Select appropriate data storage, integration, and processing technologies for each project’s context. Evaluate emerging tools, technologies, and … understanding of data modelling (conceptual, logical, and physical), including relational, dimensional, and NoSQL approaches. Expertise in data integration, ETL/ELT, and data pipeline design. Hands-on experience with data lakehouse, warehouse, and streaming data architectures. Working knowledge of SQL, Python, and relevant data engineering frameworks (e.g. More ❯

Practice Group/Department: Integrations/Development & Data Management Job Description We're Norton Rose Fulbright - a global law firm with over 50 offices and 7,000 employees worldwide. We provide the world’s preeminent corporations and financial institutions with a full business law service. At Norton Rose Fulbright, our strategy and our culture are closely entwined. We … as the relevant skills and experience, we're looking for people who are innovative, commercial and value the work that they do. We are embarking on an exciting Data Programme of work and are looking for a talented Data Engineer to join our team. You will play a crucial role in building and managing data pipelines that enable efficient and reliable data integration, transformation and delivery for all data users across the EMEA Region. 12 month FTC, possibility of being made permanent Responsibilities Design and develop data pipelines that extract data from various sources, transform it into the desired format, and load it into the More ❯

Data Architect page is loaded Data Architectremote type: Hybridlocations: Edinburgh, GB: London, GBtime type: Full timeposted on: Posted Todayjob requisition id: JR2477Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need … committed - we put customers at the heart of our decisions Future Focused - we accelerate change Curious - we turn knowledge into action Role Summary We are seeking an experienced Data Architect to lead, design and manage our modern data infrastructure, with a strong focus on Snowflake, data modelling, dbt, and data engineering. The … in designing enterprise ontologies and knowledge networks. Strong understanding of dimensional and normalized data modelling techniques. Hands-on expertise in dbt for data transformation and pipeline orchestration. Solid background in data engineering with proficiency in SQL and Python. Experience with ELT/ETL frameworks and modern data stack tools. Knowledge of More ❯

energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. JOB … growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

energy and utilities, financial services, government and public services, health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE … growth area for the business with a diverse and growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

over 10,000 people. Its big-scale stuff and we’re still growing. Job Purpose With a big investment into Databricks, and with a large amount of interesting data, this is the chance for you to come and be part of an exciting transformation in the way we store, analyse and use data in a fast … paced organisation. You will join as a Senior Platform Data Engineer providing technical leadership to the Data Engineering team. You will work closely with our Data Scientists and business stakeholders to ensure value is delivered through our solutions. Job Accountabilities Develop robust, scalable data pipelines to serve the easyJet analyst and data … time in a commercial production environment with Spark Streaming, Kafka, DLT or Beam. Understanding of the challenges faced in the design and development of a streaming data pipeline and the different options for processing unbounded data (pubsub, message queues, event streaming etc) Understanding of the most commonly used Data Science and Machine Learning More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data … solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data quality, metadata More ❯

Hatfield based (with min of 2 days in the office) Competitive basic salary + Core & flexible benefits Join Data Management within our Data & Analytics function. We operate across four pillars: Data Management, Data Strategy, Data Governance and Data Delivery. We work in agile, delivering in sprints with modern … software engineering and DevOps practices to ship reliable data products at pace. The team owns the Group Data Warehouse, a global data platform that supports Computacenters combined reporting requirements across the world. In Data Management, you will turn Data Demand into prioritised backlog requirements and partner with business units to … deliver maximum customer value from data. If you enjoy practical delivery, measurable outcomes and helping teams make better decisions with trusted data, you will fit right in. What youll do As a Senior Data Consultant, you will play a key role in shaping and delivering data solutions that support business strategy. You will lead More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … across every area of the business — from supply chain and logistics to marketing, customer sales and in-store operations. As part of this journey, they are expanding their Data Engineering team and looking for a Senior Data Engineer (Azure) to help shape and scale the next generation of data products and pipelines. The Role … As a Senior Data Engineer, you’ll play a key role in designing, building, and optimising scalable data pipelines and solutions on Microsoft Azure. You’ll work closely with Data Architects, Analysts, and stakeholders in the business to expand the current data platform — which already powers sales and performance dashboards — into a More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … across every area of the business — from supply chain and logistics to marketing, customer sales and in-store operations. As part of this journey, they are expanding their Data Engineering team and looking for a Senior Data Engineer (Azure) to help shape and scale the next generation of data products and pipelines. The Role … As a Senior Data Engineer, you’ll play a key role in designing, building, and optimising scalable data pipelines and solutions on Microsoft Azure. You’ll work closely with Data Architects, Analysts, and stakeholders in the business to expand the current data platform — which already powers sales and performance dashboards — into a More ❯

Senior Data Engineer (Azure) 2-3 days on-site - central London up to £75k + 20% Bonus + Excellent Benefits Our client is a leading global Retail/FMCG brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world-class data platform … across every area of the business — from supply chain and logistics to marketing, customer sales and in-store operations. As part of this journey, they are expanding their Data Engineering team and looking for a Senior Data Engineer (Azure) to help shape and scale the next generation of data products and pipelines. The Role … As a Senior Data Engineer, you’ll play a key role in designing, building, and optimising scalable data pipelines and solutions on Microsoft Azure. You’ll work closely with Data Architects, Analysts, and stakeholders in the business to expand the current data platform — which already powers sales and performance dashboards — into a More ❯

The Job As Principle Data Engineer, your responsibilities will include designing, developing, and implementing high-performance data pipelines using Azure Data Factory, Databricks, and other Azure data services. You will architect and manage data solutions using Azure Data Lake Storage, Databricks, Databricks DLT and Streaming and Event Based … Architectures. This role will see you collaborating with data scientists, analysts and other engineers to translate data requirements into technical solutions. You will also be responsible for driving best practices for data governance, data quality, data security and data lineage. About You You are a Data Engineer with extensive experience using Azure data platform services: Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Azure SQL Database and/or Azure Synapse Analytics. You will have strong SQL and excellent programming skills in Python (Scala is a strong advantage) as well as a solid understanding of data More ❯

About WillHire WillHire is a forward-thinking staffing and talent acquisition platform that helps top organizations discover exceptional talent. As part of our expansion into the Data Engineering vertical , were inviting analytical, detail-oriented, and passionate individuals to join our Data Engineering Internship Cohort . Role Overview As a Data Engineering Intern at WillHire … you will support our data and infrastructure teams in designing, building, and maintaining scalable data pipelines. Youll gain hands-on experience with modern data engineering tools, cloud platforms, and big data ecosystems while working in a fast-growing HR-tech environment. Key Responsibilities Assist in designing, developing, and maintaining ETL pipelines for … structured and unstructured data. Work with databases (SQL/NoSQL) to ensure data accuracy, integrity, and accessibility. Support integration of APIs and third-party data sources into the data ecosystem. Help optimize data storage, transformation, and retrieval for performance and scalability. Contribute to data quality checks, validation processes, and monitoring More ❯

algorithms. Lead the selection, validation, and optimization of models to discover meaningful patterns and insights, ensuring models remain relevant, reliable, and scalable. Drive continuous integration and deployment of data science solutions, optimizing performance through advanced machine learning techniques, code reviews, and best practices. 'Develop and deliver sophisticated visualizations, dashboards, and reports translate complex data into clear … actionable insights for business stakeholders. Present technical solutions to business stakeholders, using creative methods to explain complex concepts, increase understanding, and encourage solution adoption. Mentor and develop junior data scientists, fostering a culture of continuous learning, knowledge sharing, and skills development within the organization. Write clean, high-quality code, ensuring all outputs pass quality assurance checks, and contribute … Experience with MLOps practices including model drift detection, decay, A/B testing, integration testing, differential testing, Python package building, and code version control. Skilled in data pipeline creation and working with both structured and unstructured data. Familiar with cloud platforms (AWS, Azure, GCP) and containerization technologies like Docker and Kubernetes. Excellent problem-solving skills, combined with More ❯

Data Engineer | Hybrid | Pontypridd IntaPeople are proud and excited to be appointed to recruit an experienced Data Engineer for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data/IT function in this newly created position. You will … be joining the data team as one of the first employees in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and … management capability, lacks data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data processing, meeting the organisation’s More ❯

brands and an ever-expanding portfolio of market-leading events, we are shaping the future of business conversations – and we are just getting started. Purpose of Role As Data Manager you are the nerve-centre of BizClik’s data operations: every record that leaves a silo and lands in BigQuery travels a path you design, monitor … and improve. Reporting to the Director of Technology and leading a two-person data team, you architect resilient ELT pipelines in GCP Dataflow, design warehouse schemas that reflect how the business operates, and document not just the fields but the full context - what the data represents, who uses it, and how it connects to real-world … already know the answers. Your remit spans governance - access controls, retention rules, GDPR-safe handling - and the technical operations needed to keep data flowing and reliable, from pipeline monitoring to resolving issues when things break. You’re hands-on: writing SQL, tuning Dataflow jobs, tracking anomalies. You’re also strategic - prioritising the backlog, coaching the team, and More ❯

brands and an ever-expanding portfolio of market-leading events, we are shaping the future of business conversations – and we are just getting started. Purpose of Role As Data Manager you are the nerve-centre of BizClik’s data operations: every record that leaves a silo and lands in BigQuery travels a path you design, monitor … and improve. Reporting to the Director of Technology and leading a two-person data team, you architect resilient ELT pipelines in GCP Dataflow, design warehouse schemas that reflect how the business operates, and document not just the fields but the full context - what the data represents, who uses it, and how it connects to real-world … already know the answers. Your remit spans governance - access controls, retention rules, GDPR-safe handling - and the technical operations needed to keep data flowing and reliable, from pipeline monitoring to resolving issues when things break. You’re hands-on: writing SQL, tuning Dataflow jobs, tracking anomalies. You’re also strategic - prioritising the backlog, coaching the team, and More ❯

brands and an ever-expanding portfolio of market-leading events, we are shaping the future of business conversations – and we are just getting started. Purpose of Role As Data Manager you are the nerve-centre of BizClik’s data operations: every record that leaves a silo and lands in BigQuery travels a path you design, monitor … and improve. Reporting to the Director of Technology and leading a two-person data team, you architect resilient ELT pipelines in GCP Dataflow, design warehouse schemas that reflect how the business operates, and document not just the fields but the full context - what the data represents, who uses it, and how it connects to real-world … already know the answers. Your remit spans governance - access controls, retention rules, GDPR-safe handling - and the technical operations needed to keep data flowing and reliable, from pipeline monitoring to resolving issues when things break. You’re hands-on: writing SQL, tuning Dataflow jobs, tracking anomalies. You’re also strategic - prioritising the backlog, coaching the team, and More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

the Role We re working with a market-leading organisation that s undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you ll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … the business. This is a hands-on, strategic role where you ll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You ll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2 … using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable batch-first integration strategy with AS400 during its More ❯

the Role We're working with a market-leading organisation that's undergoing a major transformation, moving from manual, Excel-based reporting to a fully automated, intelligence-driven data ecosystem. As Data Architect, you'll be responsible for designing and implementing the Azure-based data platform that becomes the single source of truth across … the business. This is a hands-on, strategic role where you'll build scalable, governed data architecture and shape how data is used across Finance, Operations, and Commercial functions. What You'll Be Doing Data Architecture & Platform Design Design and implement an enterprise data lake on Azure Data Lake Gen2 … using Bronze/Silver/Gold architecture. Build and maintain scalable ETL/ELT pipelines in Azure Data Factory to integrate data from core systems (AS400, Tagetik, CRM, Esker, Slimstock). Develop the overall data model, data dictionaries, and lineage documentation. Deliver a stable “batch-first” integration strategy with AS400 during its More ❯