1 to 25 of 1,151 Data Pipeline Jobs in the UK excluding London

Databricks ML and Azure ML to develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage … Minimum 10+ years of experience as a Data Engineer or similar role.* Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices.* Excellent problem-solving and analytical skills and strong communication and teamwork skills.Security ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … focus of the client engagement and your skillset, but could include and may require you to:Develop enterprise Conceptual, Logical, and Physical Data Models, conforming to national and international standards and conventions (e.g. ISO, UK Government Data Standards, NATO, etc).Provide leadership and guidance on enterprise ...

relationships, and the variety of our skills and expertise that we bring to help them achieve their mission. We’re growing our Data & AI Architecture teams. If you are cleared to SC level and want to grow your career in this sector, we are very keen to hear … focus of the client engagement and your skillset, but could include and may require you to:Develop enterprise Conceptual, Logical, and Physical Data Models, conforming to national and international standards and conventions (e.g. ISO, UK Government Data Standards, NATO, etc).Provide leadership and guidance on enterprise ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Contract Data Engineer - £375/day Inside IR35 - Immediate Start Please note - this is a hybrid role with 2-3 days per week required in London based office. You must have the unrestricted right to work in the UK to be eligible for this role - this organisation … data modelling, including schema design, partitioning, indexing, and performance optimisation. Proven experience with Azure Data Factory for ETL/ELT pipeline design, orchestration, and monitoring. Strong SQL skills, including queries, stored procedures, views, and performance tuning. Practical experience supporting data migration projects, including ...

growing world. We leverage cutting-edge technology to optimize operations, enhance customer experience, and drive business growth. We are seeking a Senior Data Engineer to join our team and play a pivotal role. About The Role At Maersk, we are redefining global logistics through data, platform … data ecosystems Operational Excellence Ensure data solutions are reliable, scalable, performant, secure, and production‐ready Monitor, troubleshoot, and continuously improve pipeline performance, data quality, and platform stability Drive automation, observability, and supportability across data, analytics, and AI/ML solutions ...

lead the development of high-quality BI, reporting and insight for NHS Essex ICB. This is a senior leadership role within the Data Analytics and Population Health Intelligence function, working alongside Data Engineering and Advanced Analytics colleagues to support strategic commissioning, performance oversight, service improvement … population health priorities.You will lead the BI function, setting standards for dashboards, reporting products, data visualisation, insight generation and analytical quality. Help ensure that senior leaders, programme boards and system partners have access to clear, reliable and actionable intelligence to support decision-making across Essex.This is an opportunity ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

Role Profile Job Title: Data Engineering & Insights Manager (Hybrid Working Policy) 2 days a month. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside … delivery of high-quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted ...

NEXT CHAPTER STARTS WITH YOU. Data Engineer Build trusted data products that turn complexity into confident decisions Vanquis is strengthening how it uses data to improve customer outcomes, insight and competitive advantage. This is an opportunity to help shape a modern, cloud-first data … tools that improve time to market. Learning together. We document well, share experience and help the wider engineering community grow. Technology stack Snowflake – ELT pipeline development – Agile and DevOps Coalesce – Data modelling and data marts – CI/CD and test automation SQL – Metadata-driven pipelines ...

complex system questions and translate findings into clear intelligence that supports senior decision making.The role will work closely with colleagues across analytics, BI, data engineering, information governance, commissioning and system partners, while focusing on advanced analysis, evidence generation and evaluation rather than routine reporting or dashboard development.Main duties … skills, sound judgement, and the ability to work collaboratively across organisational boundaries. You will support the development of advanced analytical capability within the Data, Analytics and Population Health Intelligence function and help ensure analysis is robust, proportionate and useful for decision making.About usNHS Essex ICB is a statutory ...

Closing date: 2026-10-18Location: CardiffSalary: Competitive Salary DOE (per annum)Job type: PermanentWorking pattern: Full timeIndustry: Banking & Financial Services/Data & Advanced AnalyticsCompany: HaysConsultant: Adam SinclairHays office: London-City — 5th Floor, 107 Cheapside,Phone: 0333 010 6203Email: adam.sinclair@hays.comRole ProfileJob Title: Data Engineering & Insights … Manager (Hybrid Working Policy) 1 day a week.Reports To: Chief Innovation OfficerRole PurposeThe Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society’s data platforms, alongside the delivery of high-quality, business-ready insights that support strategic decision-making ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world. Our mission-first software and data engineering platform modernizes data operations … utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact. We are committed to delivering cutting-edge tools and capabilities that address the most complex ...

about making a positive impact, we'd love to have you on our team. About the role We are seeking a Data Pipeline Manager to join the team at Valpak on a permanent basis. This role offers primarily remote working, with occasional travel to our Stratford-upon … Avon office, typically once per quarter. As the Data Pipeline Manager, you will lead a team of 2 responsible for building and maintaining scalable, reliable data pipelines that support enterprise reporting and analytics. You will oversee the development and optimisation of Talend-based data ...

Data Pipeline Manager - Remote Working (UK) - Qlik/ADF - Up to £55,000 Are you working with ETL tools and data pipelines but looking for a role where you can have more influence, take ownership and help shape how data integration is done … built a reputation for looking after its people. You Will Work With Leading and supporting a small team responsible for data pipeline development Driving the implementation and adoption of Qlik Talend Building, improving, and maintaining scalable ETL pipelines Working closely with stakeholders to understand requirements and priorities ...

Data Architect is responsible for designing, building, and managing the data warehouse’s data architecture, ensuring it is scalable, secure, and optimized for performance. This position plays a crucial role in shaping our data strategy, working across multiple departments to design … implement a robust data ecosystem that supports our business intelligence, analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud ...

Manager AI & Data Architect London | Up to £90,000 Were working with a leading change and transformation consultancy that helps organisations turn strategy into practical solutions that deliver lasting impact. Theyre looking for a Manager AI & Data Architect to join their Technology & Data Practice … London. This is an opportunity for an experienced data professional to take ownership of end-to-end data architecture, working across modern data platforms, cloud technologies, analytics and AI to solve complex business challenges. What youll be doing Design and deliver ...

recruiting for a Head of Dat for a Not for Profit based in London. You as the Head of Data will focus of the Data strategy, governance & quality. You will Modernise the cloud data infrastructure, including Microsoft Fabric & Power BI Analytics, MI & self-service … reporting. Building data literacy across the organisation. Head of Data Location: London - Hybrid Salary: £70,000-£96,000 per annum Contract: Permanent, Full Time The Client- Our client is a well-established professional organisation with a strong reputation within its sector and an important role ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

Requirement (NFR).Excellent SQL Skills with Data Warehousing and Data Lake understanding.Understand Data Model, ETL Data Pipeline, Data Lineage.An understanding of Data Products, business analysis techniques, including requirement gathering, documentation, function design and process flows.Articulate your ideas … able to articulate technical concepts to non-technical stakeholders.Some other highly valued skills include:Understanding of Data Model, ETL Data Pipeline and Data Lineage. Ability to analyse large volumes of data and articulate findings.Good understanding of SDLC and Agile Delivery processes. ...

Requirement (NFR).Excellent SQL Skills with Data Warehousing and Data Lake understanding.Understand Data Model, ETL Data Pipeline, Data Lineage.An understanding of Data Products, business analysis techniques, including requirement gathering, documentation, function design and process flows.Articulate your ideas … able to articulate technical concepts to non-technical stakeholders.Some other highly valued skills include:Understanding of Data Model, ETL Data Pipeline and Data Lineage. Ability to analyse large volumes of data and articulate findings.Good understanding of SDLC and Agile Delivery processes. ...

competitive salary, and opportunities for professional development. Apply now to make a difference in our community! We are seeking a dedicated and experienced Data Engineer to join our Insights team. At North East and North Cumbria Integrated Care Board, we are committed to providing high-quality care … modifying and supporting data pipelines or data processing solutions in production or operational environments. Diagnosing and resolving data pipeline, data quality or processing issues, identifying root causes and taking corrective action within agreed parameters. Supporting the deployment of data ...

help transform airport travel. Together, we can reach new heights. Together, we are Cavu. The role We're looking for an experienced Lead Data Engineer to play a critical role in shaping and evolving CAVU's data platform, enabling data-driven decision-making across … products and business. Reporting to the Head of Data Engineering, you'll lead a team of Data Engineers while remaining hands-on in the design, development and optimisation of our modern data ecosystem. You'll help define technical strategy, drive engineering best practice ...