1 to 25 of 562 Data Pipeline Jobs in the UK

delivering large-scale data and analytical solutions in a cloud environment Hands-on experience with end-to-end data pipeline implementation on AWS, including data preparation, extraction, transformation & loading, normalization, aggregation, warehousing, data lakes, and data governance Expertise … architecture and data modelling practices Cost-effective management of data pipelines Familiarity with CI/CD driven data pipeline and infrastructure Agile delivery approach using Scrum and Kanban methodologies Ability to scope, estimate, and deliver committed work within deadlines, both independently ...

Data Architect Hybrid RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

Data Domain Architect - Nationwide At Places for People, we hire People, not numbers! So, if you like the sound of one of our jobs, please apply - you could be just who we're looking for! Of course, experience and track record are important, but we're more interested … Data Product Design Standards: Ensuring that data products are discoverable, interoperable, and trustworthy, adhering to high standards. Data Pipeline Design: Designing robust data pipelines, including batch, event-driven, and streaming architectures. Operational Considerations: Addressing operational concerns such as security, scalability, performance ...

Fabric. The ideal candidate will have strong expertise in modern data architecture, cloud-based analytics, and end-to-end data pipeline development. You will work closely with data analysts, data scientists, and business stakeholders to deliver high-quality, reliable, and secure … transformation. Experience with cloud platforms, preferably Microsoft Azure. Understanding of data governance, security, and compliance frameworks. Key Skills Data Pipeline Development Cloud Data Architecture Data Modeling & Optimization ETL/ELT Frameworks Performance Tuning Stakeholder Communication To apply for this role ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

data platforms on Microsoft Azure . The ideal candidate will have deep hands-on expertise in Azure Data Factory (ADF) pipeline engineering, SQL performance tuning , and end-to-end data integration architecture , along with a strong analytical mindset to troubleshoot complex data … ingestion, transformation, orchestration, and serving layers. Lead architectural decisions around scalability, resiliency, performance, security, governance, and cost optimization. Azure Data Factory (ADF) Pipeline Engineering (Core) Design, develop, test, and deploy Azure Data Factory pipelines following best practices (modular design, parameterization, reusability, CI/CD readiness ...

Lead Data Analyst Salary: Up to £70,000 + Benefits Location: Esher - Hybrid (4 days onsite, 1 day remote) Working Hours: Full time - PermanentA large well-established firm has recently implemented Microsoft Fabric and is now seeking a Lead Data Analyst to take ownership … organisation's data and analytics capability. This role will lead the development of the company's data platform, ensuring data is transformed into meaningful insights that support decision-making across the business. The Lead Data Analyst will work across the full data ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data Engineer role focused on designing and delivering modern data platforms using Microsoft technologies. As a Senior Data Engineer , you will work across a varied client base, taking ownership of data solutions from initial scoping through to build and delivery. The Role Senior ...

Role: Data Migration Specialist - Defence Sector Location: London (On-site) Start Date: ASAP Contract: Freelance Duration: 12 Months + A leading organisation within the defence sector is seeking a Data Migration & Data Synchronisation Specialist to support a large-scale data transformation initiative. … This role requires a contractor experienced in designing and delivering secure data migration frameworks across complex enterprise environments, integrating both on-premise and cloud platforms. Candidates must be freelance contractors and have Security clearance or eligible for Security clearance due to the nature of the programme The successful ...

Role: Data Engineer (Automation) Location: Milton Keynes (Hybrid 3 Days In-Office Weekly) Salary: £45,000 - £55,000 Network IT are supporting a large, enterprise-scale organisation as they continue to evolve and modernise their Data Analytics and Automation Platform ; were looking for an experienced Data Engineer to design, build, and optimise secure, automated data pipelines that enable scalable analytics, business intelligence, and data-driven decision-making across multiple business units. This is a highly technical role with strong exposure to cloud and on-prem data platforms , automation ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … with Information Security to ensure compliant data handling. Participate in agile sprints, contributing to technical planning. Operational Ownership Monitor data pipeline health, performance, and reliability. Troubleshoot data issues swiftly, communicating effectively with stakeholders. Drive continuous improvement of the data platform ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … with Information Security to ensure compliant data handling. Participate in agile sprints, contributing to technical planning. Operational Ownership Monitor data pipeline health, performance, and reliability. Troubleshoot data issues swiftly, communicating effectively with stakeholders. Drive continuous improvement of the data platform ...

Role: Senior Data Engineer Background: Leveraging data analytics to provide insights and recommendations to drive strategic decision-making collaborating with cross-functional teams, including Finance, Accounting, Operations, HR, and others to deliver accurate and timely financial reporting, dashboards, analytics, and data-driven insights. … quality and integrity checks (row counts, duplicates, missing data, schema changes). * Review ETL/ELT job runs, data pipeline executions, and batch processes. * Validate data loads into staging, warehouse, and downstream systems for critical tables. * Monitor real-time and scheduled jobs ...

Technical Data Product Manager/Technical Data Product Owner/Head of Data Product/Senior Data Product Owner/Senior Data Product Manager We're looking for a number of Technical Data Product owners … conduit between the Data engineering and Platform team and our clients business stakeholders. You will be instrumental in ensuring the requirements are detailed and thorough, to enable the Data team to build and deliver effectively and efficiently. The role will be circa 40% working with ...

passionate about data and eager to advance your career in a dynamic environment? Join our client as a Data Engineer and drive the growth and efficiency of the Data Warehouse and Data Pipelines alongside a talented team. Why This Role Stands … models using dbt Core and VS Code. Data Source Integration: Integrate new data sources into the Data Pipeline and Data Warehouse. Essential Skills and Experience: SQL: Proficiency in PostgreSQL or Snowflake SQL. dbt Experience: Preferably with dbt Core. Business Process ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

Data Engineer/London OR Newcastle/Hybrid/Permanent We're recruiting an Azure Data Engineer to join a growing data function, playing a key role in designing, building, and maintaining scalable data infrastructure that supports analytics, insight, and automation across … access controls, and security standards Support self-service analytics by enabling clean, well-structured datasets Proactively identify and resolve data issues and pipeline failures Skills & Experience Strong experience designing and building ETL workflows and data pipelines Experience integrating data from APIs, databases ...

Title Pre-Sales Data and GCP AI Solution Architect About the Role Design and implement a comprehensive strategy for migrating and modernizing existing relational on premise databases, data warehouses (Teradata, Hadoop, Netezza, AWS, Azure) to scalable and cost-effective solution on Google Cloud Platform (GCP). … Responsibilities • Prepare Data & AI Industry Specific GTM by conducting Research & Analyze Industry Outlook/Emerging Agentic AI Trends and define HCLTech POV/Approach for Foundational Unified Data Platform/Capability & Strategic Tooling Blueprint/Data to AI Democratization/Common Data ...