1 to 25 of 598 Data Pipeline Jobs in the UK

delivering large-scale data and analytical solutions in a cloud environment Hands-on experience with end-to-end data pipeline implementation on AWS, including data preparation, extraction, transformation & loading, normalization, aggregation, warehousing, data lakes, and data governance Expertise … architecture and data modelling practices Cost-effective management of data pipelines Familiarity with CI/CD driven data pipeline and infrastructure Agile delivery approach using Scrum and Kanban methodologies Ability to scope, estimate, and deliver committed work within deadlines, both independently ...

Data Architect Hybrid RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

Data Domain Architect - Nationwide At Places for People, we hire People, not numbers! So, if you like the sound of one of our jobs, please apply - you could be just who we're looking for! Of course, experience and track record are important, but we're more interested … Data Product Design Standards: Ensuring that data products are discoverable, interoperable, and trustworthy, adhering to high standards. Data Pipeline Design: Designing robust data pipelines, including batch, event-driven, and streaming architectures. Operational Considerations: Addressing operational concerns such as security, scalability, performance ...

Product Manager – Data & Data Science Remote (UK) Up to £90,000 + Benefits About the Company Our client is an award-winning search intelligence platform that helps global brands, marketers, and agencies gain an unparalleled understanding of the paid search landscape. Powered by patented AI technology … intelligence for over a decade. In 2024, they secured multiple industry awards including Best AI Search Software Solution , Best Use of AI for Data , and Best PPC Management Software Suite . You’ll be joining a business that combines the maturity and stability of an established company with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … data storage technologies including relational, columnar, document, NoSQL, data warehouses, and data lakes Implement modern data pipeline patterns, event-driven architectures, ETL/ELT processes, and stream processing solutions Translate business requirements into technical specifications and actionable solution designs Work with ...

data platforms on Microsoft Azure . The ideal candidate will have deep hands-on expertise in Azure Data Factory (ADF) pipeline engineering, SQL performance tuning , and end-to-end data integration architecture , along with a strong analytical mindset to troubleshoot complex data … ingestion, transformation, orchestration, and serving layers. Lead architectural decisions around scalability, resiliency, performance, security, governance, and cost optimization. Azure Data Factory (ADF) Pipeline Engineering (Core) Design, develop, test, and deploy Azure Data Factory pipelines following best practices (modular design, parameterization, reusability, CI/CD readiness ...

Lead Data Analyst Salary: Up to £70,000 + Benefits Location: Esher - Hybrid (4 days onsite, 1 day remote) Working Hours: Full time - PermanentA large well-established firm has recently implemented Microsoft Fabric and is now seeking a Lead Data Analyst to take ownership … organisation's data and analytics capability. This role will lead the development of the company's data platform, ensuring data is transformed into meaningful insights that support decision-making across the business. The Lead Data Analyst will work across the full data ...

Role: Data Migration Specialist - Defence Sector Location: London (On-site) Start Date: ASAP Contract: Freelance Duration: 12 Months + A leading organisation within the defence sector is seeking a Data Migration & Data Synchronisation Specialist to support a large-scale data transformation initiative. … This role requires a contractor experienced in designing and delivering secure data migration frameworks across complex enterprise environments, integrating both on-premise and cloud platforms. Candidates must be freelance contractors and have Security clearance or eligible for Security clearance due to the nature of the programme The successful ...

Role: Data Engineer (Automation) Location: Milton Keynes (Hybrid 3 Days In-Office Weekly) Salary: £45,000 - £55,000 Network IT are supporting a large, enterprise-scale organisation as they continue to evolve and modernise their Data Analytics and Automation Platform ; were looking for an experienced Data Engineer to design, build, and optimise secure, automated data pipelines that enable scalable analytics, business intelligence, and data-driven decision-making across multiple business units. This is a highly technical role with strong exposure to cloud and on-prem data platforms , automation ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … with Information Security to ensure compliant data handling. Participate in agile sprints, contributing to technical planning. Operational Ownership Monitor data pipeline health, performance, and reliability. Troubleshoot data issues swiftly, communicating effectively with stakeholders. Drive continuous improvement of the data platform ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … with Information Security to ensure compliant data handling. Participate in agile sprints, contributing to technical planning. Operational Ownership Monitor data pipeline health, performance, and reliability. Troubleshoot data issues swiftly, communicating effectively with stakeholders. Drive continuous improvement of the data platform ...

Role: Senior Data Engineer Background: Leveraging data analytics to provide insights and recommendations to drive strategic decision-making collaborating with cross-functional teams, including Finance, Accounting, Operations, HR, and others to deliver accurate and timely financial reporting, dashboards, analytics, and data-driven insights. … quality and integrity checks (row counts, duplicates, missing data, schema changes). * Review ETL/ELT job runs, data pipeline executions, and batch processes. * Validate data loads into staging, warehouse, and downstream systems for critical tables. * Monitor real-time and scheduled jobs ...

Technical Data Product Manager/Technical Data Product Owner/Head of Data Product/Senior Data Product Owner/Senior Data Product Manager We're looking for a number of Technical Data Product owners … conduit between the Data engineering and Platform team and our clients business stakeholders. You will be instrumental in ensuring the requirements are detailed and thorough, to enable the Data team to build and deliver effectively and efficiently. The role will be circa 40% working with ...

Elasticsearch, Milvus, pgvector), embedding models, and RAG architectures. Familiarity with document processing pipelines, chunking strategies, and semantic search patterns. · Familiarity with data pipeline and orchestration tools (e.g., Airflow, dbt, Spark, Kafka, cloud-native ETL tools) and batch vs. streaming patterns. · Understanding of data governance (catalog … model, and optimize for self-service analytics. · Familiarity with data science and ML workflows (feature engineering, experimentation, model training/deployment, RAG pipeline development, prompt engineering) and tools/languages such as Python, Spark, notebooks, and ML frameworks (e.g., scikit-learn, MLflow, TensorFlow/PyTorch, LangChain, LlamaIndex ...

Elasticsearch, Milvus, pgvector), embedding models, and RAG architectures. Familiarity with document processing pipelines, chunking strategies, and semantic search patterns. · Familiarity with data pipeline and orchestration tools (e.g., Airflow, dbt, Spark, Kafka, cloud-native ETL tools) and batch vs. streaming patterns. · Understanding of data governance (catalog … model, and optimize for self-service analytics. · Familiarity with data science and ML workflows (feature engineering, experimentation, model training/deployment, RAG pipeline development, prompt engineering) and tools/languages such as Python, Spark, notebooks, and ML frameworks (e.g., scikit-learn, MLflow, TensorFlow/PyTorch, LangChain, LlamaIndex ...

passionate about data and eager to advance your career in a dynamic environment? Join our client as a Data Engineer and drive the growth and efficiency of the Data Warehouse and Data Pipelines alongside a talented team. Why This Role Stands … models using dbt Core and VS Code. Data Source Integration: Integrate new data sources into the Data Pipeline and Data Warehouse. Essential Skills and Experience: SQL: Proficiency in PostgreSQL or Snowflake SQL. dbt Experience: Preferably with dbt Core. Business Process ...

Location: London, Watford or Bristol (Hybrid working options available) The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires strong expertise in Azure cloud services, Databricks, data engineering … DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain and enterprise data products. Overseeing Data Analysts ...

Palantir Data Engineer Our client is a Leading Digital Transformation Consultancy who have been named a Times Top 100 Company To Work For for 7 consecutive years. As a Palantir Data Engineer , you will join a highly regarded digital, data, and technology consultancy recognised … outcomes across public sector, healthcare, defence, and commercial environments . Our client has built a strong industry reputation for solving complex, large-scale data challenges, with recognition for engineering excellence, collaborative delivery, and long-term client impact. Our client is known for its people-first culture, investment ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...