1 to 25 of 350 Data Pipeline Jobs in the UK excluding London

summary Join Essex ICB as our Head of Data Engineering (Data Architecture & Engineering) and help shape how data improves health and care for a population of 2 million people. This strategic leadership role is central to developing secure, scalable data platforms that … support population health management, integrated care and evidence-based decision making. You will lead enterprise data architecture and engineering capabilities, ensuring trusted, high-quality and timely data flows across the health and care system. Working with senior leaders, clinicians, analysts and partners, you will translate strategic ...

Minimum 10+ years of experience as a Data Engineer or similar role. Proven expertise in the technologies below, and data pipeline development and strong understanding of data warehousing concepts and practices. Excellent problem-solving and analytical skills and strong communication and teamwork skills. … Databricks ML and Azure ML to develop predictive models and drive business insights. Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage ...

Data Architect Inside IR35 up to £600+ Nottingham Hybrid Summary We're undertaking a fast paced data transformation into Databricks at E.ON Next using best practice data governance and architectural principles, and we are growing our data engineering capability within the Data … data storage concepts and logical data structures i.e. data warehousing. - Able to make recommendations for data pipeline design based on business requirements. - Be open to new ways of working, and open to working with new technologies. - Be able to set your ...

Manchester (Data Engineer, Senior Data Engineer, ETL, AWS, AWS Glue, AWS Lambda, AWS S3, AWS Redshift, Amazon EMR, Python, SQL, Pipeline Orchestration, PySpark, data warehousing, data lakehouse, data architecture, Agile, Senior Data Engineer, Data Engineer … proficiency, including experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. Proven expertise in Python, SQL, Pipeline Orchestration and PySpark is also expected, as is experience with data lakehouse architectures and data warehousing solutions. Agile experience ...

Title: Data Engineering & Insights Manager (Hybrid Working Policy) 1 day a week. Reports To: Chief Innovation Officer Role Purpose The Data Engineering & Insights Manager is responsible for leading the design, build and operation of the Society's data platforms, alongside the delivery of high … quality, business-ready insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight ...

Data Engineer Location: London (Hybrid) Salary: Up to £75,000 + Bonus + Benefits Technology: SQL, Python, Spark - Azure, AWS, GCP - ETL/ELT - Data Governance The Opportunity Are you a Data Engineer looking for an opportunity to work on large-scale data transformation programmes whilst helping shape enterprise-wide data strategy? We're partnering with an organisation that is making significant investments in its data capabilities and digital transformation journey. Data sits at the heart of business decision-making, making this an excellent opportunity ...

Week) 550 per day (Outside IR35) 6-Month Initial Contract We're working with a large, technology-driven organisation undergoing a significant data transformation programme and seeking an experienced Data Architect to play a pivotal role in shaping its enterprise data landscape. This … exciting opportunity to help unlock the value of a complex and diverse data estate, enabling the creation of unified customer and property data views, supporting system integrations and migrations, and establishing best-in-class data architecture and governance practices. The Role As a Data ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

Senior Data Scientist Welwyn Garden City, Hertfordshire or Slough, Berkshire | Hybrid (2 Days Office) | Python | SQL | PySpark | Azure | Databricks | Machine Learning | Statistics | Time Series Forecasting | Propensity Models Role: Senior Data Scientist, Lead Data Scientist, ML Scientist, AI Data Scientist, Statistical Data Scientist, Predictive Analytics Key Skills: Senior Data Scientist, Data Scientist, Machine Learning, Artificial Intelligence, Predictive Analytics, Statistical Modelling, Python, SQL, PySpark, Azure, Databricks, MLflow, GitHub Actions, CI/CD, Time Series Forecasting, Propensity Modelling, Feature Engineering, Data Engineering, Azure Machine Learning, Azure ...

platforms so they are reliable, secure, and easy to change. You will work across engineering and operations to automate delivery, improve data pipeline observability, and embed good governance so analytics and AI workloads can run at scale. You will be part of the Data Platforms … restricted environments. Delivering data applications in an automated and continuous fashion. Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes) Building data pipelines using both cloud-native and open-source data ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With The Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety … projects and sectors. Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference ...

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...

About the Role We are seeking an experienced Data Engineer with deep expertise in Snowflake to join a growing Data & Analytics function. This is an exciting opportunity to play a pivotal role in designing, developing and optimising an enterprise data platform that underpins business … intelligence, reporting and analytics across the organisation. The successful candidate will be responsible for building scalable, high-performance data solutions within Snowflake , designing robust data architectures, and developing modern data pipelines that transform data into trusted, business-ready information. This role will ...

Principal Data Engineer – Hybrid/Remote – (SC Cleared) THE COMPANY: A leading organisation undergoing a significant digital transformation is looking to appoint a Principal Data Engineer to play a key role in shaping its enterprise data platform and future analytics capabilities. Joining a growing … Data & Integration function, you’ll work alongside architects, product owners, and engineering teams to deliver modern, cloud-based data solutions that support business-critical decision-making. This is an opportunity to influence technical strategy, establish engineering standards, and drive the adoption of modern DataOps and cloud ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … Fabric experiences to operationalise models and drive business insights. Design, monitor and optimise data pipelines and platform performance: Use Fabric capacity management, pipeline monitoring, logging, and operational best practices to improve reliability, throughput, cost, and scalability. Collaborate with cross-functional teams: Work closely with business analysts, data ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Principal Data Engineer - Secure Digital Platform (SDP) Data and Integration Location: Reading (hybrid working) Duration: Initially Until Feb '27 - but very likely to extend (new programme) (Inside IR35) Active SC Clearance Required Role details: We are looking for SC cleared Data Engineers to support … defence client on a contract basis. This role is focused on the Secure Digital Platform (SDP) Data and Integration, and will be based in Reading with hybrid working arrangements. The initial contract will run until February 2027, with a strong likelihood of extension as this is a long ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … ready architectures, taking end to end ownership from vision through to delivery and value realisation You will be part of the Data Platforms team that is part of the Insights and Data Global Practice that has seen strong growth and continued success across a variety ...

Overview This is an exciting opportunity for a technically minded Data Engineer to join a growing and innovative organisation working at the forefront of data-driven solutions. Youll play a key role in building, maintaining, and optimising data systems that support operational performance … reporting. This role offers exposure to modern data tools, cloud technologies, and large-scale datasets, making it ideal for someone looking to develop a career in data engineering. Data Engineer Key Responsibilities Data Integration & ETL Design, develop, and optimise ETL processes ...

Description We are seeking an experienced Data Engineer to join our Group Technology team on a 9-month contract. You’ll play a key role in delivering Connells Group Reporting Data, covering medallion architecture, data modelling, design, and pipelines. You’ll work closely with … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Lead Data Engineer/Data Tech Lead Permanent, Leeds/Hybrid Who are we? Enablis is a technology delivery consultancy who partner with clients to accelerate digital roadmaps. By combining our deep knowledge and best practice experience with the client’s domain expertise, we are able … open the door to incredible opportunities and introduce you to a network of equally driven, like-minded professionals. Job Brief The Lead Data Engineer role is responsible for owning the technical direction, design and delivery of data platforms and data engineering solutions ...

automation in data engineering — this is a small team that needs to move fast, and we expect the use of AI‐assisted pipeline development and management to be embedded in how we work Data Governance Lead the Data Governance function from a standing … alongside a technology partner or platform team (similar to our Ingenuity relationship) Demonstrated use of AI in data engineering contexts — AI‐assisted pipeline development, automated quality monitoring, or similar Strong leadership and stakeholder management skills — able to influence at Director and C‐suite level Experience ...

IntaPeople are seeking an experienced Data Engineer to join one of their financial services focussed clients based in South Wales. This role is critical to transforming a reporting-led organisation into a proactive, insight-driven business. The Data Engineer will be responsible for developing robust data engineering solutions that reduce manual processes, improve data quality, and enable self-service analytics at scale. You will have strong experience in data architecture, ETL development, and modern data warehousing practices, including the application of Kimball methodology and dimensional modelling, alongside ...

Description We’re looking for a talented and passionate Core Data Engineer to join our Group Technology team in Milton Keynes. You’ll play a key role in delivering Connells Group Reporting Data, covering architecture, data modelling, design, and pipelines. You’ll work closely … Maintain the Common Data Model to ensure organisation-wide consistency. Apply Agile principles for iterative and collaborative development. Ensure data pipeline quality, reliability and performance. Develop, test and implement monitoring to ensure effective operation. Support cross-functional data projects, providing expertise as required. ...

Senior Data Engineer Up to £75,000 - London (3 days in office) We are partnering with a global consulting and technology services organisation that delivers large-scale digital, data and AI transformation programmes for enterprise clients across a range of industries. Due to continued growth within … Data & Analytics practice, the organisation is looking to hire a Senior Data Engineer to take a leading role in designing, developing and optimising modern enterprise data platforms. This is an excellent opportunity to join a highly skilled team delivering complex data transformation ...