1 to 25 of 379 Permanent Data Pipeline Jobs in the UK excluding London

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your … to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet business and technical requirements. Process Improvement … years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data More ❯

technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. We are seeking a Head of Data & AI to join our technology function. The practice is built on the belief that architecture should be business driven and purposeful. You'll be … joining a collaborative team, co-creating tools, supporting each other, providing governance, and building a community. The Head of Data & AI will act as a catalyst for innovation, spotting emerging client challenges and translating them into repeatable scalable data solutions. This role can be completed in … Strong knowledge of SQL, NoSQL, cloud-based databases (e.g., AWS Redshift, Snowflake, Google BigQuery, Azure Synapse). Experience in ETL development, data pipeline automation, and data integration strategies. Familiarity with AI-driven analytics Strong understanding of data governance, security, and regulatory compliance. Excellent More ❯

technology and people, and we help everyone here to succeed. At TXP, you can multiply your potential. We are seeking a Head of Data & AI to join our technology function. The practice is built on the belief that architecture should be business driven and purposeful. You'll be … joining a collaborative team, co-creating tools, supporting each other, providing governance, and building a community. The Head of Data & AI will act as a catalyst for innovation, spotting emerging client challenges and translating them into repeatable scalable data solutions. This role can be completed in … Strong knowledge of SQL, NoSQL, cloud-based databases (e.g., AWS Redshift, Snowflake, Google BigQuery, Azure Synapse). Experience in ETL development, data pipeline automation, and data integration strategies. Familiarity with AI-driven analytics Strong understanding of data governance, security, and regulatory compliance. Excellent More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and Machine Learning Understanding of machine learning More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … culture makes it all possible. As a team, we collaborate globally to reach our ultimate goalhelping people. Were searching for aLondon-based Principal Data Engineer to join our Data and Reporting Platform team, so that we can design and implement a robust data strategy … warehousing, and ETL/ELT architecture at scale; Advanced programming skills in SQL and Python; experience with orchestration and data pipeline tools; Demonstrated success delivering complex data architectures in support of cross-functional business needs; Experience with implementing data governance frameworks More ❯

Data Engineer/Scientist Department: Consultancy Employment Type: Full Time Location: United Kingdom/Hybrid Description As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business … problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. … Locations: London, Guildford, Bristol, M4 corridor Hybrid working Roles and Responsibilities Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data More ❯

please contact the . For any general queries, please contact: . Job Introduction You will play a crucial role in ensuring that our data platforms have the right level of governance and controls applied to them. You will ensure these are secure and compliant to our data … will ensure that metadata is governed, and that cataloguing is automated as much as possible to enable us to achieve our goal of 'data governance as code' on our platforms. This role requires a deep technical understanding of data platforms governance. Main Responsibilities You will play … a key role in developing effective data management and governance practises. You will work closely with Data and Platform Engineers, Platform Architects as well as Data Owners, Stewards and Custodians to ensure that the BBCs data platforms are set up for best More ❯

with length of service Sick Pay Increasing with length of service The Role: DataOps Engineer Job Description We are seeking a senior Data DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role … you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯

with length of service Sick Pay Increasing with length of service The Role: DataOps Engineer Job Description We are seeking a senior Data DataOps Engineer to serve as our first DataOps specialist in a growing team of Data Engineers and DevOps professionals. In this pivotal role … you will focus on operationalising and automating our data lifecycle to ensure that data workflows perform with reliability and efficiency. You will integrate CI/CD data pipelines, streamline deployment processes, enforce robust data governance, and optimise operational costs within our Microsoft …/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark for automation. Strong aptitude for data pipeline monitoring and an understanding of data security practices such as RBAC and encryption. Implemented data and pipeline observability dashboards More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and communicating … enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience or an … data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Ability to implement data processing and transformation pipelines in Databricks Experience in leading data platform development teams Knowledge of More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of … their data assets through robust data infrastructure and sophisticated analysis, playing a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we More ❯

the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer … data transformation. You'll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data … data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You More ❯

the complexity of modern cruising — all while keeping things collaborative and fun. ⭐ Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer … data transformation. You'll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data … data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. What You More ❯

the complexity of modern cruising — all while keeping things collaborative and fun. ⭐ Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer … data transformation. You'll play a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data … data engineers, fostering their growth and ensuring high standards in coding, testing, and documentation. Optimise: Continuously monitor and improve data pipeline performance, reliability, and cost-efficiency. Document: Create and maintain clear, comprehensive documentation for data models, pipeline architecture, and processes. 🔧 What You More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … industry trends and emerging technologies, continually improving data engineering capabilities Metrics-Driven Impact: Develop and track success metrics, including data pipeline reliability, availability, and time-to-insight, to evaluate and continuously improve team performance Communicate the impact of data engineering initiatives through clear … excellence through the implementation of efficient data engineering workflows, processes, and tools Drive the adoption of best practices for data pipeline development, continuous integration/continuous deployment (CI/CD), and data monitoring Identify and implement opportunities for automation and optimization, improving operational More ❯

About Us We are Data Services, our mission is to unlock the value of data by delivering high-quality, reliable, and secure data services that are accessible, understandable, and actionable! We continuously evolve our offerings, using modern cloud-based technologies, and foster strong partnerships … product groups, identifying common solution patterns and developing reusable frameworks. Lead the identification of dependencies and produce detailed design documents for data pipeline solutions. Leverage subject-matter expertise to drive project and release plans with key partners including SMEs and Product Owners. Participate in organisation-wide projects … platform-centric FinOps policies. Provide mentorship and coaching to data engineers on modern tools and technologies in Azure, data pipeline management, coding practices, design principles, and implementation patterns. Minimum Criteria Extensive experience in data engineering on an Azure data platform More ❯

Role: Data Lead Location: Knutsford Contract Role Job Description: AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge Language & Scripting: Python and Spark ETL: DBT Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata Responsibilities: Serve as the primary … point of contact for all AWS related data initiatives and projects. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform. Gather and analyze business requirements to develop scalable and efficient data … data lakes. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS. Strong leadership and project management skills with the ability to effectively lead a team More ❯

Job Title: Data Engineer Location: Leeds ( 1 day every 2 weeks) Department: Data & Analytics Salary: £70,000 - £80,000 About Us One of the UK’s leading services for selling items in one simple, hassle-free process. With a mission to promote sustainability and support a … circular economy, as they expand into new markets, they are looking for a highly skilled and motivated Data Engineer to join the dynamic team and help elevate their data infrastructure and analytics capabilities. If you have experience with Snowflake, digital marketing analytics, and are familiar with … data warehousing as well as what best practice looks like when undertaking data engineering. Key Responsibilities Data Architecture & Pipeline Development: Design, implement, and maintain robust and scalable data pipelines, ensuring seamless integration and flow of data across multiple systems. More ❯

Job Title: Data Engineer Location: Leeds ( 1 day every 2 weeks) Department: Data & Analytics Salary: £70,000 - £80,000 About Us One of the UK’s leading services for selling items in one simple, hassle-free process. With a mission to promote sustainability and support a … circular economy, as they expand into new markets, they are looking for a highly skilled and motivated Data Engineer to join the dynamic team and help elevate their data infrastructure and analytics capabilities. If you have experience with Snowflake, digital marketing analytics, and are familiar with … data warehousing as well as what best practice looks like when undertaking data engineering. Key Responsibilities Data Architecture & Pipeline Development: Design, implement, and maintain robust and scalable data pipelines, ensuring seamless integration and flow of data across multiple systems. More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

life. Are you excited at the opportunity to electrify and decarbonize the world? We are seeking a dynamic, forward-thinking, and results-driven Data Engineer to join our Grid Innovation team. This role focuses on designing, building, and maintaining the infrastructure and data pipelines that enable … effective data collection, processing, storage, and analysis for cutting-edge AI/ML applications in the energy domain. Experience in the energy sector, smart infrastructure, or industrial automation is fundamental, as this role supports AI-driven innovation in mission-critical systems with high regulatory and operational complexity. As … Azure, or GCP for deploying and managing data systems. Extensive experience with ETL processes (Extract, Transform, Load) and automating data pipeline workflows. Effective communication skills, with the ability to collaborate smoothly with cross-functional teams and resolve conflicts proactively.Adaptability to work in a dynamic, multi More ❯