1 to 25 of 637 Data Pipeline Jobs in the UK excluding London

Create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional/non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure … variety of data sources using SQL and AWS 'big data' technologies. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. Work with stakeholders including the Executive, Product, Data … data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark More ❯

as well as optimising data flow and collection for other teams. Using their experience in data architecture, ETL processes and pipeline management to support the building, testing and maintenance of data architecture. Job Details - Data Engineer (12-month FTC) Salary - circa … Experience building and deploying machine learning models in production Strong proficiency in object-oriented languages and scripting languages Strong proficiency in data pipeline and workflow management tools Strong project management and organisational skills Excellent problem-solving, communication, and organisational skills Proven ability to work independently and with … performance indicators Develop and deliver insightful analytics for the assigned department to inform key business decisions Create and maintain an optimal data pipeline architecture Assemble large, complex data sets that meet functional/non-functional business requirements Identify, design, and implement internal process improvements: automating More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we're investing in our central data teams. We're now recruiting a Principal Data Engineer to join our More ❯

Location: Guernsey, Haywards Heath, Home Office (Remote) or Manchester Salary: £85,000 - £100,000 - depending on experience Department: Technology and Data We're First Central Insurance & Technology Group (First Central for short), an innovative, market-leading insurance company. We protect the things customers love so they can get … on with what matters to them in life. Data drives us. It fuels our outstanding distribution, finance, technology and legal services. Our underwriting skills are built on data expertise; it creates the insights we need to give the right cover to the right customers at the … At First Central, we have ambitious growth plans and a commitment to delivering outstanding services to our customers. To support our business and data strategy, we're investing in our central data teams. We're now recruiting a Principal Data Engineer to join our More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

Data Engineer required by our market leading, award winning, professional services organisation based in Yeovil. The successful Data Engineer, you'll play a vital role in designing, building, and maintaining sophisticated data pipelines and ensuring the integrity of our clients extensive customer data. Your … to develop your expertise in data engineering. Key Responsibilities Design & Build Data Pipelines: Create and maintain scalable data pipeline architecture that supports business needs. Data Management: Assemble large, complex data sets to meet business and technical requirements. Process Improvement … years of hands-on experience with big data tools and frameworks. Technical Skills: Proficiency in SQL, Python, and data pipeline tools such as Apache Kafka, Apache Spark, or AWS Glue. Problem-Solving: Strong analytical skills with the ability to troubleshoot and resolve data More ❯

Head of Data, Data Manager, SQL, Azure, Hybrid, 5-Month Contract, £600, Inside IR35 I'm looking for an experienced Head of Data/Data Manager with experience developing and implementing a robust data strategy, ensuring data governance … compliance, for an initial 5-month contract, working on a hybrid basis This contract has been deemed Inside IR35. As the Head of Data/Data Manager, will take ownership of the data strategy, implementing the best tools and technologies, oversee data warehousing, build and optimise data pipelines, and work closely with business stakeholders to translate data into actionable insights. What's required of the Head of Data? Proven experience in data strategy, governance, and compliance Experience with Azure Cloud Strong expertise More ❯

Select how often (in days) to receive an alert: Head of Data Strategy Location: UK - Hatfield, UK - London, UK - Manchester, UK - Milton Keynes, UK - Nottingham Job-ID: 213406 Contract type: Standard Business Unit: Information Technology Life on the team You will oversee the development and implementation of a … comprehensive data strategy, encompassing data governance, data management, data quality, and data analytics to ensure high-quality data outcomes, insights leading to action, maximizing data value, and treating data as an asset. What you … ll do As Head of Data Strategy, you will be responsible for defining and implementing our Data Strategy, including data governance, management, quality, master data management, and reporting/analytics/outcomes-aligned with our Technology Strategy. You will: Own, define, and More ❯

Select how often (in days) to receive an alert: Head of Data Strategy Location: UK - Hatfield, UK - London, UK - Manchester, UK - Milton Keynes, UK - Nottingham Job-ID: 213406 Contract type: Standard Business Unit: Information Technology Life on the team You will oversee the development and implementation of a … comprehensive data strategy, encompassing data governance, data management, data quality, and data analytics to ensure high-quality data outcomes, insights leading to action, maximizing data value, and treating data as an asset. What you … ll do As Head of Data Strategy, you will be responsible for defining and implementing our Data Strategy, including data governance, management, quality, master data management, and reporting/analytics/outcomes-aligned with our Technology Strategy. You will: Own, define, and More ❯

Select how often (in days) to receive an alert: Head of Data Strategy Location: UK - Hatfield, UK - London, UK - Manchester, UK - Milton Keynes, UK - Nottingham Job-ID: 213406 Contract type: Standard Business Unit: Information Technology Life on the team You will oversee the development and implementation of a … comprehensive data strategy, encompassing data governance, data management, data quality, and data analytics to ensure high-quality data outcomes, insights leading to action, maximizing data value, and treating data as an asset. What you … ll do As Head of Data Strategy, you will be responsible for defining and implementing our Data Strategy, including data governance, management, quality, master data management, and reporting/analytics/outcomes-aligned with our Technology Strategy. You will: Own, define, and More ❯

Select how often (in days) to receive an alert: Head of Data Strategy Location: UK - Hatfield, UK - London, UK - Manchester, UK - Milton Keynes, UK - Nottingham Job-ID: 213406 Contract type: Standard Business Unit: Information Technology Life on the team You will oversee the development and implementation of a … comprehensive data strategy, encompassing data governance, data management, data quality, and data analytics to ensure high-quality data outcomes, insights leading to action, maximizing data value, and treating data as an asset. What you … ll do As Head of Data Strategy, you will be responsible for defining and implementing our Data Strategy, including data governance, management, quality, master data management, and reporting/analytics/outcomes-aligned with our Technology Strategy. You will: Own, define, and More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and Machine Learning Understanding of machine learning More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … respectful culture makes it all possible. As a team, we collaborate globally to reach our ultimate goalhelping people. Were searching for a Senior Data Engineer to join our Data Platform team, so that we can build and maintain robust infrastructure for handling large-scale data … governance and security policies within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to More ❯

are on an exciting growth trajectory. This is truly an exciting time to join us on our journey. We are seeking a Lead Data Architect to join our scaling architecture practice. The practice is built on the belief that architecture should be business driven and purposeful. You'll … be joining a collaborative team, co-creating tools, supporting each other, providing governance, and building a community. The Lead Data Architect will act as a catalyst for innovation, spotting emerging client challenges and translating them into repeatable scalable data solutions. This role can be completed in … Strong knowledge of SQL, NoSQL, cloud-based databases (e.g., AWS Redshift, Snowflake, Google BigQuery, Azure Synapse). Experience in ETL development, data pipeline automation, and data integration strategies. Familiarity with AI-driven analytics Strong understanding of data governance, security, and regulatory compliance. Excellent More ❯

are on an exciting growth trajectory. This is truly an exciting time to join us on our journey. We are seeking a Lead Data Architect to join our scaling architecture practice. The practice is built on the belief that architecture should be business driven and purposeful. You'll … be joining a collaborative team, co-creating tools, supporting each other, providing governance, and building a community. The Lead Data Architect will act as a catalyst for innovation, spotting emerging client challenges and translating them into repeatable scalable data solutions. This role can be completed in … Strong knowledge of SQL, NoSQL, cloud-based databases (e.g., AWS Redshift, Snowflake, Google BigQuery, Azure Synapse). Experience in ETL development, data pipeline automation, and data integration strategies. Familiarity with AI-driven analytics Strong understanding of data governance, security, and regulatory compliance. Excellent More ❯

Enterprise Data Architect Permanent Edinburgh/Glasgow/Wilmslow Hybrid 50% home/office based A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the … execution of the Data Transformation roadmap. The expectations: Accountable for the delivery of the Enterprise Data Architecture and directing detailed Data Architecture for major transformation programmes Key contributor to the data architecture target state including maintaining key architectural viewpoints (Data More ❯

Enterprise Data Architect Permanent Edinburgh/Glasgow/Wilmslow Hybrid 50% home/office based A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the … execution of the Data Transformation roadmap. The expectations: Accountable for the delivery of the Enterprise Data Architecture and directing detailed Data Architecture for major transformation programmes Key contributor to the data architecture target state including maintaining key architectural viewpoints (Data More ❯

Job Title: Lead Data Engineer (AWS) Business Unit/Segment: Data Management/Analytics Location: London, United Kingdom (Flexible hybrid working) Employment Type: Permanent - Salary -£80k to £100k Summary of the Role: A leading global data and AI company is looking for a Lead … with emerging data technologies and recommend improvements to data engineering practices. Develop and enforce best practices for data pipeline orchestration, testing, and deployment. Provide mentorship, feedback, and leadership across project and operational initiatives. Collaborate with cross-functional teams to design a consistent and … CD practices and code versioning systems. Key Skills and Attributes: Cloud & Data Engineering: Deep expertise in AWS services and data pipeline development. Data Modelling & Architecture: Strong background in data warehousing and modern modelling frameworks. Leadership: Ability to lead teams, provide feedback More ❯

As a Tech Manager - Data Engineer with AWS experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven … initiatives. Key Responsibilities: Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion. AWS Expertise: Utilize your expertise in AWS services such … as Amazon EMR, S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions. Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance. Data Quality: Implement data More ❯

We are currently recruiting for an experienced Data Architect to work for Lincolnshire Police at their headquarters in Nettleham. This role will be hybrid working Monday to Friday 37 hours a week. This is a temporary role until October 2026 PLEASE NOTE DUE TO POLICE VETTING CRITERIA YOU … YEARS AT THE TIME OF APPLICATION. UNFORTUNATELY ANYTHING LESS THAN THIS WILL NOT BE CONSIDERED. JOB PURPOSE AND SCOPE The Force's Data Architect is accountable for the design and build of the Force's overall data architecture, taking full responsibility for its implementation and its … ability to serve the data required to produce information, intelligence and insights products for the Force and its partners. CORE WORK AREAS Leadership Subject matter expert on data architecture for the Force and, as required provides expertise to partner organisations, and representing the Force's interest More ❯