1 to 25 of 126 Data Pipeline Jobs in the North of England

the infected blood community to provide financial compensation to victims of infected blood on a UK-wide basis. This role will lead our data platform architecture and modelling team within the Data Operations arm of the IBCA Data Directorate. The Data Operations … team is responsible for developing and running safe and secure data solutions that provide a single source of truth for those going through their compensation journey. They are designing and building a new data platform using Amazon Web Services (AWS) and data management and … intelligence products using Databricks and Quantexa. We are taking a product-centric approach treating data as a product and are building squads around our products, with a focus on paying compensation to those impacted by the infected blood scandal seamlessly. You will focus on designing scalable and flexible More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Azure based data warehouse technologies such as Azure Data Factory, Analysis Services, SQL server and Azure Synapse. Data Pipeline Creation: Build and optimize ETL/ELT data pipelines using Azure Data Factory, Databricks, or similar services to ensure data More ❯

Select how often (in days) to receive an alert: Head of Data Strategy Location: UK - Hatfield, UK - London, UK - Manchester, UK - Milton Keynes, UK - Nottingham Job-ID: 213406 Contract type: Standard Business Unit: Information Technology Life on the team You will oversee the development and implementation of a … comprehensive data strategy, encompassing data governance, data management, data quality, and data analytics to ensure high-quality data outcomes, insights leading to action, maximizing data value, and treating data as an asset. What you … ll do As Head of Data Strategy, you will be responsible for defining and implementing our Data Strategy, including data governance, management, quality, master data management, and reporting/analytics/outcomes-aligned with our Technology Strategy. You will: Own, define, and More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and communicating … enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience or an … data quality, metadata management, etc. Experience in designing data engineering solutions using open source and proprietary cloud data pipeline tools Ability to implement data processing and transformation pipelines in Databricks Experience in leading data platform development teams Knowledge of More ❯

Job Title: Data Migration Analyst Location: Manchester, UK Role Overview The Data Migration Analyst will play a pivotal role in a large-scale IT transformation programme, supporting the implementation of a robust data migration strategy. This position involves extensive collaboration with stakeholders across the … business and technical teams to ensure data accessibility, quality, and integrity during system transitions. The analyst will contribute to the broader data strategy, data governance, and support the development of processes, systems, and standards to enhance data quality and management across the … organisation. Key Responsibilities Analyse source systems to map data structures to target systems. Develop technical specifications for ETL processes to support migration. Collaborate with Data Engineers to develop data pipelines. Design and implement data validation rules and tests. Coordinate with Data More ❯

Job summary Ready to take on a career-defining challenge? HDFT are looking for two Senior Data Engineers to play a pivotal role in a ground-up deployment of Microsoft Fabric. This is a rare opportunity to work on a completely greenfield project, shaping architecture and developing robust … scalable data pipelines using best-fit technologies. What's in it for you??Immediate exposure to Microsoft Fabric -- be at the forefront of cutting-edge data engineering.?Greenfield deployment -- minimal legacy constraints, just innovation.?Critical role -- influence architecture, tooling, and best practices from day one.?Technology … first environment -- work with modern cloud and data technologies to build something that lasts. What you'll be doing? Designing and implementing high-performance data pipelines for real-time and batch processing.? Architecting a future-proof data platform, leveraging Microsoft Fabric and other best More ❯

Role: Data Lead Location: Knutsford Contract Role Job Description: AWS Services: Glue, Lambda, IAM, Service Catalogue, Cloud Formation, Lake Formation, SNS, SQS, Event Bridge Language & Scripting: Python and Spark ETL: DBT Good to Have: Airflow, Snowflake, Big Data (Hadoop), and Teradata Responsibilities: Serve as the primary … point of contact for all AWS related data initiatives and projects. Responsible for leading a team of data engineers and analysts to design, implement, and maintain data solutions on the AWS platform. Gather and analyze business requirements to develop scalable and efficient data … data lakes. In-depth knowledge of AWS services such as EMR, Glue, Kinesis, and Redshift. Hands-on experience with data pipeline development, ETL processes, and data modeling on AWS. Strong leadership and project management skills with the ability to effectively lead a team More ❯

Senior Data Engineer - Data Infrastructure and Architecture: C-4 Analytics C-4 Analytics is a fast-growing, private, full-service digital marketing company that excels at helping automotive dealerships increase sales, increase market share, and lower cost per acquisition. We are currently hiring for a Senior … Data Engineer as we look to expand our team and support our growing roster of local and national clients. If you are unable to complete this application due to a disability, contact this employer to ask for accommodation or an alternative application process. Who We're Looking For … growing AI team, you'll play a critical role in the orchestration of Intelligent Systems. Working with AI related orchestration and data pipeline technologies to turn information into insights using multiple platforms. We're not just processing data-we're transforming it into organizational intelligence. More ❯

At Victrex, we are dedicated to harnessing the power of data to drive innovation and deliver exceptional value. We are seeking a talented and experienced IT Data Engineering Manager to join our dynamic team and lead our data engineering efforts. As Data Engineering Manager you will beresponsible for leading the data engineering team to design, build, and maintain scalable, high-performance data infrastructure and pipelines. This role ensures the availability, reliability, and security of data systems to support business intelligence, analytics, and data … a dynamic and fast-paced environment. Strong understanding of data architecture, data modelling, ETL/ELT processesand data pipeline development. Competency with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies (e.g., Hadoop, Spark, Kafka etc). Excellent communication and More ❯

or Manchester Salary: £60,000 - £65,000 depending on experience Department: Finance We're 1st Central, a market-leading insurance company utilising smart data and technology at pace. Rapid growth has been based on giving our 1.4 million customers exactly what they want: great value insurance with an … Employer of the Year at the British Insurance Awards 2024 and our Glassdoor score is pretty mega too! Are you passionate about driving data excellence within finance? Do you thrive on enhancing data functionality that supports business success? If so, we'd love to hear from … and Technology teams to define, capture, and document data requirements. Ensure smooth integration between finance systems and the wider data pipeline, including key logic and calculations. Help shape and evolve the Data Roadmap for Finance, aligning with strategic priorities and business needs. Collaborate More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title : Data Engineer with Azure Experience Location : Newcastle/Sunderland, UK About the Role We are seeking a talented and motivated Data Engineer with … or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power BI) Strong programming skills, ideally in Python. Understanding of ETL pipeline development for data source integrations and data transformations. Understanding of data modelling to describe the data More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title : Data Engineer with Azure Experience Location : Newcastle/Sunderland, UK About the Role We are seeking a talented and motivated Data Engineer with … or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power BI) Strong programming skills, ideally in Python. Understanding of ETL pipeline development for data source integrations and data transformations. Understanding of data modelling to describe the data More ❯

Job Title: Data Engineer Location: Newcastle (Hybrid 3 days on-site) Salary: £45,000 – 55,000 D.O.E About the Company: Our client, a leading utilities company based in Newcastle, is dedicated to providing reliable and sustainable utility services to the community. They are currently seeking a talented Data Engineer to join their dynamic team and contribute to their mission of leveraging data to enhance operations and services. Job Description: As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the data infrastructure. You will collaborate … data pipelines. Integrate data from multiple sources into a unified data warehouse. Monitor and troubleshoot data pipeline performance. Implement data quality checks and validation processes. Collaborate with data analysts to support their data needs. Maintain More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the … Moorepay Data Platform' (MDP). This includes managing data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular … literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and More ❯

About the Machine Learning Engineer for CDAO Europe CDAO Europe is looking for a machine learning engineer to build efficient, data-driven AI systems that advance our predictive automation capabilities. The candidate should be highly skilled in statistics and programming, with the ability to confidently assess, analyze, and … reviewing use cases from around the business, and play a key role in Vanguard's model governance processes. Core Responsibilities Leverages data pipeline designs and supports the development of data pipelines to support model development. Proficient with software tools that develop data pipelines … a distributed computing environment (PySpark, GlueETL). Supports integration of model pipelines in a production environment. Develops understanding of SDLC for model production. Reviews pipeline designs, makes data model design changes as needed. Documents and reviews design changes with data science teams. Supports data More ❯

this is done on a rota basis. Job Purpose The BI Lead will be responsible for shaping and maintaining the Enterprise BI and Data warehouse estate. You'll be working with both on-prem and cloud technologies, predominantly focussed on the Microsoft stack (SQL/Azure SQL databases … Data Factory, Synapse, Power BI, Power Platform) You will play a critical role in designing, developing, implementing and maintaining robust data solutions on the Azure and Power BI platforms. You will collaborate closely with cross-functional teams to gather requirements, understand business objectives, and translate them … into scalable and efficient data pipelines and reporting suites. Your expertise will be instrumental in establishing best practices and guiding the development of our data infrastructure to support our long-term data strategy. In addition, the role will be pivotal to understanding the direction More ❯

Based (Hybrid working model, 2 days a week office based, 3 days remote) Competitive Salary plus performance related bonus The Role: As a Data Ops Engineer, you will be responsible for enhancing the efficiency and reliability of our data management processes, supporting our advanced analytics, machine … learning, and AI initiatives. You will harness your engineering skills to develop and automate data pipelines, ensuring data is seamlessly integrated, processed, and available across our analytics platforms. Your role will include automating data workflows, improving data quality, and ensuring efficient delivery … pipelines. You will work alongside teams across the organization to address their data needs, craft agile solutions, and continuously improve the data environment. What will you be doing? Design and implement efficient ETL processes for data extraction, transformation, and loading. Build real-time data More ❯

We are looking for a hands-on, technically driven Data Engineer to join our expanding data team. This role is ideal for someone with a strong foundation in SQL and data management, who has recently graduated from a Data Science or Data … programme and is eager to apply their skills in a modern, forward-thinking environment. You will be responsible for developing and maintaining robust data solutions that support reporting, automation, and strategic decision-making across the business. The successful candidate will have up-to-date knowledge of data tooling and methodologies, particularly in SQL, Power BI, and data automation, with an interest in modern data architecture such as cloud-based warehousing and lakehouse solutions. As the role sits within a relatively new department, where methodologies and processes are still evolving, there is More ❯

Data Engineering Vacancies - Mid to Lead Level - Leeds I am working with a brand new client, and end user based in Leeds who are building an exciting data practice, doing some highly advanced work in the data space. Salary and Benefits Highly comptetitive salary … days per week in Leeds office Competitive annual leave package And many more Role and Responsibilities Design and manage Snowflake-based data pipelines, ensuring data flows seamlessly from multiple sources into the data platform. Collaborate with business stakeholders and data analysts to … identify data requirements and deliver the appropriate solutions. Ensure the integration of structured and unstructured data sources into Snowflake, optimizing data models for reporting. Work with data analysts to support their data needs and optimize semantic models for Snowflake-based More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … a global presence of 15 offices (and 10 delivery centers) across four continents. About the Role: We are currently looking for a Senior Data Engineer to manage teams on client projects. Your Profile: Proven experience as a Data Engineer with a focus on Azure cloud services. … Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with More ❯

Peaple Talent has partnered with a global digital engineering consultancy who are recruiting for a Lead Data Engineer on a permanent basis based out of their Sunderland office. You will have a great understanding of technology consultancy services along with fantastic communication and stakeholder engagement skills as this … role will be client facing. Skills and experience: Proven experience as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data … Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with More ❯

Peaple Talent has partnered with a global digital engineering consultancy who are recruiting for a Lead Data Engineer on a permanent basis based out of their Sunderland office. You will have a great understanding of technology consultancy services along with fantastic communication and stakeholder engagement skills as this … role will be client facing. Skills and experience: Proven experience as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data … Analytics, Azure Data Lake, Azure Databricks and Power BI. Experience with creating low-level designs for data platform implementations. ETL pipeline development for the integration with data sources and data transformations including the creation of supplementary documentation. Proficiency in working with More ❯