326 to 350 of 1,010 Data Pipeline Jobs in England

Lead Data Engineer Remote UK £75,000 - £90,000 + Progression + Pension An excellent opportunity awaits an experienced Data Engineer/Architect looking for a hands-on lead role where you will take ownership of and lead the data solutions, with progression, autonomy … company is an established business focused on operational and management solutions, specialising in monitoring services. In this role, you will join the existing data team and lead the design, build, and delivery of the company's data solutions. You will take ownership of the data … working in the Azure Data stack, with Azure Data Factory and Azure Synapse, designing and implementing ETL/ELT pipelines, data modelling, and building scalable data architecture. The right candidate for this role will have a strong understanding of the operational and More ❯

Software Engineer – Data focused – Hybrid in York – up to £60,000 About the Role We are seeking an experienced and highly motivated Senior C# Developer with a strong focus on data-centric development to join our dynamic technology team. You will play a pivotal role in … designing, developing, and maintaining robust C# applications with a deep integration into large-scale data pipelines, databases, and analytics platforms. Key Responsibilities Design, develop, and maintain C# applications and backend services with a strong emphasis on data integration and transformation. Optimise large-scale data … and ensure high-performance querying and storage. Develop and maintain RESTful APIs and services that interact with large datasets. Implement best practices for data integrity, data quality, and data security. Contribute to the design of data models, schemas, and ETL pipelines. Collaborate More ❯

skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. Job title: Lead Data Engineer at JPMorgan Chase within Corporate Technology As a core technical contributor, you will be responsible for maintaining critical data pipelines and … architectures across multiple technical areas within various business functions to support the firm's business objectives. Job responsibilities Generate data models using firmwide tooling, statistics, and algorithms. Develop data extraction and transformation pipelines in collaboration with other Data Engineers and stakeholders. Deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable manner. Understand key data requirements by working closely with stakeholders. Design and implement secure and effective data solutions with appropriate access control. Create data visualization solutions focusing on User Experience. More ❯

REQUIRED: DATA ENGINEER - SC CLEARED LOCATION: FULLY REMOTE WITH OCCASIONAL TRAVEL TO CENTRAL LONDON IR35 STATUS: INSIDE DURATION: 6 MONTH INITIAL CONTRACT Seeking a Data Engineer who has a strong understanding of data concepts - data types, data structures, schemas (both … JSON and Spark), schema management etc - Strong understanding of complex JSON manipulation - Experience working with Data Pipelines using a custom Python/PySpark frameworks - Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference … Data. - Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets - Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction More ❯

Senior Data Engineer (Ingestion) Hybrid Working (6 days per month onsite in our Farringdon office) Who are we? Toyota Connected Europe wants to create a better world through connected mobility for all. We are a new company created to bring big data and a customer focus … an opportunity to have an immediate impact and voice: what you create today, you will see being used tomorrow. About the role: The Data Engineering team enables and manages the ingestion of low latency, high volume car telemetry data that powers our engineering and data science teams to build smart and insightful products. We are looking for an experienced Data Engineer to join the team who will have a key role in the design, development, implementation and documentation of large-scale, distributed software data applications, systems and services. You More ❯

REQUIRED: DATA ENGINEER - SC CLEARED Location: Fully remote with occasional travel to Central London IR35 Status: Inside Duration: 6-month initial contract Job Description: Seeking a Data Engineer with a strong understanding of data concepts, including data types, data structures … schemas (JSON and Spark), and schema management. Key Skills and Experience: Strong understanding of complex JSON manipulation Experience with Data Pipelines using custom Python/PySpark frameworks Knowledge of the 4 core Data categories (Reference, Master, Transactional, Freeform) and handling Reference Data Understanding of … Data Security principles, access controls, GDPR, and handling sensitive datasets Strong problem-solving and analytical skills Experience in support roles, incident triage, and handling (SLAs) Linux system administration basics, Bash scripting, environment variables Experience with browser-based IDEs like Jupyter Notebooks Familiarity with Agile methodologies (SAFE, Scrum, JIRA More ❯

the forefront of industry advancements. My client pride themselves on fostering a collaborative and inclusive work environment where creativity and excellence thrive. The data team is dedicated to pushing boundaries and achieving remarkable results. Your new role As a Principal Data Engineer, you will play a … pivotal role in designing, building, and managing the data infrastructure and systems, supporting the organisation's data strategy. You will be responsible for developing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. Additionally, you … will mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure and strategic alignment with business goals. You will be the 'what does good look like' person, you will always be horizon scanning, you will be the ideas' person, and you will More ❯

the forefront of industry advancements. My client pride themselves on fostering a collaborative and inclusive work environment where creativity and excellence thrive. The data team is dedicated to pushing boundaries and achieving remarkable results. Your new role As a Principal Data Engineer, you will play a … pivotal role in designing, building, and managing the data infrastructure and systems, supporting the organisation's data strategy. You will be responsible for developing scalable solutions, optimising data systems, and collaborating with various teams to support data-driven decision-making. Additionally, you … will mentor junior engineers, ensuring best practices and innovative techniques are implemented to enhance overall data infrastructure and strategic alignment with business goals. You will be the 'what does good look like' person, you will always be horizon scanning, you will be the ideas' person, and you will More ❯

Closing Date : 30 Apr 2025 Salary Details: Up to £70,000 p.a (dependent on experience) Summary About the role As the world of data engineering becomes increasingly pivotal in driving modern digital ecosystems, The Coventry is looking to welcome a Senior DataOps Engineer who can inspire and coach … our existing Data Engineering teams. This is more than just a technical role; we're looking to build a culture of innovation, ownership, and continuous improvement. Working alongside domain-oriented, multi-disciplinary data product teams to design, develop, and test high-quality data solutions … as the backbone of our decision-making and digital services. What You'll Be Doing Drive automation and CI/CD practices across data pipelines and infrastructure Build robust, scalable, and secure infrastructure that supports our data platform strategy Lead and mentor data engineers More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in … a dynamic, fast-growing category? If so, you might be the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting … decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust More ❯

Job Title: Azure Data Engineer Lead - Outside IR35 Location: Remote Salary/Rate: £450 per day - Outside IR35 Start Date: 28/04/2025 Duration: 3 months We have an exciting opportunity with a major retail company. They are looking for a Lead Azure Data … outside IR35 and fully remote. Job Responsibilities/Objectives: Lead the design and execution of the end-to-end migration from on-premise data systems to Azure, ensuring scalability, reliability, and performance. Develop and optimise data pipelines using Azure Data Factory, Synapse Analytics, and … related services to support data ingestion, transformation, and integration. Architect and implement Azure-based data solutions, including Data Lake, SQL Database, and Databricks, aligning with business and technical requirements. Establish cloud data engineering best practices, including governance, security, monitoring, and cost optimisation. More ❯

Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client are seeking a talented … Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes … of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable data migration processes across various project phases. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct More ❯

Data Engineer - Leading Energy Company - London (Tech Stack: Data Engineer, Databricks, Python, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) Company Overview: Join a dynamic team, a leading player in the energy sector, committed to innovation and sustainable solutions. Our client are seeking a talented … Data Engineer to help build and optimise our data infrastructure, enabling them to harness the power of data-driven insights to drive our business forward. Responsibilities: Design and develop a cutting-edge data warehouse capable of efficiently ingesting and organising large volumes … of data from multiple sources. Champion best practices in data architecture governance, ensuring compliance with security and privacy regulations. Implement automated, scalable data migration processes across various project phases. Conduct rigorous data quality assessments, employing cleansing and validation techniques as needed. Construct More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

GIS Data Engineer 35k to 50k Bath Hybrid I am working with a tech for good client who is looking for a data engineer, with skills in geospatial engineering for some exciting and large scale projects that they have underway. They are looking for skills in … that really enjoys problem solving and technical challenges. Benefits: 25 days holiday Company phone Health insurance Life insurance And more Role Responsibilities: Developing data pipelines Managing databases Analysing and visualizing GIS data Developing python scripting to automate data ingestion Testing and validating data Data manipulation and cleansing Creating tiles from datasets You will be working with a cross functional team including data analysts, developers, and other key stakeholders. Experience: Degree in Computer Science, GIS, Geography or related field Experience in data engineering Geospatial related software More ❯

Business Intelligence Engineer, Amazon Last Mile Come help Amazon create cutting-edge data and science-driven technologies for delivering packages to the doorstep of our customers! The Last Mile Routing & Planning organization builds the software, algorithms, and tools that make the "magic" of home delivery happen: our flow … Amazon Fresh, Lockers, and other new initiatives. As part of the Last Mile Science & Technology organization, you'll partner closely with Product Managers, Data Scientists, and Software Engineers to drive improvements in Amazon's Last Mile delivery network. You will leverage data and analytics to generate … scripting languages (e.g., Python, Java, or R) Master's degree or advanced technical degree Knowledge of data modeling and data pipeline design Experience with statistical analysis and correlation analysis Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have More ❯

Senior Azure Data Engineering Lead Global FS/Insurance Location : London - 2-3 days hybrid working in central London Day Rate : £100,000 - £110,000 + 20% Bonus Are you a seasoned data engineering expert passionate about Azure cloud services? Do you thrive in a leadership … role, guiding teams to build cutting-edge data solutions? Join us as a Senior Azure Data Engineering Lead and spearhead the development of our single version of truth (SVOT) platform. Key Responsibilities : Leadership & Team Management : Lead, mentor, and manage a team of talented Azure data engineers. Drive the technical execution of the team. Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to ensure a high-quality SVOT platform. Architecture & Delivery : Design, develop, and implement scalable and secure data lake solutions on Azure. Ensure best practices More ❯

Senior Azure Data Engineering Lead Global FS/Insurance Location : London - 2-3 days hybrid working in central London Day Rate : £100,000 - £110,000 + 20% Bonus Are you a seasoned data engineering expert passionate about Azure cloud services? Do you thrive in a leadership … role, guiding teams to build cutting-edge data solutions? Join us as a Senior Azure Data Engineering Lead and spearhead the development of our single version of truth (SVOT) platform. Key Responsibilities : Leadership & Team Management : Lead, mentor, and manage a team of talented Azure data engineers. Drive the technical execution of the team. Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to ensure a high-quality SVOT platform. Architecture & Delivery : Design, develop, and implement scalable and secure data lake solutions on Azure. Ensure best practices More ❯

Data Lead - Strategy & Integration - £500 (outside IR35) - London/Hybrid Investigo are supporting a growing IT Consultancy, currently going through an exciting period of change due to acquisitions, and now require a strategic, hands-on Data Strategy & Integration Lead. This hire will help architect and execute … the company-wide data infrastructure from the ground up. Building the data warehouse, connecting disparate systems, and driving the overall data vision. £500 p/day (Outside IR35) 6 months (with view to extend) Hybrid - London (city)/remote. The team currently work … systems and environments is essential Deep experience integrating CRM and financial platforms Solid understanding of ETL/ELT processes and modern data pipeline tools Hands-on experience managing data migrations from diverse legacy systems into new consolidated environments (e.g., post-M&A or system upgrades More ❯

Data Engineer 4 months - with extensions Remote Active SC clearance required £640 per day inside ir35 REQUIRED Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc Strong understanding of complex JSON manipulation Experience working … with Data Pipelines using a custom Python/PySpark frameworks Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data. Strong understanding of Data Security principles - data owners, access … CLI usage and scripting) Git Markdown Scala DESIRABLE Azure SQL Server as a HIVE Metastore DESIRABLE TECHNOLOGIES Azure Databricks Apache Spark Delta Tables Data processing with Python PowerBI (Integration/Data Ingestion) JIRA If you meet the above requirements, please apply for the vacancy to be More ❯

10959HS £550 - 620 per day Data Solutions Architect Hybrid - Inside IR35 We're looking for a seasoned Data Solutions Architect with deep expertise in the Lloyd's of London Market and a strong background in Snowflake and ETL/data transformation tools . As … a Data Architect , you'll lead the design, development, and deployment of enterprise-grade data architecture using Snowflake and a modern suite of data tools. You'll work at the intersection of IT and business, collaborating closely with stakeholders to create solutions that unlock … the full value of data-driving decision-making and business growth across the organisation. Key Responsibilities Architecture Design: Design and maintain enterprise data architecture models, data flows, and integrations using Snowflake. Data Governance: Manage data collection, storage, transformation, and protection More ❯

promise of AI. GX has built specialised knowledge AI assistants for the banking and insurance industry. Our assistants are fed by sector-specific data and knowledge and easily adaptable through ontology layers to reflect institution-specific rules. GX AI assistants are designed for Individual Investors, Credit and Claims … professionals and delivering 10x improvements by supporting them in their day-to-day tasks. Responsibilities: Helping to architect, design, implement, and optimise our data ingestion, transformation, and spreading pipelines and processes. Developing data models, processing pipelines, and back-end services supporting the data science … least one of the big 3 cloud ML stacks (AWS, Azure, GCP). Hands-on experience with open-source ETL, and data pipeline orchestration tools such as Apache Airflow and Nifi. Experience with large scale/Big Data technologies, such as Hadoop, Spark, Hive, Impala More ❯

and open-minded individual with an interest in state-of-the-art machine learning engineering and research? Thomson Reuters Labs is seeking a Data Engineer with a passion for solving challenging machine learning problems in a data-rich, complex and innovative environment. What does Thomson Reuters …/Applied ML, as well as Research, to drive the company's leading internal AI model development, fueled by an unprecedented wealth of data and powered by cutting-edge technical infrastructure. You will have the opportunity to contribute to a data curation & filtering system combining the … and ability to work with limited supervision. Experience with relational and NoSQL databases (e.g., PostgreSQL, MySQL, MongoDB, Cassandra). Experience with data pipeline orchestration tools. Experience with cloud-based data platforms such as AWS, GCP, or Azure (e.g., S3, BigQuery, Azure Data Lake More ❯

ECOM are pleased to be exclusively recruiting for a Senior Data Engineer here in Manchester. You'll join a team where your work reaches millions. This role is within a forward-thinking company leading, offering a dynamic environment where you can grow, make an impact, and shape the … future of technology. The Role: As a Data Engineer, you'll design, develop, and optimise data pipelines on a Databricks-based platform, Symphony. You'll collaborate with teams to create scalable data solutions, ensuring efficient data ingestion, transformation, and analysis. Responsibilities: Design … and maintain scalable data pipelines and infrastructure using Databricks. Collaborate with commercial teams to define data product requirements and visualisations. Develop and optimise ETL/ELT processes for smooth data flow and accurate analysis. Ensure adherence to data architecture principles and support More ❯