626 to 650 of 1,261 Data Pipeline Jobs in England

Data Scientist – Category Management (with ML/AI Focus) About the Role: Quest Search & Selection is working with a leading tech-driven eCommerce platform specializing in consumer goods and rapid delivery. Offering a wide product assortment; including groceries, household essentials, over-the-counter medicine, office supplies, and fresh food. The business leverages data and innovation at … scale to drive customer satisfaction and operational excellence. We are seeking a Data Scientist – Category Management with a strong foundation in machine learning and applied AI to join the Analytics & Insights team. In this role, you'll lead data science initiatives that optimize product availability, buying strategies, and category performance using advanced statistical modeling and machine … Set and tune dynamic targets for availability and expiry rates using continuous learning models. Guide and mentor a Data Analyst to support ongoing analysis, data pipeline development, and dashboarding. Key Requirements: 4–6 years of experience in data science, analytics, or ML engineering , ideally in consumer products, retail tech, or supply chain. Solid More ❯

Data Scientist – Category Management (with ML/AI Focus) About the Role: Quest Search & Selection is working with a leading tech-driven eCommerce platform specializing in consumer goods and rapid delivery. Offering a wide product assortment; including groceries, household essentials, over-the-counter medicine, office supplies, and fresh food. The business leverages data and innovation at … scale to drive customer satisfaction and operational excellence. We are seeking a Data Scientist – Category Management with a strong foundation in machine learning and applied AI to join the Analytics & Insights team. In this role, you'll lead data science initiatives that optimize product availability, buying strategies, and category performance using advanced statistical modeling and machine … Set and tune dynamic targets for availability and expiry rates using continuous learning models. Guide and mentor a Data Analyst to support ongoing analysis, data pipeline development, and dashboarding. Key Requirements: 4–6 years of experience in data science, analytics, or ML engineering , ideally in consumer products, retail tech, or supply chain. Solid More ❯

the atmosphere. With hundreds of active business clients and growing international reach, our impact is expanding daily. The Opportunity We’re looking for an innovative, proactive, Junior Carbon Data Scientist to help us to streamline our data collection and analysis process, transforming small and large datasets into manageable formats for import into our software. You’ll … also be supporting on the design and automation of data pipelines, building predictive models, and piloting new tools. We’ll teach you the environmental context - your superpower is data, code, and a knack for creating reliable, repeatable solutions. We’re looking for you to support: Data driven carbon footprint measurement (Scopes … Key Responsabilities Data Collection and Transformation Ingest and clean CSV datasets (e.g. via Excel Power Query, VBA or comparable ETL tools) Standardise irregular inputs into a repeatable pipeline (“raw → final”) Automate routine data-prep steps where possible Write prompts for AI tools to organise and standardise data Support with developing new tools and More ❯

the atmosphere. With hundreds of active business clients and growing international reach, our impact is expanding daily. The Opportunity We’re looking for an innovative, proactive, Junior Carbon Data Scientist to help us to streamline our data collection and analysis process, transforming small and large datasets into manageable formats for import into our software. You’ll … also be supporting on the design and automation of data pipelines, building predictive models, and piloting new tools. We’ll teach you the environmental context - your superpower is data, code, and a knack for creating reliable, repeatable solutions. We’re looking for you to support: Data driven carbon footprint measurement (Scopes … Key Responsabilities Data Collection and Transformation Ingest and clean CSV datasets (e.g. via Excel Power Query, VBA or comparable ETL tools) Standardise irregular inputs into a repeatable pipeline (“raw → final”) Automate routine data-prep steps where possible Write prompts for AI tools to organise and standardise data Support with developing new tools and More ❯

This fantastic institution located in SW London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines while building a scalable data warehouse architecture. … A major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to the necessary data, as well as assisting in optimizing SQL reporting processes. The ideal candidate will: Possess a strong curiosity … and passion for exploring, transforming, and integrating data from diverse sources. Be adept at troubleshooting and fine-tuning data processes to enhance data quality and stability. Thrive in team settings, with excellent communication skills and the confidence to engage with various stakeholders. Key Responsibilities: Support the development of the data warehouse and More ❯

Senior Data Engineer We are looking for a technical expert with deep data engineering experience, who thrives on solving complex problems, driving business impact, and coaching other engineers. Salary : £70k-£90k Reporting to : François-Xavier Decroix (Engineering Manager) Location : primarily based in our London Office, with flexible and hybrid working (ideally 2 days per week in … the office). About the role As a Senior Data Engineer, you will take responsibility for continuously improving critical systems which transport hundreds of gigabytes of data per day and trillions of messages per year. You will work closely with the broader team to bring innovative new datasets and insights to customers in a reliable, scalable … our mission to empower safe and sustainable transport around the world through data insights. You will be the go-to person for our cloud data pipeline & underlying infrastructure, especially Apache Kafka and our PostgreSQL database . You will also work with tech like Kubernetes, Vault, go microservices and other cloud services, as well as on More ❯

Senior Data Engineer - Hedge Fund - London Company Overview A leading London-based systematic hedge fund managing over $8 billion in client assets. Technology is core to its operations, with a strong focus on data-driven strategies. The team is currently overhauling its data infrastructure to better support quant research and trading. Role Overview Join … a lean, high-impact Data Engineering team responsible for the ingestion, transformation, and delivery of diverse datasets—from tick and time series to reference and alternative data. You’ll build modern, scalable data pipelines and platforms, support the strategic tech stack, and collaborate closely with quants and portfolio managers. This is a hands-on role with … full ownership across the development lifecycle. Qualifications 5+ years in data engineering Strong Python and data wrangling libraries Expert SQL skills and solid RDBMS understanding Experience with cloud-based data solutions (e.g. serverless ETL, data warehouses) Familiarity with Git, Docker, CI/CD pipelines, testing and monitoring Clear communicator, comfortable with cross More ❯

Senior Data Engineer - Hedge Fund - London Company Overview A leading London-based systematic hedge fund managing over $8 billion in client assets. Technology is core to its operations, with a strong focus on data-driven strategies. The team is currently overhauling its data infrastructure to better support quant research and trading. Role Overview Join … a lean, high-impact Data Engineering team responsible for the ingestion, transformation, and delivery of diverse datasets—from tick and time series to reference and alternative data. You’ll build modern, scalable data pipelines and platforms, support the strategic tech stack, and collaborate closely with quants and portfolio managers. This is a hands-on role with … full ownership across the development lifecycle. Qualifications 5+ years in data engineering Strong Python and data wrangling libraries Expert SQL skills and solid RDBMS understanding Experience with cloud-based data solutions (e.g. serverless ETL, data warehouses) Familiarity with Git, Docker, CI/CD pipelines, testing and monitoring Clear communicator, comfortable with cross More ❯

Senior Data Engineer - Hedge Fund - London Company Overview A leading London-based systematic hedge fund managing over $8 billion in client assets. Technology is core to its operations, with a strong focus on data-driven strategies. The team is currently overhauling its data infrastructure to better support quant research and trading. Role Overview Join … a lean, high-impact Data Engineering team responsible for the ingestion, transformation, and delivery of diverse datasets—from tick and time series to reference and alternative data. You’ll build modern, scalable data pipelines and platforms, support the strategic tech stack, and collaborate closely with quants and portfolio managers. This is a hands-on role with … full ownership across the development lifecycle. Qualifications 5+ years in data engineering Strong Python and data wrangling libraries Expert SQL skills and solid RDBMS understanding Experience with cloud-based data solutions (e.g. serverless ETL, data warehouses) Familiarity with Git, Docker, CI/CD pipelines, testing and monitoring Clear communicator, comfortable with cross More ❯

Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end … to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For … Proven Data Engineering experience (5+ years). Consultancy experience is a must. Leadership and multi-project environments experience. Expertise in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points More ❯

A prestigious organization based in London is seeking a dynamic and versatile Data Engineer/Analytics Engineer to contribute to the development, enhancement, and management of their data systems, pipelines, and reporting infrastructure. This role will focus on designing and maintaining efficient data pipelines while building a scalable data warehouse architecture. A … major aspect of this position will involve integrating new data sources to create a unified Single Customer View. Additionally, collaboration with the Analytics and Insights teams is essential to ensure they have seamless access to the necessary data, as well as assisting in optimizing SQL reporting processes. The ideal candidate will: Possess a strong curiosity and … passion for exploring, transforming, and integrating data from diverse sources. Be adept at troubleshooting and fine-tuning data processes to enhance data quality and stability. Thrive in team settings, with excellent communication skills and the confidence to engage with various stakeholders. Key Responsibilities: Support the development of the data warehouse and enhance More ❯

Data Quality & Governance Manager - Leeds - Hybrid - £70k - £75k My client are greenfielding an entire data practice! The chosen candidate for this role will lead efforts to ensure data across the organization is consistent, reliable, and governed effectively. You’ll develop and implement frameworks for data quality, governance, and master data management. You will ensure the effective management of data warehouse architecture, pipelines, and support data migrations using a combination of Snowflake and Microsoft Azure technologies. Salary and Benefits Competitive salary of £70k - £75k (DOE) Hybrid working (4 days in office, 1 from home) 25 days annual leave plus bank holidays (rising to 27 with … service) Discretionary bonus of up to 10% Private medical care And many more Role and Responsibilities Lead Data Governance Strategy : Develop and execute the overall data governance and quality strategy, aligned with business needs and global standards. Data Warehouse Architecture & Pipelines: Work closely with data engineering teams to ensure data More ❯

Role: Principal Data Engineer Type: Permanent Location: Hampshire, London (Hybrid Working) Salary: £80,000 - £90,000 + Benefits Are you an experienced Data Engineer ready to take the next step into a strategic, hands-on leadership role? This is a fantastic opportunity to join a well-established organisation with a long-standing heritage and a strong … They are a household name in general insurance and part of a larger European group, with a UK presence that continues to grow. With significant investment in their data and technology function, theyre now looking to bring on a Principal Data Engineer to help shape and evolve their data infrastructure and engineering capability. The … Opportunity: This is a pivotal role where youll lead on the design, delivery, and optimisation of scalable, secure data systems that support the wider business strategy. Youll be part of a collaborative tech environment, working closely with cross-functional teams and mentoring fellow engineers. Its a great blend of hands-on technical work and strategic influence. What Youll More ❯

We’re working with a leading insurance organisation undergoing a large-scale data transformation, and they’re now seeking a Senior Data Engineer to play a key role in building and improving their data architecture and governance capabilities as part of a major programme of work. Key Responsibilities: Design and implement robust data pipelines and integration frameworks. Support the implementation and enhancement of Master Data Management (MDM) solutions. Work with business and technical stakeholders to ensure data quality, consistency, and governance across systems. Collaborate closely with data architects, analysts, and engineering teams to support strategic data initiatives. Key Skills & Experience: Strong experience as … a Data Engineer in enterprise environments. Proven expertise with MDM tools (e.g. Informatica MDM, Reltio, Semarchy, IBM InfoSphere, etc.). Solid background in data integration, ETL, and data warehousing concepts. Proficiency in SQL and modern data engineering tools/platforms. Experience working in the insurance or financial services sector is highly desirable. More ❯

Title: Senior Data Engineer Salary: Up to £100,000 D.O.E Location: London (Hybrid 3 Days on site) Are you a data engineer ready to make a real impact in a company that values innovation, autonomy, and excellence? iO Associates is recruiting for a high-growth, forward-thinking investment firm that sits at the intersection of finance … and technology - and they're looking for a Data Engineering Specialist to join their collaborative data team. This is a unique chance to step into a role that offers both technical ownership and strategic influence, within a business that's genuinely committed to doing things differently. Our client is known for backing purpose-driven investments and … building tech-enabled solutions that scale with the future of finance. The Role: As a Data Engineering Specialist, you'll play a vital role in transforming how the business uses data. You'll lead critical migration projects, work with modern tooling like Snowflake, and help architect scalable, future-proof data solutions. You'll also collaborate with More ❯

The Senior Data Engineer plays a key role in driving the development and ongoing enhancement of the modern data platform. This platform is designed to provide reliable, actionable insights by integrating data from various systems into a single resource that informs business strategy and decision-making. This position focuses primarily on backend data engineering tasks, including data ingestion, transformation, curation, and analysis, while also shaping the overall data architecture. Working with technologies such as Snowflake, Python, and Matillion, the Senior Data Engineer collaborates closely with internal teams and external partners to deliver high-quality, well-structured, and thoroughly documented datasets. These outputs enable product innovation … driven decisions throughout the organisation. This role offers remote working however you must be commutable to the Newcastle office on an ad-hoc basis. Key responsibilities: Data Pipeline Development Data Modelling & Architecture Data Quality, Testing & Performance Data Enablement & Platform Strategy Data Standards Stakeholder Engagement & Training Ideally you’ll have More ❯

Senior Data Engineer London/Hybrid 2 days per week Permanent Salary: Up to £90,000 We have partnered with a leading investment firm who are seeking a Senior Data Engineer. They have garnered a strong reputation in delivering solutions across the full investment life cycle. They are looking for a skilled and hands-on Senior … Data Engineer to design and build scalable data pipelines to support evolving business and technology needs. This is a key role and will contribute significantly to the company's vision of becoming a data-centric organisation. The ideal candidate will have demonstrable experience with the modern Azure tech stack and a deep understanding of … ingesting and transforming data from diverse internal and external sources. Key Responsibilities: Design and implement robust data solutions to support a modern cloud-native data warehouse. Provide technical leadership and identify effective solutions for complex data-related challenges. Perform and participate in peer reviews of design, code, and tests, ensuring high-quality More ❯

Senior Data Engineer London/Hybrid 2 days per week Permanent Salary: Up to £90,000 We have partnered with a leading investment firm who are seeking a Senior Data Engineer. They have garnered a strong reputation in delivering solutions across the full investment life cycle. They are looking for a skilled and hands-on Senior … Data Engineer to design and build scalable data pipelines to support evolving business and technology needs. This is a key role and will contribute significantly to the company's vision of becoming a data-centric organisation. The ideal candidate will have demonstrable experience with the modern Azure tech stack and a deep understanding of … ingesting and transforming data from diverse internal and external sources. Key Responsibilities: Design and implement robust data solutions to support a modern cloud-native data warehouse. Provide technical leadership and identify effective solutions for complex data-related challenges. Perform and participate in peer reviews of design, code, and tests, ensuring high-quality More ❯

Senior Data Engineer London/Hybrid 2 days per week Permanent Salary: Up to £90,000 We have partnered with a leading investment firm who are seeking a Senior Data Engineer. They have garnered a strong reputation in delivering solutions across the full investment life cycle. They are looking for a skilled and hands-on Senior … Data Engineer to design and build scalable data pipelines to support evolving business and technology needs. This is a key role and will contribute significantly to the company's vision of becoming a data-centric organisation. The ideal candidate will have demonstrable experience with the modern Azure tech stack and a deep understanding of … ingesting and transforming data from diverse internal and external sources. Key Responsibilities: Design and implement robust data solutions to support a modern cloud-native data warehouse. Provide technical leadership and identify effective solutions for complex data-related challenges. Perform and participate in peer reviews of design, code, and tests, ensuring high-quality More ❯

Data Engineer Department: Data Employment Type: Permanent - Full Time Location: London Reporting To: Mike Stanley Compensation: £45,000 - £70,000/year Description Freetrade's mission is to become the default place to invest. Investing has been too complicated and expensive for too long, keeping millions from making the most of their savings. We're changing … tools. We're also exploring how we can leverage AI to deliver an even better experience for our customers. Key Responsibilities Build the pipelines that put Freetrade's data to work, deploying jobs into our Kubernetes cluster, writing Python code to orchestrate them in Dagster, and modelling the data in our BigQuery data warehouse. … Evolve our testing, alerting and quality monitoring capabilities to continuously improve the trust of our data. Deploy data infrastructure through Terraform+Atlantis and write CICD pipelines. Improve the team's operations, adding robustness and increasing efficiency. Build relationships with the Product and Engineering teams that produce our data and implement best practices for the data More ❯

Job Title: Data & Business Intelligence Analyst - Electronics Manufacturing (Power BI Focus) Salary: 26,000 - £35,000 D.O.E Location: Sunderland We're working with a Electronic Manufacturing Services (EMS) company that's looking to unlock the full potential of its data. This is a newly created role within a forward-thinking EMS business that's invested in ERP, MES … and other core systems-but is only scratching the surface of what their data can do. They're now looking for a capable and curious analyst to bridge the gap between IT infrastructure and commercial/manufacturing insight using Power BI. Responsibilities Integrating data from ERP, MES, and other operational systems Building and maintaining Power BI … dashboards and reports Supporting manufacturing and commercial teams with data-driven insights Developing and optimizing data pipelines and ETL processes Collaborating with stakeholders to define KPIs and reporting needs What You'll Need Experience with Power BI (DAX, data modeling, visualizations) Solid SQL skills and understanding of data integration Familiarity with ERP More ❯

Now Hiring: Data Engineering Unit Head | Full-time | Manila, Philippines 🇵🇭 BDO Bank – The Philippines' Largest Bank Are you a data visionary with a passion for shaping the future of enterprise technology? This is your chance to lead transformation with the largest financial institution in the Philippines and one of the fastest-growing companies in the Asia … Pacific region. We're on the hunt for a Data Engineering Unit Head to join the IT Data and Analytics team , where you’ll spearhead innovation across cloud-native architecture, Azure Data Platform, and Databricks ecosystems—powering insights across an entire banking empire. Why Join? 🌏 Opportunity to relocate and live in Manila, Philippines 🚀 Influence … transformation, governance standards, and data engineering excellence What You’ll Lead: • Data platform strategy, standards, and architecture at scale • End-to-end data pipeline optimization using Azure Data Factory, SQL, Cosmos DB, Streaming, and Databricks • A high-performing team of engineers, analysts, and architects • Strategic vendor partnerships and enterprise data More ❯

Now Hiring: Data Engineering Unit Head | Full-time | Manila, Philippines 🇵🇭 BDO Bank – The Philippines' Largest Bank Are you a data visionary with a passion for shaping the future of enterprise technology? This is your chance to lead transformation with the largest financial institution in the Philippines and one of the fastest-growing companies in the Asia … Pacific region. We're on the hunt for a Data Engineering Unit Head to join the IT Data and Analytics team , where you’ll spearhead innovation across cloud-native architecture, Azure Data Platform, and Databricks ecosystems—powering insights across an entire banking empire. Why Join? 🌏 Opportunity to relocate and live in Manila, Philippines 🚀 Influence … transformation, governance standards, and data engineering excellence What You’ll Lead: • Data platform strategy, standards, and architecture at scale • End-to-end data pipeline optimization using Azure Data Factory, SQL, Cosmos DB, Streaming, and Databricks • A high-performing team of engineers, analysts, and architects • Strategic vendor partnerships and enterprise data More ❯

Join a respected and forward-thinking IT consultancy as a Trainee Data Analyst and kickstart your journey into one of the most in-demand fields today. Whether you're a recent graduate or someone looking to make a career change, this is a fantastic opportunity to gain hands-on experience, mentorship, and long-term growth. What Youll Be … Doing: Assisting with data collection, cleansing, and analysis from a range of sources Supporting senior analysts in managing databases and improving data workflows Applying statistical methods to identify trends and uncover insights Helping develop data pipelines and contribute to more efficient data practices Creating clear reports and visual dashboards using tools like … Power BI or Tableau What Were Looking For: A degree in Data Science, Computer Science, IT, Maths, or a related subject Strong analytical thinking and a keen eye for detail Familiarity with tools such as Excel, SQL, SPSS, or similar analytics platforms Some experience or interest in visualisation tools like Power BI or Tableau A proactive, team-oriented More ❯

Now Hiring: Data Engineering Unit Head | Full-time | Manila, Philippines BDO Bank – The Philippines' Largest Bank Are you a data visionary with a passion for shaping the future of enterprise technology? This is your chance to lead transformation at BDO Bank , the largest financial institution in the Philippines and one of the fastest-growing companies in … the Asia-Pacific region. We're on the hunt for a Data Engineering Unit Head to join the IT Data and Analytics team , where you’ll spearhead innovation across cloud-native architecture, Azure Data Platform, and Databricks ecosystems—powering insights across an entire banking empire. Why Join? Opportunity to relocate and live in Manila … transformation, governance standards, and data engineering excellence What You’ll Lead: • Data platform strategy, standards, and architecture at scale • End-to-end data pipeline optimization using Azure Data Factory, SQL, Cosmos DB, Streaming, and Databricks • A high-performing team of engineers, analysts, and architects • Strategic vendor partnerships and enterprise data More ❯