951 to 975 of 1,504 Data Pipeline Jobs in England

today and tomorrow's problems with the companies who need their help to do it. AND WITH AI. An opportunity to get your hands down and dirty with data to help companies find the best talent. Specifically focusing on research, innovation, science, and engineering. There is a huge and complex database, using AI to provide quantitative insights that … are unmatched. These insights highlight underrepresented talent, particularly women. Day to day, you'll design and develop data pipelines, ensuring data is clean, transformed, and integrated efficiently into the database. The environment is collaborative, working closely with machine learning engineers and data scientists to facilitate seamless data analysis. You'll work within … a dynamic team to support and enhance our AI-driven talent platform. Your background is in a heavy data environment, with a natural inclination towards statistical analysis. A STEM degree is beneficial but not necessary. You should be comfortable in the cloud, preferably AWS, with good experience building, managing, and enhancing data pipelines. Proficiency in Python More ❯

world. The Search product area is central to that mission-reinventing how users find and connect with content in new and relevant ways. We're looking for a Data Engineer to join a squad passionate about delivering pioneering search experiences powered by Machine Learning (ML) and Large Language Models (LLMs). In this role, you'll help craft … the team's data strategy and build the systems that power smarter, more intuitive discovery on Spotify. You'll work alongside a dedicated mix of ML and Backend Engineers to tackle some of Spotify's most exciting challenges in retrieval, ranking, and personalization. If you're excited by data systems, ML-powered products, and the opportunity … to impact how millions of people explore audio content-this is the role for you. What You'll Do Design, build, and maintain scalable, reliable data pipelines that support advanced search capabilities. Partner closely with ML and Backend Engineers to enable features like organic search retrieval and personalized recommendations. Continuously assess and improve the health of the team More ❯

a top hedge fund and a global leader in management consultancy, that brings together world-class expertise and a shared ambition to build an exceptional team delivering innovative, data-driven solutions that drive real business impact. You can be the next Data Engineer to join their fast growing Data team. This role offers a … unique opportunity to work at the intersection of finance and technology, engaging directly with front-office teams to develop and maintain high-performance data systems. You will be responsible for building and optimising their data platform, creating robust data pipelines, and implementing scalable solutions that meet the evolving needs of the business. Utilise your … strong background in data engineering, combined with your existing experience using SQL, Python and Apache Spark in production environments. The role will entail strong problem-solving skills, attention to detail, and the ability to work independently while collaborating closely with internal and external stakeholders. At this firm, you will have the opportunity to contribute from day one, working More ❯

Data Engineer | Software and Analytics Scale Up | Bristol/Hybrid | £60 - 65,000 + bonus (doe) iO Associates are delighted to be partnering with an exciting Software and Analytics scale up, who are looking for a Data Engineer to join their growing data team. Focused on the IoT devices arena, this Tech-for-Good … to provide technology to those that need it most, and creates a safer environment for all to live in. Key responsibilities: Manage ClickHouse clusters to handle large-scale data storage and analytics. Manage MySQL database performance, including design of data models, query optimization and indexing. Advise and implement elegant data models, working with product … and understanding of database design principles. Experience with NoSQL databases like ElasticSearch, Dynamo DB. Experience with ETL tools and data integration processes. Familiarity with data pipeline orchestration and data streaming technologies such as RabbitMQ, Kinesis, Kafka. Please note that you will be required to work in the Bristol office 4 days per week. More ❯

Talent Guardian are working with a well-established business based near Maidstone to offer a fantastic opportunity for a highly motivated Graduate Data Scientist to join their growing data and analytics team. This role is perfect for a recent graduate (2:1 or above in Computer Science, Data Science, AI, or a related field … a passion for machine learning and artificial intelligence. You’ll have the chance to apply the skills you’ve gained during your studies to develop advanced models and data solutions that directly influence business decisions. The position offers flexibility and autonomy — you’ll be encouraged to use your research, initiative, and expertise to design innovative approaches and solve … complex problems. Key Responsibilities Build clean, robust, and scalable data pipelines in collaboration with the data team. Develop and test machine learning models that support and enhance business operations. Identify and explore how AI can be used to improve efficiency and drive innovation. Assist with ad-hoc data requests and collaborate with analysts to More ❯

Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served … overseas. This role provides an exceptional opportunity for a data leader to make a difference in one of the most exciting parts of Government. We are looking for a Data Engineering leader with outstanding technical skills to improve the use of data to inform decisions in everything it does, as well as leading our More ❯

We’re Hiring: Data Engineering Manager | Leadership | Cloud | Agile | London/Hybrid Are you a people-first technical leader who’s passionate about building high-performing teams and scalable data platforms? At Reward, data is at the core of everything we do — from powering real-time customer insights to supporting our global loyalty platform. … We’re looking for an experienced and inspiring Data Engineering Manager to lead our talented team as we grow. 🔧 What you’ll be doing: Reporting into the Director of Engineering, you’ll manage multiple engineering teams focused on designing and delivering robust, scalable data pipelines. You’ll ensure best practices are upheld while keeping our delivery … roadmap aligned with company goals. You will: Lead and develop the Data Engineering team in an agile environment Instil and maintain engineering best practices and documentation standards Oversee resource planning, team escalations, and tooling access Collaborate with Product, Architecture, Project Management and Scrum Masters to deliver high-quality solutions Support operational excellence in monitoring and maintaining production services More ❯

We’re Hiring: Data Engineering Manager | Leadership | Cloud | Agile | London/Hybrid Are you a people-first technical leader who’s passionate about building high-performing teams and scalable data platforms? At Reward, data is at the core of everything we do — from powering real-time customer insights to supporting our global loyalty platform. … We’re looking for an experienced and inspiring Data Engineering Manager to lead our talented team as we grow. 🔧 What you’ll be doing: Reporting into the Director of Engineering, you’ll manage multiple engineering teams focused on designing and delivering robust, scalable data pipelines. You’ll ensure best practices are upheld while keeping our delivery … roadmap aligned with company goals. You will: Lead and develop the Data Engineering team in an agile environment Instil and maintain engineering best practices and documentation standards Oversee resource planning, team escalations, and tooling access Collaborate with Product, Architecture, Project Management and Scrum Masters to deliver high-quality solutions Support operational excellence in monitoring and maintaining production services More ❯

Job Title: Data Lead Salary: up to ~£110k + very generous equity (of the same value as your salary!) Benefits include: unlimited AL, 2 company trips/year, contribution towards your own holiday Location: Shoreditch (2 office days/week) Industry: FinTech/Payments Company overview Having raised over £7m at seed stage, this FinTech company is shaking … largest players in payments, this company is causing the biggest change to how businesses access card payments in over two decades. Role overview As the company's first data hire, you’ll be tasked with designing, building and owning their data stack. You’ll also be responsible for applying your expertise in quantitative analysis to understand … how their users behave. Your insights will feed into data products that you’ll own, as well as into the wider product strategy. Reporting directly to the CTO/founder and working alongside the founding employees, you'll have a huge impact on the business from day 1 - you'll get to experiment and built innovative products at More ❯

Job Title: Data Lead 💰 Salary: up to ~£110k + very generous equity ( of the same value as your salary !) 🌴 Benefits include : unlimited AL, 2 company trips/year, contribution towards your own holiday 📍 Location: Shoreditch (2 office days/week) 💵 Industry: FinTech/Payments Company overview Having raised over £7m at seed stage, this FinTech company is shaking … largest players in payments, this company is causing the biggest change to how businesses access card payments in over two decades. Role overview As the company's first data hire , you’ll be tasked with designing, building and owning their data stack. You’ll also be responsible for applying your expertise in quantitative analysis to understand … how their users behave. Your insights will feed into data products that you’ll own, as well as into the wider product strategy. Reporting directly to the CTO/founder and working alongside the founding employees, you'll have a huge impact on the business from day 1 - you'll get to experiment and built innovative products at More ❯

Job Title: Data Lead 💰 Salary: up to ~£110k + very generous equity ( of the same value as your salary !) 🌴 Benefits include : unlimited AL, 2 company trips/year, contribution towards your own holiday 📍 Location: Shoreditch (2 office days/week) 💵 Industry: FinTech/Payments Company overview Having raised over £7m at seed stage, this FinTech company is shaking … largest players in payments, this company is causing the biggest change to how businesses access card payments in over two decades. Role overview As the company's first data hire , you’ll be tasked with designing, building and owning their data stack. You’ll also be responsible for applying your expertise in quantitative analysis to understand … how their users behave. Your insights will feed into data products that you’ll own, as well as into the wider product strategy. Reporting directly to the CTO/founder and working alongside the founding employees, you'll have a huge impact on the business from day 1 - you'll get to experiment and built innovative products at More ❯

We’re Hiring: Data Engineering Manager | Leadership | Cloud | Agile | London/Hybrid Are you a people-first technical leader who’s passionate about building high-performing teams and scalable data platforms? At Reward, data is at the core of everything we do — from powering real-time customer insights to supporting our global loyalty platform. … We’re looking for an experienced and inspiring Data Engineering Manager to lead our talented team as we grow. What you’ll be doing: Reporting into the Director of Engineering, you’ll manage multiple engineering teams focused on designing and delivering robust, scalable data pipelines. You’ll ensure best practices are upheld while keeping our delivery … roadmap aligned with company goals. You will: Lead and develop the Data Engineering team in an agile environment Instil and maintain engineering best practices and documentation standards Oversee resource planning, team escalations, and tooling access Collaborate with Product, Architecture, Project Management and Scrum Masters to deliver high-quality solutions Support operational excellence in monitoring and maintaining production services More ❯

to develop a wide range of new skills on the job. In our team you will: We typically work hand-in-hand with our clients to build great data products. To do this, we need experienced, capable engineers who can both deploy their own mastery to get things done hands-on and successfully lead others in doing so. … experience, and learn from colleagues working in very diverse problem spaces. We are looking for experience in the following skills: You’ve spent at least 5 years building data pipelines and products using various platforms and languages, for example batch warehouses driven by ELT and real-time insights. You’re fluent in at least one of the core … data languages, such as Python or Scala, and of course versed in SQL and its use in data pipelines. You have recent experience building, deploying, and running data pipelines or insights tooling on cloud services (AWS, Azure, Snowflake, Databricks) You have some experience leading a team and growing the careers of team members What More ❯

About the role Reporting into the Data Systems Manager, the Data Systems Executive is a key position within the Operations arm of the Moorepay marketing team. The role will work with key stakeholders within the wider Data Operations team to enable and maintain the 'Moorepay Data Platform' (MDP). This includes managing … data quality as well as administration and maintenance of the ETL Engine and the Data Lakehouse, enabling the business to build value-adding data products at scale to support core business objectives. In particular, the role holder will conduct a data cleanse exercise to deliver a defined Customer Master Data … Model Highly data literate with strong data language expertise - SQL and Python primarily - for data manipulation and end-to-end data pipeline management Familiar with data-as-code methodology, specifically around version control and documentation/change controls Knowledge of working within GDPR and other data regulatory More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … encourages applications from underrepresented groups. We are committed to equality of opportunity and welcome applications from individuals, regardless of their background. Job Description We are looking for a Data Engineer to join our Product Development team. You will work closely with the Scrum Master to deliver our technical builds, approach, and prioritisation. Are you a developer, data or software engineer with experience working with advertising/media dataset, and a history of creating data pipelines and structures that can be used in front end applications or creating automations that make data work harder? If so this is the role for you! Qualifications To be successful in this role you will need More ❯

as specialist practices Publicis Media Exchange (PMX), Performics, Publicis Sport & Entertainment, Publicis Media Content and NextTECHnow. Together they combine deep expertise in media investment, strategy, insights and analytics, data and technology, commerce, performance marketing and content. Publicis Media is part of Publicis Groupe and is present in more than 100 countries with over 23,500 employees worldwide. Our … encourages applications from underrepresented groups. We are committed to equality of opportunity and welcome applications from individuals, regardless of their background. Job Description We are looking for a Data Engineer to join our Product Development team. You will work closely with the Scrum Master to deliver our technical builds, approach, and prioritisation. Are you a developer, data or software engineer with experience working with advertising/media dataset, and a history of creating data pipelines and structures that can be used in front end applications or creating automations that make data work harder? If so this is the role for you! Qualifications To be successful in this role you will need More ❯

Data Pipeline Development: Design and implement end-to-end data pipelines in Azure Databricks, handling ingestion from various data sources, performing complex transformations, and publishing data to Azure Data Lake or other storage services. Write efficient and standardized Spark SQL and PySpark code for data transformations, ensuring … data integrity and accuracy across the pipeline. Automate pipeline orchestration using Databricks Workflows or integration with external tools (e.g., Apache Airflow, Azure Data Factory). Data Ingestion & Transformation: Build scalable data ingestion processes to handle structured, semi-structured, and unstructured data from various sources (APIs, databases, file systems). … Tuning & Optimization: Optimize Spark jobs for performance by tuning configurations, partitioning data, and caching intermediate results to minimize processing time and resource consumption. Continuously monitor and improve pipeline performance, addressing bottlenecks and optimizing for cost efficiency in Azure. Automation & Monitoring: Automate data pipeline deployment and management using tools like Terraform, ensuring consistency across environments. More ❯

Skilled Machine Learning Engineer with strong experience in AWS cloud services, and proven ability in integration and development of ML solutions. The ideal candidate will collaborate closely with data scientists, developers, and DevOps teams to design, deploy, and maintain scalable machine learning systems in production. Key Responsibilities: Design, develop, and deploy machine learning models in production environments using … AWS services (eg, SageMaker, Lambda, EC2, S3, EKS, etc.). Build scalable data pipelines for training and inference using AWS Glue, Step Functions, and other ETL tools. Integrate ML models into existing systems and APIs, ensuring seamless operation across multiple services and platforms. Collaborate with cross-functional teams to gather requirements and implement ML solutions aligned with business … clean, maintainable code in Python (and optionally Java/Scala) following best software engineering practices. Automate model training, validation, and deployment workflows using CI/CD pipelines (eg, Code Pipeline, Jenkins, GitHub Actions). Ensure security and compliance in data handling and model deployment within the AWS ecosystem. Document ML workflows, APIs, and integration points to support More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be … the ideal candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places … pipelines, and infrastructure that supports advanced analytics and machine learning. DataOps & DevOps Enablement: Skilled in implementing CI/CD pipelines, observability standards, and modern engineering workflows to enhance pipeline reliability, agility, and operational efficiency. Technical Standards & Frameworks: Experience in defining and enforcing data engineering best practices, architectural patterns, and reusable frameworks across multiple product teams. Data More ❯

Experience in Cloud Data Pipelines Building cloud data pipelines involves using Azure native programming techniques such as PySpark or Scala and Databricks. These pipelines are essential for tasks like sourcing, enriching, and maintaining structured and unstructured data sets for analysis and reporting. They are also crucial for secondary tasks such as flow pipelines, streamlining … systems. Key Skills and Experiences Strong programming experience in Python Proven experience working on the MS Azure cloud platform and its native tech stack in designing and building data & AI solutions Experience with data modeling, ETL processes, and data warehousing Knowledge of big data tools and frameworks such as Spark, Hadoop, or More ❯

cloud, while learning new tools and pushing your engineering skills forward. What Youll Do Design and develop robust backend applications using Go/Golang Build scalable APIs and data pipelines integrating with multiple platforms Write clean, well-documented code with strong testing practices Collaborate in agile sprints to deliver high-quality features and improvements Develop and manage CI … ideally Google Cloud Platform , or AWS/Azure Familiar with agile development, version control, and dev standards Confident writing maintainable, scalable, and production-ready code Desirable: CI/CD pipeline experience (GitHub Actions preferred) Experience with microservices , Kubernetes , or serverless architectures Infrastructure automation using Terraform Frontend experience with JavaScript , TypeScript , or frameworks like Svelte , React , or Vue Understanding of More ❯

AI-driven autonomous workflows, enabling seamless human-AI interaction. Build and deploy open-source models in cloud environments, optimizing inference and serving costs. Improve and maintain data pipeline reliability and participate in on-call rotations. Debug and fix issues in ML pipelines, even when the cause is obscure. Collaborate with cross-functional teams to integrate AI models … scalable and cost-efficient ways. Optimize prompts, refine model outputs, and experiment with novel prompting strategies. Implement backend endpoints to bridge AI capabilities into our production stack. Label data and refine model training workflows. Hire and manage part-time annotators to improve data quality. Create quick prototypes using Dash/Streamlit to validate concepts. Own features … and monitoring systems. Experience with GCP is a big plus. DevOps experience is a big plus. Prompt engineering expertise and creative problem-solving mindset. Experience with processing multimodal data (text, images, audio) is a plus. Perks and Benefits: Fully Remote: Work from anywhere with flexible hours. In-person Meetups and regular team-building remote events: Enjoy occasional meetups More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building … and developing the tooling and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work … their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building … and developing the tooling and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work … their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own More ❯

The Role We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the Data team, building … and developing the tooling and pipelines that form our data ingestion and modelling machine for driving forward our revenue. What we're offering you Flexible hours and summer hours Hybrid working Competitive holiday benefits - 25 days a year paid holiday, plus 8 bank holidays (increases 1 day a year up to 30 days) Closed for Christmas holidays Work … their mini-mes Free breakfast when in the office 2 charity days a year Responsibilities Ability to communicate technical information to both technical and business audiences Understand our data landscape and architecture Design and implement high-performance, reusable, and scalable data models to ensure your internal customers get consistent and reliable answers when running their own More ❯