526 to 550 of 1,167 Data Pipeline Jobs in the UK

continuous improvement, and ensure our moderation efforts align with broader business objectives. What You Will Do: Conduct in-depth analysis of UGC moderation data to identify trends, patterns, and optimization opportunities, translating complex insights into actionable recommendations. Collaborate with cross-functional teams like product, engineering and vendor management … as well as with external industry partners to stay current on emerging moderation practices and implement data-driven solutions. Champion a data-driven culture by fostering collaboration, knowledge sharing, and best practices that elevate moderation quality, efficiency, and scalability. Develop and implement new methodologies to measure … the impact of moderation decisions, using advanced analytics and big data techniques to inform strategic direction. Generate and maintain reports, dashboards, and data pipelines by consolidating multiple data sources, programming algorithms, and automating processes to produce actionable insights. Work on diverse-scope problems where More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer- About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing within the team Senior Engineer - Desirable Skills More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer- About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing within the team Senior Engineer - Desirable Skills More ❯

is seeking a software engineer to join their team in Mayfair, London. We are looking for a Senior Backend Software Engineer with strong data engineering skills to join a small, agile team developing software solutions for our energy supply and trading functions. Hybrid working is in play, with … days at home. Software Engineer - About the role: My client’s energy business is growing rapidly with a strong focus on using advanced data systems and analytics to deliver exceptional service. We are looking for someone to take ownership of the backend architecture that underpins our analytics applications … Databricks Containerisation: Docker, Kubernetes CI/CD: Azure DevOps, GitHub Actions Relational databases and data lake architecture Model and data pipeline integration (e.g. MLflow) Microsoft Azure (Functions, Storage, Compute) Monitoring tools (Grafana, Prometheus, etc.) Mentoring and knowledge sharing within the team Senior Engineer - Desirable Skills More ❯

Data Manager | London 3 or 4 times a month |£74,000-£84,000 + Huge Bonus My client, a forward-thinking organisation in the interactive tech and entertainment space, is on the lookout for an experienced Engineering Manager to head up their data engineering function. This … a high-performing team to deliver it. You'll collaborate with analysts, scientists, and stakeholders to design fast, scalable pipelines and shape the data architecture that fuels innovation. What You'll Be Doing: Lead a team of data engineers, providing technical guidance, mentoring, and support. Oversee … the build and optimisation of scalable data pipelines and robust ETL workflows. Partner with teams across the business to gather data requirements and deliver accessible, reliable datasets. Champion best practices in data quality, governance, and platform security. Modernise and evolve the data More ❯

Data Manager | London 3 or 4 times a month |£74,000-£84,000 + Huge Bonus My client, a forward-thinking organisation in the interactive tech and entertainment space, is on the lookout for an experienced Engineering Manager to head up their data engineering function. This … a high-performing team to deliver it. You'll collaborate with analysts, scientists, and stakeholders to design fast, scalable pipelines and shape the data architecture that fuels innovation. What You'll Be Doing: Lead a team of data engineers, providing technical guidance, mentoring, and support. Oversee … the build and optimisation of scalable data pipelines and robust ETL workflows. Partner with teams across the business to gather data requirements and deliver accessible, reliable datasets. Champion best practices in data quality, governance, and platform security. Modernise and evolve the data More ❯

years, we've scaled the global Customer Experience Centre (a hybrid startup-consultancy) in one of the world's most powerful brands. The Data & Analytics & Reporting team drives value generated by millions of customer interactions across 110 countries. The team helps global markets to imagine, deliver and run … on the build of personalisation and recommendation models that enhance customer experience (CX). Help design a reliable, secure, scalable platform that allows Data Scientists to bring machine learning models to production. Drive the optimisation of performance analyses, landing page testing and funnel optimisation. Act as a bridge … of models and product. Work with big data, using data science techniques and alongside engineers to define data pipeline needs. We would like you to have Experience with Personalisation and Experimentation solutions is essential, preferably in a retail, ecommerce or multi-channel environment. More ❯

We are seeking a skilled senior data engineer to join a dynamic team in London responsible for building a global and scalable data lakehouse which will be used by multiple trading desks at the fund. This role offers the opportunity to work with cutting-edge technologies … and collaborate with multiple trading teams to drive data-driven decision-making. Key Responsibilities: Design, develop, and maintain a robust data lakehouse solution for use by multiple trading desks. Collaborate with trading teams to understand their data needs and provide tailored solutions. Implement data pipelines in python using data libraries and cloud software development kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large More ❯

We are seeking a skilled senior data engineer to join a dynamic team in London responsible for building a global and scalable data lakehouse which will be used by multiple trading desks at the fund. This role offers the opportunity to work with cutting-edge technologies … and collaborate with multiple trading teams to drive data-driven decision-making. Key Responsibilities: Design, develop, and maintain a robust data lakehouse solution for use by multiple trading desks. Collaborate with trading teams to understand their data needs and provide tailored solutions. Implement data pipelines in python using data libraries and cloud software development kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large More ❯

Job Title: Mid-Level Data Engineer Location: Fully Remote (UK-based applicants only, with optional weekly co-working in Cambridge) Employment Type: Full-Time, Permanent Sector: Data & AI Consultancy – Banking & Video Gaming Salary: Competitive, dependent on experience About the Role Intellect Group is delighted to be … recruiting on behalf of a specialist data consultancy based in Cambridge, renowned for delivering high-impact solutions across the Banking and Video Gaming sectors. Their areas of expertise include Digital Transformation , Machine Learning & AI , Data Engineering , and Data Science . As they continue to … grow, they are now looking for a Mid-Level Data Engineer to join their close-knit team. This is a fantastic opportunity for a technically strong and motivated individual with a few years of experience under their belt, who’s ready to take ownership of their work, contribute More ❯

Job Title: Mid-Level Data Engineer Location: Fully Remote (UK-based applicants only, with optional weekly co-working in Cambridge) Employment Type: Full-Time, Permanent Sector: Data & AI Consultancy – Banking & Video Gaming Salary: Competitive, dependent on experience About the Role Intellect Group is delighted to be … recruiting on behalf of a specialist data consultancy based in Cambridge, renowned for delivering high-impact solutions across the Banking and Video Gaming sectors. Their areas of expertise include Digital Transformation , Machine Learning & AI , Data Engineering , and Data Science . As they continue to … grow, they are now looking for a Mid-Level Data Engineer to join their close-knit team. This is a fantastic opportunity for a technically strong and motivated individual with a few years of experience under their belt, who’s ready to take ownership of their work, contribute More ❯

Job Title: Mid-Level Data Engineer Location: Fully Remote (UK-based applicants only, with optional weekly co-working in Cambridge) Employment Type: Full-Time, Permanent Sector: Data & AI Consultancy – Banking & Video Gaming Salary: Competitive, dependent on experience About the Role Intellect Group is delighted to be … recruiting on behalf of a specialist data consultancy based in Cambridge, renowned for delivering high-impact solutions across the Banking and Video Gaming sectors. Their areas of expertise include Digital Transformation , Machine Learning & AI , Data Engineering , and Data Science . As they continue to … grow, they are now looking for a Mid-Level Data Engineer to join their close-knit team. This is a fantastic opportunity for a technically strong and motivated individual with a few years of experience under their belt, who’s ready to take ownership of their work, contribute More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days' work from home Salary: Negotiable to 70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities Assist in the design, development, and maintenance of data pipelines and ETL processes Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery Monitor More ❯

Data Engineer (Airport/Manufacturing Experience Required) Location: Middlesex 3 days in the office 2 days' work from home Salary: Negotiable to £70,000 Dependent on Experience Job Reference J12953 Please note we can only accept applications from those with current UK working rights for this role, this … client cannot offer visa sponsorship. A market leading global logistics organisation seeks an experienced Data Engineer to support the development and optimisation of data pipelines. The role will focus on ensuring the reliable flow of information across the business, maintaining the highest standards of quality data … and collaborative team working in a fast paced, team orientated environment. Job Role and Responsibilities ·Assist in the design, development, and maintenance of data pipelines and ETL processes ·Collaborate with data scientists, analysts, and other stakeholders to ensure accurate data collection and delivery ·Monitor More ❯

Data Science Manager London (Lloyd's Market) About the Company Our client is a high-performing, diversified insurer operating in the Lloyd's market. Known for strong underwriting performance and a collaborative culture, they are a long-term, solution-driven partner to brokers and clients worldwide. They offer … where empowered decision-making, innovation, and mutual success are at the heart of their business. About the Role We're looking for a Data Science Manager to lead the development and integration of machine learning and advanced analytics solutions that support underwriting, risk selection, pricing, and automation. This … role will drive key data science initiatives including algorithmic risk ranking, profitability analysis, pricing model enhancement, and digital rule-based trading strategies. The ideal candidate will collaborate closely with underwriters, actuaries, data engineers, and senior stakeholders to translate data into action and insights. Key More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. … Azure certified Data Engineer/Architect Knowledge of Machine Learning and NLP unstructured data. Implemented ML platform in enterprise client experience of ML use-cases AIML Platforms: DataRobot, Dataiku, Anaconda, Sagemaker, Vertex etc. AIML Frameworks: MLFlow, KubeFlow, BentoML, TensorFlow etc. AIML Development: PyTorch, Jupyter Notebooks, XGBoost, Tensorflow etc. More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. … Azure certified Data Engineer/Architect Knowledge of Machine Learning and NLP unstructured data. Implemented ML platform in enterprise client experience of ML use-cases AIML Platforms: DataRobot, Dataiku, Anaconda, Sagemaker, Vertex etc. AIML Frameworks: MLFlow, KubeFlow, BentoML, TensorFlow etc. AIML Development: PyTorch, Jupyter Notebooks, XGBoost, Tensorflow etc. More ❯

Data Engineering Team Lead London x2 days a month A fast-growing technology company is looking for an experienced Data Engineering Team Lead to guide and grow its core data infrastructure. This is a key leadership role for someone excited about building scalable systems … managing a high-performing team, and collaborating across disciplines to support advanced analytics, product development, and data-driven decision-making. Role Overview You'll take ownership of the data engineering function, ensuring the systems in place are robust, efficient, and capable of handling the company’s … and advising on architecture, this role balances technical execution with strategic oversight. In this role, you’ll: Lead and support a team of data engineers working on the company’s key data platforms Design and implement reliable, high-throughput data pipelines to serve diverse More ❯

Data Engineering Team Lead London x2 days a month A fast-growing technology company is looking for an experienced Data Engineering Team Lead to guide and grow its core data infrastructure. This is a key leadership role for someone excited about building scalable systems … managing a high-performing team, and collaborating across disciplines to support advanced analytics, product development, and data-driven decision-making. Role Overview You'll take ownership of the data engineering function, ensuring the systems in place are robust, efficient, and capable of handling the company’s … and advising on architecture, this role balances technical execution with strategic oversight. In this role, you’ll: Lead and support a team of data engineers working on the company’s key data platforms Design and implement reliable, high-throughput data pipelines to serve diverse More ❯

In this unique role, you will play a pivotal role in enhancing our infrastructure's reliability, scalability, and security, while also optimizing our data pipelines and storage solutions. If you're excited about building an economy where every company creates an impact for a sustainable world and empowering … effective monitoring and incident response. Implement security best practices to protect data and comply with industry standards. Responsibility 2: CI/CD Pipeline Development Develop and optimize CI/CD pipelines using tools such as GitHub Actions or GitLab CI. Automate deployment processes to enhance developer productivity … and accelerate feature delivery. Troubleshoot and resolve pipeline issues to maintain seamless integration and deployment workflows. Responsibility 3: Data Engineering and Management Design and implement data pipelines and ETL workflows to process and analyze large datasets. Manage data warehouses and streaming solutions to More ❯

we're understandably biased. Click here to explore Life at Octopus. About the Role What's in it for you? As a Senior Data Insight Analyst within the Data Insights function at Octopus Investments, you will play a crucial role in supporting the team to derive … small team of analysts to deliver impactful insights that contribute to the strategic objectives of the organisation. Reporting directly to the Head of Data Insights, you will be instrumental in driving the success of the central insights function. The team: Data Insights is a team of … into four main categories: access & enablement, insights development, operational intelligence, and campaign & comms support. These categories have been defined with the aim of Data Insights acting as a Centre of Excellence to the wider business. What will you be doing? Mentoring and inspiring a team of data More ❯

you can apply for a job. Business Analyst, analytics and insights, EU AMZL Capacity Planning Analytics View more categories View less categories Sector Data Science ,Technology Role Analyst Contract Type Permanent Hours Full Time DESCRIPTION The goal of Amazon Logistics (AMZL) is to build a world class last … broad exposure to various business, operational, financial, and technical teams across Amazon. If you are someone who is passionate about getting insights from data, who systematically breaks down highly complex and ambiguous problems with ease and who enjoys working on a fast paced environment, we would love to … business problem and build an analytical solution to address the same 3. Develop and deploy an analytical solution (from setting up data pipeline to building a user-friendly report/application/analysis) and share insights back to business leaders using a white paper 4. Actively engaging More ❯

Big Data Engineer, Global Finance Technology (GFT) Are you an experienced Big Data Engineer passionate about building scalable and enterprise-level data engineering solutions? This opportunity is a great fit for an experienced Big Data Engineer who enjoys working on large-scale … computing leveraging AWS distributed systems. In addition to technical expertise, you will invest time to understand the needs of the business, the data behind it, and how to transform information into technical solutions that allow the business to take action. Key job responsibilities - Design and build scalable big … data pipelines to ingest, transform and publish massive amounts of data at scale - Troubleshoot system and data quality issues - Identify bottlenecks with current architecture and propose efficient and long term solutions - Provide operational support by participating in team's on call rotations - Mentor junior More ❯

cutting-edge AI Innovation Team, and we are looking for an exceptional Machine Learning Engineer/MLOps Engineer/AIOps Engineer/AI Data Engineer/Data Scientist/Data Science Engineer/Software Engineer Tech Lead to be at the heart of this … transformation. Call it what you want, but this is a critical role for someone who can bridge the gaps between data science, data engineering and software engineering, ensuring AI/ML models are successfully built, deployed and scaled. You will work on real-world machine learning … doing: Develop and deploy AL/ML artificial intelligence/machine learning models for large-scale business applications. Build and maintain high-performance data pipelines, integrating structured and unstructured data sources. Take AI models from prototype to fully scalable production systems. Implement CI/CD pipelines More ❯

cutting-edge AI Innovation Team, and we are looking for an exceptional Machine Learning Engineer/MLOps Engineer/AIOps Engineer/AI Data Engineer/Data Scientist/Data Science Engineer/Software Engineer Tech Lead to be at the heart of this … transformation. Call it what you want, but this is a critical role for someone who can bridge the gaps between data science, data engineering and software engineering, ensuring AI/ML models are successfully built, deployed and scaled. You will work on real-world machine learning … doing: Develop and deploy AL/ML artificial intelligence/machine learning models for large-scale business applications. Build and maintain high-performance data pipelines, integrating structured and unstructured data sources. Take AI models from prototype to fully scalable production systems. Implement CI/CD pipelines More ❯