776 to 800 of 926 Data Pipeline Jobs in the UK

on highly impactful problems Promote a positive culture of collaboration, through open and effective communication, particularly when addressing issues or raising concerns. Are able to form well reasoned, data driven or otherwise evidence based arguments, to influence key stakeholders across the business. Required Skills and Experience Has 5+ years commercial experience Expert level in (Javascript Typescript Python) Familiar … with Postgres and K8s Feels at home in AWS console Has built infrastructure with Terraform Bonus points Has worked in an intelligence collection setting Experience with "big data" technologies, the management of data, and data pipelines Familiarity with functional programming concepts Has run production workloads of 1000s QPS Has been part of an "on More ❯

Contract Role - Government/Elections/Politics Data Operations Manager/Research Analyst - London/Onsite - 12 Months Initial - Inside IR35 PAYE We are seeking an exceptional Government/Elections/Politics Data Operations Manager/Research Analyst to join the team supports all government, elections and nonprofit partners globally and that is done through a … backbone of several interconnected data sets to identify this dynamic audience. This role is responsible for reviewing these data sets to ensure compliant and equitable partner support in the government and elections space. This role requires a person who is detail-oriented, capable of analyzing and reviewing large data sets, collaborating and building relationships … with our partner managers, data managers and auditors. Role Overview: Job Title: Government/Elections/Politics Data Operations Manager/Research Analyst Location: London/Onsite Contract Type: Contract Duration: 12 months initially 5-10 years of experience in data operations, or other relevant space leading large scale global projects or programs. Knowledge More ❯

We are looking for a Senior Backend Engineer to join our AI/ML team. In this role, you'll work closely with data scientists to transform cutting-edge machine learning models into scalable, production-ready services. You will take ownership of designing, building, and maintaining the backend systems that power our AI-driven features. This is a … key position that bridges the gap between data science and production engineering , ensuring high performance, reliability, and maintainability of our ML-powered products. Responsibilities Collaborate with data scientists to understand modeling outputs and convert them into deployable services. Design and develop robust, scalable backend systems and microservices to support AI use cases. Own the deployment and … monitoring of ML models in production (with CI/CD, logging, observability). Implement data processing pipelines in support of model training and inference. Ensure software adheres to best practices in architecture, testing, and documentation. Optimize model inference for latency, throughput, and resource efficiency. Contribute to design decisions and technical strategy alongside AI and infrastructure leads. Requirements 5+ More ❯

have become a multibillion-dollar asset manager, and we have ambitious goals for the future. Role Overview You will be developing the company's production trading systems and data pipelines that support our machine learning models in both production and research environments. Collaboration with research and trading teams is essential to meet diverse requirements and complex trading behaviors. … world-class machine learning researchers. Responsibilities Develop and maintain real-time distributed trading systems that execute orders based on our machine learning models. Design and optimize large-scale data processing systems for historical and real-time ML feature pipelines. Enhance the resilience and performance of trading and data processing systems. Build tools to integrate and validate … in Computer Science, Engineering, or a related field, or equivalent industry experience. Preferred Qualifications Experience or interest in mentoring junior engineers. Familiarity with data-centric workflows and pipeline orchestration (e.g., Apache Airflow). Proficiency in data validation, anomaly detection, or debugging using tools like Pandas, Polars, or data.table/R. Experience working with AWS or More ❯

Product About Cognitive Credit: Cognitive Credit is a technological pioneer transforming global credit markets through innovative data and analytics. We partner with the majority of the world's leading buy-side and sell-side institutions, providing unparalleled insights into investment grade bond, high yield bond, and leveraged loan markets, across the US and Europe. By delivering the fastest … most accurate credit data paired with specialist research software, we empower our clients to navigate an ever-more-digitalized global credit market with agility and confidence. Role Summary: We are seeking an experienced Quantitative Analyst to lead our quantitative research and modelling efforts. In this role you will drive innovation and growth across our product lines by applying … a quant finance framework to our proprietary, market-leading datasets. You will be collaborating with our Data and Engineering teams and working with clients to enhance our product offerings and grow our emerging quant services. The successful candidate will own the development of market valuation models and incorporate additional predictive analytics components across our web application, to support More ❯

to humanity's enduring challenges. We are looking for a Senior DevSecOps Engineer to join the Pathogen Programme at EIT. In this role, you'll help ensure our data platform is built to the highest standards, with a strong emphasis on automation across the development lifecycle. You'll work closely with engineers to deploy data pipelines … their workflows. You'll be responsible for maintaining infrastructure, designing secure automation pipelines, managing cloud environments, and ensuring security and compliance. You'll collaborate with cross-functional teams, data engineers, backend, and full-stack developers, to build robust, automated deployment pipelines across our environments. Key Responsibilities Design, implement, and maintain secure cloud infrastructure using Oracle Cloud Infrastructure (OCI … tools like Terraform to enable secure, repeatable deployments. Implement and manage CI/CD pipelines, focusing on automated security testing, deployment, and monitoring. Ensure all aspects of the data platform OCI infrastructure, data ingest pipelines, tool deployments, access controls, and monitoring are developed, tested, and deployed using automation best practices. Support bioinformaticians in building pipelines that More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2024, Aker Systems won the Breakthrough Culture Awards highlighting growth companies putting culture first. In 2020 Aker Systems was recognised as a 'One to Watch' on the Sunday Times Tech Track. The Company was also recognised at the Thames Valley Tech Awards 2020; winning the … of a cross-functional, security-focused product team delivering into public sector and regulated domains like BFSI. Key Responsibilities Define and drive a robust QA strategy across microservices, data pipelines, APIs, and UI Champion BDD principles-writing and maintaining Gherkin-style feature files and executable specifications Build and evolve automated test suites using custom frameworks in Kotlin/ More ❯

to enter prize draws via an app and website - both of which are seeing exponential growth.They've recently launched a new app and are investing heavily into data, product and engineering to optimise user experience and fuel innovation. You'll join a mission-driven company that combines a growth-focused product mindset with a meaningful social purpose. The … Product), reporting directly to the Director of Analytics. This role will be central to shaping new customer propositions, pricing experiments, digital journeys, and app strategies.You'll own the data behind product development and customer experience, driving forward ideas that directly impact retention, user satisfaction, and revenue. You'll have access to billions of rows of data and collaborate closely with data engineers and product managers to test hypotheses and uncover actionable insight. Key Responsibilities Act as the dedicated data partner to the product team across web and app Lead A/B and multivariate testing to validate feature development, UX changes, and pricing experiments Analyse performance of new customer propositions More ❯

governance, validation and audit exercises of existing solutions. You will work closely with the global measurement team, external agency partners and service providers to develop, standardize and optimize data pipelines and operational parameters that can be applied consistently across 12+ European countries while capturing local nuances. You will collaborate with our tech & tools team on the development of … functions and locations, and have demonstrable experience in stakeholder engagement. We are looking for someone who is highly organized and comfortable working in a fast-moving, dynamic and data-driven environment. This role is based at our Amazon corporate office in London/UK or Munich/DE. Key job responsibilities Automate: Identify opportunities to standardize, off-shore … media budget management and business insights. Partner with our external media agency, internal and external measurement partners across Europe and US central team, aligning measurement project and supporting data collection, acquisition and validation. BASIC QUALIFICATIONS 6+ years relevant professional experience in media planning, media finance or media buying. Have experience in media research, insights or data More ❯

About Route Reports Route Reports builds cutting-edge devices and software for inspecting roads, railways, and airports. We empower infrastructure teams with real-time data and analytics to keep infrastructure safe and costs down. Our AI hardware and software solution is market-leading in the UK, and we work with clients like Network Rail, Gatwick Airport, Essex Highways … develop the platform. Key Responsibilities Architect and implement new features across our React front end and Python/JS backend. Build and integrate with RESTful APIs, microservices, and data pipelines Optimise application performance, load times, and reliability Collaborate on UX design, sprint planning, and code reviews Ensure security best practices and compliance with data-protection standards More ❯

Are you a highly skilled Senior Backend Engineer with a passion for Data and Machine Learning, ready to make a global impact? Join Spotify's Commerce Platform to build the next generation of our robust, high-performing, and resilient payments ecosystem. This is a unique opportunity to solve complex challenges, work with ML-powered systems, and contribute to … prevention. The reliability of these systems is business-critical for Spotify. What You'll Do Architect, design, and implement highly scalable backend services (Java/Python) and robust data pipelines that power Spotify's internal Commerce platform. Develop and enhance our ML-powered systems taking solutions from concept to production. Take the lead on API design, platform development … and ensuring the scalability, reliability, and performance of our services. Collaborate with a talented, cross-functional team of engineers, product managers, and data scientists to deliver impactful solutions. Mentor other engineers and foster a culture of continuous learning and technical excellence within the team. Who You Are You have significant experience building and scaling backend services (Java and More ❯

models, we build the driving intelligence that feeds them. Our mission is to drive safer roads and fairer insurance through data. The Telematics team transforms raw phone sensor data into meaningful insights about how people drive. Using advanced signal processing and machine learning, we process high-frequency data to extract behavioural signals that power our understanding … of driving quality, context, and risk. About the Role As a Lead Data Scientist, you'll drive the technical direction of our behavioural modelling work. You'll lead the development of telematics features from idea to production, including exploratory analysis, signal design, risk evaluation, and scalable deployment. This is a hands-on leadership role where you'll design … things into production, values strong engineering, and has opinions on building reliable, scalable systems. What you will be doing Drive the development of telematics features from mobile sensor data, including project design, modelling, validation, and deployment. Conduct deep dives into driving signals, develop hypotheses, and evaluate their predictive power for risk. Design technical solutions with clear trade-offs More ❯

different types of databases: Relational, Graph etc Design and optimise APIs using Python and FastAPI to serve AI solutions. Familiar with GCP ecosystem and Cloudrun Build and optimise data pipelines for vector search and knowledge retrieval using Vector databases and embedding models. What We're Looking For: Professional AI engineering experience. Background in Software Engineering with Python. Solid … Excellent communication skills and the ability to work well in a collaborative team environment Nice to have: Strong experience with GCP Experience with Graph databases Experience in bringing data-intensive projects into production Experience with CI/CD pipelines Benefits: Private Health Insurance: Comprehensive coverage for both physical and mental health. Flexible and Remote-First Work Environment: Choose More ❯

BI Developer/Data Analyst (Power BI) Location: West Midlands Salary: Up to £65,000 Type: Full-time, Office-based About the Role An established food manufacturer and supplier is implementing their first-ever ERP system, focusing on four key modules: Manufacturing, Compliance, Reliability, and Learning. Each module will take approximately 4-6 months to complete. To support … and maintain Power BI dashboards and reports delivering actionable insights. Collaborate with internal stakeholders and external implementation partners throughout the ERP rollout and ongoing system maintenance. Develop robust data pipelines and write advanced SQL queries for ETL processes and data analysis. Migrate and integrate data between systems to ensure seamless communication and reporting. Continuously … monitor and improve BI tools post-ERP implementation. Analyse large datasets to uncover trends supporting strategic decision-making. Ensure data integrity, security, and automation of workflows to maintain reliability and efficiency. Benefits Competitive salary up to £65,000 25 days holiday plus bank holidays Onsite parking available Employee rewards and retail discounts Pension scheme (details to be confirmed More ❯

an engineer early in the career, or a more experienced engineer to take on new challenges. As part of Spotify's Commerce Platform, we manage backend services and data sets that power end-to-end merchandising, order management, payment orchestration and purchase flows. You have the chance to create a significant impact by evolving our technology stack aimed … team that implements change to complex systems at high scale. Collaborate with talented peers and teams across Spotify to deliver value to our users. Gain exposure to backend, data and ML-based systems. Who You Are Experience building and scaling Java or Python services on a large scale cloud platform, such as Google Cloud Platform, or equivalent. Exposure … to scalable database technologies, such as Postgres. Exposure to data and data pipelines, being adept is a plus. Excellent problem-solving skills with a strong bias for action. Strong writing and communication skills. Comfortable driving engineering deep dives and workshops, as well as stakeholder demos. Self-driven and enjoys being part of a team that works More ❯

prioritise innovation and growth - they're considered one of the most well-funded and exciting InsurTech scale-ups in the UK. ROLE AND RESPONSIBILITIES Build and design robust data models, working end-to-end across modelling in DBT and ETL processes Develop and maintain scalable data pipelines using SQL and Snowflake Work closely with analysts, data scientists and product teams to ensure data is reliable and well-structured Own the design and implementation of new models, not just building but shaping how they’re developed Contribute to improving analytics engineering standards and best practices Communicate findings and recommendations clearly across technical and non-technical stakeholders SKILLS AND EXPERIENCE Required: 3+ years in More ❯

prioritise innovation and growth - they're considered one of the most well-funded and exciting InsurTech scale-ups in the UK. ROLE AND RESPONSIBILITIES Build and design robust data models, working end-to-end across modelling in DBT and ETL processes Develop and maintain scalable data pipelines using SQL and Snowflake Work closely with analysts, data scientists and product teams to ensure data is reliable and well-structured Own the design and implementation of new models, not just building but shaping how they’re developed Contribute to improving analytics engineering standards and best practices Communicate findings and recommendations clearly across technical and non-technical stakeholders SKILLS AND EXPERIENCE Required: 3+ years in More ❯

Senior Software Engineer/Architect - £80,000-£100,000 (Hybrid - Cambridge HQ) An emerging startup at the forefront of drone data systems for commercial and government use is looking for a Senior Software Engineer/Architect to join their growing team. This is a unique opportunity to shape cloud-native platforms that convert multi-sensor drone data into real-time insights. You'll work closely with ML engineers and systems architects to design secure, scalable backend systems and data infrastructure from the ground up. Key Responsibilities: Design and build robust, cloud-native backend systems using C++, Python, or Go Develop scalable, secure infrastructure on AWS Collaborate with cross-functional teams including ML and … data engineers Contribute to the architecture of data pipelines and system integrations Lead backend development best practices in a fast-paced startup environment Support the evolution of systems from prototype to production-ready platforms Required Skills & Experience: Strong backend development skills in C++, Python, or Go Proven experience with AWS and cloud infrastructure Expertise in building More ❯

Senior Software Engineer/Architect - £80,000-£100,000 (Hybrid - Cambridge HQ) An emerging startup at the forefront of drone data systems for commercial and government use is looking for a Senior Software Engineer/Architect to join their growing team. This is a unique opportunity to shape cloud-native platforms that convert multi-sensor drone data into real-time insights. You'll work closely with ML engineers and systems architects to design secure, scalable backend systems and data infrastructure from the ground up. Key Responsibilities: * Design and build robust, cloud-native backend systems using C++, Python, or Go * Develop scalable, secure infrastructure on AWS * Collaborate with cross-functional teams including ML and … data engineers * Contribute to the architecture of data pipelines and system integrations * Lead backend development best practices in a fast-paced startup environment * Support the evolution of systems from prototype to production-ready platforms Required Skills & Experience: * Strong backend development skills in C++, Python, or Go * Proven experience with AWS and cloud infrastructure * Expertise in building More ❯

Job title: Power Platform & Azure Data Developer (AI focused) Location: Central London (hybrid - 2 days on site) Salary: Up to £70,000 DOE About the role/company: This is a great opportunity to join a Pharmaceutical company in London who are growing their team. The business are in the process of delivering some of their AI strategies … and are seeking a dynamic and skilled Power Platform & Azure Data Developer with hands-on experience or exposure to AI Key skills/responsibilities: Design, build, and maintain Power Apps (integrate them with Power Automate and in Power BI). Integrate Power Platform solutions with other Microsoft services (e.g SharePoint, Dynamics) Build and manage data pipelines … using Azure Data Factory. Support the deployment of cognitive services (e.g., Azure OpenAI, Azure Machine Learning) Work closely with business stakeholders, analysts, and other developers to gather requirements. Proven experience designing and deploying Power Automate workflows. AI/ML exposure with basic understanding of AI concepts Click 'apply now' or get in touch with Joe Bigsby on (phone More ❯

Job title: Power Platform & Azure Data Developer (AI focused) Location: Central London (hybrid - 2 days on site) Salary: Up to £70,000 DOE About the role/company: This is a great opportunity to join a Pharmaceutical company in London who are growing their team. The business are in the process of delivering some of their AI strategies … and are seeking a dynamic and skilled Power Platform & Azure Data Developer with hands-on experience or exposure to AI Key skills/responsibilities: Design, build, and maintain Power Apps (integrate them with Power Automate and in Power BI). Integrate Power Platform solutions with other Microsoft services (e.g SharePoint, Dynamics) Build and manage data pipelines … using Azure Data Factory. Support the deployment of cognitive services (e.g., Azure OpenAI, Azure Machine Learning) Work closely with business stakeholders, analysts, and other developers to gather requirements. Proven experience designing and deploying Power Automate workflows. AI/ML exposure with basic understanding of AI concepts Click 'apply now' or get in touch with Joe Bigsby on More ❯

systems (TMS), and mobile measurement platforms (MMPs). Campaign Enablement & Optimization Oversee deployment and optimization of digital campaigns through technologies like DCO, SPO, and MMP. Drive efficiency through data-informed testing, measurement frameworks, and performance optimization techniques. Tagging, Pixel & Tech Implementation Own onsite tagging strategies and data accuracy across web and mobile environments. Partner with developers … Analytics & Reporting Use tools like GA4 and Adobe Analytics to create actionable insights and stakeholder dashboards. Collaborate with regions to drive visibility, consistency, and readiness across reporting outputs. Data Governance & Compliance Enforce policies that safeguard data privacy, accuracy, and platform compliance. Implement and optimize Conversion APIs and data pipelines that support attribution and decision … Google Tag Manager, Adobe Launch). Proficient in web analytics tools (e.g., GA4, Adobe Analytics). Hands-on experience with DCO, MMPs (AppsFlyer, Kochava), SPO, Conversion APIs, and data c lean rooms. Familiarity with CDPs, CMPs, DSPs, and social/search activation platforms (e.g., Meta, Google Ads). Strong knowledge of data governance, privacy frameworks , and More ❯

Description For Lead Software Engineer- Python & AWS Join JPMorgan Chase's Commercial & Investment Bank team as a Lead Data Engineer, where you'll be an integral part of an agile team focused on enhancing, building, and delivering data collection, storage, access, and analytics solutions. As a core technical contributor, you'll be responsible for maintaining critical … data pipelines and architectures across multiple technical areas within various business functions. The role combines software engineering excellence with cloud expertise, particularly in AWS services. You'll work with cutting-edge technologies including Python, AWS Glue, Athena, and S3, while implementing best practices in test-driven development and distributed systems architecture. The position offers the opportunity to work … on large-scale data solutions within one of the world's leading financial institutions. The ideal candidate will bring strong technical expertise in both software development and cloud technologies, with particular emphasis on Python and AWS services. You'll be working in a collaborative environment where you can contribute to software engineering communities of practice and explore new More ❯

in architecting our real-time mindshare platform that turns noisy social feeds into crystal-clear token insights. Your work will power a product so fast and intuitive, ingesting data from every channel, powering advanced NLP models, and delivering sub-second API responses that will deliver a trading experience that end users will only describe as magic. This role … deliver new ML-driven insights and to design intuitive consumer-facing dashboards and alert systems that visualize real-time mindshare and sentiment metrics aligned with product goals. Ensure data security and compliance, particularly around user generated content, API keys, and any PII in social media streams. Maintain code and model quality : author clean, efficient, and maintainable code; implement … designing feedback loops, active learning, or user-in-the-loop systems to continuously improve model relevance. Experience with Git-based workflows and integrating model training into CI/CD pipeline Ideal Candidate Profile A creative problem-solver who is eager to innovate and push boundaries in the DeFi space. Deep expertise in data engineering and ML pipelines More ❯

Core Responsibilities: Design and build robust data pipelines within Foundry. Integrate diverse data sources using Foundry's Ontology and Code Workbooks (Python, SQL). Develop and maintain Foundry applications (data lineage, pipelines, object models). Collaborate with analysts, data scientists, and business users to understand requirements. Optimize data flows and More ❯