826 to 850 of 1,009 Data Pipeline Jobs in the UK

Were looking for a data and technology-oriented Staff Software Engineering Manager to help us accomplish our mission to improve and extend lives by learning from the experience of every person with cancer. Are you ready to be the next changemaker in cancer care? Flatiron Health is a healthtech company using data for good to power … the US, Europe and Asia to transform patients real-life experiences into real-world evidence and create a more modern, connected oncology ecosystem. Our multidisciplinary teams include oncologists, data scientists, software engineers, epidemiologists, product experts and more. Flatiron Health is an independent affiliate of the Roche Group. What You'll Do This role will design and develop technology … challenges Rapidly iterate on products while maintaining engineering practices that ensure quality and security Promote technical excellence and elegant infrastructure design with teammates and customers Work with complex data pipelines using a variety of data processing tools Bring or develop a deep knowledge of healthcare in the UK, including data sources, security requirements, and More ❯

As a Privacy Engineer at NCC Group, you will play a crucial role in assessing and enhancing our clients' privacy solutions. You will leverage your expertise in data engineering and privacy to analyse, design, and develop innovative privacy solutions tailored to enterprise environments. Your work will ensure that our clients' technologies meet the highest standards of privacy and … data protection. Summary Conduct comprehensive assessments of clients' privacy solutions to identify strengths and areas for improvement. Design and develop customised privacy solutions to address clients' specific needs and challenges. Execute rigorous testing processes to validate the effectiveness of privacy technologies. Collaborate with clients' cross-functional teams to integrate privacy into their system designs and workflows. Provide expert … technical guidance on data engineering and privacy best practices to clients. Develop and utilise tools and scripts in Python to support privacy engineering tasks. Conduct technical tests and experiments to validate privacy solutions for clients. Document and communicate privacy solutions and findings to clients and stakeholders. Knowledge of global privacy regulations and compliance requirements. Experience with privacy impact More ❯

Job Title: Data Consultant (Azure) - Outside IR35 Location: London - onsite 3 days per week Salary/Rate: £350 per day - outside IR35 Start Date: August Duration: March 2026 I have an exciting opportunity to work with a sector-leading consultancy client. They are looking for an experienced Software Engineer to join on a 12-month contract working outside … IR35. Job Responsibilities/Objectives Develop and deploy ETL pipelines for data cleansing using Azure-based tooling. Build and maintain outbound/inbound API endpoints for downstream systems (e.g. reporting tools, finance systems). Write scripts to generate unique client identifiers and validate data quality rules. Design and configure integration flows between Dataverse, the practice management … experience delivering technical solutions across Microsoft Dataverse, Azure Fabric, and Power Platform. Strong coding experience in one or more languages: Python, C#, Hands-on experience with API integrations, data pipelines, and transformation logic. Demonstrated expertise with modern delivery techniques - including TDD, pairing, infrastructure-as-code, and CI/CD pipelines, using tooling such as Azure DevOps or GitHub More ❯

For more information, contact Mieke Van Tonder at . This is an exciting opportunity for someone passionate about technology, data, and machine learning, eager to contribute to a collaborative environment. The Data Scientist will build and deploy machine learning models to support personalization, recommendations, anomaly detection, and data insights. The role involves working with … as monitoring, continuous integration, and automated retraining. Utilize AI-assisted development tools like Cursor and Copilot to improve productivity. Collaborate with engineers, DevOps, and leadership to ensure robust data pipelines and translate business needs into technical solutions. Requirements At least 3 years of experience in applied machine learning and deploying production models. Proficiency in Python, SQL, and frameworks … learn. Experience with AWS services and Databricks; understanding of ML Ops is highly beneficial. Ability to adapt quickly to new tools and deliver scalable solutions independently. Familiarity with data pipelines involving Kafka, Debezium, S3, Lambda, and Delta Lake is a plus. Note: Some irrelevant content and personal opinions were removed for clarity and focus. This job posting is More ❯

in architecting our real-time mindshare platform that turns noisy social feeds into crystal-clear token insights. Your work will power a product so fast and intuitive, ingesting data from every channel, powering advanced NLP models, and delivering sub-second API responses that will deliver a trading experience that end users will only describe as magic. This role … deliver new ML-driven insights and to design intuitive consumer-facing dashboards and alert systems that visualize real-time mindshare and sentiment metrics aligned with product goals. Ensure data security and compliance, particularly around usergenerated content, API keys, and any PII in social media streams. Maintain code and model quality: author clean, efficient, and maintainable code; implement comprehensive … designing feedback loops, active learning, or user-in-the-loop systems to continuously improve model relevance. Experience with Git-based workflows and integrating model training into CI/CD pipeline Ideal Candidate Profile A creative problem-solver who is eager to innovate and push boundaries in the DeFi space. Deep expertise in data engineering and ML pipelines More ❯

SQL Data Engineer/BI Developer North West NHS Client Outside IR35 3 Month initial period Flexible day rate We are seeking a BI Developer/Data Engineer with end-to-end data project experience to join a North-West based NHS trust. This is a fantastic opportunity to contribute to meaningful healthcare improvement … by delivering high-quality BI solutions that drive clinical, operational, and strategic decision-making. You will play a pivotal role in transforming complex healthcare data into accessible and actionable insights. Develop and maintain robust Power BI dashboards and reports, ensuring accuracy and usability for clinical and operational teams. Design and build data pipelines and transformation logic More ❯

Yes Job Reference: 973e563a7c0a Job Views: 4 Posted: 14.07.2025 Expiry Date: 28.08.2025 Job Description: Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock - from around the world. In Data, we are responsible for delivering this data … support to our content partners and customers to ensure Bloomberg is the platform of choice for content distribution. You will be responsible for ensuring the delivery of quality data for the Mutual Funds and ETP product, focusing on improving coverage, completeness, timeliness, and accuracy of funds' data. The team maintains and ensures the quality of the funds dataset … including pricing, dividends, reference data, corporate actions, documents, and regulatory data. Your role involves developing expertise in your market, building relationships with fund houses, custodians, administrators, exchanges, and third-party content partners to establish sustainable data pipelines, educate on data dissemination best practices, stay updated on industry trends, and maintain a comprehensive profile of More ❯

BI Developer/Data Analyst (Power BI) Location: West Midlands Salary: Up to £65,000 Type: Full-time, Office-based About the Role An established food manufacturer and supplier is implementing their first-ever ERP system, focusing on four key modules: Manufacturing, Compliance, Reliability, and Learning. Each module will take approximately 4-6 months to complete. To support … and maintain Power BI dashboards and reports delivering actionable insights. Collaborate with internal stakeholders and external implementation partners throughout the ERP rollout and ongoing system maintenance. Develop robust data pipelines and write advanced SQL queries for ETL processes and data analysis. Migrate and integrate data between systems to ensure seamless communication and reporting. Continuously … monitor and improve BI tools post-ERP implementation. Analyse large datasets to uncover trends supporting strategic decision-making. Ensure data integrity, security, and automation of workflows to maintain reliability and efficiency. Benefits Competitive salary up to £65,000 25 days holiday plus bank holidays Onsite parking available Employee rewards and retail discounts Pension scheme (details to be confirmed More ❯

deliverables Manage and resolve dependencies across teams, ensuring smooth and efficient project execution Operational Excellence & Risk Management Identify and mitigate technical risks and obstacles, ensuring that the product development pipeline runs smoothly and efficiently. Ensure the security, performance, and scalability of products through proactive monitoring and improvements. Ensure adherence to high coding standards, software quality, and efficient development processes … Technical Skills: Strong technical background with hands-on experience in modern software development technologies (e.g., Java, Python, microservices, cloud platforms like AWS, Azure, etc.) Expertise in software architecture, data architecture, and system design, with an ability to lead and influence technical decision-making. Drive innovation toward building high-scalable, real-time data pipelines and data … observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence, pinpointing risks and opening possibilities. We Accelerate Progress. Our People: We're more than 35,000 strong worldwide-so we're able to understand nuances while More ❯

to the next level and be part of a global innovative team shaping the future of betting entertainment for millions worldwide. The Goal We're looking for a Data Engineer/AI Platform Specialist to build and optimize the infrastructure powering our AI ambitions. In this hands-on role, you'll design scalable data pipelines, manage … cloud services, and implement infrastructure-as-code to enable secure, efficient, and high-performance AI workflows. Your work will ensure data is not just available-but ready for AI at scale. You'll collaborate closely with ML engineers, software developers, and stakeholders to unlock siloed data, improve compliance, and drive platform reliability. This is your chance … the technical foundation behind real-world AI impact in a high-growth, high-regulation industry. The Player You bring deep expertise in cloud infrastructure (AWS, Azure, or GCP), data engineering, CI/CD, and IaC tools like Terraform. You thrive in cross-functional environments, balance performance with governance, and know how to turn complex systems into seamless pipelines. More ❯

Social network you want to login/join with: Are you ready to shape the future of digital advertising through data? A fast-growing, innovative ad tech company is looking for a Head of Data Engineering to lead the development of its audience intelligence and targeting infrastructure. This is a rare opportunity to build from the … ground up and make a direct impact on campaign performance for some of the world's most recognisable brands. What You'll Do As Head of Data Engineering, you'll sit at the intersection of data, strategy, and technology. Your mission: to design and manage the systems that power audience targeting across a video advertising platform. … Key Responsibilities: Audience Data Infrastructure : Build and evolve the architecture for ingesting, storing, and activating digital audiences across publisher and SSP networks. Data Pipelines : Design robust pipelines to process real-time and historical data for audience segmentation. Identity Resolution : Lead the integration of identity resolution solutions to unify first- and third-party data More ❯

on highly impactful problems Promote a positive culture of collaboration, through open and effective communication, particularly when addressing issues or raising concerns. Are able to form well reasoned, data driven or otherwise evidence based arguments, to influence key stakeholders across the business. Required Skills and Experience Has 5+ years commercial experience Expert level in (Javascript Typescript Python) Familiar … with Postgres and K8s Feels at home in AWS console Has built infrastructure with Terraform Bonus points Has worked in an intelligence collection setting Experience with "big data" technologies, the management of data, and data pipelines Familiarity with functional programming concepts Has run production workloads of 1000s QPS Has been part of an "on More ❯

Contract Role - Government/Elections/Politics Data Operations Manager/Research Analyst - London/Onsite - 12 Months Initial - Inside IR35 PAYE We are seeking an exceptional Government/Elections/Politics Data Operations Manager/Research Analyst to join the team supports all government, elections and nonprofit partners globally and that is done through a … backbone of several interconnected data sets to identify this dynamic audience. This role is responsible for reviewing these data sets to ensure compliant and equitable partner support in the government and elections space. This role requires a person who is detail-oriented, capable of analyzing and reviewing large data sets, collaborating and building relationships … with our partner managers, data managers and auditors. Role Overview: Job Title: Government/Elections/Politics Data Operations Manager/Research Analyst Location: London/Onsite Contract Type: Contract Duration: 12 months initially 5-10 years of experience in data operations, or other relevant space leading large scale global projects or programs. Knowledge More ❯

We are looking for a Senior Backend Engineer to join our AI/ML team. In this role, you'll work closely with data scientists to transform cutting-edge machine learning models into scalable, production-ready services. You will take ownership of designing, building, and maintaining the backend systems that power our AI-driven features. This is a … key position that bridges the gap between data science and production engineering , ensuring high performance, reliability, and maintainability of our ML-powered products. Responsibilities Collaborate with data scientists to understand modeling outputs and convert them into deployable services. Design and develop robust, scalable backend systems and microservices to support AI use cases. Own the deployment and … monitoring of ML models in production (with CI/CD, logging, observability). Implement data processing pipelines in support of model training and inference. Ensure software adheres to best practices in architecture, testing, and documentation. Optimize model inference for latency, throughput, and resource efficiency. Contribute to design decisions and technical strategy alongside AI and infrastructure leads. Requirements 5+ More ❯

have become a multibillion-dollar asset manager, and we have ambitious goals for the future. Role Overview You will be developing the company's production trading systems and data pipelines that support our machine learning models in both production and research environments. Collaboration with research and trading teams is essential to meet diverse requirements and complex trading behaviors. … world-class machine learning researchers. Responsibilities Develop and maintain real-time distributed trading systems that execute orders based on our machine learning models. Design and optimize large-scale data processing systems for historical and real-time ML feature pipelines. Enhance the resilience and performance of trading and data processing systems. Build tools to integrate and validate … in Computer Science, Engineering, or a related field, or equivalent industry experience. Preferred Qualifications Experience or interest in mentoring junior engineers. Familiarity with data-centric workflows and pipeline orchestration (e.g., Apache Airflow). Proficiency in data validation, anomaly detection, or debugging using tools like Pandas, Polars, or data.table/R. Experience working with AWS or More ❯

Product About Cognitive Credit: Cognitive Credit is a technological pioneer transforming global credit markets through innovative data and analytics. We partner with the majority of the world's leading buy-side and sell-side institutions, providing unparalleled insights into investment grade bond, high yield bond, and leveraged loan markets, across the US and Europe. By delivering the fastest … most accurate credit data paired with specialist research software, we empower our clients to navigate an ever-more-digitalized global credit market with agility and confidence. Role Summary: We are seeking an experienced Quantitative Analyst to lead our quantitative research and modelling efforts. In this role you will drive innovation and growth across our product lines by applying … a quant finance framework to our proprietary, market-leading datasets. You will be collaborating with our Data and Engineering teams and working with clients to enhance our product offerings and grow our emerging quant services. The successful candidate will own the development of market valuation models and incorporate additional predictive analytics components across our web application, to support More ❯

to humanity's enduring challenges. We are looking for a Senior DevSecOps Engineer to join the Pathogen Programme at EIT. In this role, you'll help ensure our data platform is built to the highest standards, with a strong emphasis on automation across the development lifecycle. You'll work closely with engineers to deploy data pipelines … their workflows. You'll be responsible for maintaining infrastructure, designing secure automation pipelines, managing cloud environments, and ensuring security and compliance. You'll collaborate with cross-functional teams, data engineers, backend, and full-stack developers, to build robust, automated deployment pipelines across our environments. Key Responsibilities Design, implement, and maintain secure cloud infrastructure using Oracle Cloud Infrastructure (OCI … tools like Terraform to enable secure, repeatable deployments. Implement and manage CI/CD pipelines, focusing on automated security testing, deployment, and monitoring. Ensure all aspects of the data platform OCI infrastructure, data ingest pipelines, tool deployments, access controls, and monitoring are developed, tested, and deployed using automation best practices. Support bioinformaticians in building pipelines that More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. We build and operate ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2024, Aker Systems won the Breakthrough Culture Awards highlighting growth companies putting culture first. In 2020 Aker Systems was recognised as a 'One to Watch' on the Sunday Times Tech Track. The Company was also recognised at the Thames Valley Tech Awards 2020; winning the … of a cross-functional, security-focused product team delivering into public sector and regulated domains like BFSI. Key Responsibilities Define and drive a robust QA strategy across microservices, data pipelines, APIs, and UI Champion BDD principles-writing and maintaining Gherkin-style feature files and executable specifications Build and evolve automated test suites using custom frameworks in Kotlin/ More ❯

to enter prize draws via an app and website - both of which are seeing exponential growth.They've recently launched a new app and are investing heavily into data, product and engineering to optimise user experience and fuel innovation. You'll join a mission-driven company that combines a growth-focused product mindset with a meaningful social purpose. The … Product), reporting directly to the Director of Analytics. This role will be central to shaping new customer propositions, pricing experiments, digital journeys, and app strategies.You'll own the data behind product development and customer experience, driving forward ideas that directly impact retention, user satisfaction, and revenue. You'll have access to billions of rows of data and collaborate closely with data engineers and product managers to test hypotheses and uncover actionable insight. Key Responsibilities Act as the dedicated data partner to the product team across web and app Lead A/B and multivariate testing to validate feature development, UX changes, and pricing experiments Analyse performance of new customer propositions More ❯

governance, validation and audit exercises of existing solutions. You will work closely with the global measurement team, external agency partners and service providers to develop, standardize and optimize data pipelines and operational parameters that can be applied consistently across 12+ European countries while capturing local nuances. You will collaborate with our tech & tools team on the development of … functions and locations, and have demonstrable experience in stakeholder engagement. We are looking for someone who is highly organized and comfortable working in a fast-moving, dynamic and data-driven environment. This role is based at our Amazon corporate office in London/UK or Munich/DE. Key job responsibilities Automate: Identify opportunities to standardize, off-shore … media budget management and business insights. Partner with our external media agency, internal and external measurement partners across Europe and US central team, aligning measurement project and supporting data collection, acquisition and validation. BASIC QUALIFICATIONS 6+ years relevant professional experience in media planning, media finance or media buying. Have experience in media research, insights or data More ❯

About Route Reports Route Reports builds cutting-edge devices and software for inspecting roads, railways, and airports. We empower infrastructure teams with real-time data and analytics to keep infrastructure safe and costs down. Our AI hardware and software solution is market-leading in the UK, and we work with clients like Network Rail, Gatwick Airport, Essex Highways … develop the platform. Key Responsibilities Architect and implement new features across our React front end and Python/JS backend. Build and integrate with RESTful APIs, microservices, and data pipelines Optimise application performance, load times, and reliability Collaborate on UX design, sprint planning, and code reviews Ensure security best practices and compliance with data-protection standards More ❯

Are you a highly skilled Senior Backend Engineer with a passion for Data and Machine Learning, ready to make a global impact? Join Spotify's Commerce Platform to build the next generation of our robust, high-performing, and resilient payments ecosystem. This is a unique opportunity to solve complex challenges, work with ML-powered systems, and contribute to … prevention. The reliability of these systems is business-critical for Spotify. What You'll Do Architect, design, and implement highly scalable backend services (Java/Python) and robust data pipelines that power Spotify's internal Commerce platform. Develop and enhance our ML-powered systems taking solutions from concept to production. Take the lead on API design, platform development … and ensuring the scalability, reliability, and performance of our services. Collaborate with a talented, cross-functional team of engineers, product managers, and data scientists to deliver impactful solutions. Mentor other engineers and foster a culture of continuous learning and technical excellence within the team. Who You Are You have significant experience building and scaling backend services (Java and More ❯

models, we build the driving intelligence that feeds them. Our mission is to drive safer roads and fairer insurance through data. The Telematics team transforms raw phone sensor data into meaningful insights about how people drive. Using advanced signal processing and machine learning, we process high-frequency data to extract behavioural signals that power our understanding … of driving quality, context, and risk. About the Role As a Lead Data Scientist, you'll drive the technical direction of our behavioural modelling work. You'll lead the development of telematics features from idea to production, including exploratory analysis, signal design, risk evaluation, and scalable deployment. This is a hands-on leadership role where you'll design … things into production, values strong engineering, and has opinions on building reliable, scalable systems. What you will be doing Drive the development of telematics features from mobile sensor data, including project design, modelling, validation, and deployment. Conduct deep dives into driving signals, develop hypotheses, and evaluate their predictive power for risk. Design technical solutions with clear trade-offs More ❯

different types of databases: Relational, Graph etc Design and optimise APIs using Python and FastAPI to serve AI solutions. Familiar with GCP ecosystem and Cloudrun Build and optimise data pipelines for vector search and knowledge retrieval using Vector databases and embedding models. What We're Looking For: Professional AI engineering experience. Background in Software Engineering with Python. Solid … Excellent communication skills and the ability to work well in a collaborative team environment Nice to have: Strong experience with GCP Experience with Graph databases Experience in bringing data-intensive projects into production Experience with CI/CD pipelines Benefits: Private Health Insurance: Comprehensive coverage for both physical and mental health. Flexible and Remote-First Work Environment: Choose More ❯

addressing issues in execution, risk, and P&L. Perform post-trade and transaction cost analysis (TCA) to continuously improve execution quality and strategy effectiveness. Work across the full data pipelinesourcing, cleaning, and managing large datasets for signal generation and backtesting. Contribute to the development and maintenance of trading infrastructure, including EMS, OMS, and backtesting frameworks. Collaborate with researchers … and operational excellence. What You'll Bring 5+ years of software development experience in quantitative trading, with strong skills in Java and/or Python. Proficient in Pythons data science ecosystem (Pandas, NumPy, Scikit-learn) with solid debugging and analytical capabilities. Demonstrated experience implementing trading algorithms and working on large-scale distributed systems. Familiarity with transactional systems using More ❯