676 to 700 of 926 Data Pipeline Jobs in the UK

designing, deploying, maintaining and refining statistical and machine learning models using Azure ML. Optimize model performance and computational efficiency. Ensure that applications run smoothly and handle large-scare data efficiently. Implement and maintain monitoring of model drifts, data-quality alerts, scheduled r-training pipelines. Collect, clean and preprocess large datasets to facilitate analysis and model training. … Implement data pipelines and ETL processes to ensure data availability and quality. Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control, testing and code review. ML Ops Engineer Skills Required: Experience in designing, building, optimising, deploying and managing business-critical machine learning models using Azure ML in Production environments. … Experience in data wrangling using Python, SQL and ADF Experience in CI/CD and DevOps/MLOps and version control Familiarity with data visualization and reporting tools, ideally PowerBI Experience in the pensions or similar regulated financial services industry Due to the volume of applications received for positions, it will not be possible to respond More ❯

independent boutique technology firm with a global presence, including teams in London, Sydney, San Francisco, and New Zealand. We specialise in creating technology solutions at the intersection of data, AI, machine learning, data engineering, and software engineering. Our mission is to help enterprises, technology companies, and governments better connect with and understand their organisations, their people … their customers, and citizens. We are a team of creative engineers and technologists dedicated to unleashing the potential of data in new and impactful ways. We design and build bespoke data platforms and unique software products, create and deploy intelligent systems, and bring engineering expertise to life by transforming data into actionable insights and … tangible outcomes. We engineer data to life. As a Senior Software Engineer at Simple Machines , you'll be at the heart of groundbreaking projects, collaborating closely with both our talented internal team and forward-thinking clients. In this hands-on role, you'll drive the development of sophisticated, scalable solutions across the full technology stack-from intuitive frontends More ❯

slippage and deep liquidity. The Opportunity We're looking for a Staff Backend Engineer who enjoys implementing systems that will connect users to our DEX and transmit external data to our DEX. You will be an important member of our company, making history, contributing to the development of the first fully decentralized perpetuals exchange built around a Central … entirely on an EVM chain! You will report to the Principal Backend Engineer and work to develop and maintain the systems connecting web and mobile clients to blockchain data and systems. Although this project centers around a blockchain system, previous experience with blockchain is not a hard requirement. Our Culture We cultivate a dynamic and inclusive culture where … solution that is performant and reliable. Qualifications 5+ years of experience. Experience developing secure production backend systems at scale on cloud infrastructure, involving the following components: Data Pipeline Tools Relational, In-Memory, and Time-series Databases Notification Systems Virtualization Prior experience: Shipping products and written production-grade code. Working with Rust, Go, or other high-performance languages More ❯

maintainable solutions What We're Looking For: Deep expertise in core Python development Strong foundation in OOP and software design patterns and multithreading Experience working with large-scale data pipelines and ETL workflows Experience working on Time Series systems Proven track record building Fixed Income trading systems Exposure to portfolio optimisation and pricing analytics Please submit your CV More ❯

in high-velocity environments. Deep knowledge of modern ML (supervised, unsupervised, generative, self-supervised learning, etc.). Strong understanding of ML systems at scale: inference pipelines, observability, MLOps, data pipelines, etc. Background in building ML for real-world infra, distributed systems, or low-latency environments is a big plus. Confident working at both strategic and technical depth, exec More ❯

a fast moving environment, takes ownership and is passionate about building reliable, scalable systems. Responsibilities Design and maintain backend services in Node.js and PHP (Symfony). Build scalable data pipelines that ingest, process and serve blockchain data. Mentor other engineers and champion best practices (testing, version control, CI/CD). Prototype new solutions and drive performance improvements. More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies. Proven experience managing AI/ML-based products, with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills, with a More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies. Proven experience managing AI/ML-based products, with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills, with a More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies Proven experience managing AI/ML-based products , with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills , with a More ❯

Trading & Shipping industry - a must! Experience in Product Management within B2B SaaS companies Proven experience managing AI/ML-based products , with a solid grasp of model workflows, data pipelines, and the tradeoffs between performance and explainability. Extensive customer-facing experience , including running discovery sessions, field interviews, and roadmap presentations with enterprise clients. Excellent communication skills , with a More ❯

deploying scientific software using common CI and containerization solutions. - Enjoy staying up to date with current software development best practices and tools, e.g. AI coding assistants or modern data pipelines and scheduling solutions. - Enjoy diving into new problems with a continuous learning attitude, absorbing relevant domain knowledge. - Additional experience with scientific C++ and Fortran libraries, HPC technologies, cloud More ❯

Experienced building SaaS products that delight customers, from conception to production. Experienced with building and operating production distributed systems. Experienced with cloud native, containers, Kubernetes. Confident working with data pipelines and a variety of databases. You'llstand out if you: Haveexperience building cyber security products. Haveexperience working in startups. Have experience as a site reliability engineer or similar More ❯

problem that you're solving, and you will have the opportunity to shape the direction of the product. You will evaluate your own work, leveraging our data pipeline and frameworks that we have established to understand the impact your features have on our commercial objectives and pivoting where necessary. You will consider the long-term direction of More ❯

Multilingual team, you will play a crucial role in developing and enhancing our language models to support a wide range of languages. Your primary focus will be on data engineering tasks, including data collection, cleaning, and preparation, to ensure our models perform exceptionally across various linguistic contexts. You will work closely with our research scientists, machine … friendly! Applicants for this role may work anywhere between UTC 06:00 and UTC:00. As a Member of Technical Staff for Multilingual you will: Design and implement data pipelines to process and prepare multilingual datasets. Collaborate with researchers to understand data requirements and model performance. Develop tools and scripts to automate data-related … tasks and improve efficiency. Ensure data quality and integrity through rigorous testing and validation. Stay updated on the latest advancements in multilingual data processing and contribute to the team's knowledge base. You may be a good fit if you have: A Bachelor's degree in Computer Science, Data Science, or a related field More ❯

Front Office Data & Analytics Engineer - Crude & Products Apply locations: London, United Kingdom Type: Full time Posted: Yesterday Main Purpose: We are recruiting a software engineer to work directly with traders and research analysts in our trading teams. This role offers the opportunity to work in a fast-paced, data-driven trading environment, collaborating with global teams … in Geneva, Houston, and Singapore. The engineer will be part of the global data science and engineering team responsible for market and fundamental data ingestion, management, modeling, and analytics applications. The software engineer will lead the development of applications and software using modern cloud and technology stacks, building end-to-end software platforms in an innovative … business setting. Knowledge, Skills, Abilities, and Responsibilities: Develop software components, frameworks, and micro-services Build core infrastructure and shared services for DnA applications Create cloud-native big data platforms and analytics solutions Maintain time-critical data pipelines (ETL/ELT) Implement SDLC and agile practices Apply domain-driven design principles Solve problems and automate complex business More ❯

time left to apply End Date: August 1, 2025 (3 hours left to apply) job requisition id R Job Description: Job Title Product Manager - Data Location London Corporate Title Vice President You will be working within the Market Risk Information Technology team (MRIT) within TDI (Technology, Data & Innovation) and own and deliver on the RiskFinder platform … functions across the Bank's business lines. The system calculates over 600 billion scenarios per day on a high-performance compute grid, stores the results into a big data store and provides our end users the capability to aggregate, report and analyze the results. The Data Product Manager role will be delivering towards the capabilities of … designing, building and maintaining vast array of data-pipelines together with the adherence and implementation of data-governance controls. You are expected to perform data-mining and analysis and be able to present your findings. You will be part of a product team driving formulation of the roadmap, strategy and backlog for the wider More ❯

services (AWS, Azure, or Google Cloud – Primarily Azure). • Industry Knowledge: • Experience in the oil and gas industry, particularly within trading operations, is highly desirable. • Understanding of market data, trading systems, and financial instruments ideally related to oil and gas. Preferred Qualifications: • Certifications in relevant technologies or methodologies. • Proven experience in building, operating, and supporting robust and performance … databases and data pipelines. • Experience with Databricks and Snowflake • Solid understanding of web performance optimization, security, and best practices Experience supporting Power BI dashboards More ❯

Head of Data Engineering Are you ready to shape the future of digital advertising through data? A fast-growing, innovative ad tech company is looking for a Head of Data Engineering to lead the development of its audience intelligence and targeting infrastructure. This is a rare opportunity to build from the ground up and … make a direct impact on campaign performance for some of the world's most recognisable brands. What You'll Do As Head of Data Engineering, you'll sit at the intersection of data, strategy, and technology. Your mission: to design and manage the systems that power audience targeting across a video advertising platform. Key Responsibilities: Audience … Data Infrastructure : Build and evolve the architecture for ingesting, storing, and activating digital audiences across publisher and SSP networks. Data Pipelines : Design robust pipelines to process real-time and historical data for audience segmentation. Identity Resolution : Lead the integration of identity resolution solutions to unify first- and third-party data sources. AI More ❯

solutions and consultancy projects to clients across a range of sectors (travel, manufacturing, microfinance, engineering, services etc.). Typical responsibilities will include: Manage both scheduled and ad hoc data harvesting processes. Write efficient regular expressions to extract data from raw HTML, JSON, and XML. Clean and validate harvested data using automated processes. Troubleshoot and … resolve complex data processing issues. Maintain and enhance existing data pipelines and services. Improve automation for data processing and delivery. Core Requirements: Solid understanding of HTTP protocols and request/response architecture. Proficiency in writing Regular Expressions for data extraction. Working knowledge of Python, SQL, and either C# or Java. Strong problem … solving and debugging skills. Effective communication skills for understanding project needs and working with the team. Advantageous: Experience with automated data harvesting using Python, C#, or Java. Familiarity with front-end technologies (JavaScript, React). Experience with cloud platforms like AWS or GCP (especially BigQuery). Exposure to Big Data tools such as Elasticsearch. Background in More ❯

Graduate Data Engineer £35,000 Location: London (office-based, 4 days per week) Build Something That Matters native has been building for 10 years, but we're still very much a startup: fast-moving, ambitious, and building with intent. We're creating the infrastructure that connects students, Students' Unions, universities, and advertisers through a managed marketplace. Our goal … understand how your thinking has been shaped and why it stands up. What you'll be working on You'll be directly involved in: Building and maintaining reliable data pipelines, ensuring accurate aggregation of behavioural event data and survey responses Implementing identity stitching processes to reliably connect diverse datasets and manage consistent student identifiers … across multiple sources Ensuring robust pseudonymisation and data minimisation practices are consistently applied, maintaining privacy and GDPR compliance Identifying and implementing practical enhancements to existing infrastructure, improving pipeline scalability, reliability, and efficiency Collaborating closely with the Student Personas team, contributing directly to data quality, documentation clarity, and overall process improvement This role is hands-on More ❯

WEKA is growing fast! We're looking for smart, dedicated, driven individuals that want to help the world's most innovative organizations solve complex data management challenges. We envision a future without compromise for our customers, so we're creating a novel approach to data management that's purpose-built for performance-intensive workloads in the … on a hyper-growth trajectory. We've raised $375M in capital and are backed by dozens of leading venture capital and strategic investors. Our flagship product, the WEKA Data Platform, is helping hundreds of the world's leading research organizations and enterprises-including 12 of the Fortune 50-to achieve first-to-market results with AI, machine learning … exciting journey. Our Culture WEKA is growing fast! We're looking for smart, dedicated, driven individuals that want to help the world's most innovative organizations solve complex data management challenges. "Everyone at WEKA works so hard, and we come together to do some really amazing things. It's a rush to be surrounded by so much talent More ❯

part of S&P Global's enterprise marketing transformation, this role ensures that investments, tactics, and campaigns are accountable to measurable business impact. The Director will work across data, analytics, and campaign teams to define how marketing success is … measured and how its impact on revenue is forecasted, visualized, and optimized. Responsibilities and Impact: Revenue Attribution & Impact Modeling: Design and operationalize attribution frameworks that connect marketing activity to pipeline and revenue across touchpoints. Build and maintain predictive models to forecast marketing-influenced revenue, campaign lift, and investment ROI. Partner with Sales Operations and Finance to validate impact models … for campaign measurement, segmentation performance, and influence tracking. Analytics Partnership & Insight Delivery: Translate technical outputs into clear narratives for CMO and executive stakeholders. Work closely with the Marketing Data Visualization & Reporting lead to develop dashboards and visualization layers. Partner with Customer Data Intelligence and CDP/Target teams to align audience modelling with performance insight. Collaborate More ❯

Your new company Working for a globally renowned bank. Your new role You will be working as a Senior Bi Engineer in a newly formed data product team. In this role you will be supporting Front Office operations possessing strong expertise in Power Bi and Data Engineering, with good stakeholder management experience.You will be: Designing and … maintaining Power BI dashboards for trading, risk, and regulatory reporting as well as building data pipelines for real-time financial data. Partnering with the front office to deliver analytics solutions and optimising data models for front office reporting. What you'll need to succeed Strong business intelligence/data engineering experience with strong Power … BI expertise. Data engineering experience building production pipelines - with Databricks Business experience working around the Front Office/Risk is a must! Understanding of regulatory reporting processes. Financial product knowledge e.g. - equities, fixed income, derivatives. Experience on Azure cloud platforms. What you'll get in return Flexible working options available. What you need to do now If you More ❯

and push boundaries, then CAVU is the place for you. Together, we can reach new heights. Together, we are CAVU. The role We're looking for a Lead Data Engineer to join our growing tech team. In this senior technical role, you'll lead the design and implementation of scalable data infrastructure and robust ETL pipelines … to enable data-driven decision-making across the business. Working closely with analysts, data scientists, and stakeholders across the business, you'll ensure we extract maximum value from our data assets. You'll be at the heart of our mission to make our global single platform the best in the market - a tech-first … travel. This is a hands-on, delivery-focused leadership role-perfect for someone who thrives on innovation, collaboration, and making things happen. Projects range from client integrations and data warehousing to machine learning and real-time reporting. If you're excited about building systems from the ground up in a supportive, forward-thinking environment, this is your opportunity More ❯

Your new company Working for a globally renowned bank. Your new role You will be working as a Senior Bi Engineer in a newly formed data product team. In this role you will be supporting Front Office operations possessing strong expertise in Power Bi and Data Engineering, with good stakeholder management experience. You will be: Designing … and maintaining Power BI dashboards for trading, risk, and regulatory reporting as well as building data pipelines for real-time financial data. Partnering with the front office to deliver analytics solutions and optimising data models for front office reporting. What you'll need to succeed Strong business intelligence/data engineering experience with strong … Power BI expertise. Data engineering experience building production pipelines - with Databricks Business experience working around the Front Office/Risk is a must! Understanding of regulatory reporting processes. Financial product knowledge e.g. - equities, fixed income, derivatives. Experience on Azure cloud platforms. What you'll get in return Flexible working options available. What you need to do now If More ❯