751 to 775 of 1,236 Data Pipeline Jobs in the UK

As a Finance Business Intelligence Analyst you will be a key member of the Data team translating data into useful and meaningful information that can be utilised for decision making and strategic planning. You will be responsible for delivering timely, accurate, and actionable insights across Loadsure … s financial and commercial functions. As the analytical bridge between the Data, Finance, and Commercial teams, the Business Intelligence Analyst will develop and maintain dashboards, reporting frameworks, and data models to support strategic decision-making, revenue attribution, partner evaluation, and operational performance tracking. The ideal candidate … and commercial acumen, with the ability to design and deliver high-impact reporting that aligns with Loadsure’s rapid scaling, product expansion, and data-driven culture. You will be highly organised and comfortable building relationships and working with all levels of the firm. Stakeholder management and communication will More ❯

users, we're building a world-class R&D team to push the boundaries of AI creativity. The Role: As a Research Engineer - Data at Leonardo , you will architect and manage petascale data pipelines, combining text, images, 3D models, and other data modalities to … world-class AI models. You'll work hand-in-hand with our Researchers to create and curate large, multi-modal datasets, including synthetic data, that supercharge SOTA generative AI solutions. Your expertise in distributed systems, data processing, and experimentation will shape the backbone of our research … work. Responsibilities: Data Acquisition & Curation Lead the ingestion, unification, and organization of large, unstructured data sources (e.g., text, images, 3D geometry, code snippets) into scalable, high-quality datasets suitable for machine learning research and production. High-Performance Data Pipelines Develop and optimize distributed systems More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning More ❯

A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of … They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work … with minimal guidance, exercising broad latitude in decision-making. Key responsibilities include migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks, creating and optimizing data pipelines in Databricks, and leveraging scheduling, job orchestration, and optionally machine learning More ❯

practices and create novel processes and technologies to drive up the quality and interoperability of our segmentation and identity data. Architect next-gen data distribution systems. Oversee main production systems to ensure system uptime and quality assurance. Troubleshoot data delivery issues. Collaborate with the Chief Engineer … of Data Distributions to align on strategic goals. About Experian Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights … into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and More ❯

Role: Principal Data Engineer Type: Permanent Location: Hampshire, London (Hybrid Working) Salary: £80,000 - £90,000 + Benefits Are you an experienced Data Engineer ready to take the next step into a strategic, hands-on leadership role? This is a fantastic opportunity to join a well … in general insurance and part of a larger European group, with a UK presence that continues to grow. With significant investment in their data and technology function, theyre now looking to bring on a Principal Data Engineer to help shape and evolve their data … infrastructure and engineering capability. The Opportunity: This is a pivotal role where youll lead on the design, delivery, and optimisation of scalable, secure data systems that support the wider business strategy. Youll be part of a collaborative tech environment, working closely with cross-functional teams and mentoring fellow More ❯

Junior Azure Data, ML & GenAI Ops Engineer (Contractor) £200–£250 per day | 3-month initial contract | Outide IR35 Remote/Hybrid (UK-based) Recruiting via: DATAHEAD We are recruiting on behalf of a leading international media business - an ambitious and fast-growing organisation with a strong track record … of innovation and operational excellence. The business is investing heavily in its technology and digital capabilities, creating new opportunities to drive data-driven and AI-led transformation across multiple sectors. They are known for fostering a collaborative and high-performing environment, consistently recognised as a great place to … work. About the Role We are seeking a Junior Azure Data, ML & GenAI Ops Engineer to join their dynamic technology team on a contract basis. You will play a key role in supporting the development, deployment, and management of next-generation digital products and AI-driven solutions, ensuring More ❯

and intuitive user experience. Rapid Problem-Solving: Quickly fix bugs and solve problems, particularly related to AI performance, model integration, or data pipeline issues, to enhance customer satisfaction. Continuous Improvement: Participate in code reviews and contribute to improving our AI development processes, ensuring that the AI components … experience working with AI automation engines, process automation using AI, or integrating AI with business logic to streamline processes. Enterprise Governance: Understanding of data privacy regulations (GDPR, HIPAA, etc.) and EU AI Act. What's in it for you? Join an ambitious tech company reshaping the way people More ❯

written and verbal communication skills. Desirable (bonus points for each of these) Experience of Industrial Automation and Control Engineering Experience with ETL/data pipelines Experience of integrating with technology similar to databricks, PowerBI, Aveva PI Database schema design Experience of creating Windows installers Experience of GUI development More ❯

Location: Leeds City Centre + Hybrid Working Job Type: Full-time Team: Product Reports to: Head of Product Development About Us: We use data science and AI to help retailers make profitable pricing, marketing and retail media decisions. Put simply, we help retailers sell the right products, to … a business intelligence development or related role Excellent SQL skills Good understanding of relational and analytical database architectures and methodologies Experience of cloud data warehousing solutions e.g. Snowflake, BigQuery, Redshift Good hands-on experience with at least one Business Intelligence platform Strong analytical and problem-solving skills Excellent … the ability to explain technical details to non-technical stakeholders Comfortable with occasional client interaction in a professional and supportive capacity Great UX & data visualisation skills The Role: Design, develop and maintain BI solutions including dashboards, reports and data models Produce visually engaging deliverables for consumption More ❯

The Vacancy Are you a Data Analyst looking to join an organisation where what you do genuinely makes an impact? This is an opportunity to work on projects where you will create and use actionable insight to make the U.K. health and care systems work better for everyone. … We are looking for a Data Analyst with Python and SQL skills to join our talented and innovative team. This role sits within a part of the EMIS-X Analytics team responsible for taking large data sets from various sources and converting them into meaningful insights. … Your main focus will be solving data engineering problems to allow healthcare personnel, NHS organisations and research organisation access to the analytical power of EMIS-X We are a collaborative team, we work hard and are passionate about what we do, but we ensure we have fun along More ❯

About The Role Hippo is recruiting for a Principal Data Engineer to join our Hippo Herd. Principal Data Engineers work in multi-disciplinary teams that build, support & maintain User-Centred digital solutions that offer real value and work for everyone. Hippo's Principal Data Engineers are experts in their field. You will act as a principal consultant providing technical expertise in data engineering practices both internally and to our clients. You will drive the team's technical deliverables, maintain client relationships and be passionate about developing and upskilling others. Your … ensuring that challenges are overcome. Lead in the recruitment of other engineers, and support other consultants in their professional development. Ensure Hippo's Data and Engineering communities contribute to Hippo's business at a strategic level. Lead on new business opportunities, writing technical bids and proposals. Promote Hippo More ❯

working directly with senior architects and distributed peers across the US and EMEA. You'll lead by doing — designing and building serverless microservices, data-rich APIs, and resilient infrastructure that scales. This is a hands-on role that also offers long-term opportunities to grow into technical leadership … Build and refine APIs (REST and GraphQL) using AppSync, API Gateway, and EventBridge • Work with DynamoDB, Aurora Serverless, and S3 for cloud-native data solutions • Collaborate with frontend (Vue.js) and data platform engineers (Snowflake, Airflow) • Contribute to CI/CD pipelines, observability, and day-2 operational … non-technical audiences Bonus Experience • Familiarity with IaC frameworks (CloudFormation, Terraform, SAM) • Exposure to Snowflake, DBT, Airflow, or cost analytics/data pipeline tools • Knowledge of FinOps practices or cost intelligence platforms • Experience contributing to open-source platforms or cloud-native communities • Working knowledge of ML or More ❯

working directly with senior architects and distributed peers across the US and EMEA. You'll lead by doing — designing and building serverless microservices, data-rich APIs, and resilient infrastructure that scales. This is a hands-on role that also offers long-term opportunities to grow into technical leadership … Build and refine APIs (REST and GraphQL) using AppSync, API Gateway, and EventBridge • Work with DynamoDB, Aurora Serverless, and S3 for cloud-native data solutions • Collaborate with frontend (Vue.js) and data platform engineers (Snowflake, Airflow) • Contribute to CI/CD pipelines, observability, and day-2 operational … non-technical audiences Bonus Experience • Familiarity with IaC frameworks (CloudFormation, Terraform, SAM) • Exposure to Snowflake, DBT, Airflow, or cost analytics/data pipeline tools • Knowledge of FinOps practices or cost intelligence platforms • Experience contributing to open-source platforms or cloud-native communities • Working knowledge of ML or More ❯

Data Engineer – Databricks About the Role We’re looking for a Databricks Champion to design, build, and optimize data pipelines using Databricks. You’ll work with clients and internal teams to deliver scalable, efficient data solutions tailored to business needs. Key Responsibilities Develop ETL …/ELT pipelines with Databricks and Delta Lake Integrate and process data from diverse sources Collaborate with data scientists, architects, and analysts Optimize performance and manage Databricks clusters Build cloud-native solutions (Azure preferred, AWS/GCP also welcome) Implement data governance and quality … best practices Automate workflows and maintain CI/CD pipelines Document architecture and processes What We’re Looking For Required: 5+ years in data engineering with hands-on Databricks experience Proficient in Databricks, Delta Lake, Spark, Python, SQL Cloud experience (Azure preferred, AWS/GCP a plus) Strong More ❯

An esteemed Data Consultancy are seeking a number of ambitious Databricks Data Engineers to join their team. They are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in their data. They pride … themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you will be working in a team of highly skilled professionals to deliver effective market-leading data solutions using the latest cutting-edge technologies. This particular role will focus on leveraging the Databricks Data Intelligence platform, and Azure Data Platform technologies. You will split your time between client-site, home and the London office depending on requirements, and are asked to More ❯

An esteemed Data Consultancy are seeking a number of ambitious Databricks Data Engineers to join their team. They are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in their data. They pride … themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you will be working in a team of highly skilled professionals to deliver effective market-leading data solutions using the latest cutting-edge technologies. This particular role will focus on leveraging the Databricks Data Intelligence platform, and Azure Data Platform technologies. You will split your time between client-site, home and the Manchester office depending on requirements, and are asked to More ❯

An esteemed Data Consultancy are seeking a number of ambitious Databricks Data Engineers to join their team. They are both a Microsoft Partner and a Databricks Partner, and are experts in helping their clients to better manage and uncover the value in their data. They pride … themselves on developing tailor-made data-driven solutions to suit the specific needs of their clients, with a growing client base largely within Financial Services, amongst other industries. In this role, you will be working in a team of highly skilled professionals to deliver effective market-leading data solutions using the latest cutting-edge technologies. This particular role will focus on leveraging the Databricks Data Intelligence platform, and Azure Data Platform technologies. You will split your time between client-site, home and the Edinburgh office depending on requirements, and are asked to More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used by quant researchers and … traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

What's the opportunity? The Research, Analytics & Data Science (RAD) team at Intercom uses data and insights to drive evidence-based decision-making. We're a team of data scientists and product researchers who use data - both big and small - to unlock … and shape products that deliver real value to our customers. If you get really excited about asking the right questions, exploring patterns in data, and surfacing actionable insights that drive strategic decisions, then this role is for you. Data Scientists in RAD partner with teams across … Intercom make sense of our users, our products, and our business, using metrics and data. This role will enable you to drive key data projects that directly impact our customers and millions of end users who communicate via our messaging platform daily. What will I be doing? You More ❯

your own ideas to our initiatives. What will your role look like? You will work on a modern tech stack, addressing software and data challenges that propel our business. You will design and deliver robust, scalable solutions within an agile, DevOps environment, utilizing the latest Microsoft and Azure … technologies. Initially, you will collaborate closely with a Technical Architect to develop a cutting-edge data lake for HRPW, laying the groundwork for custom AI solutions to improve team efficiencies. Key responsibilities include: Collaborating with our AI team on developing custom copilot solutions for HRPW. Working with high … Assessing trade-offs and barriers pragmatically during software delivery. Leading non-functional improvement efforts such as security and performance profiling. Liaising with the data engineering group to stay updated on Azure data tooling and promote best practices. Ideal candidate qualities: Passionate about technology, especially the Microsoft More ❯

We are looking for a Data Engineer to help us build structured, high-quality data solutions for our Content Understanding teams. Our teams process petabytes of data using tools such as BigQuery and Dataflow, and where needed we develop our own data tooling to support and evolve our music catalog. What You'll Do Take ownership over, maintain and improve data pipelines that are integral to our success Evaluate and optimize our offerings for efficiency and reliability at scale Identify areas of architectural improvement to remove the potential … for human error Collaborate with product and engineering teams to understand data requirements and create innovative solutions to challenging problems Understand the analytics data we collect from our systems and how it relates to the business value being produced Who You Are Proven experience in data More ❯

and cloud deployment. Key Experience: Develop Python code for backend logic, automation, and machine learning model integration. Design and maintain robust APIs, optimising data pipelines for ML tasks. Collaborate on the setup and maintenance of CI/CD pipelines, Docker containerisation, and cloud deployment. Key Skills: 5+ years More ❯

PR review and architecture discussions Desirable (but not essential): Event-driven architecture (e.g., SNS, SQS, EventBridge) AI/LLM integration (Python experience welcome) Data pipelines and ETL workflow knowledge Experience scaling cloud services and optimising for performance and cost in serverless environments Location & Flexibility: This is a London More ❯