1,176 to 1,200 of 2,555 Data Pipeline Jobs in the UK

seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform . The ideal candidate will have deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, cloud platforms, and enterprise data solutions. Key Responsibilities … Design and architect Databricks Lakehouse solutions for large-scaleenterprise data platforms. Lead end-to-end Databricks implementation, including architecture, development, deployment, and optimization. Define Databricks workspace architecture, clusterstrategies, security models, and operational standards. Design and developscalable data pipelinesusing Databricks, Apache Spark, PySpark, SQL, andDelta Lake . ...

orientation, veteran status, or any basis prohibited by the laws that govern its operations. How does this role contribute to our collective success? Data and analytics are of critical importance for AXIS. Simply put, we want to turn data into information, that can be used … pairing, structured code reviews, and knowledge‐sharing sessions on emerging techniques and tools. Resource & Capacity Planning: Support the Head of in tracking the project pipeline, estimating costs (including cloud compute and API consumption), and managing resource allocation to ensure the team is effectively deployed against priorities. Technology Vision: Stay ...

seeking outstanding individuals to join our team as an Apromore Solution Engineer with a strong technical background and deep expertise in process intelligence, data engineering, and AI-driven solutions. In this role, you will go beyond traditional pre-sales; you will be pivotal in bridging the gap between … agents (such as Agentforce). You will guide C-level executives and technical stakeholders away from broad anecdotes and align them onto data-driven, value-backed technical solutions. What you'll be doing: Run Great Technical Discovery: Partner with AEs to conduct comprehensive technical discovery sessions. Analyze sophisticated ...

Location: Hybrid/Monument St, London EC3R 8AJ, UK job type: Permanent/Full-time Sector and subsector: IT | Data Engineer Salary: Competitive salary Platform Architecture & Engineering responsibilities: Design and implement scalable Databricks Lakehouse platforms on AWS and/or Azure aligned to client requirements Architect … data platforms including ingestion, storage (Delta Lake), processing, and consumption layers Build and configure cloud infrastructure using infrastructure-as-code (e.g. Terraform & Declarative Automation Bundles(DAB's)) Establish secure, compliant environments including networking (VNet/VPC, Private Link), identity (IAM/Entra ID), data governance (Unity ...

analytics across Fasanara's Asset-Backed Finance (ABF) strategies. This role sits at the intersection of Risk, Investment, and Technology, translating complex portfolio data into actionable insights to support investment decisions, portfolio construction, and risk monitoring. The position combines strong technical expertise in data analytics … Markets, and Investor Relations. The role involves writing a lot of code for the analytics platform, and ensuring high standards of code and data quality, as well as scalability. Responsibilities Contribute to the development of portfolio risk analytics across ABF strategies, including: concentration, exposure, performance tracking, stress testing ...

Solirius Reply, part of the Reply Group, is a technology consultancy focused on data engineering and digital transformation. You will join a team designing and delivering data pipelines, collaborating with data scientists, analysts and client teams to ensure reliable data for analysis … projects. The role requires hands-on data engineering experience across SQL, NoSQL, ETL/ELT, and cloud platforms. You will operate in an agile environment, contribute to data quality, and help advance the #J-18808-Ljbffr ...

product team, with customer-facing support and services responsibilities. This role is for a tech-savvy person who will be responsible for using data and code to drive customer success with data-driven Watershed solutions, bridging the gap between their data challenges and Watershed … 12pm - 8pm UK timeKey Responsibilities Client Implementation: Build connections between Watershed and client systems, and configure Watershed to meet each client's goals. Data Pipelines & Integrations: Build and maintain data pipelines and API integrations, and write scripts to create and manage data connections ...

Ventures, Nosara Capital and angels from CarWow, JustPark, Autotrader and Bumper. The Role Your first project is to automate the vehicle data pipeline that keeps our catalogue current. Every vehicle on the UK road has to be matched to the right entry in the catalogue, the source … data changes every month, and parts of that process still need an engineer to run them. You will build the pipeline that does it on a schedule, so that our catalogue team reviews what it proposes rather than operating it. The work is a mix of data ...

Network Plus seeks a Data Engineer to join our IT team in Worsley, focusing on building scalable data pipelines and lakehouses using Microsoft Fabric and Azure data services. You will help migrate and modernise our data estate to support enterprise reporting … analytics. You will collaborate with Data Analysts, BI Developers, and stakeholders to define and deliver data requirements, implement ETL/ELT processes, and ensure data quality and security across platforms. #J-18808-Ljbffr ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up — where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane — a greenfield platform that connects the firm's data ...

About Us: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across … Engineer to design, build, and maintain scalable, secure, and high-performing cloud infrastructure on Microsoft Azure. This role is heavily focused on enabling data platforms—including Databricks, Event Hubs, and Azure Storage—through infrastructure-as-code, automation, and modern DevOps practices. You will work closely with engineering, data ...

Technical Account Manager - ETFs and Mutual Funds Location London Business Area Data Ref # 10053247 Description & Requirements Bloomberg runs on data and the Data department is responsible for acquiring and supplying data, news and analytics to our clients for their financial data needs. We collect, analyse, process and publish the data which is the backbone of our iconic Bloomberg Terminal; the facts and figures which ultimately move the financial markets. We apply problem-solvin g skills to identify innovative workflow efficiencies, and we implement technology solutions to enhance ...

Scott Logic is a UK data engineering partner delivering bespoke software and data platforms. You will design and implement data pipelines, build data lakes/warehouses, and transform datasets for analytics, ML, and reporting. You’ll work hands-on with modern tools ...

ENGINEER LONDON/HYBRID UP TO £80,000 This is an exciting opportunity for an Analytics Engineer to take ownership of the full data lifecycle within a growing, data-driven business. You'll work across analytics engineering, data engineering, and business intelligence, helping shape … data powers decision-making, product development, and commercial growth. ROLES AND RESPONSIBILITIES: The Analytics Engineer will: Design, build, and maintain end-to-end data pipelines from source systems through to analytics-ready datasets Develop scalable and well-documented transformation pipelines using dbt and BigQuery Write ...

This is an opportunity for a Data Operations Manager to join a research and analytics business focused on improving data delivery, automation, and operational processes. You'll work across a range of data projects, helping to drive efficiency and support the continued development … data function. The Company They are an established insights and research organisation that works with clients across multiple sectors. The business is investing in technology, automation, and operational improvement to support future growth. You will join a collaborative team where data and technology play ...

roles within our FDE team. As a Forward Deployed Engineer (FDE), you will work with customers to build and productionize solutions to their data & AI challenges using the company platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning data … will have: Production Solution Delivery: Lead impactful customer technical projects by delivering production‐grade systems, designing and building reference architectures, custom applications and data ingestion and ML/AI model integration Transformational Impact: Guide strategic customers as they implement transformational big data projects, including ...

engineering skills: clean, tested Python, comfortable owning systems end to end Hands-on experience with large, messy datasets - cleaning, joining, versioning, and validating data at scale Experience making ML training and inference run efficiently on very large data: caching, data loading, memory management, cross … workloads on HPC or multi-node GPU clusters (e.g. Slurm, distributed training) Bonus points Prior work with health records, single-cell/cytometry data, or time-series Prior experience working with Tabular data/datasets Comfortable across the stack — data pipelines, model training ...

exciting opportunity for a Data & ML Engineer to join a thriving technology and innovation hub where talented engineers, data specialists and industry experts come together to build solutions that make a real difference. Working across a diverse range of projects, youll have the opportunity to work … with cutting-edge technologies, solve challenging data problems and develop your expertise across the rapidly evolving world of AI. You will have the opportunity to: Design and implement robust data pipelines and ML workflows using Python, SQL, Spark and Databricks. Develop and deploy machine learning models ...

market insights quickly, the Lead Ruby Engineer will play a crucial role in shaping this product. Key Responsibilities: Scale systems to handle increasing data streams. Collaborate with a team of experienced engineers on next-gen research and data analysis tools. Utilise Ruby and JavaScript daily, integrating … with data pipelines for Data Lake, Data Warehouse, ML training loops, and data operations workflows. Requirements: Strong expertise in Ruby and Rails with 7+ years of experience. Solid understanding of object-oriented programming and relational databases (PostgreSQL).Proficient in writing tested code ...

maximising customer value. Bridge Product and Pricing - translate product strategy into pricing implications and vice versa, ensuring both teams operate from a shared, data-driven understanding. Drive strategic impact - lead analytical roadmaps, cut through ambiguity, and influence pricing direction in leadership forums. Champion technical excellence - write high-performing … Marketing. You influence without authority and drive consensus through clear, compelling communication. Advanced technical skills - expert-level SQL, experience with data pipeline tools like dbt, and the ability to architect scalable data solutions. Leadership and influence - you mentor analysts, build partnerships with senior stakeholders ...

building expertise that makes you a sought-after leader in the transformation of global work. Responsibilities: Lead the design and development of the data reporting layer and analytics pipelines to ensure they are scalable, maintainable, and meet business requirements. Architect and implement complex end-to-end data … code and design reviews to ensure quality and consistency. Mentor and train analytics engineers, fostering continuous learning and adherence to best practices in data modeling and reporting. Collaborate with cross-functional teams (product, engineering, analytics) and stakeholders to align data projects with broader business objectives ...

Bristol seeks a Data Engineer to design, build and maintain scalable data solutions supporting the underwriting function. You will develop data pipelines, integrate diverse data sources and collaborate with underwriting, pricing and data science teams to enable data-driven decision making. The role combines hands-on data engineering with leadership development and domain knowledge to drive data capabilities across the business. Hybrid working and a strong benefits package are offered. #J-18808-Ljbffr ...

Lorien is seeking a data engineer to support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated reporting. You will identify, onboard and integrate cyber security data sources, design automated workflows, develop data models and ensure data quality to boost dashboard reliability. This role emphasizes scalable analytics using Power BI and Databricks to drive security insights. #J-18808-Ljbffr ...

Hippo is seeking a Senior Azure Data Engineer to join our Managed Services Team in the Manchester area. You will lead production data pipelines, collaborate with internal and client teams, and drive platform reliability and data-driven decision making. You’ll apply expertise … Python, Microsoft Fabric, and Azure Data Factory to deliver scalable, automated data solutions, with on-call commitments within a dynamic consultancy environment. #J-18808-Ljbffr ...

roles within our FDE team. As a Forward Deployed Engineer (FDE), you will work with customers to build and productionize solutions to their data & AI challenges using the Databricks platform. You will own the architecture, lead design decisions, and implement end-to-end systems spanning data … will have: Production Solution Delivery: Lead impactful customer technical projects by delivering production-grade systems, designing and building reference architectures, custom applications and data ingestion and ML/AI model integration Transformational Impact: Guide strategic customers as they implement transformational big data projects, including ...