451 to 475 of 1,510 Data Pipeline Jobs in London

Credit Principal Algo Data Lead

Hiring Organisation
UBS
Location
London, UK
Employment Type
Full-time
delivering AI solutions? We are seeking a talented and self-driven candidate to join and lead our Credit Principal Algo Credit Algo Data team within UBS Global Markets This is a fast paced and collaborative team that are responsible for the development and enhancement of our growing trading … analytics platform We're looking for a Credit Principal Algo Data lead to: Participate in the design, development, of our data platform Play a key role in designing and implementing the next generation of platform, partnering closely with Algo Quant Trading, Trading, and Sales from idea ...

Data Engineer - AWS, Spark & AI

Location
City Of London, England, United Kingdom
Data Engineer - AWS, Spark & AI Salary: £60,000-£75,000 Dependent on Experience London: Hybrid working - 3 days per week in the office, 2 days home-based Job Ref: J13171 Join a fast-growing technology start-up where you'll have the freedom to experiment with cutting-edge … data and AI technologies, solve interesting problems and make a visible impact from day one. Working alongside a talented team of engineers, analysts and data scientists, you won't be confined to one small part of the platform. You'll build scalable pipelines, work with large ...

Data Engineer (Tech Lead/Staff)

Location
Greater London, England, United Kingdom
Octopus Electric Vehicles we’ve built a data platform that provides data services to all areas of our business. Key Responsibilities Own and optimise our platform architecture (improve reliability, scalability, maintainability, etc) Shape the direction of our growing team and coach team members on best practices. … outputs and raising the technical bar of the organization without losing touch with hands-on engineering Interact with Senior Leadership to present your data projects back to them Build new data sources and data pipelines that deliver key data and insights ...

Data Engineer

Location
Greater London, England, United Kingdom
About Unifeye Unifeye is a delivery-led, Databricks first consultancy helping organisations unlock the full value of their data and AI. We're a lean, high growth team based in London, working at the intersection of data, technology and business strategy. We partner with enterprise organisations … across industries to solve complex data challenges through modern Lakehouse architectures on Databricks. Joining Unifeye means more than delivering projects. From day one, you'll be trusted to take ownership, challenge conventional thinking and make a genuine impact. With a high degree of autonomy, you'll help shape ...

Principal Backend Engineer

Hiring Organisation
Publicis Media
Location
London, UK
Employment Type
Full-time
integrated platform-based technologies and offerings from CJ, Epsilon and Influential. A key business solution of Publicis Groupe, Publicis Media's digital-first, data-driven global solutions deliver client value and drive growth in a platform-powered world. It is present in over 100 countries with over … plus strong SQL and modern testing practicesHands-on Databricks/PySpark experience and lakehouse/medallion architecture (or equivalent large-scale data pipeline experience)Strong AWS serverless background (Lambda, API Gateway, S3, DynamoDB, IAM) with infrastructure-as-code (e.g., CloudFormation/SAM)Deep understanding of multi-tenant ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
Lead Data Engineer About CRU CRU International is a leading provider of business intelligence and consulting services in the metals, mining, and fertilizer industries. With over 50 years of experience, we offer valuable insights and analysis that help our clients make informed decisions in an ever-changing global … market. About the role We are looking for a Lead Data Engineer to take ownership of a business domain within our modern Snowflake, Airflow, and dbt data platform. This role will combine hands-on technical leadership with team coordination, helping ensure stable platform operations, strong data ...

Data Engineer: Build Scalable ETL Pipelines & Models

Location
Greater London, England, United Kingdom
Disguise Technologies Ltd in London seeks an experienced Data Engineer to design, build, and maintain robust data pipelines and a scalable data warehouse. You will work with large, complex … datasets to empower analysts and stakeholders to make data-driven decisions shaping the company’s future. Key responsibilities include ETL/ELT pipeline development, data modelling, and data quality monitoring. Strong SQL, Python and AWS experience, plus CI/CD and Docker ...

Senior Data Analytics Consultant

Hiring Organisation
Harnham
Location
London Area, United Kingdom
Senior Data Analytics Consultant London Up to £65,000 This is an excellent opportunity for a Senior Data Analytics Consultant to join a high-growth data and analytics consultancy delivering impactful solutions for globally recognised organisations. The role combines hands-on technical expertise with … decision-making, and drive measurable business outcomes. The Company They are a specialist analytics and AI consultancy that helps organisations unlock value from data through reporting, business intelligence, and advanced analytics solutions. Their teams work closely with clients to solve complex business challenges, improve performance, and embed data ...

Public Sector Data Platform Architect | Cloud & Pipelines

Location
City Of London, England, United Kingdom
technology consultancy in London is seeking a Lead Data Engineer to help public sector organizations become data-led. This role involves defining data strategies … advising teams on data value, and contributing to recruitment and management efforts. Ideal candidates will possess strong skills in data pipeline creation, architecture design, and have a thorough understanding of agile practices. The role also offers flexible remote working arrangements. #J-18808-Ljbffr ...

Senior Data Platform Enablement Lead

Location
Greater London, England, United Kingdom
Sydney. About WPP WPP is the trusted growth partner for the world’s leading brands. We unite cutting-edge media intelligence and data solutions, world-class creativity, next-generation production, transformative enterprise solutions and expert strategic counsel in a single company – powered by exceptional talent and our agentic … platform, WPP Open, to help our clients navigate change, capture opportunity and deliver transformational growth. For more information, visit WPP.com. Job Title : Senior Data Platform Enablement Lead Location : London Department : Data Intelligence/Open Intelligence Product & Engineering Role Overview As we scale the rollout of Open ...

Principal Azure Data Engineer (Databricks)

Hiring Organisation
Capco
Location
London, UK
Employment Type
Full-time
Principal Azure Data Engineer (Databricks)Location: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentLead the architecture of data platforms driving the future of financial services. The RoleAs a Principal Azure Data Engineer (Databricks) at Capco, you'll architect and lead the delivery of enterprise … grade data solutions using the Databricks platform within the Azure ecosystem. You'll drive the design and implementation of streaming and batch data pipelines, helping our clients modernise their data capabilities. Working with cross-functional teams, you'll guide clients on technical strategy ...

Data Engineer

Location
Greater London, England, United Kingdom
monitoring the commercial performance of our algorithmically underwritten insurance business in real time. We’re upgrading the foundation that captures algorithm decision data, moving from database logging to a versioned event stream with purpose-built views for each customer use case. This will unlock faster, more reliable insights … released, as well as stress-test changing market conditions. You’ll have the chance to dive deep into insurance domain modelling problems alongside data engineering. You’ll work in an agile, cross-functional squad close to the people who consume what we build, helping us shape our engineering ...

Lead Data Engineer

Location
Greater London, England, United Kingdom
funded AI business that is building the operating system for a large, traditionally under-digitised industry, and looking to hire their first Lead Data Engineer into a small, high-impact team. This is a broad and genuinely technical role sitting at the heart of the data … their AI products. Already live with pilot customers managing 14,000+ units, this is a rare opportunity to join early and own the data architecture from day one, working closely with AI engineers, backend engineers and product teams to translate business needs into real-time, AI-ready data ...

AWS Data Engineer

Location
Greater London, England, United Kingdom
London, United Kingdom | Posted on 24/11/2025 We provide end-to-end IT solutions and services including Applications services, Data & Analytics services, AI/ML Technologies and Professional services in the UK and EU market. Job Description Role Overview We are developing a next-generation … type hints, linters, and test frameworks such as pytest. Solid understanding of data engineering fundamentals including batch processing, schema evolution, and ETL pipeline development. Experience with—or strong interest in learning—Apache Spark for large-scale data processing. Familiarity with AWS data ecosystem ...

Founding Data Platform Engineer

Location
Greater London, England, United Kingdom
well-funded, fast-growing data intelligence startup based in London backed by leading venture investors. The problem Every growing company eventually reaches the same point: its data is everywhere. Customer information lives in one system. Revenue data sits in another. Product activity, operations … through dashboards, writing queries or waiting for someone to bring the numbers together. We’re building a better way. We’re building a data intelligence platform for a world in which AI agents, not just people, need to understand and use business information. Our platform connects fragmented data ...

Lead Data Analyst (Pricing & Monetization)

Location
Greater London, England, United Kingdom
long way, there's still so much exciting work to do. Come join us at the heart of trust! About the Role: Data isn’t just a byproduct of our business; it’s the engine that drives our growth. We are looking for a Lead Pricing & Monetization Analyst … this role, you’ll focus on empowering the Pricing & Monetization team while working cross-functionally across our commercial organization, and broader analytics and data teams. What You’ll Be Doing: Pricing & Monetization Analytics: Partner with product and commercial leadership to evaluate pricing and packaging strategies, analyzing discount behaviors ...

Data Engineer

Hiring Organisation
Capgemini
Location
London Area, United Kingdom
About the Job you are considering: We are seeking a highly skilled Data Engineer with strong expertise in Apache Spark AWS Scala TABLEAU and JAVA Microservices Architecture to design and build scalable cloud native data platforms and applications. The ideal candidate will have experience in developing … high performance data processing solutions implementing robust DevOps practices and enabling data driven business insights through modern data engineering frameworks. Hybrid working: The places that you work from day to day will vary according to your role, your needs, and those of the business ...

Data Engineer

Location
Greater London, England, United Kingdom
Location: London (Hybrid - 4 days on-site) The Role We are seeking a mid-level Data Engineer to join a small, high-impact technology team. This role is suited to a self-starter who enjoys autonomy, takes full ownership of their work, and is comfortable operating close … business in a regulated financial context. You will design, build, and maintain robust batch data pipelines, transforming data from diverse sources into a consistent, well-modelled SQL-based warehouse. Your work will directly support investment analysis, risk management, accounting, and external reporting. This is a hands ...

Senior Engineer, Commodities Technology

Hiring Organisation
Balyasny Asset Management
Location
London, UK
Employment Type
Full-time
Location: LondonDepartment: TechnologyExperience Level: Experience ProfessionalsContact: Paul KrugJob ID: REQ8322Role overviewWe are hiring a senior engineer to build and operate the data systems that turn vendor feeds, weather data, and satellite and vessel-tracking signals into decisions our commodities investment teams act on directly. The role … covers the full path from external data sources to end users. You will ingest vendor feeds, define schemas and data models, load data into analytical stores, and build controls that identify incomplete or incorrect data before it reaches the desk. The datasets ...

Lead GCP Engineer

Location
City Of London, England, United Kingdom
analytics engineering team operating within a highly regulated environment. Key Responsibilities Technical Leadership & Platform Ownership Provide technical leadership for the organisation's strategic data and analytics products. Define and drive the technical roadmap for the GCP Analytics platform from concept through to implementation. Take ownership of engineering standards … with organisational governance standards, security policies and regulatory obligations. Balance innovation and rapid delivery with appropriate risk management and control frameworks. Design secure data integration patterns incorporating authentication, authorisation and access management technologies. Support delivery of solutions that are suitable for audit scrutiny and regulatory reporting requirements. Operate ...

Analytics Engineer - Contract | Outside IR35

Hiring Organisation
Oliver Bernard
Location
City of London, London, United Kingdom
Analytics Engineer - Contract | Outside IR35 I’m working with a rapidly growing global technology-led business that is investing heavily in its Data & AI function and wider data platform. They’re now looking for an Analytics Engineer to join their data enablement team … help build scalable data products and improve their analytics capabilities. The role: • Build and optimise data pipelines and data products • Design data models and support ELT processes • Work closely with Data Analysts, Engineers and business stakeholders • Translate business requirements into ...

AI-Enabled Data Analytics Engineer

Location
Greater London, England, United Kingdom
hiring an AI-Enabled Data Analytics Engineer to join a global technology organisation, building scalable data, analytics and AI-assisted automation solutions that improve business decision-making. This is a hands-on engineering role for someone strong in Databricks, SQL and Python who is already using … improve them , ensuring solutions are technically accurate, reliable and relevant to the business. What you'll be doing Design, build and optimise data pipelines and analytics solutions using Databricks Develop SQL, Python and PySpark solutions for transformation, analytics and automation Build and improve AI agents, reusable workflows, prompt ...

Principal Engineer

Hiring Organisation
9fin
Location
London, UK
Employment Type
Full-time
world's largest asset class at over $145 trillion. Debt markets are vast, global, and mission-critical, yet still run on fragmented data, PDFs, and manual workflows. 9fin replaces this broken infrastructure with a single platform that centralises proprietary credit data, deep analysis, and high-value … -intensive, fast-moving engineering org — and has the range to show for itCan credibly walk into a conversation about data pipeline architecture, RAG evaluation, API design, or system scalability — and add something useful in all of themOwns problems, not just opinions. You're not here ...

Data Engineer

Hiring Organisation
Data Careers
Location
South East London, London, United Kingdom
Employment Type
Contract
Contract Rate
£700 - £800 per day
Data Engineer 6 Month Contract Location: London (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will … joining an established defence programme requiring additional engineering support across an existing data platform. You will be responsible for building, maintaining and improving new and existing data pipelines within a secure MoD environment. Due to the nature of the work you will be required to work ...

Clinical Engineer

Location
City Of London, England, United Kingdom
/pain points. Next 6 months - some examples of what to expect: Help architect and deploy a scalable & cost effective ETL data pipeline with version control, outputting clean data ready for tokenisation. Help deploy our active deep learning training & validation architecture to prod, so that … healthcare and save lives. Work with the ML/data team to creatively ideate and ship features to improve ETL pipeline throughput and quality through a data-driven approach powered by analytics. #J-18808-Ljbffr ...