1,001 to 1,025 of 1,474 Data Pipeline Jobs in London

Lead Solutions Architect

Hiring Organisation
Celonis
Location
London, UK
Employment Type
Full-time
Celonis is the trusted platform to industrialize Enterprise AI. At our core is the Celonis Context Model — which combines process data, business knowledge, and intelligence into a living digital twin of the enterprise that AI can actually understand, turning AI's operational blind spots into operational clarity. World … necessary tradeoffs. Promote reusability by choosing between dedicated customer solutions and broader platform enhancements in collaboration with Celonis product development. Establish real-time data integrations between customer systems and Celonis via APIs and internal tools. Guide customers on authentication, user/group management, and provisioning best practices. Thus ...

Data Engineer: Build Scalable, Secure Data Pipelines

Location
Greater London, England, United Kingdom
Seven Investment Management in London is seeking a Data Engineer to design, build, test and release data solutions, contributing to a modernisation of the data platform. You will deliver robust, scalable pipelines in a regulated financial services environment. Responsibilities include collaborating with stakeholders, developing … data models, adhering to security standards and maintaining documentation while driving continuous improvement across the data engineering team. #J-18808-Ljbffr ...

Bi/GCP Analyst

Hiring Organisation
Sphere Digital Recruitment
Location
London, South East England, United Kingdom
Employment Type
Part-Time
Salary
£325.00 - £365.00 per day
exciting media agency in London is looking for a Contract Data Engineer/BI Consultant to join the team on a short-term contract, supporting dashboard development and data infrastructure projects until a permanent hire joins in December. Based in London 4 days per week … until 7th December 2026 (with potential handover period) Start date: ASAP Up to £365 per day Outside Ir35 The Job As the Contract Data Engineer/BI Consultant , your responsibilities will include: Building and enhancing dashboards and data visualisation solutions for internal and client reporting. Developing ...

Senior AWS Data Platform Engineer

Location
Greater London, England, United Kingdom
Jobtailor is seeking a skilled Data Engineer to design, build and maintain scalable data platforms in AWS for analytical and operational workloads. You will develop end-to-end data pipelines, implement best practices, and collaborate with multiple stakeholders to ensure data quality … governance across environments. The role requires strong Python/SQL capabilities, experience with AWS data services, and the ability to lead technical decisions while mentoring engineers. #J-18808-Ljbffr ...

Software Developer - Core Data

Hiring Organisation
SQUAREPOINT CAPITAL
Location
London, UK
Employment Type
Full-time
Core Data team models and owns the structured datasets that connect Squarepoint to the outside world, effectively representing the firm's view of reality. We partner closely with portfolio managers and investment researchers to define robust data models and build reliable data pipelines that … collaborative, learning-oriented environment where excellence is recognized, diverse perspectives are valued, and innovative solutions are encouraged. Acquire a deep understanding of the data requirements provided by investment research teams and deliver solutions that create business impactDesign, implement, test, optimize and troubleshoot data pipelines and services ...

Senior Databricks Architect - Data Mesh & Streaming Tech

Location
Greater London, England, United Kingdom
Infosys Limited in London is seeking a Senior Databricks Architect to design, build, and operate scalable data pipelines and data products that enable a modern data mesh. The role focuses on integrating legacy systems with cloud-native platforms for analytics, reporting, and domain-owned … data products, with hands-on work in Databricks, Kafka, and AWS S3. You will implement batch and streaming pipelines, apply the Bronze-Silver-Gold medallion architecture, ensure data quality and governance, and #J-18808-Ljbffr ...

Lead Data Platform Engineer – BigQuery & GCP

Location
Greater London, England, United Kingdom
Menzies is seeking a senior data engineering lead to design and deliver scalable, secure data pipelines into BigQuery and related GCP services. You will shape the engineering approach, set standards for data modelling, testing, and cost optimisation, and partner with teams to deliver reusable … data products. You will mentor engineers and promote governance and data quality by design. Ideal candidates have 5+ years in data engineering, strong SQL/Python skills, and deep knowledge of BigQuery, #J-18808-Ljbffr ...

Senior Python Engineer: AI Agents & Forecasting

Location
Greater London, England, United Kingdom
stack. The network, signal layers, and forecasting architectures need to work together as one coherent system. Designing and building the agent orchestration pipeline that allows AI forecasters to ingest data, reason, and produce predictions. Building and optimising the signal pipeline that feeds real-world data … underway on forecasting architectures. You're making architectural decisions independently and contributing to technical strategy, not just executing tickets. At 6 months: The signal pipeline has an inductive process, a world model sits on top, and there's a sellable product for clients. You've unified the different parts ...

Senior AI Risk Technical Advisory Lead

Location
City Of London, England, United Kingdom
serve as a senior subject matter expert for AI risk and responsible AI across Bloomberg. This person will work closely with engineering, product, data science, legal, compliance, CISO, privacy, and risk stakeholders to provide practical, technically credible guidance on AI use cases, AI systems and data … Bloomberg, including product, platform, internal tooling, automation, and third-party AI solutions. Evaluate AI risks related to bias, explainability, hallucination, robustness, model drift, data leakage, privacy, security, intellectual property, misuse, transparency, and human oversight. Advise teams on appropriate controls, testing, monitoring, documentation, and risk mitigation strategies based ...

Data Engineer - Scalable Pipelines & Impactful Dashboards

Location
Greater London, England, United Kingdom
NextGenEnergyJobs is seeking a data engineer to design, build, and maintain scalable data pipelines in Databricks while ensuring data reliability. You will own Databricks models, define schemas, test, and maintain a clean data warehouse. The role also focuses on automating processes with … Python and delivering useful dashboards for Finance and Asset Management. You will integrate systems via REST APIs, promote data quality through monitoring and governance, and collaborate with non-technical #J-18808-Ljbffr ...

Lead Analyst - Payment Operations Risk

Hiring Organisation
Wise
Location
London, UK
Employment Type
Full-time
Operations Analyst who is passionate about our mission of Money Without Borders. You will partner with our Payment Operations organisation to help drive data-driven decisions that would evaluate the current risks the organisation faces, interpret risk appetite and monitor and control for these risks. The Payment Operations … that support the organisation's risk appetite and build control assurance models around our risky payment processing flows. You will also own the data behind the reconciliation of bank balances and customer funds to ensure that there are no material financial discrepancies. You will own the relationship with ...

Senior Audio AI Research Engineer

Hiring Organisation
Logitech
Location
London, UK
Employment Type
Full-time
within a given space. Address complex challenges before deploying new Audio AI technologies. This involves optimizing integration with other components in the Audio AI pipeline, identifying the most effective task combinations, and developing strategies to minimize bias while enhancing robustness against noise, reverberation, and echo. Conduct in-depth research … deployment, and C++ optimization. Demonstrate the ability to rapidly prototype Audio AI technologies by implementing research papers and extending them—such as modifying data augmentation strategies, adjusting FFT parameters, incorporating auxiliary tasks, and optimizing loss functions. Experience with data-driven algorithm tuning using metadata evaluations ...

Databricks Lead Engineer: Lakehouse & Pipelines

Location
Greater London, England, United Kingdom
DATA, Inc. is seeking an experienced Data Engineer to design and deliver Databricks-based data pipelines for complex client projects. You will engage with clients, collaborate with architects and engineers, and drive best practices across the data lifecycle. The role requires … years in data engineering, strong SQL/Python, and hands-on experience with Databricks on cloud platforms such as AWS, Azure, or GCP. #J-18808-Ljbffr ...

Senior Forward Deployed Engineer

Location
Greater London, England, United Kingdom
enterprise that impacts the customer will be disrupted. We believe the future will run on the connective tissue between people, machines and data: all in the service of creating the most human processes and experiences for customers and employees. Job Description: About the Role As a Senior Forward … just coding - you're solving some of the most exciting challenges and problem solving in enterprise AI rollout, spanning enterprise data pipelines, multi‐agent orchestration/workflows and RAG/SLM finetuning. Responsibilities Lead the technical solution design and implementation of large‐scale Agentic and Knowledge AI solutions ...

AI-Powered Data Engineer for Scalable Pipelines

Location
Greater London, England, United Kingdom
Arct a L is seeking a data-obsessed individual to manage AI agents in Old Street, London. You will ensure data quality and build efficient data pipelines while debugging issues. This is a full-time, in-office position with a salary range … 100k and requires experience in data science or a related field. The role emphasizes data engineering and AI tool usage, making it ideal for candidates passionate about data accuracy and system optimization. #J-18808-Ljbffr ...

Senior Software Engineer, Real-Time

Location
Greater London, England, United Kingdom
Build and improve software components that aggregate, correlate and present data from over 30 global distribution sites Develop applications and data-processing logic to identify performance issues, service degradation and hotspots across distributed systems Contribute to telemetry pipelines that ingest, transform and route metrics, logs … telemetry standards is desirable Exposure to Kubernetes, containers or cloud platforms is desirable Exposure to data-processing, event-streaming or telemetry-pipeline technologies is desirable Exposure to CI/CD, GitOps or configuration-as-code approaches is desirable Exposure to synthetic monitoring, automated testing, probes or distributed ...

AI Solutions Technical Engineering Manager

Location
Greater London, England, United Kingdom
ready to LEVEL-UP THE GAME? We’re looking for an AI Solutions Technical Engineering Manager to lead the delivery of AI- and data-enabled products and platforms from early shaping through to measurable outcomes in production. You’ll operate at the intersection of engineering leadership, AI delivery … drive innovation while delivering under tight timelines and high expectations. The role You will lead multidisciplinary engineering teams (AI/ML, data, software, platform) to deliver AI capabilities that are trusted, adopted, and production-grade . You’ll partner with senior stakeholders & Product Managers to define outcomes, guide ...

Senior Software Engineer (Backend)

Location
Greater London, England, United Kingdom
decision intelligence company used by governments, defence organisations, financial institutions, and corporates operating in complex, fast-moving environments. Our capabilities fuse curated data sources, domain-specific AI, and deep human expertise to transform information overload into clear, actionable foresight. Our ambition is to become the analytical backbone that … over which problems we take on. Breadth rather than a narrow track. The work follows the problem, which means service design one month and pipeline or infrastructure work the next. Engineers here have the opportunity to build depth across several areas rather than being funnelled into one. Progress without ...

Enterprise Architect

Location
Greater London, England, United Kingdom
within our Business Solutions Team, the role works across the whole of IT, collaborating closely with Infrastructure, Information Security, Business Solutions, Legal Tech, Data Architecture and Insights, Finance Systems and our Project Management Office to ensure solutions and platforms are designed from the ground up with our full … cloud strategy across major platforms. Cross-Team Collaboration: Work across the whole of IT, partnering with Infrastructure, Information Security, Business Solutions, Legal Tech, Data Architecture and Insights, Finance Systems and our Project Management Office to take solutions and platforms from concept through to production. Business Translation: Evaluate business ...

Senior Python Engineer

Hiring Organisation
INTEC SELECT LIMITED
Location
London, South East England, United Kingdom
Employment Type
Full-Time
Salary
£450.00 per day
Senior Python Engineer/Back End Developer to join a fast-moving team. You will develop Python microservices, scalable services, voice chat, and data pipelines, using AI technologies including ASR, TTS, and LLMs. The ideal candidate will have strong Python skills, a pragmatic delivery-focused approach … ability to take ownership in a fast-paced, evolving environment. Key Responsibilities: Develop and maintain scalable Python services, microservices, voice chat, and data pipelines. Work with the Tech Lead and wider team on architecture, technical decisions, and solution design. Collaborate with product, data science, QA, design ...

Lead Data Engineer - Python, SQL - Team Lead - Vice President

Location
Greater London, England, United Kingdom
agile team that's constantly pushing the envelope to innovate, build, enhance and deliver top-notch technology products. As a Lead Data Engineer at JPMorgan Chase within the GIB and a part of the Capital Markets Team you are an integral part of an agile team that works … solutions across multiple technical areas within various business functions in support of the firm’s business objectives. Job responsibilities Lead a Squad of Data Engineers to meet business deliveries working with Product and Design leads. Lead Agile ceremonies including standups, retros and technical refinements. Self-starter able ...

RVP Forward Deployed Engineering, Salesforce

Location
Greater London, England, United Kingdom
future of Salesforce. We are Salesforce, the Customer Company, inspiring the future of business with AI + Data + CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower … Technical Authority: Serve as the final technical escalation point for your portfolio. Maintain deep architectural judgment across the Salesforce platform, advanced LLM techniques, data pipelines, and agentic orchestration. Guide Enterprise Implementations: Unblock complex data readiness, tool integration, and multi-agent orchestration challenges. Step in directly ...

Staff Software Engineer - Machine Learning

Hiring Organisation
Capital One UK
Location
London, UK
Employment Type
Full-time
United Kingdom, London, London Staff Software Engineer - Machine Learning About this role We’re on a mission to transform the way we use data and AI to service our customers and drive efficiency across the business. Do you love shaping the technical landscape and driving innovation across … MLOps standards and practices across teams, including CI/CD for models, automated testing, monitoring, and deployment pipelines Collaborate with enterprise platform and data science teams, contributing to platform capabilities where appropriate and partnering on use case delivery Build and maintain strong relationships with key stakeholders, including senior ...

Azure Data Engineer — Real-Time Analytics for Energy Markets

Location
Greater London, England, United Kingdom
RocketFin Inc in Greater London is looking for a skilled Data Engineer to build and enhance data pipelines and automation workflows on Azure. Responsibilities include maintaining and optimizing toolkits, databases, and supporting real-time analytics within a dynamic trading environment. The ideal candidate will have strong … proficiency in Python and hands-on experience with Azure services like Data Factory and Databricks. Familiarity with Snowflake data models and third-party market data APIs is essential for success in this role. #J-18808-Ljbffr ...

Software Quality Engineer

Location
Greater London, England, United Kingdom
agents and LLM-powered applications Design and develop robust, scalable, and maintainable automated test frameworks Collaborate with product managers, machine learning engineers, and data scientists to translate AI features and model behaviors into test cases and validation criteria Improve testing processes and infrastructure, integrating automated checks into … model performance and contribute to post-release quality validation Champion quality best practices across engineering teams Design, manage, and maintain test data strategies and mock services Manage the full defect lifecycle using customer feedback and debugging logs Report directly to the director of engineering Requirements 5+ years ...