376 to 400 of 470 Data Pipeline Jobs in London

Azure Data Engineer - 1/2 days onsite 18 month FTC Summary: Join a team building a modern Azure-based data platform. This hands-on engineering role involves designing and developing scalable, automated data pipelines using tools like Data Factory, Databricks, Synapse … Logic Apps. You'll work across the full data lifecycle - from ingestion to transformation and delivery - enabling smarter, faster click apply for full job details ...

Bloomberg, we believe in fostering a transparent and efficient financial marketplace. Our business is built on technology that makes news, research, financial data, and analytics on over 35 million financial instruments searchable, discoverable, and actionable across the global capital markets. Bloomberg has been building Artificial Intelligence applications that … explainability for our sustainability solutions. Bloomberg's sustainable finance solutions are built on comprehensive, reliable, and contextualized environmental, social, and governance data, helping investors see clearly and act with confidence. Our team powers the ML systems behind these solutions, enabling clients to surface opportunities in a shifting landscape ...

client is a digital bank that is looking for a Head of Data Engineering to get involved in the very early stages of a greenfield project. In this role, you'll lead and mentor a data engineering team to design, develop, and implement data … their multi-cloud product. You'll also design and develop scalable, cost-effective, and secure distributed architectures and solutions that comply with relevant data security and regulations. You'll also design, implement, and maintain data pipelines that efficiently collect, process, and store large volumes of data ...

next generation of analytical and trading capabilities. The Fixed Income Rapid Application Development (RAD) team is a specialized group of engineers, quants, and data scientists that delivers tactical, production-grade application and AI solutions for Fixed Income portfolio managers, traders, risk, and operations teams. Working closely with investment … Work directly with portfolio managers, traders, execution desks, and risk teams to rapidly prototype and deliver tactical, production-grade applications. Build and maintain data pipelines that combine internal and market data sources into custom analytics and delivery formats (dashboards, APIs, Excel/notebook tools).Design ...

Data Engineer (Python SQL AWS) London/WFH to £85k Do you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role at a scaling Investment Research tech company with … great benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery click apply for full job details ...

environment that's empowering, collaborative, and full of opportunities to turn today's challenges into tomorrow's solutions. Job DescriptionJoining Wavestone's UK Data & AI Service Line offers the opportunity to help shape large-scale AI and data transformations for FTSE100 organisations and enterprise clients. … ability to operate across the full lifecycle: from strategy to design to build to deploy and scale As a senior member of the Data & AI practice, your key responsibilities will cover client delivery, business development, people development, and key contribution to our thought leadership. Depending on your level ...

customer-facing software engineering team at Databricks. We work with Databricks most strategic customers to design, build, and productionize first-of-their-kind data and AI solutions. This team is the right fit for you if you love working side-by-side with customers, collaborating with teammates … pushing your curiosity across the latest trends in data, applications, and AI innovation. Role DescriptionAs a Forward Deployed Engineer (FDE), you will embed directly with our most strategic customers to design and deliver custom fullstack applications and solutions on the Databricks Data Intelligence Platform and other ...

with colleagues across the product and technical delivery. Your new role This is a hands-on position spanning AI application development, backend engineering, data integration and production delivery. You will: Design, build and deliver the backend services and APIs that support the new AI layer. Develop controlled integrations … with internal data and agreed external information sources, ensuring outputs are current and traceable. Work with a Frontend Engineer to connect the AI capability to the user interface and agree delivery priorities. Build appropriate security controls, including permissions, audit logging and safeguards for sensitive data. Establish automated tests ...

build critical backend security guardrails across the organisation. Key Responsibilities AI Guardrails & Governance: Design and implement backend security guardrail capabilities to sanitize sensitive data (PII and MNPI) and prevent prompt injection risks in production LLM workflows. GenAI Workflows & Scalable Solutions: Build and deploy enterprise-level GenAI …/UX & Frontend Integration: Design and implement user interfaces and frontends for AI guardrail requirements (~20-25% of the role). Cloud Infrastructure & Data Pipelines: Build with AWS and Azure services to construct ETL workflows and dynamic systems using orchestration platforms like Apache Airflow. Production Operations: Support production ...

provider with ambitious plans to become the best and biggest in the UK market. We've made huge investments in our pricing and data capabilities over the past few years, along with nurturing our 4Cs culture. We provide insurance for over four million customers, but we know there … even bigger opportunity out there - our Pricing, Data and Analytics community value curiosity, collaboration and constructive challenge. We are always looking for new ideas and diverse perspectives to question established thinking and drive meaningful change. Great pricing is built on trust, innovation and precision ...

Applied AI Engineer Up to £100,000 This is an exciting opportunity to join a growing technology consultancy at the forefront of AI, Data and Cloud transformation, helping enterprise clients solve complex business challenges through innovative AI-driven solutions. You will play a key role in designing, building … opportunity to work with cutting-edge technologies including Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, MLOps and cloud-native data platforms helping clients move beyond proof-of-concept and into real-world AI adoption. This position would suit someone who combines strong software engineering ...

Senior Applied AI Engineer - UK (Remote) - GenAI, LLMs, RAG & Data Engineering - Up to £105,000 I'm working with a growing technology consultancy that's making significant investment in AI and looking to hire a Senior Applied AI Engineer to help build innovative, real-world AI solutions … trusted by end users. You'll join a collaborative team of engineers, architects and AI specialists, helping organisations unlock the potential of their data through modern AI technologies. You'll have the opportunity to work across a range of enterprise AI initiatives, helping clients turn emerging AI capabilities ...

United Kingdom, London, London Staff Software Engineer - Machine Learning About this role We're on a mission to transform the way we use data and AI to service our customers and drive efficiency across the business. Do you love shaping the technical landscape and driving innovation across … MLOps standards and practices across teams, including CI/CD for models, automated testing, monitoring, and deployment pipelines Collaborate with enterprise platform and data science teams, contributing to platform capabilities where appropriate and partnering on use case delivery Build and maintain strong relationships with key stakeholders, including senior ...

customer-first products and services. Software Engineers may support teams across backend engineering, frontend engineering, cloud engineering, mobile, AI/machine learning, data-oriented engineering, infrastructure-adjacent engineering, or full-stack product development. You will design, code, test, improve, and support applications and services that help customers, colleagues … deliver value. Work across different parts of the technology stack, such as APIs, services, microservices, user interfaces, mobile experiences, cloud platforms, or data-driven solutions. Explore responsible use of AI-powered developer tools, machine learning concepts, and intelligent automation relevant to your team's work. Participate in graduate ...

Docker, Kubernetes, Elastic Container Service, or equivalent technologies in production environmentsStrong experience designing and implementing application programming interfaces, distributed systems, event-driven architectures, data pipelines, PostgreSQL, MongoDB, Redis, vector databases, observability, and automated deployment pipelinesDemonstrated ability to influence technical direction while remaining close to the codebase, mentoring engineers … designing, coding, reviewing, debugging, and improving production systems that support AI-powered products and servicesDesign and build scalable backend services, application programming interfaces, data pipelines, inference pipelines, and platform capabilities that support real-time and batch AI workloads at enterprise scaleImplement advanced large language model applications using retrieval ...

document understanding, search, summarisation and workflow automation, while ensuring solutions are performant, reliable, secure and maintainable in a production-grade cloud environment. From data pipelines and model evaluation to inference optimisation and guardrails, you will own key parts of the AI stack and help establish best practices … aligned with client needs. Optimise model serving and inference pipelines for low latency and cost efficiency in AWS (ECS, Lambda, S3, CloudWatch).Develop data pipelines for training and evaluation, leveraging existing stores (PostgreSQL, Redis, Elasticsearch/OpenSearch, S3).Ensure models meet scalability, security, and compliance requirements for enterprise ...

that do not have a known answer. The work involves building evaluation frameworks for LLM-based and agentic systems, systems integration testing, and data problems with no off-the-shelf answer. Experience with agentic systems matters: tool and context protocols such as MCP, evaluation harnesses, and entity resolution … evaluating a single agent or a single module, but the coherence, quality, and reliability of the full system: from the data ontology layer through the Agentic Core to the three product modules that clients use. Your work is the quality gate that determines what is ready to ship ...

building, and operating production-grade ML systems from the ground up. Responsibilities include: Building and owning end-to-end machine learning solutions, from data ingestion through to deployment and monitoring Developing scalable data pipelines that process large volumes of real-time and batch data … environments Working with Databricks, AWS, Python, Kafka, and modern MLOps tooling Leveraging machine learning, LLMs, and multimodal AI techniques across structured and unstructured data sources Collaborating with engineering, product, and business stakeholders to deliver impactful solutions Contributing to system architecture, platform design, and technical best practices Driving measurable ...

KDB+ Data Engineer - Banking and Financial Services Permanent Based in London - hybrid £70K - £80K Urgently hiring for a hands-on KDB+ Data Engineer with 2-3 years experience and strong Python skills for an exciting opportunity within the banking industry. This is a permanent role with … great opportunity for a technically minded engineer looking to build on their KDB+/q and Python experience, working with financial data and high-performance data solutions in a banking environment. Skills and Requirements: * 2-3 years of hands-on KDB+/q experience. * Strong Python ...

Monzo. At Monzo, we don't treat risk and controls as a bureaucratic governance process. We treat our control framework, tools, and data pipelines as an internal product - designed to give engineers, product managers, and business leads the ability to ship fast - and safely. We are looking … Controls Product Manager to join our newly established Controls Product & Enablement team within our Controls Discipline. Sitting at the intersection of Product, Risk, Data, and Engineering, you will act as the Product Lead for Monzo's core risk lifecycles (Issues, RCSAs, Controls, Policy, Reg Traceability). ...

About Us: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across … production. Essential ExperienceDemonstrable success designing and delivering enterprise-scale ML platforms and products (ideally using AWS SageMaker).Proven experience delivering ML solutions from data ingestion and feature engineering through to production deployment, monitoring, and continuous improvement. Experience building reliable, low-latency inference services and operating ML workloads ...

About Us: LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across … potential with meaningful careers. About the Role: Do you want to help reinvent Governance Risk and Compliance by turning cyber security controls, risk data and audit evidence into software, automation and real-time assurance? If so, we are seeking a Lead Software Engineer to join the Cyber Security ...

crucial phase of growth and help change an industry for the better. About the teamGenAI Engineering sits within Motorway's Data and AI function, alongside Machine Learning and the Machine Learning Data Platform. We own the AI features that shape how buyers and sellers experience … good sits around the model rather than in it. The prompting is rarely the hard part. Retrieval quality is, and so is the data feeding it, evaluation you can trust, sensible behaviour when things fail, and getting it live and keeping it there. The standards that matter most ...

team's deliverables and outputs — what is committed, what is delivered, to what standard, and by when. Allocate people and effort across the demand pipeline, and be the person who says no, not yet, or not like that. Hold the engineering bar through design and code review, and grow … signals from one desk into a supported, firm-wide capability, and lead the build-out of citizen developer workflows through to production. Expose data and capability through Accio, our centralised MCP server, and as skills, tools, and connectors on Nexus, building reusable components rather than one-off integrations. ...

KDB+/q and Python Developer with 3-5 years of commercial experience to join a technology team developing and supporting high-performance, data-driven applications. Responsibilities: * Develop and maintain applications using KDB+/q and Python. * Build and optimise data pipelines and time-series data solutions. * Improve query performance, data processing and system efficiency. * Troubleshoot technical issues and support application development. * Collaborate with technical teams to deliver robust, scalable solutions. Skills & Experience: * 3-5 years of hands-on KDB+/q development experience. * Strong Python development skills. * Experience working with large ...