376 to 400 of 552 Data Pipeline Jobs in London

lead technical discovery workshops, define solution architectures, oversee implementation, and ensure successful delivery from proof of concept through to production. Working alongside engineers, data specialists, and business stakeholders, you'll establish technical standards, review solution designs, and drive engineering excellence throughout the delivery lifecycle. This is a hands … TypeScript. Experience designing cloud-native solutions on AWS, Azure, or Google Cloud Platform. Expertise in systems architecture, APIs, integration patterns, and modern data pipelines. A track record of translating business objectives into practical technical solutions. Experience leading technical teams and coordinating delivery across multiple workstreams. Knowledge ...

with a London-based investment bank who are actively seeking a Senior Software Engineer to assist in the development of a business-critical data ingestion and search interface to simplify the onboarding of future applications. What you'll need to succeed : Proficiency in UI development with React. Extensive … Python and PowerShell scripting experience. Strong experience building data pipelines, architectures, and datasets. Strong experience building processes to support data transformation, data structures and metadata Extensive big-data experience. Good experience with at least one object-orientated programming language. What ...

Requirements (Must Have Skills) 6 to 8 years of experience in data software engineering with a strong focus on Azure technologies Expertise in Azure Databricks development , including efficient handling of large datasets Strong working knowledge of Azure Data Factory for building complex ETL workflows Experience with … performance optimization of data pipelines and distributed processing setups Proficiency in Scala development (hands-on experience highly desirable) Solid understanding of Azure services relevant to data engineering and cloud architecture Strong problem-solving ability with effective communication skills for team collaboration ...

Contract Data Engineer Duration - 6 months Outside IR35 - Competitive Market Rate Fully Remote British Citizenship and SC clearance is required Fruition Group are representing a boutique technology consultancy who are specialist at delivering cutting edge solutions for public and private sector clients. They're known as the 'Knights … Join a high-impact government programme using AI, machine learning and computer vision to solve real-world national challenges. You'll build scalable data pipelines and ML infrastructure alongside a specialist consultancy renowned for delivering mission-critical solutions, working with modern technologies in a secure, cutting-edge environment ...

fast-paced environment. The Role You'll play a key role in designing and developing modern backend systems that process live data, integrate with external platforms and support business-critical applications. Responsibilities include: Designing and developing scalable backend services using Python and Java Building cloud-native, event-driven … applications Developing integrations with third-party platforms and APIs Designing and optimising real-time data processing pipelines Improving application performance, resilience and scalability Working closely with technical stakeholders to deliver high-quality software Contributing to infrastructure, deployment and continuous improvement initiatives Technology You'll be working with ...

engineered across the organisation. Operating across domains including traditional infrastructure, cloud engineering, network operations, identity, observability, security, AI-driven operations, and automated data workflows, the role focuses on designing scalable systems, reusable engineering patterns, and standardised controls that reduce operational toil, improve resilience, and embed reliability, governance … driving operational maturity across a broad and diverse technology landscape. The ideal candidate is a systems thinker who understands how services, networks, identity, data flows, and operational processes fail in real-world conditions, and can apply that understanding to build automation-first, reliability-focused operating models that scale ...

just analysing them. We care far more about what you changed than what you built. You might be a strong analyst, product-minded data scientist, or even an ex-engineer, but what matters most is that you: Take ownership of outcomes, not just outputs Are comfortable operating … long-term: incidents vs systemic improvements Create leverage: frameworks, dashboards, and narratives that scales Technical Expectations: Excellent SQL proficiency and experience with data visualization tools like Looker, Grafana, Lightdash, or Superset Ability to build and manage data pipelines that are modularised and scalable, using tools like ...

front lines, dedicated to safeguarding our platform against sophisticated financial crime. We leverage cutting‐edge machine learning, real‐time transaction monitoring, and advanced data analysis to create robust controls and detection capabilities. Our vision is to build a globally scalable fraud prevention engine that protects customer accounts, prevents …/CD pipelines, Distributed, and Concurrent Systems. Product Ownership: A strong product mindset, accountability, and the ability to drive projects independently, making data‐driven decisions with the customer in mind. Data Proficiency: Experience with relational and non‐relational databases, including query optimisation and designing resilient schemas. ...

front lines, dedicated to safeguarding our platform against sophisticated financial crime. We leverage cutting-edge machine learning, real-time transaction monitoring, and advanced data analysis to create robust controls and detection capabilities. Our vision is to build a globally scalable fraud prevention engine that protects customer accounts, prevents …/CD pipelines, Distributed, and Concurrent Systems. Product Ownership: A strong product mindset, accountability, and the ability to drive projects independently, making data-driven decisions with the customer in mind. Data Proficiency: Experience with relational and non-relational databases, including query optimisation and designing resilient schemas. ...

with cloud and third‐party AI services to deliver production-ready outcomes. Your role spans the full solution lifecycle—assessing client needs and data, selecting and customizing models (including Deep Learning, Generative AI, and Large Language Models), designing scalable data and MLOps/LLMOps pipelines … practical, efficient, and scalable AI and Machine Learning solutions. Develop and implement machine learning algorithms, models, and computational systems; design and build scalable data pipelines to support model training and production with DevOps & MLOps. Customize and apply Deep Learning and Gen AI models for various use cases based ...

reports. Work Experience Required Qualifications & Experience: Bachelors degree (minimum) in Engineering , Software, IT or a closely related discipline. Knowledge and awareness of assessing data and producing summary reports. Able to develop a project specification with colleagues, often including those from other engineering disciplines. Able to produce details … needs. Solution orientated mindset and the ability to consider the bigger picture. Experience with the Microsoft Office Suite (Intermediate+) Comfortable working with unstructured data and building data pipelines . A good awareness of data quality and structure. An eye for detail. TPBN1_UKTJ ...

Squid, based in London, is hiring a Data Engineer to join as one of our first engineers. You will build data pipelines, design models, and enable ingestion, transformation, validation, and serving of complex grid datasets using Python … modern orchestration. The role focuses on high ownership, collaboration with founders and customers, and applying AI to data mapping and pipeline development; the position offers salary range £75k-£200k with equity. #J-18808-Ljbffr ...

Learning Engineer at JPMorgan Infrastructure Platform, you will be at the forefront of combining cutting-edge AI techniques with the company's unique data assets to optimize business decisions and automate processes. You will have the opportunity to advance the state-of-the‐art in AI as applied … based model performance. Develop and maintain tools and frameworks for prompt-based agent evaluation, monitoring, and optimization at enterprise scale. Build and maintain data pipelines and processing workflows for scalable, efficient data consumption. Write secure, high-quality production code and conduct code reviews. Partner with Engineering ...

Learning Engineer at JPMorgan Infrastructure Platform, you will be at the forefront of combining cutting‐edge AI techniques with the company’s unique data assets to optimize business decisions and automate processes. You will have the opportunity to advance the state‐of‐the‐art in AI as applied … based model performance. Develop and maintain tools and frameworks for prompt‐based agent evaluation, monitoring, and optimization at enterprise scale. Build and maintain data pipelines and processing workflows for scalable, efficient data consumption. Write secure, high‐quality production code and conduct code reviews. Partner with Engineering ...

Responsibilities Architect and deliver distributed, high-performance systems for trading environments Build and optimise real-time and near real-time data pipelines supporting intraday trading decisions Design systems integrating market data feeds, positions, P&L, risk, and back-office platforms Define engineering standards, architecture patterns … coding best practices across teams Mentor and technically lead engineers across multiple delivery workstreams Partner with senior client stakeholders to shape data, AI, and platform architecture roadmaps Trading & Client Delivery Lead delivery of front, middle, and back-office transformation initiatives through to production Act as the primary technical ...

strategy. Key responsibilities include but are not limited to: Digital Transformation: Support the delivery of strategic tax technology projects, including process automation, data analytics, and AI-driven solutions for the global tax function Data & Analytics: Build and automate tax data pipelines using Alteryx … technology execution for complex global mandates such as Pillar 2, e-invoicing, and public Country-by-Country Reporting (CBCR) System Interrogation: Support financial data analysis across various global systems including SAP, HFM, and Longview to ensure data integrity and remediation at the source Compliance Support: Standardize ...

reinvent how fans experience them. Together with partners like NFL, NHL, FIFA, and Disney, we push the boundaries of real‐time sports data, 3D graphics, and AI‐driven storytelling. If you’re passionate about machine learning architecture, scalable technical solutions, and guiding engineering teams through complex technical challenges … work closely with Machine Learning Engineers, Tech Leads, Product teams, and other Team Architects to design intelligent systems that transform live sports data into immersive digital experiences. Your role combines strategic thinking with hands‐on technical leadership. One day you might be evaluating approaches for scalable inference pipelines ...

Global Market Intelligence in London seeks a Senior Product Analyst to design workflows for market data ingestion, enrichment, validation, and delivery within Risk Analytics. You will translate business needs into data mappings, user stories, and acceptance criteria, while supporting APIs, data pipelines, and observability … across teams. The role requires experience with SQL/Python, data quality, and agile delivery, and involves collaboration with product, engineering, QA, and client-facing #J-18808-Ljbffr ...

Settlements. Work across a distributed application landscape and partner closely with Trading, Risk, Operations, and Technology teams to deliver scalable solutions with strong data quality, resiliency, observability, and control. Responsibilities Design, develop, and support applications and services across the end-to-end commodities trade lifecycle. Build and enhance … integrations between ETRM platforms and systems utilizing Java & Oracle. Develop and maintain robust data pipelines including mapping, transformations, validations, and exception handling to ensure accuracy and completeness. Partner with Trading, Risk, Scheduling, Settlements, and Accounting stakeholders to translate requirements into technical designs and deliverables. Own production support ...

tackle real‐world problems, particularly in automating complex, manual processes in a range of real‐world verticals. Optimize and Scale: Build scalable data pipelines, optimize models for performance and accuracy, and prepare them for production. Monitor and maintain deployed models to ensure they continue delivering value across various … practices. You Might Thrive In This Role If You: Hold a BSc/Master’s/PhD degree in Computer Science, Machine Learning, Data Science, or a related field. Have experience building GenAI‐focused applications with the latest technologies, including but not limited to Agents, reasoning models ...

complex operational challenges in a technology and music environment. What You'll Do You coordinate the day‐to‐day processing of digital usage data, ensuring high levels of accuracy and timely delivery across the global Digital Operations function. You oversee cross‐functional operational projects from planning through … monitor operational performance and key metrics, identifying opportunities to improve processes and service delivery. You develop a detailed understanding of AMRA's digital data pipelines, operational processes, and reporting workflows to help resolve complex issues and identify future opportunities. You build strong relationships with senior stakeholders, department leaders ...

concept to scalable, enterprise-grade deployment with measurable adoption and impact.Data & Platform Strategy* Own the Applied AI platform strategy, including real-time data pipelines, ML feature stores, model registries, and agentic runtime and control plane infrastructure.* Partner with relevant teams and stakeholders to ensure a coherent, governed … that meets enterprise architecture, regulatory, and risk requirements.**PERSONAL REQUIREMENTS*** Significant experience senior leadership roles within financial services; significant experience in AI, or data science technology.* Proven track record building and scaling applied AI functions within global markets, capital markets, or institutional financial services.* Familiarity with core trading ...

Beyond closing deals, we use customer engagements as opportunities to prototype and ship improvements to Klaviyo. Recent team projects include AI‐powered demo data generators, a public Chrome extension for troubleshooting API calls, web SDK injectors, and templatized mobile apps that showcase our SDK capabilities. … Learning Library and mentor peers through example Operate with Deep Technical Mastery and Innovation Become an expert across Klaviyo’s platform, from data pipelines and integrations to technical trade‐offs between implementations Develop broad, advanced familiarity with web development, APIs, cloud computing, and modern software development practices Confidently ...

will serve as the primary architect of the programme's delivery, overseeing the safe, compliant, and irreversible transition of critical Consumer Risk data, code, and processes to the Enterprise Data Platform (EDP) on AWS. You will own the strategic roadmap, manage senior stakeholder expectations across Barclays … assurance. #LI-OK4 Requirements Strategic Programme Leadership: 10+ years of experience leading large-scale IT programmes, with a demonstrated history of delivering complex data migrations, cloud transformations, or infrastructure modernization within Tier-1 financial services environments. Financial Services & Compliance Depth: Deep expertise in the regulatory and governance rigor ...

Description \n We're looking for a skilled Software Developer to join a public sector delivery team working on data-driven services. You'll design, build, and maintain robust, secure, and scalable data pipelines and applications, working closely with data engineers, analysts, and platform … services with Docker \n Managing source control, CI/CD pipelines, and deployments through GitLab \n Integrating automated security scanning into the development pipeline to ensure code and dependencies meet public sector security standards \n Using Jupyter Notebooks for data exploration, prototyping, and analysis \n Building ...