1 to 25 of 95 Data Pipeline Jobs in the City of London

Title: Manager – Cloud Data Architect (AWS & Snowflake) Protiviti’s UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. … solutions range from data strategy and governance through the development, design and implementation of advanced analytics and digitisation. About the Role We are seeking a Manager-level Cloud Data Architect with deep expertise in AWS cloud services , Snowflake , and AWS-native data platforms ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … with Information Security to ensure compliant data handling. Participate in agile sprints, contributing to technical planning. Operational Ownership Monitor data pipeline health, performance, and reliability. Troubleshoot data issues swiftly, communicating effectively with stakeholders. Drive continuous improvement of the data platform ...

financial and tax planning, offering home finance and annuities propositions, and providing collective fund solutions to third party customers. Job Purpose The Lead Data Engineer will provide hands-on technical leadership in Azure cloud and Databricks-based solutions within our Enterprise Data Platform. The role requires … strong expertise in Azure cloud services, Databricks, data engineering, and DevOps, leading a cross-functional team to build, deploy, and support high-performance data-driven solutions. The role involves: Interpreting Outcomes and user stories and translating them into technical solutions. Creating innovative solution designs for domain ...

Senior Data Engineer Location: London (Hybrid) Function: Data Engineering/Data Platform Salary: Up to £140,000 base + bonus + benefits About the Role Our client is a global commodities and energy trading firm operating at the intersection of quantitative research, technology …/CD pipelines. Experience with Infrastructure as Code and deployment tooling such as CloudFormation or CDK. Strong understanding of data pipeline design, performance optimisation, and data quality practices. Experience working directly with front-office stakeholders such as traders, quants, or analysts. Comfortable operating in agile ...

Data Architect (AI Data Foundations) Location - Erskine, London, Farnborough or Newcastle Candidates are required to be eligible for clearance We are seeking an AI Data Architect to design and implement AI-ready data foundations. You will define data models, storage … patterns, pipelines, and governance frameworks that support machine learning and analytics. Working closely with data engineers and ML engineers, you will ensure data is well-structured, accessible, secure, and scalable for AI use cases. Key Responsibilities Design and maintain data models and schemas (relational ...

Senior Data Engineer London | Hybrid | AI-Native Consulting Environment £80,000-£90,000 + package Our client is a fast-growing, AI-native, engineering-led consultancy building advanced semantic, ontology-driven and agentic AI systems. As they deepen their data engineering capability, they are seeking … will play a foundational role in building robust semantic layers and enabling high-value AI systems for clients. Key Responsibilities Data Pipeline Engineering (Semantic & Ontology-Aligned) Design, build and maintain ETL/ELT pipelines aligned to ontology and knowledge graph structures Implement transformations that respect entity models ...

requirement for this role is strong hands-on experience with Airbyte . The team relies heavily on Airbyte for data ingestion and pipeline orchestration, so candidates must have proven experience implementing, managing, and scaling Airbyte pipelines in production environments. Key Responsibilities Build and maintain scalable data … efficient data flows Monitor, maintain, and improve existing data infrastructure Use Airbyte extensively to manage data ingestion and pipeline workflows Requirements Strong experience in data engineering and modern data platforms Hands-on experience with Airbyte is essential Experience building ...

Senior Data Engineer - Role Overview We are seeking a Senior Data Engineer to support the development and evolution of a scalable data platform underpinning private equity investment activity across EMEA. Working closely with investment, research, and technology teams, you will design, build, and optimise … data engineering or a similar data-focused role. Strong proficiency in SQL and Python for data transformation, pipeline development, and analytics. Experience working with cloud platforms (AWS) and modern data warehouses such as Snowflake . Experience using data visualisation ...

product, and have your voice heard. At the core of what we build is a large dataset and data processing pipeline covering UK property data. You'll work closely with this data, helping to consume, refine, and unlock its value based on evolving product requirements … Write clean, well-tested, and maintainable code with a focus on long-term scalability Work with our UK property dataset and data pipeline to surface meaningful information through the product Participate actively in code reviews, giving and receiving feedback constructively Contribute to architectural discussions and help raise ...

Data Engineering Technical Lead Global Investment Bank London - Hybrid £85,000 - £90,000 + Bonus + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/… Developer/Data Engineering Lead to join their International Technology team in London. You will be a key part of the Architecture, Middleware, Data & Enterprise Services (AMD) division, driving data engineering, integration and automation initiatives across our clients EMEA banking and securities entities. This ...

Senior Data Engineer | Azure & Snowflake | Enterprise Data Platform in Alternative Asset Management Salary: £100,000 Location: Central London, 3 to 4 days onsite You will be joining a global technology consultancy to help design and deliver long-term, enterprise-grade data platforms that enable … data-driven decision-making across complex, multi-line organizations. This is a high-impact role within a growing data engineering practice, focused on building modern cloud-based solutions that power analytics, reporting, and business intelligence at scale for enterprise clients. The Role You will design, build ...

role you will be designing and developing complex data processing modules and reporting using Big Query and Tableau. In addition, you will also work closely with the Infrastructure/Platform Team who are responsible for architecting, and operating the core of the client's Data Analytics … and MLOps capability infrastructure Ensure data quality, governance, and compliance with internal and external standards. Monitor and troubleshoot data pipeline issues, ensuring reliability and accuracy. ...

essential. Your work will directly impact patient outcomes by ensuring our predictive models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated … pipelines for model retraining, validation, and promotion across development, staging, and production environments. Implement pipeline monitoring, alerting, and failure recovery to eliminate silent failures and ensure operational reliability. Design pipeline architectures that support rapid experimentation while enforcing production-grade reproducibility. Model Deployment & Serving Deploy and manage ML models ...

Senior Trading Data Engineer Location: London (Hybrid) Salary: Up to £140,000 base, plus bonus and benefits A leading global trading firm is expanding its front‐office data engineering function and is seeking an experienced Senior Trading Data Engineer to build and own real … time data platforms for traders and quantitative teams. This is an opportunity to work at the heart of energy and financial markets, solving complex data problems that directly influence trading decisions and P&L. The role As a Senior Trading Data Engineer ...

world-changing. We are exceptional engineers and researchers taking a novel approach to accurate database reasoning. About the role This is a founding Data Engineer role, with the opportunity to shape our data and backend architecture from day one. Productionise research into robust, scalable data and backend systems Design and build data pipelines and APIs used by internal systems and customers Work deeply with databases (SQL, complex schemas, real-world, messy enterprise data) Design and operate data ingestion, transformation, and validation workflows Own scaling, performance, reliability ...

SENIOR DATA ENGINEER – AI PLATFORM Opportunity for a Senior Data Engineer to join a high-growth AI-powered SaaS organisation in London Offering a salary up to £85,000 + strong benefits package including hybrid working and the opportunity to shape production-grade data … ensure models are robust, monitored, and embedded into reliable pipelines. Alongside delivery, you’ll help shape engineering best practice, mentor others in SQL and pipeline design, and strengthen DataOps standards across the wider team. This position suits someone who enjoys building reusable, scalable infrastructure and wants their work ...

smoothly and effectively. This is an ideal role for someone who enjoys both coaching people and building scalable systems, someone who can drive pipeline growth while also creating the structure, tooling and insight that enable sales teams to perform at their best. You’ll work closely with Sales Leadership … Develop the SDR Team Manage, coach and mentor a team of 5 SDRs, with plans to scale Run regular 1:1s, call coaching and pipeline reviews Build a high-performance culture focused on accountability and development Support career progression and skill development within the SDR team Ensure consistent delivery ...

Senior Data Engineer London £65-85k + 15% bonus A London-based software company on a mission to make data work smarter. Their products power thousands of businesses, and as they grow, they’re building a data stack that scales with their ambition. … They’re looking for a Data Engineer who’s excited about designing modern data systems, experimenting with new tech, and helping shape how data flows through everything they build. What You’ll Do Build and own data pipelines that connect product, analytics ...

Senior Data Engineer (Hands-On/Technical Lead Focus) Hybrid working - Central London Ashdown Group are partnering with an innovative, data-led organisation who are recruiting a Senior Data Engineer to take ownership of core data architecture and lead from the front … technically. This is a hands-on senior role for someone who enjoys building robust data systems while mentoring others and raising engineering standards. The Role You will design, build, and optimise scalable data pipelines and models across Snowflake, Databricks, and cloud environments (AWS/GCP). ...

Business & Data Analyst - Inflight Entertainment and Digital Media Location: London (with opportunities for international travel) Job Type: Full-time Salary: Competitive with benefits Join a leading content technology company that delivers innovative media solutions to the world's top airlines. We are at the forefront of transforming inflight … processes, and ensure data integrity across multiple platforms. Business Development Tools & Systems Management: Optimize the use of CRM and BI tools, support pipeline analysis, and maintain data consistency across systems. Market & Industry Insights: Conduct research on emerging trends in aviation and digital media, and translate ...

Complete and Timely reporting ), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted … data ingestion and transformation pipelines in Python for large-scale financial datasets. Improve reliability and performance of the onboarding data pipeline through automation, testing and observability. Mentor team members and continuously improve team processes. Champion AI tooling adoption across the engineering team, helping establish norms ...

Were partnering with a leading organisation seeking a Snowflake specialist to help modernise and scale their data capability. This is a delivery-focused role where youll shape cloud data architecture, lead migrations, and build high-performance data pipelines that directly support business-critical decision … making. The Opportunity Youll take ownership of Snowflake environments from design through to optimisation, ensuring data is structured, accessible and engineered for performance. Working across technical and business teams, youll translate complex requirements into scalable, resilient data solutions that support analytics, reporting and operational insight. Your ...

Developer | £45,000 - £55,000 | Coventry/Remote | ETL | Talend | Azure Data Factory | Extract Transform Load | Data Pipeline Manager | Tech4Good | Sustainability | Are you looking to join a company that are doing their bit to look after the environment? Or maybe you want to work with … experience to come on board and support with the migration into Qlik Talend. As an ETL Developer you will be looking after 2 Pipeline Analyst to migrate data from over 300 sources. You will be managing the ETL process, building scalable data pipelines and communicate ...

push the boundaries of what’s possible with Open Data. It’s a fast-paced, rapidly-changing environment at the intersection of data science, cultural analysis & brand consultancy. As a Senior Data Scientist at Synthesis, you will play a key role in shaping our data science practice and driving innovation across both client projects and internal products. You will lead end-to-end data projects, from shaping datasets and building models to designing scalable data workflows that power the insights and decision frameworks we deliver. You will work with ...

learning technologies. We’re looking for someone who can bring strong infrastructure and automation expertise, and who can work closely with engineering and data science teams to support rapid product development & launch. Important Details · Location: Hybrid (3 days/week in office). Candidates must currently reside within … data scientists to support application deployments, optimize performance, and troubleshoot infrastructure issues. • Support ETL/ELT workflows and data pipeline infrastructure for training and inference workloads across databases (SQL, NoSQL, Vector DBs, Graph DBs). • Provide technical guidance and mentorship on DevOps best practices, infrastructure ...