1 to 25 of 1,540 Data Pipeline Jobs in London

Azure Data Platform Manager Putney, London | Hybrid £85,000+ Bonus + Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with a strong background designing and delivering enterprise-scale Azure data platforms? We're looking for an experienced Azure Data Platform Manager to lead the design, development and optimisation of a modern Azure Data Platform ...

DescriptionWe're passionate about using technology to drive sustainability. You too? Join us as a Data Architect for Technology Architecture at Ramboll Tech and help us become the leading Tech-Enabled Partner for Sustainable Change. We are seeking an experienced and results-driven Data Architect … integration with engineering systems (Great to have skill) Advanced knowledge of data modelling tools, data lakes, SQL, and pipeline design Excellent communication and interpersonal skills, with the ability to convey technical concepts to non-technical stakeholders Proficient in Microsoft Fabric platform (Great ...

Remote/Hybrid: for London (4 days WFO, 1-day WFH mandatory) Experience 15+ years About the Role We are seeking a senior Data Architect to join the engineering organisation as part of Project Compass. This programme is delivering next-generation capabilities across Accounts (Real-Time Ledger), Payments … Engine, and Foreign Exchange – all of which generate, consume, and depend on high-quality, well-governed data at scale. The Data Architect will own the end-to-end data architecture across spanning Snowflake as the enterprise data warehouse and a landscape ...

Team Leader - Data Engineering & Integration - Commodities Data Location London Business Area Data Ref # 10052628 Description & Requirements Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around … Finance, or related business/STEM fieldExperience leading or materially improving a data manufacturing, data operations, data pipeline, workflow engineering, or integration environment in a commodities, market data, financial data, or similarly complex domain. Solid understanding of commodities data ...

Engineer DUAL Personal Lines’ strategic data platforms, especially the Data Lakehouse Provide technical expertise in data engineering, analysis, orchestration, and enrichment Build data solutions to address changing requirements, new requests, and incidents Build, test, and deploy data products while maintaining … governance, change control, accountability, data quality, and data security Consult business analysts, developers, and system owners to maintain agreed data standards Assess the impact of changes on the data model and prevent issues affecting operational, analytical, and reporting environments Collaborate with data ...

Data Engineer – Snowflake We are seeking an experienced Data Engineer with strong expertise in Snowflake, data analysis and data architecture to join our Data Services team and play a key role in delivering our Reporting & Analytics programme. This … exciting opportunity to help shape and develop an enterprise data platform, ensuring high-quality, reliable and accessible data supports business reporting and analytics across the organisation. The Role As a Data Engineer, you will be responsible for designing, developing and maintaining the enterprise data ...

Contract Data Engineer - £375/day Inside IR35 - Immediate Start Please note - this is a hybrid role with 2-3 days per week required in London based office. You must have the unrestricted right to work in the UK to be eligible for this role - this organisation … data modelling, including schema design, partitioning, indexing, and performance optimisation. Proven experience with Azure Data Factory for ETL/ELT pipeline design, orchestration, and monitoring. Strong SQL skills, including queries, stored procedures, views, and performance tuning. Practical experience supporting data migration projects, including ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … Support governance and catalogue integration, including alignment with Microsoft Purview where required. Establish monitoring, logging and operational support processes for Fabric workloads. Troubleshoot platform, pipeline, data modelling, refresh, connectivity and performance issues. Support testing, release management and transition into live service. Contribute to technical assurance reviews, identifying ...

Lead and oversee multiple audit data analytics engagements, ensuring quality, timeliness and budget control Design and implement data analytics solutions using Databricks, SQL, Python and Power BI Coach and develop managers and more junior team members through hands-on support and formal reviews Engage with Directors … Partners and clients to translate data insights into audit-relevant outcomes Modernise audit delivery through data and analytics Lead high-performing teams and complex engagements Requirements Significant experience delivering data and analytics solutions within external audit or regulated assurance environments Ability to lead ...

scalable solutions.* Participate in code reviews, technical discussions, and platform improvement initiatives as an active contributor.* Proactively identify data quality issues, pipeline risks, and improvement opportunities, and communicate them clearly in a fast‐paced environment.# **Duties*** Develop and maintain PySpark notebooks and jobs to ingest, transform … workflows, including use of PySpark.* Proficiency in SQL for querying, transformation, and analytical data processing.* Solid understanding of ETL/ELT pipelines, data transformation patterns, and data integration concepts.* Experience analyzing enterprise data sources to identify data relationships, transformations ...

Methods is recruiting for a permanent Mid/Senior Data Engineer to join the Data and AI Capability Centre. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol. You will support complex … reused as part of an enduring data governance model. Experience implementing and advocating for test‐driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks Proven experience leading technical aspects of data projects Strong ...

Kaluza's evolving data & architecture strategy - they build and own the infrastructure, tooling and governance for Kaluza's internal data pipeline, from data ingestion, data cataloguing to data storage and exposing data externally. What will … pipelines, strategic data architectural decisions, and high-quality "data mart" objects across functions like product, finance, or strategy. Pipeline Specialist: You possess extensive experience in engineering robust ETL/ELT processes and data pipelines, with a focus on curating, transforming ...

direction they choose. About You: You are a motivated and adaptable professional with a strong analytical mindset and a passion for working with data to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality, data-driven solutions … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps).Expertise in data ...

group companies and manage the IT service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. It will ensure data integrity, quality, lineage, and accessibility, enabling the business to derive meaningful insight and value from its data assets. This is both a strategic and hands‐on role: the Enterprise Data Manager will shape the roadmap, define ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI. We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline orchestration. Streaming and event-driven data architectures. Agile and DevOps delivery methodologies applied to data platforms (DataOps). Expertise in data ...

reward programmes and loyalty initiatives. Purpose of the job The role provides expert legal advice and strategic support on all aspects of data protection, privacy and information governance across the Group. The role ensures that the organisation's data strategy, governance framework and commercial initiatives … responsible and innovative use of data. As a member of the wider legal team, the role will be working closely with the Data Enablement Officer, Data Protection, Information Security, Compliance, Technology and Business teams, the role embeds privacy by design , supports enterprise data governance ...

Business Intelligence - Data EngineerExperience working with SEI frameworks and Data Delivery to various firms using Snowflake, Airflow, Azure Data Factory and Microsoft Azure. Day to Day job Duties: (what this person will do on a daily/weekly basis)Work closely with client stakeholders … goals. Participate in daily stand-ups, sprint planning, and review meetings to ensure continuous communication and progress tracking. Design, build, and optimize scalable data pipelines using Azure Data Factory and Apache Airflow for scheduling and orchestration. Implement efficient data ingestion, transformation, and movement processes ...

Role Data Architect Working Structure Hybrid (Regular visits to client site) Career Grade Senior Technical Consultant The Role As a Data Architect at CACI Information Intelligence Group, you will join a community of dedicated engineers delivering cutting-edge data solutions for our public sector … customers across Central Government, Defence, National Security, Critical National Infrastructure and Law Enforcement. This role is focused on architecting and delivering modern cloud data platforms, with particular emphasis on Snowflake and/or Databricks. You will work directly with customers to design, assess, optimise, and modernise enterprise data ...

Data Architect - Manager Location: London - Hybrid Salary: £80,000- £90,000 We are seeking an experienced AI & Data Architect to join a leading change and transformation consultancy, delivering modern data and analytics solutions across complex client environments. This role will focus … data architecture, cloud data engineering, data governance and AI-enabled data solutions , providing technical leadership across data initiatives. Key Responsibilities as a AI & Data Architect - Manager Design and implement end-to-end data solutions from ingestion ...

Manager - AI & Data Architect £70,000 to 90,000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Manager - AI & Data Architect Location: London | Hybrid Salary: Up to £90,000 + bonus We're working with a leading change and transformation consultancy … that is looking to hire an experienced AI & Data Architect into its Technology & Data practice. This is an excellent opportunity for a Data Architect from a consultancy background who enjoys working directly with clients, solving complex business problems and designing modern, scalable data ...

## Lead Product Performance Data Analyst, GlobalApply: London, England: Full time: Posted Today: R24596# **About Vantage**Vantage powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America, EMEA and Asia Pacific, Vantage … including Pandas, NumPy or similar libraries.* Experience with ETL/ELT workflows, automated validation routines, controlled data refreshes, or data pipeline documentation.* Exposure to benchmarking, normalization, regional factors, configuration bridges, confidence frameworks, or variance attribution.* Experience working with Developers and IT to translate dataset requirements ...

Engineer to join our Data & AI practice. The successful candidate will bring deep expertise in data migration, ETL/ELT pipeline engineering, and cloud-native data platforms, with a strong focus on AWS-based Data Lakehouse architectures. This role is critical … maintain ETL/ELT pipelines using: AWS GluePython/PySparkSQLYAML-driven configurationsImplement bulk data migration processes followed by incremental/delta loadsSupport pipeline repointing and replatforming to target cloud architecturesData Pipeline Testing & Validation (Core Focus)Test end-to-end ETL data solutions running ...

Manager AI & Data Architect London | Up to £90,000 Were working with a leading change and transformation consultancy that helps organisations turn strategy into practical solutions that deliver lasting impact. Theyre looking for a Manager AI & Data Architect to join their Technology & Data Practice … London. This is an opportunity for an experienced data professional to take ownership of end-to-end data architecture, working across modern data platforms, cloud technologies, analytics and AI to solve complex business challenges. What youll be doing Design and deliver ...

Manager AI & Data Architect London Up to £90,000 Were working with a leading change and transformation consultancy that helps organisations turn strategy into practical solutions that deliver lasting impact. Theyre looking for a Manager AI & Data Architect to join their Technology & Data Practice … London. This is an opportunity for an experienced data professional to take ownership of end-to-end data architecture, working across modern data platforms, cloud technologies, analytics and AI to solve complex business challenges. What youll be doing Design and deliver ...