26 to 50 of 1,537 Data Pipeline Jobs in London

recruiting for a Head of Dat for a Not for Profit based in London. You as the Head of Data will focus of the Data strategy, governance & quality. You will Modernise the cloud data infrastructure, including Microsoft Fabric & Power BI Analytics, MI & self-service … reporting. Building data literacy across the organisation. Head of Data Location: London - Hybrid Salary: £70,000-£96,000 per annum Contract: Permanent, Full Time The Client- Our client is a well-established professional organisation with a strong reputation within its sector and an important role ...

world’s well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America, EMEA and Asia Pacific, Vantage has evolved data center design in innovative ways to deliver dramatic gains in reliability, efficiency and sustainability in flexible environments that can scale as quickly … including Pandas, NumPy or similar libraries. Experience with ETL/ELT workflows, automated validation routines, controlled data refreshes, or data pipeline documentation. Exposure to benchmarking, normalization, regional factors, configuration bridges, confidence frameworks, or variance attribution. Experience working with Developers and IT to translate dataset requirements ...

Senior Data Engineer Who we areArtefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud … enjoying skyrocketing growth. Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients' specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon ...

capital and derivative valuation adjustments. Using the latest analytics and technology such as a fully vectorized pricing library, Machine Learning, and a Big Data stack for scalability, our products and solutions are used by the largest tier-one banks to smaller niche firms. Our risk analytics solutions … London to join the Market Data and Integration team within Risk Analytics. The role will focus on workflow design, data pipeline requirements, integration patterns, validation controls, and operational improvements that support scalable risk analytics delivery. ResponsibilitiesThe Senior Product Analyst will work with product, financial engineering ...

capital and derivative valuation adjustments. Using the latest analytics and technology such as a fully vectorized pricing library, Machine Learning, and a Big Data stack for scalability, our products and solutions are used by the largest tier-one banks to smaller niche firms. Our risk analytics solutions … London to join the Market Data and Integration team within Risk Analytics. The role will focus on workflow design, data pipeline requirements, integration patterns, validation controls, and operational improvements that support scalable risk analytics delivery. Responsibilities The Senior Product Analyst will work with product, financial ...

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. … broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise ...

Design, build and maintain scalable data platforms and data pipelines within AWS Develop ETL/ELT processes for ingesting, transforming and processing data from multiple sources Implement data solutions using AWS S3, Glue, Lambda, Athena, Redshift, EMR and related technologies Design data … ability to mentor engineers and lead technical decisions. Highest-signal resume keywords AWS Data Services Python Programming SQL Proficiency ETL/ELT Pipeline Development Infrastructure-as-Code Hard Skills Data Engineering Data Modelling Data Warehousing Data Lakes CI/ ...

ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologies Optimize data pipeline performance, ensuring data accuracy, reliability, and timely delivery Mentor and guide junior data engineers, fostering a culture of continuous learning … with at least 3 years in a leadership role Strong proficiency in Apache Spark, Azure Data Factory, and other data pipeline tools Experience with cloud platforms such as Azure, AWS, or GCP Solid understanding of data modeling, data warehousing ...

Data Engineering activities. Working alongside the wider Data Engineering team, they will help shape, validate and consume the underlying pipelines, data warehouse and data lake that feed reporting, flagging data quality issues and new data needs as they … data platform (Azure Synapse, Data Lake, Microsoft Fabric) that feeds reporting and analytics Monitor, troubleshoot and resolve data pipeline and platform issues, ensuring high availability and reliability for reporting and analytics consumers Work with the wider Data Engineering team on data ...

data engineering team. In this role, you will be responsible for managing and scaling data products, driving data pipeline development, and ensuring the availability, quality, and security of our data assets. You will collaborate closely with cross-functional teams including data … engineering or software engineering roles, with at least 3 years in a leadership/management position. Strong expertise in data pipeline development, ETL/ELT processes, and data warehousing solutions. Proficient with cloud platforms (AWS, GCP, Azure) and big data tools ...

Lead Data Engineer (Azure Data Platform) Inside IR35 Rate: £650.00 - £675.00 per day Location: UK Remote Clearance: Active SC Clearance Required The Opportunity We're looking for an experienced Lead Azure Data Engineer to play a key role in delivering a large-scale Azure … Data Platform programme. You'll be responsible for designing, building, and optimising modern data solutions that transform data from multiple source systems into trusted, governed, and reusable data products. This is a hands-on leadership role focused on data platform ...

company's internal teams to interact with data comprehensively. The ideal candidate has a strong background in big data processing, pipeline orchestration, and data modeling, with a proven track record of delivering scalable and high-quality data solutions in fast-paced … pipelines and products, ensuring data accuracy and lineage are a top priority. Participate in a shared PagerDuty on-call rotation, responding to pipeline and platform incidents, performing root-cause analysis, and driving remediation and postmortems. Triage production issues quickly and expedite them appropriately, knowing when to loop ...

Purpose Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data platform, tools … processes. About The Role Design, build, test and release data solutions to support the requirements of the business. Working within the data engineering team, you will deliver robust, scalable and secure data pipelines and contribute to the modernisation of 7IM’s data ...

minds, together we can solve the world’s most complex challenges and deliver more impact together. Role description Arcadis is seeking a Senior Data Engineer to design, develop, and optimise enterprise-scale data solutions that support major projects, programmes, and business functions. As a technical specialist … Demonstrable experience delivering data engineering solutions within complex project, programme, or enterprise environments. Strong experience designing and maintaining ETL/ELT pipelines, data integration processes, and structured data platforms. Experience working with Microsoft Fabric, Azure Data Services, SQL, Power BI, or equivalent ...

team you'll be working with: We are seeking an experienced QE Automation Lead to operate as the Test Lead for automated data testing within a complex, multi‐vendor data transformation programme. This test role reports to the QE Lead (Test Director level) and is accountable … logic and data queries for data transformationsTest framework and supporting toolingLead testing of AWS‐based Lakehouse and data pipeline solutions, including: AWS GlueApache IcebergAI‐enabled ETL acceleratorsNeo4jPython/PySpark, SQL and YAML‐driven configurationsQuality, Defect & Risk ManagementEnsure quality issues, risks issues and data ...

institutions to measure and manage market risk, counterparty credit risk, regulatory risk capital, and derivative valuation adjustments. Задачи Work with product, financial engineering, data, technology, support, professional services, and client-facing teams to analyze requirements and design robust workflows for market data ingestion, enrichment, validation, transformation … integration, and delivery into Risk Analytics products and services Translate business, analytical, and operational needs into clear specifications, data mappings, process flows, user stories, acceptance criteria, test scenarios, release notes, and operational documentation Support the design and continuous improvement of data pipelines, APIs, integration services, controls ...

mappings, business rules, and transformation logic into automated test scenariosDevelop reusable and maintainable test scripts using approved automation frameworksTest data feed pipeline migrations repointing from an existing Data Warehouse to a new AWS Data Lakehouse architecture, underpinned with AI ETL accelerators, Python … closely with data engineers and analysts to diagnose issues and verify fixesSupport root-cause analysis of data quality failures and pipeline issuesCI/CD & Delivery SupportExecute automated tests within CI/CD pipelines and scheduled testing runsEnsure test assets are version controlled and aligned with ...

sends, logistics, offers, and reporting, but also the analytical core that makes it work, building the response model and sourcing the data pipeline and user-data enrichment that let us target the right customer, with the right offer, at the right moment. … creative, modelling, automation)Desirable: Experience in financial services, regulated or other consumer categories where offers and eligibility matterExperience standing up a data pipeline or enrichment stack (first-party + third-party/bureau data)Experience building a channel or function from scratchFamiliarity with credit/ ...

sends, logistics, offers, and reporting, but also the analytical core that makes it work, building the response model and sourcing the data pipeline and user-data enrichment that let us target the right customer, with the right offer, at the right moment. … creative, modelling, automation)Desirable: Experience in financial services, regulated or other consumer categories where offers and eligibility matterExperience standing up a data pipeline or enrichment stack (first-party + third-party/bureau data)Experience building a channel or function from scratchFamiliarity with credit/ ...

description Connect to your Industry Do you want to help deliver some of the UK's largest and most ambitious Data & AI transformation programmes? Technology & Transformation helps organisations unlock the full value of their data through modern platforms, cloud technologies, and AI. Within Deloitte's Engineering … team, you will: Design, build, test and deploy scalable batch and streaming data pipelines, AI-ready data products, feature pipeline and analytics solutions on the Databricks Platform using Delta Lake, Spark SQL/PySpark, Unity Catalog and Databricks SQL. Deliver solutions across the full data ...

sends, logistics, offers, and reporting, but also the analytical core that makes it work, building the response model and sourcing the data pipeline and user-data enrichment that let us target the right customer, with the right offer, at the right moment. … modelling, automation)**Desirable:*** Experience in financial services, regulated or other consumer categories where offers and eligibility matter* Experience standing up a data pipeline or enrichment stack (first-party + third-party/bureau data)* Experience building a channel or function from scratch* Familiarity with credit ...

Senior Data Engineer – Customer Data Location: Waterloo, London – Hybrid Contract: 6 months Rate: £650–£700 per day, Inside IR35 Working Pattern: Full-time About the Role We are seeking an experienced Senior Data Engineer to join the Customer Data team within … data and AI function of a leading UK retail organisation. The team is responsible for building and operating the data foundations that support a wide range of customer-focused use cases, including Customer 360, analytics, AI/ML, marketing and data-driven commercial initiatives ...

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation is at the heart … everything we do, and we have been recertified as a 2025 Great Place to Work®. This achievement not only highlights Talan Data x AI’s positive organisational culture but also strengthens its reputation as an employer of choice within the industry. We invest heavily in the training ...

Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution Architects Data Engineers, Developers, ML Engineers, and Analysts Client stakeholders up to Head … Data Engineering, Chief Data Architect, and Analytics leadership Key Competencies Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms. Strong consulting values with ability to collaborate effectively in client-facing environments. Hands‐on expertise across the data ...

world’s largest asset class at over $145 trillion. Debt markets are vast, global, and mission-critical, yet still run on fragmented data, PDFs, and manual workflows. 9fin replaces this broken infrastructure with a single platform that centralises proprietary credit data, deep analysis, and high-value … markets worldwide. The Opportunity 9fin has built one of the most comprehensive datasets in credit and debt markets: news, financials, cap tables, instrument data, legal documents, and ESG analysis. Today, most clients access that data through 9fin.com. But a large and growing segment of the market ...