1 to 25 of 71 Data Pipeline Jobs in the City of London

About the Job you are considering: We are looking for an experienced Data Architect with strong expertise in Azure Databricks, Azure Data Factory, Azure Data Lake, Delta Lake, data modelling, data governance, and cloud data architecture, along with … domain experience in London Market Insurance. The candidate will be responsible for defining and delivering scalable data architecture solutions for insurance transformation programmes covering underwriting, claims, policy administration, bordereaux, delegated authority, premium processing, regulatory reporting, reinsurance, analytics, and data migration.The ideal candidate should have strong hands ...

Principal Data Architect Location: Remote Duration: 6 months £700 - £800 per day - Umbrella only Our client is looking for Principal Data Architect for Data Science family under DSF as part of Professional services sell. This request for NGET under the department of Customer Network … GDPR and Regulatory/CNI control environments In-depth experience in providing resolution to an extensive range of complicated data pipeline related problems, proactively and as issues surface. Demonstrable ability to troubleshoot problems across infrastructure, platform, and application domains. Controlling access to the data ...

stringent service level agreements (SLAs) and business requirements. What experience you need to be the successful Data Engineer: Proficiency in Palantir Foundry pipeline development: Extensive experience in building, maintaining, and optimising data pipelines and transformations within Palantir Foundry, leveraging tools such as Foundry Code Workbooks … integration. Strong coding skills in Python (Pandas) and PySpark: Essential experience in using Python (Pandas) and PySpark for data manipulation, transformation, and pipeline development within Palantir Foundry, ensuring high performance and scalability across various data flows. Experience in data modelling and ontology development ...

SENIOR DATA ENGINEER Salary up to £75,000 London-based role - hybrid working with 4 days per week in the office Play a key role in developing AI-powered data platforms for enterprise clients Work with SQL, Python and cloud technologies across Azure … Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're recruiting for a Senior Data Engineer to join an innovative AI-powered SaaS organisation that's transforming the way businesses use their data. You'll join a collaborative engineering team building scalable ...

Data Engineer _ London_ Permanent Location: London (Onsite – 5 Days/Week) Role: Data Engineer Experience: 4–6 Years Job type: Permanent Salary range: 50K - 60K About the Role We are seeking a skilled Data Engineer with strong hands-on experience in designing and building … agents for post-sales call audits and analysis . Collaborate with cross-functional teams including analysts, product managers, and data scientists. Monitor pipeline performance and ensure data quality, consistency, and reliability . Follow best practices for data governance, security, and compliance . Required ...

expectation to attend the office in London or Swindon 1 day per month. The successful AI Engineer will join a growing data team supporting the development of a modern AWS-based data platform while contributing to emerging AI initiatives. This is a hands-on role combining … data engineering, business intelligence and analytics, working across both BAU support and new capability development. You will help build and optimise data pipelines, improve reporting capabilities and support the delivery of innovative data and AI solutions. You will need proven experience working with ...

successful multinational technology business is looking for a Data Observability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

focuses on building and optimising data infrastructure that enables advanced marketing and customer data capabilities. You will create scalable pipelines, data models, and governance practices that support analytics, segmentation, and real-time engagement. Working closely with cross-functional teams, you will help deliver reliable … MarTech, and marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

experienced AWS Databricks Engineer with strong hands-on expertise in Databricks, AWS cloud services, PySpark, Spark SQL, Delta Lake, Python, SQL, and data engineering. The candidate will be responsible for designing, developing, optimizing, and supporting scalable data pipelines and lakehouse solutions for a banking client.The ideal … candidate should have strong experience in building enterprise-grade data platforms, processing large volumes of structured and semi-structured data, and implementing secure, reliable, and high-performance data pipelines in AWS-based environments. Hybrid working: The places that you work from ...

Working Environment Data engineering work is grounded in real operational needs, often involving imperfect data, technical constraints and organisational complexity. Engineers work closely with delivery teams and stakeholders to understand problems end to end and deliver robust, production-grade solutions. Collaboration, pragmatism and persistence are valued … alongside strong engineering craft. What You'll Be Doing - Design, build and improve enterprise-scale data pipelines, platforms and services - Lead complex data engineering work end to end, from problem definition through build and operational use - Work directly with technical and non-technical stakeholders to translate ...

Consultancy Clearance: Active SC Clearance required. Start Date: Immediate About Amber Labs Amber Labs is a forward-thinking digital consultancy delivering innovative cloud, data, and DevOps solutions across the UK public sector. We specialise in helping organisations achieve digital transformation at pace while maintaining the highest security … will collaborate with architects, analysts, developers, and business stakeholders to deliver reliable and maintainable data solutions. Key Responsibilities Data Pipeline Development Design, develop, and maintain robust ETL/ELT pipelines using Informatica and cloud-native technologies. Build scalable data ingestion, transformation, and delivery ...

Consultancy Clearance: Active SC Clearance required. Start Date: Immediate About Amber Labs Amber Labs is a forward-thinking digital consultancy delivering innovative cloud, data, and DevOps solutions across the UK public sector. We specialise in helping organisations achieve digital transformation at pace while maintaining the highest security … will collaborate with architects, analysts, developers, and business stakeholders to deliver reliable and maintainable data solutions. Key Responsibilities Data Pipeline Development Design, develop, and maintain robust ETL/ELT pipelines using Informatica and cloud-native technologies. Build scalable data ingestion, transformation, and delivery ...

shapes best practice for years to come. If you enjoy ownership, influence, and hands-on technical work across Databricks, data modelling, and pipeline development, this role offers genuine impact and long-term career growth. The Company They are investing heavily in their data capabilities … orchestration tools. • Ability to translate business needs into logical, scalable data models. • Comfortable working across multiple data sources and handling pipeline design. • Experience with Power BI, including semantic models or Tabular Editor. • Curious, collaborative mindset with the ability to push back constructively and guide stakeholders. ...

About the Job you are considering: Results-driven Hadoop Data Engineer with experience designing, developing, and maintaining large-scale data processing solutions for financial services organizations. Skilled in building robust data pipelines, managing big data platforms, and transforming high-volume structured … unstructured financial data into actionable insights. Proficient in Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from day to day will vary according to your role, your ...

About the Job you are considering: Results-driven Hadoop Data Engineer with experience designing, developing, and maintaining large-scale data processing solutions for financial services organizations. Skilled in building robust data pipelines, managing big data platforms, and transforming high-volume structured … unstructured financial data into actionable insights. Proficient in Hadoop ecosystem technologies including HDFS, Hive, Spark, Sqoop, Kafka, Oozie, and YARN , along with SQL and cloud-based data platforms Hybrid working: The places that you work from day to day will vary according to your role, your ...

Data Engineer — 12-Month FTC | London (Hybrid) 60-85K We're hiring a Data Engineer to join a growing data team, contributing to the development of a firm wide data platform that sits at the heart of business decision-making. … work alongside experienced data professionals with mentorship and support, building and maintaining pipelines and data models that underpin reporting and analytics across the business. What you'll be doing Building and maintaining data pipelines to ingest and transform data from core business ...

Data Engineer — 12-Month FTC | London (Hybrid) 60-85K We're hiring a Data Engineer to join a growing data team, contributing to the development of a firm wide data platform that sits at the heart of business decision-making. … work alongside experienced data professionals with mentorship and support, building and maintaining pipelines and data models that underpin reporting and analytics across the business. What you'll be doing Building and maintaining data pipelines to ingest and transform data from core business ...

Cribl Data Analytics Engineer Location: London (Hybrid 4 Days per Week Onsite) Contract Length: 12 Months Engagement: Inside IR35 Start Date: ASAP Overview We are supporting a leading financial services organisation in London seeking an experienced Cribl Data Analytics Engineer to join a large-scale Cyber … enrichment processes. Support integration with security and monitoring platforms such as Splunk, Microsoft Sentinel, Elastic, and Datadog. Troubleshoot data ingestion, routing, and pipeline performance issues. Work with Security Operations teams to ensure required log sources are onboarded and monitored. Support cloud and hybrid environments including Azure ...

Senior Data Engineer London £65-85k + 15% bonus A London-based software company on a mission to make data work smarter. Their products power thousands of businesses, and as they grow, they’re building a data stack that scales with their ambition. … They’re looking for a Data Engineer who’s excited about designing modern data systems, experimenting with new tech, and helping shape how data flows through everything they build. What You’ll Do Build and own data pipelines that connect product, analytics ...

Senior Data Engineer London £65-85k + 15% bonus A London-based software company on a mission to make data work smarter. Their products power thousands of businesses, and as they grow, they’re building a data stack that scales with their ambition. … They’re looking for a Data Engineer who’s excited about designing modern data systems, experimenting with new tech, and helping shape how data flows through everything they build. What You’ll Do Build and own data pipelines that connect product, analytics ...

Role Overview SAP Data & Analytics Architect - Senior Manager will lead enterprise-wide data transformation initiatives leveraging SAP’s modern analytics stack, including SAP Business Data Cloud (BDC), SAP Datasphere, SAP Analytics Cloud (SAC), and SAP HANA Cloud. This role requires a blend of solution … architecture, client advisory, delivery oversight and ensuring scalable, high-quality data and analytics solutions aligned with business goals. Key Responsibilities: Strategy & Leadership Define and drive SAP Data & Analytics strategy aligned to business transformation goals. Lead large-scale digital transformation programs involving SAP BDC, Datasphere ...

Senior Data Engineer (Python Enterprise Developer) Position: Senior Data Engineer (Python Enterprise Developer) Location: London (Canary Wharf) Work Mode: Hybrid (4 days per week onsite) Contract Duration: Long-term Contract Recruitment Agency: Norton Blake About the Client Norton Blake is partnering with a premier, global player … someone who thrives under agility, coordinates seamlessly across global time zones, and brings a strong, motivated leadership presence to the technical team. Key Responsibilities Pipeline Architecture: Lead the design, end-to-end development, and optimization of highly scalable data pipelines and enterprise-grade Python applications. Technical Leadership ...

Senior Data Engineer (Python Enterprise Developer) Position: Senior Data Engineer (Python Enterprise Developer) Location: London (Canary Wharf) Work Mode: Hybrid (4 days per week onsite) Contract Duration: Long-term Contract Recruitment Agency: Norton Blake About the Client Norton Blake is partnering with a premier, global player … someone who thrives under agility, coordinates seamlessly across global time zones, and brings a strong, motivated leadership presence to the technical team. Key Responsibilities Pipeline Architecture: Lead the design, end-to-end development, and optimization of highly scalable data pipelines and enterprise-grade Python applications. Technical Leadership ...

Data Engineer As a Data Engineer, you’ll play a key role in designing, developing, and maintaining the infrastructure and pipelines that power a modern data ecosystem . Key responsibilities includ e:Collaborating with stakeholders across different teams to understand data requirements … translate them into scalable solutio nsDesigning and building data pipelines to move, transform, and manage data across multiple layers of the platfo rmDeveloping and maintaining the underlying technical infrastructure that supports data operations and processi ngEstablishing engineering standards, reusable patterns, and best practices ...