51 to 75 of 556 Data Pipeline Jobs in London

Advertisement: Software Developer/Senior Data Engineer Location: London Contract Length: 12 Months Daily Rate: £700 (Umbrella) Are you ready to be part of a transformative journey? Our client is embarking on a major enterprise-wide data platform transformation, and they need a talented Software Developer …/Senior Data Engineer to join their dynamic team! About the Role: You will play a pivotal role in designing and building a state-of-the-art data platform that consolidates data from various business areas into a centralised environment for reporting, analytics ...

Databricks Data Architect London - Hybrid Working We're working with a global consulting and digital transformation organisation that is delivering some of the UK's most ambitious cloud and data modernisation programmes. As a Senior Databricks Data Architect, you'll play a pivotal role … designing and delivering modern data platforms that transform how organisations leverage data. You'll work at the intersection of architecture, engineering and business strategy, helping clients move from legacy environments to scalable, cloud-native data ecosystems. This is an opportunity to influence architecture decisions, establish data ...

Data & Analytics Architect – Senior Manager The SAP Data & Analytics Architect – Senior Manager leads enterprise-wide data transformation initiatives leveraging SAP’s modern analytics and data platform capabilities, including SAP Business Data Cloud (BDC), SAP Datasphere, SAP Analytics Cloud … HANA Cloud. This role combines strategic advisory, solution architecture, delivery leadership, and stakeholder engagement to design and implement scalable, high-quality data and analytics solutions that support business transformation objectives. Key Responsibilities Strategy & Leadership Define and drive SAP Data & Analytics strategies aligned with business and digital ...

# Senior Data Architect - London, UK - FulltimeLondonApply for this job* Permanent* Experienced Professionals* Architecture* ID 522521-en\_GB**About the Job you are considering:**Join Capgemini’s **Integration & Data (I&D)** practice, where we **Consult with Purpose, Continuously Evolve, and Architect Tomorrow**. As a **Data … well as streaming data and unstructured data sources including Cassandra HBase Kafka and Spark* Strong ETL and data pipeline experience particularly with modern big data toolsets such as Airflow and Nifi or equivalent* Strong programming background in either Java Python ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Central London. They are seeking an experienced Azure Data Engineer to join the project on an initial 6-month contract, with strong potential for extension. Key Responsibilities - Azure Data Engineer: Design, build and maintain scalable and secure data pipelines on the Azure platform. Develop ...

Data Operations Manager up to £75,000 + Benefits London (Hybrid) This is a fantastic opportunity to join one of the UK's most innovative insurance brands, where you can take ownership of Data Operations across a large-scale, business-critical data environment supporting … support resources Driving incident management, service improvements and SLA performance Ensuring environments remain scalable, compliant and fit for purpose Overseeing data pipeline reliability and operational performance Supporting deployment, release and change management processes Providing regular operational reporting and KPI tracking to senior stakeholders Working closely with Data ...

Snowflake Data Architect Location: Wembley (Fully on-site) Salary: £110,000 + Permanent Benefits The Opportunity We are seeking an experienced Snowflake Data Architect to play a key role in shaping and evolving a modern enterprise data platform. This is an opportunity to define … architecture standards, drive best practice across data engineering teams, and build scalable solutions that support analytics, automation, and emerging AI capabilities. The successful candidate will be responsible for establishing data modelling standards, designing robust integration architectures, driving platform optimisation, and ensuring the delivery of high-quality ...

Type: Permanent Location: London, UK Mode of Working: Hybrid Working Hours: 40 hours per week (Full-time) Are you looking to build innovative data engineering solutions using PySpark, Microsoft Fabric, and Azure technologies? We have an exciting opportunity for you - Developer (PySpark + Fabric) Careers … impact that matters through challenging projects that demand innovation, collaboration, and thought leadership. Be part of a leading global financial markets infrastructure and data provider. Work within a team transforming and accelerating SDLC processes for critical application and data engineering platforms. Contribute to ambitious business transformation ...

Lead Data Engineer Hands-on technical leadership building data systems that actually work We're looking for a Lead Data Engineer to join an enterprise data engineering capability and play a critical role in designing, building, and improving real-world data … . This is not a line-management role . Instead, it's a senior, hands-on technical leadership position for someone with deep data engineering experience who leads through delivery, judgement, and technical credibility rather than hierarchy. You'll work in a complex environment spanning legacy platforms, modern ...

Media, Retail and CPG, and Public Services. Consolidated revenues as of $13+ billion. For more information on how we process your personal data, please refer to HCLTech’ s Candidate Data Privacy Notice. Investment Banking FIC experience (credit, rates, fx, or EM) is a prerequisite. FIC Data Role – CV Screening Checklist FIC/Front Office Exposure Experience with Fixed Income/Currencies/Sales/Trading data Worked closely with front-office stakeholders Data Architecture/Engineering Awareness Understanding of data pipelines, ETL, reporting layers Exposure to data ...

Description \n Market Data Engineering Team Lead Market Data | Zema | Python | Data Engineering | ETL/ELT \n A leading global commodities organisation is looking for a Market Data Engineering Team Lead to own and evolve its enterprise market data platform. … This is a strategic leadership role with a strong technical focus, responsible for shaping the market data architecture while leading a high-performing engineering team. \n You'll drive the design and delivery of scalable market data solutions, ensuring reliable ingestion, normalisation and distribution of data ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling … modern data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies ...

Senior Quantexa Data Engineer - London/Hybrid (Quantexa Data Engineer, Lead Data Engineer, Senior Data Engineer, Data Engineering Manager, Quantexa, Spark, Scala, Python Databricks, DevOps, CI/CD pipelines, Jenkins, GitHub Actions, Azure DevOps, Docker, Kubernetes, Quantexa Data … global innovator and world leader with one of the most recognisable names within technology. They are looking for an experienced Quantexa Data Engineer with significant experience leading the technical development of Quantexa-based solutions. You will be tasked with designing and implementing robust data pipelines, configuring ...

Role –Senior Databricks Architect Technology – Databricks (Spark, PySpark/SQL) and data lake architectures Location – London, UK Duration-Permanent Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling a modern … data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills • Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. • Hands-on experience with streaming technologies, especially ...

Python Data Engineer 3-6 Months initial contract London/Hybrid - 1-2 days per week on site £Negotiable rate (Inside IR35) We are seeking an experienced Python Data Engineer to join a high-performing data engineering team, building and enhancing centralised data … candidate will have experience in Hedge funds, Asset management or Investment banks. As well as a good understanding of Quant engineering/Quant data groups, Fixed income, rates, FX, macro, trading or pricing environments. This is a hands‐on engineering role focused on designing, developing and maintaining scalable ...

Data Engineering Lead – Up to £46,000 + Bonus + Exceptional Benefits (Civil Service Pension) + Hybrid (Stratford, London) We're looking for a Data Engineering Lead who thrives at the intersection of data, technology, and business strategy. This is an exciting opportunity … lead the development of enterprise-wide data solutions that provide clear visibility of performance, value delivery, and strategic outcomes.Working with senior stakeholders across technology, finance, product, and portfolio teams, you'll transform complex and fragmented datasets into meaningful insights that enable better decision-making across the organisation.If ...

Python Data Engineer 3-6 Months initial contract London/Hybrid - 1-2 days per week on site £Negotiable rate (Inside IR35) We are seeking an experienced Python Data Engineer to join a high-performing data engineering team, building and enhancing centralised data … candidate will have experience in Hedge funds, Asset management or Investment banks*** ***As well as a good understanding of Quant engineering/Quant data groups, Fixed income, rates, FX, macro, trading or pricing environments*** This is a hands-on engineering role focused on designing, developing and maintaining scalable ...

focuses on building and optimising data infrastructure that enables advanced marketing and customer data capabilities. You will create scalable pipelines, data models, and governance practices that support analytics, segmentation, and real-time engagement. Working closely with cross-functional teams, you will help deliver reliable … MarTech, and marketing teams to align data solutions with business needs Requirements Strong SQL skills and experience with ETL/ELT and pipeline orchestration tools (e.g., Airflow, dbt, Data Factory) Experience with cloud data platforms (e.g., Azure, AWS, or GCP) Proficiency in data ...

Solution Architect Willis Re is building its global technology estate from the ground up, unencumbered by legacy and designed around data, analytics and modern cloud platforms. We are looking for a Solution Architect to shape and deliver the solutions that power our reinsurance broking, analytics and client‐facing … initiatives. Key Responsibilities Cloud Architecture: Design secure, scalable, cloud‐native solutions on Microsoft Azure, spanning infrastructure, PaaS services, networking, identity, security and observability. Data Engineering: Design solutions around our data lake platform, architecting performant pipelines, sound data models and strong governance for large volumes ...

Staff Data Engineer | AWS | PySpark | Data Modernisation | London | Contract | Inside IR35 We're supporting a global, technology‐led organisation undertaking a large‐scale cloud data transformation programme. This is not a traditional data engineering role. The organisation is modernising hundreds of complex … Python and PySpark Experience with AWS Glue, Apache Spark and Apache Airflow Cloud‐native data engineering architectures Large‐scale data pipeline modernisation Building reusable engineering patterns within enterprise environments Data testing, validation and observability AI‐assisted software development using modern coding assistants Experience ...

Palantir Data Engineer London | Bristol | Manchester | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised as one of Fortune’s World’s Most Admired Companies , delivering some of the most complex and ambitious transformation programmes across Defence, Security, and critical national infrastructure. As investment … data‐driven decision making continues to grow across the Defence and Security sector, the organisation is expanding its Palantir capability to help clients turn complex data into actionable insight at scale. This opportunity is ideally suited to a Palantir Data Engineer with experience across ...

bring your ambition to work every day, which is why, at British Airways the sky is never the limit. The role: Principal Data Engineer You'll be part of either our Data & AI Delivery team or the Commercial data team, acting as a technical … leader for data engineering across the organisation. These teams play a critical role in enabling secure, scalable and high performing data products that underpin data driven decision making across British Airways. What you'll do: Act as a technical leader for data ...

Select how often (in days) to receive an alert: Create Alert Are you ready to define the data architecture that will transform how Novo Nordisk discovers, develops, and delivers life-changing medicines? We are looking for a visionary Lead Data Architect who can define the data foundation that powers AI-driven drug discovery for thousands of R&D professionals and a pipeline touching millions of patients. Your new role As a Lead Data Architect within Research & Development, you will design and implement the data ...

Title: Data Solution Architect Location: Paddington Duration: 6 months possible extension Our client is leveraging the power of data and AI to solve business problems, improve customer experience, and drive commercial value. This is an architecture-led role within the Data Architecture & Design team … helping shape how data solutions are designed, governed, and made supportable across multiple business areas. What you'll be doing: * Provide architecture and design guidance across a portfolio of data projects, ensuring solutions align with platform strategy and future changes * Guide functional design for data ...

right time. The Opportunity Every interaction on Grip's platform — a scan, a meeting, a session attendance, a lead capture, a message — generates data with real commercial value to organisers, exhibitors and attendees. We're at an inflection point where AI makes it possible to turn that … signals) in a privacy-compliant, lawful-basis-aware way Build observability into data systems — structured logging, freshness and quality monitoring, SLOs, and pipeline health dashboards Champion high-quality technical communication: proposals, specifications, and documentation that other teams can build on Mentor engineers across the organisation on data ...