151 to 175 of 1,461 Data Pipeline Jobs in London

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic ...

clients manage improvement programs and transformations by tracking initiative progress, performance, budgets, timelines, and impact on longer-term goals. Its Transformatics team builds data and AI products that provide analytics insights for clients and McKinsey teams involved in transformation programs globally. Задачи Design, build, and optimize scalable data solutions for analytics, reporting, and machine learning Develop robust data ingestion pipelines, procure data from APIs, and integrate it into cloud-based storage layers Clean and standardize data to ensure data quality Build next-generation cloud-based data ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products, enabling … modern data mesh architecture. The role focuses on integrating legacy systems with cloud-native platforms to support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies ...

architecture Work closely with analysts, software engineers, and business users using Sigma to ensure they have trusted, well-documented datasets Monitor, troubleshoot, and improve pipeline reliability, performance, and cost within the existing observability framework Contribute to documentation of pipelines, datasets, and data contracts, acting as the main … point of contact for data engineering topics Investigate and resolve data quality incidents and pipeline failures Proactively drive adoption of Databricks within the team and experiment with new Databricks features and tools where they bring clear value, including integrating AI tools for analysis ...

Senior Quantexa Data Engineer - London/Hybrid (Quantexa Data Engineer, Lead Data Engineer, Senior Data Engineer, Data Engineering Manager, Quantexa, Spark, Scala, Python Databricks, DevOps, CI/CD pipelines, Jenkins, GitHub Actions, Azure DevOps, Docker, Kubernetes, Quantexa Data … global innovator and world leader with one of the most recognisable names within technology. They are looking for an experienced Quantexa Data Engineer with significant experience leading the technical development of Quantexa-based solutions. You will be tasked with designing and implementing robust data pipelines, configuring ...

Position Overview: The Data Development group manages the lifecycle of data used for trading, back-testing, and research at Squarepoint. We work with quantitative researchers and tech teams to integrate, process, and serve data from a huge variety of sources into our data … data applications and data platform meet evolving business requirements. Work closely with data operations and data pipeline developers to improve development velocity and reduce our technical debt; increase the team's quality of life. Write and review technical documents, such ...

customers can achieve better outcomes and stay ahead of what’s next. Job Summary We are seeking a highly skilled Azure Data Engineer to design, build, and maintain our enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable … supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified ecosystem built on Microsoft Fabric and Azure Databricks. A heavy emphasis is placed ...

Title: Business Intelligence Data Engineer (CYPE) Location: Croydon, South London (CR0 1EA), Hybrid Working - 2 days office/3 days remote Daily rate: £590 per day Umbrella Contract Length: 6 -month contract (possibility of extension) Working Pattern: Full Time, Monday - Friday, 36 hours ASAP Start Help transform services … children and families through data As part of an ambitious transformation and improvement programme, a Local Authority based in Croydon are seeking a talented Business Intelligence Data Engineer to join their growing Business Intelligence team. This is a unique opportunity to use your technical expertise ...

Title: Business Intelligence Data Engineer (CYPE) Location: Croydon, South London (CR0 1EA), Hybrid Working - 2 days office/3 days remote Daily rate: 590 per day Umbrella Contract Length: 6 -month contract (possibility of extension) Working Pattern: Full Time, Monday - Friday, 36 hours ASAP Start Help transform services … children and families through data As part of an ambitious transformation and improvement programme, a Local Authority based in Croydon are seeking a talented Business Intelligence Data Engineer to join their growing Business Intelligence team. This is a unique opportunity to use your technical expertise ...

Data Engineer Financial Technology Location: London Working: Hybrid (3 days/week in office) Salary: Up to £150k + bonus The Role Joining a global investment bank as part of a growing Data Engineering function, working on critical data infrastructure across the business. Youll … build and enhance modern data solutions using Snowflake, AWS, Python and SQL , working with large-scale financial and historical data. The role sits closely with Market Data, Quant and Risk teams, with your work supporting areas including market risk analytics, VaR and stress testing. Key Responsibilities ...

Data Engineer Financial Technology Location: London Working: Hybrid (3 days/week in office) Salary: Up to £150k + bonus The Role Joining a global investment bank as part of a growing Data Engineering function, working on critical data infrastructure across the business. … build and enhance modern data solutions using Snowflake, AWS, Python and SQL , working with large-scale financial and historical data. The role sits closely with Market Data, Quant and Risk teams, with your work supporting areas including market risk analytics, VaR and stress testing. Key Responsibilities ...

Описание: Simple Machines is a global, independent technology consultancy that designs and builds modern data platforms, intelligent systems, and bespoke software across data engineering, software engineering, and AI. It helps enterprises, scale-ups, and government turn complex data into products, platforms, and actionable decisions. … Задачи Own the end-to-end architecture of modern, cloud-native data platforms Design scalable data ecosystems using data mesh, data products, and data contracts Make architectural decisions across ingestion, storage, processing, and access layers Ensure platforms are secure, compliant ...

Data & Audiences Lead, you will play a pivotal role in enabling data-driven marketing strategies and personalized customer engagement. You will develop and manage advanced segmentation strategies and data models, supporting lifecycle campaigns and marketing offers. This role is central to the Marketing Business … Management & Strategy team’s ambition to leverage first-party data, drive operational efficiency, and deliver measurable impact across CRM and paid media channels. You will collaborate cross-functionally, champion agile ways of working, and contribute to the continuous improvement of our marketing operating model.ESSENTIAL FUNCTIONS:Develop and optimize ...

Vacancy No VN427Status ActiveLocation LondonLocation Country United KingdomLocation RegionLocation City LondonDescription The opportunityWe are investing in the data foundation behind ATG's customer experiences and business decisions. As a Senior Data Engineer on the Data Enablement team, you will build production-grade data products that serve analytics, search, recommendations, personalization, and machine learning. You will work closely with product managers, analysts, data scientists, ML engineers, and software engineers to turn ambiguous needs into dependable, well-documented datasets and pipelines.This is a hands-on engineering role for someone who cares ...

Build and enhance data pipelines and automation workflows on Azure for large-scale data ingestion and processing Maintain and optimise existing toolkits, databases, dashboards, and API-based solutions Develop end-to-end automated data solutions across commodities (Gas/LNG, Power, Weather) Design … Data platforms supporting ML and demand forecasting models Required Skills & Experience Technical Strong proficiency in Python for data engineering and pipeline development Hands-on experience with Azure data services (Data Factory, Databricks, Blob Storage, etc.) Experience designing and optimising Snowflake data ...

reliably and securely from source to decision-ready output.You'll implement features and fixes against a given design, handle known classes of pipeline issues on your own, and upscale genuinely novel problems with clear context rather than working them in isolation. You're also expected to start … schema, monitoring, and catalog registration — extending the team's existing framework where a new source needs a pattern it doesn't yet support Investigate pipeline failures independently, recognize known classes of issues, and ship the documented fix without needing to upscale Before shipping a new pipeline, identify downstream ...

Data Engineer Please Note: Due to the Exciting nature of this work, Applicants must hold a valid British passport - Duel Nationality wont be accepted - sorry Salary: £45k - £60k London - Hybrid We are seeking an Data Engineer to join a growing technology consultancy delivering secure, data … 3+ years’ commercial experience in data engineering Strong Python and SQL skills Experience with ETL/ELT processes and data pipeline development Experience working with cloud platforms such as AWS, Azure or GCP Knowledge of technologies such as Spark, Kafka, Airflow or similar Experience with ...

Fabric Data Engineer - Up to £95,000+ Benefits Permanent - Mainly remote with occasional travel to client site About the Opportunity We are seeking a talented Fabric Data Engineering Consultant to join a growing Microsoft data and AI consultancy. This is an exciting opportunity … data professional who enjoys designing modern data platforms, building scalable solutions and helping organisations unlock the value of their data through advanced analytics and cloud technologies. Working within a collaborative consulting environment, you will play a key role in delivering data transformation ...

Role: Databricks Engineer Location: London (3 days in a week) Employment: Fulltime Role Overview We are seeking an experienced Azure Databricks Data Engineer to design, develop, deploy, and optimize scalable data solutions on Microsoft Azure. The ideal candidate will bring strong hands-on expertise in Azure … Data Lake Storage, Azure Data Factory, and Azure DevOps. Demonstrated ability to tune Spark workloads and troubleshoot data pipeline performance and production issues. Strong understanding of data engineering, governance, security, version control, testing, and deployment best practices. Preferred Qualifications Databricks Certified ...

NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world … visit www.exlservice.com . Location: London, United Kingdom (Hybrid) Employment Type: Permanent Summary of the role: We are looking for a highly skilled Palantir Data Engineer to join our growing Insurance practice. This role is ideal for a data engineering professional with strong experience in modern cloud ...

Your mission As part of the Data Science team, the Scientific Data Engineer will divide their time between digitalization and data analysis. The candidate will develop and maintain the R&D department's data model, data pipelines and dashboarding … support R&D activities. These span a wide range of areas including electronic lab notebook templatization and integrations, data capture and storage, results processing, dashboarding, and statistical analysis activities. They will also share responsibility with the wider Data Science team for providing technical support to scientists ...

ZoomInfo's internal teams to interact with data comprehensively. The ideal candidate has a strong background in big data processing, pipeline orchestration, and data modeling, with a proven track record of delivering scalable and high-quality data solutions in fast-paced … pipelines and products, ensuring data accuracy and lineage are a top priority. Participate in a shared PagerDuty on-call rotation, responding to pipeline and platform incidents, performing root-cause analysis, and driving remediation and postmortems. Triage production issues quickly and escalation appropriately, knowing when to loop ...

Data Engineer London - Hybrid £65,000 - £75,000 Azure Data/SQL/Financial Services I'm currently working with a growing data and technology consultancy who are looking to bring a Data Engineer into their expanding delivery team. The business works … with a range of organisations across telecommunications, financial services, insurance and healthcare, helping clients develop modern data platforms and turn complex data into valuable business insights. Joining a client-facing consulting team, you'll have the opportunity to work across a variety of data ...

Title: Data Engineer with AI knowledge - Associate ManagerSalary: Competitive salary and package (Depending on level of experience)Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the UK on an ad hoc basis) Please Note: Any offer of employment is subject … Python · Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/ ...

translating them into effective outcomes. You understand and align with Solirius Reply Values. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a fantastic … team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. Requirements ...