126 to 150 of 1,542 Data Pipeline Jobs in London

Software Engineer - Data, Lakehouse and AI Data Platform Engineer - Analyst/Associate - London location_on London, Greater London, England, United Kingdom The Opportunity Join a team building the data foundations that support the firm’s AI and analytics capabilities. This role sits within … data formats such as JSON , Avro and Parquet . For More Experienced Candidates Stronger ownership of technical design across multiple datasets or pipeline domains. Experience guiding implementation standards, code quality and engineering practices within a team. Ability to lead delivery for a workstream, manage dependencies and support ...

events that have a financial impact on Checkout.com and our merchants. Our team is responsible for maintaining an accurate record of all financial data, the data integrity of our systems and ensuring our infrastructure meets regulatory and compliance obligations in a scalable, reliable and fault-tolerant … pipelines to process data from our systems, services and applications. Implement monitoring and alerting frameworks to ensure data pipeline performance and reliability. Partner with other analytics engineers to design and implement scalable data models that support downstream business operations and analytical ...

transforming, validating and serving complex datasets. Design scalable data models, schemas and storage systems for structured, semi-structured and geospatial data. Build pipeline orchestration using directed acyclic graphs (DAGs) to manage dependencies, retries, scheduling and observability. Develop systems for data quality testing, lineage, versioning, reconciliation … products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. Work directly with customers and domain experts to understand source systems and data problems. ...

Senior Data Engineer Microsoft Azure dataThis is a new and exclusive opportunity for a Senior Data Engineer with strengths in Microsoft Azure data to be a key lead in strengthening, evolving, and modernising our core data platforms. Job detailsTitle: Senior Data … dataLocation: London or Glasgow with 1 day a week in the officePermanent role salary 80,000- 100,000Requirements: Strong experience as a Senior Data Engineer in enterprise data environments. Technical stack: Microsoft Azure data platforms, including Azure Synapse or equivalent data platform ...

automated testing to build and own features from conception to deployment. Requirements SQL/data processing experience Scalable data pipeline development Some experience building effective programmatic interfaces in any language. Desirables Experience with PostgreSQL query performance optimisation Experience with Python HTTP, API development, automated testing … data pipeline design. Experience ensuring data quality, integrity, and performance Hands-on experience with financial data sources (e.g., Bloomberg, Refinitiv) #J-18808-Ljbffr ...

Apache Iceberg as the core storage format, ensuring high-performance querying and seamless interoperability with Snowflake and heterogeneous compute engines. AI-Accelerated Schema & Pipeline Engineering: Develop and maintain end-to-end multi-stream ingestion pipelines for complex clinical trial schemas. Use AI-driven schema inference and ontology alignment tools … required under GxP, HIPAA, and GDPR standards. System Resilience: Troubleshoot complex production issues across distributed data environments and implement resilient, self-healing pipeline architectures. Key Business Value & Strategic Impact Your leadership will directly advance life sciences technology. By pairing modern lakehouse architecture (Snowflake, Apache Iceberg, Kafka) with ...

understand their product datamodels and deliver tailored data solutions that meet business needs. Job Responsibilities Deliver end‐to‐end data pipeline solutions on cloud infrastructure leveraging the latest technologies and the best industry practices Use domain modelling techniques to allow us to build best … verbal communication skills in English Experience with cloud technologies and distributed systems Experience with data transformation frameworks and data pipeline orchestration tools Experience with managing large volumes of data and optimizing data processing Understanding of event‐base architecture, data ...

hackajob is partnering directly with Accenture to hire for this role. Job Role : Data Science Associate Manager Location: London/Manchester Career Level : Manager – ML8 We Are: Accenture Song accelerates growth and value for our clients through sustained customer relevance. Our capabilities span ideation to execution: growth, product … help our clients operate at the speed of life through the unlimited potential of imagination, technology and intelligence. Visit us at: The Data & AI team: The Data and AI revolution is changing everything. It's everywhere – transforming how we work and play. Join Accenture and help ...

Multiple Data Engineer & Data Analyst Contracts | 6-Month Initial Contract at £430/day Inside IR-35 | London/Hybrid (max 2 days per week on site) We're supporting a major data transformation programme and are looking to hire multiple Data Engineers and Data Analysts on an initial 6-month contract. These opportunities are well-suited to contractors with around 2-4 years of commercial experience who are looking to build on their data engineering, BI, reporting, ETL, or analytics expertise within a modern ...

Описание Agoda is a travel platform that connects people with destinations and experiences through hotels, holiday properties, flights, and activities worldwide. Its Data department enables data-driven decision-making through operational and analytical databases, queue systems, BI tools, and data science technologies. Задачи Design … build, and maintain scalable ETL/ELT pipelines for CEG systems, third-party tools, and logs; Develop and optimize data models for reporting, monitoring, forecasting, quality assurance, and experimentation; Implement validation checks, anomaly detection, and monitoring for key datasets and metrics; Define and enforce data definitions ...

Role: Senior Data Engineer - Databricks Location: Remote - some travel to client site in London Contract: Initial 6 months Rate: £500 to £540 per day Clearance: Must be eligible to obtain SC Clearance This role has been deemed Inside IR35 The Opportunity We are looking for an experienced Senior … Data Engineer to work on complex, large-scale data projects within secure and highly regulated environments. This is an excellent opportunity for a Data Engineer with strong Databricks, PySpark and modern Lakehouse experience who wants to remain hands-on while taking greater ownership ...

Advanced Driving. We develop advanced Perception and Planning technologies, and their production software for multiple AD/ADAS systems. To deliver reliable data-driven technologies to millions of Toyota vehicles, we are solving complex real-world problems using large-scale data, machine learning, and state … architectures for Perception, Prediction, and Motion Planning. WHO ARE WE LOOKING FOR? The team is seeking an experienced, technical, and hands-on Autonomy Data Manager to grow and lead a talented team composed of Data Scientists, Data Engineers and ML Ops Engineers, working ...

innovative solutions to life. Your visionary leadership and pursuit of excellence makes a lasting impact on the firm and industry. As a Principal Data Engineer at JPMorganChase within the [insert LOB or sub LOB], youprovide expertise and data engineering excellence as an integral part … proficiency in designing and optimizing data models for analytics, reporting, and business intelligence use cases Demonstrated ability to automate data pipeline deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g. ...

Cloud Data Architect (Manager) – BIP xTechAbout BIPBIP is an international consultancy working with leading organisations to deliver transformation, create long-lasting value and shape the future with confidence. We bring together deep industry expertise, innovative thinking and a collaborative approach to help our clients solve complex challenges … ValueWe Are Creators of Our Own FutureTogether We Go FurtherAbout BIP xTechBIP xTech is BIP's Centre of Excellence for Artificial Intelligence, Big Data, and Modern Data Platforms. We work with our clients to design and deliver scalable, cloud-native data platforms that enable ...

Management. This role acts as the technical backbone for the Marketing Hub—partnering closely with analytics, MarTech, and digital teams to deliver the pipelines, data models, and governance frameworks that support personalisation, measurement, experimentation, and strategic decision‐making. The Data Engineer ensures data … advanced analytics and dashboarding environment, the role ensures that marketing has access to trusted, well‐structured, and scalable data. Responsibilities Data Architecture & Pipeline Engineering: Build and maintain reliable pipelines integrating customer, campaign, and operational data into the CDP, ensuring accuracy and readiness for analysis. Marketing ...

client is a fast-growing, AI-native, engineering-led consultancy building advanced semantic, ontology-driven and agentic AI systems. As they deepen their data engineering capability, they are seeking a senior-level Data Engineer to design and operate high-fidelity, ontology-aligned data foundations … will play a foundational role in building robust semantic layers and enabling high-value AI systems for clients. Key Responsibilities Data Pipeline Engineering (Semantic & Ontology-Aligned) Design, build and maintain ETL/ELT pipelines aligned to ontology and knowledge graph structures Implement transformations that respect entity models ...

Salary Range: £47,740.00 - £88,660.00 Band Level 4 Job Description Summary #LI-Hybrid The Data Management & Infrastructure Manager ensures the consistent application of data governance frameworks, standards, and lifecycle controls to enable trusted, compliant, and reusable data assets. This role serves … coordination point between business and technical teams, supporting governance, data quality, and performance reporting. The position drives alignment across stakeholders to ensure effective data usage and compliance across functions. Location: London (The Westworks), United Kingdom with Hybrid Working (you must be able to work ...

Senior Data Engineer Department: IT & Innovation Employment Type: Full Time Location: London Office Description Menzies is an equal opportunities employer which means that we recruit, employ, train, pay, and promote regardless of race, religion, national origin, gender, sexual orientation, disability or age. We are building a first-class … lead with purpose, and work in a place where your voice truly matters, keep reading! We have a great opportunity for a Senior Data Engineer to join our team and can be based from any of our Menzies offices. The purpose of this role is to lead ...

Select how often (in days) to receive an alert: Select how often (in days) to receive an alert: Senior Manager, Databricks Architect, AI&Data, FS Location: London Other locations: Primary Location Only Date: 9 Aug 2026 Requisition ID: 1639394 At EY, we’re all in to shape your … teams and take your career wherever you want it to go. Join EY and help to build a better working world. Senior Manager – Data Engineering – Databricks Architect London/Edinburgh The opportunity The EY Financial Services AI & Data team is continuing to grow and develop unique ...

AreBCG Expand is a specialist firm providing unique data-driven business intelligence as a trusted advisor to senior executives across the world's leading financial services firms to help them to operate more effectively. Expand's activities are focused on data benchmarking in technology, operations, FinTech … market data, with expertise around strategic cost and human resourcing benchmarking in wholesale finance. Founded in 2001 as an independent research boutique, Expand is a wholly owned subsidiary of the Boston Consulting Group, headquartered in London and with offices in Singapore and New York. At Expand ...

contributions directly shape how the business understands its finances – we’d love to hear from you. Day to day responsibilities Data modelling & pipeline ownership: Design, build, and maintain robust data models and transformation pipelines in dbt or equivalent tooling, ensuring finance data … comfortable picking up finance context as you go. You take ownership. You don’t wait to be asked – you spot a problem in a pipeline and you fix it. You communicate clearly. You can explain a complex query to a finance stakeholder and a financial concept to a data ...

news, or just browsing what’s on the market. Location: London office/Hybrid (2 days per week in the office)Reporting to: Data Engineering ManagerThe Role Millions of people visit the Rightmove website every month. We have a huge amount of data about how people … site, and what this means to our customers. You’ll be joining our growing Data Engineering & Infrastructure team, a collaborative, high-performing group of engineers that uses this data to build the infrastructure that powers the UK’s favourite property site. In this role, you will ...

Exciting opportunity for a Senior Data Engineer looking to join a growing technology function at an important stage of its data transformation journey. The business is building a new group-wide data platform using Microsoft Fabric and Azure, with Power BI as the primary … analytics and reporting layer. This is a hands-on role where you'll have genuine scope to influence how the data platform continues to evolve and mature. You will be building, maintaining and extending data ingestion, transformation and orchestration pipelines across a modern Microsoft Fabric platform ...

Permanent Opportunity for a Security Cleared Palantir Foundry Data Engineer Must have active SC or DV Clearance Mid to Lead levels available Up to £85 DoE plus package Circa 3 days on site in London Who are we? Our client is a leading secure sector consultancy with … firmly established Palantir Data team. They’re in an exciting period of growth due to increased end-customer demand. They work on complex, mission-focused programmes, using Palantir platforms to transform disparate data into trusted information assets, operational capabilities and actionable insights. What will the Data ...

Data Science and Analytics Lead Our client are a leading user-generated video marketplace, helping creators monetise their content while supplying video to publishers, broadcasters, brands and digital platforms worldwide. As demand for high-quality AI training data accelerates, they're uniquely positioned to turn their … extensive video library into valuable datasets, metadata and insights, and they need someone who can get more value out of the data they already hold. This is a hands-on role. There is no analytics team to hand work off to, you are the data function. ...