76 to 100 of 141 Data Engineering Jobs in London

Consultant, Senior Manager We are looking for a Senior Manager with deep Palantir Foundry expertise to lead the design and delivery of production-grade data and AI solutions. You will shape end-to-end architectures, lead multidisciplinary teams and work directly with senior client stakeholders to turn complex data … pipelines through Ontology, applications and AI use cases. Translate business problems into Foundry use cases, technical designs and deliverable roadmaps. Design and oversee data pipelines, Ontology models, security and governance patterns and application workflows in Foundry. Guide teams of data engineers, software engineers and data scientists ...

Consultant, Senior Manager We are looking for a Senior Manager with deep Palantir Foundry expertise to lead the design and delivery of production-grade data and AI solutions. You will shape end-to-end architectures, lead multidisciplinary teams and work directly with senior client stakeholders to turn complex data … pipelines through Ontology, applications and AI use cases. Translate business problems into Foundry use cases, technical designs and deliverable roadmaps. Design and oversee data pipelines, Ontology models, security and governance patterns and application workflows in Foundry. Guide teams of data engineers, software engineers and data scientists ...

Purpose of position As a Senior Data Engineer, you will play a pivotal role in our AI/ML workstream, you’ll work closely with business teams and data scientists to design, maintain, and improve machine learning applications. Your main responsibilities will include managing existing ML workloads … also contribute to developing Generative AI solutions and applications for the emerging Agentic Era. You’ll collaborate with a global team to create scalable data architectures optimised for AI/ML, source and prepare high-quality data, and implement robust ETL processes. You should be comfortable working independently ...

Empower your career. Sparta Global provides a launchpad for emerging talent, career changers, and individuals from diverse backgrounds to build meaningful careers in technology, data, and business consulting. A university degree is not a requirement-success in our pathways is driven by passion, commitment, and potential. Your journey begins … proactive approach to learning Communicate effectively and work well in teams Thrive in fast-paced, dynamic environments Have a genuine interest in technology, data, and business Understand the importance of professionalism and continuous development What You'll Gain at the Academy Industry-aligned training tailored to your chosen pathway ...

Data Engineering Technical Lead Global Investment Bank London - Hybrid Permanent - Excellent Package + Benefits We are working with one of the world's leading banking groups, who we have partnered with for 15 years. We are seeking an experienced Data Architect/EDM Developer/Data Engineering Lead to join their International Technology team in London click apply for full job details ...

Data Analytics Engineer Salary: £83,000 Location: London (3 Days in Office) Shape the future of data-driven decision-making by transforming raw information into trusted, insight-ready assets. Join a team where analytics engineering fuels innovation, intelligence, and impact across the business. The Opportunity This … exciting opportunity to help shape the foundation of a modern, data-enabled organisation. You'll design and build scalable analytics models and pipelines that transform raw data into trusted insights, powering smarter decisions across every level of the business. Working at the intersection of data engineering ...

Senior Data Engineer London 2-3 days on-site £65,000 - £72,000 + 20% Bonus + Excellent Benefits Our client is a leading global hospitality brand undergoing an exciting period of rapid growth and transformation. With significant investment in data and technology, they are building a world … class data platform to power decision-making across every area of the business - from supply chain and logistics to marketing, customer sales and in-store operations. We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, build, and optimize the clients data ...

their analytics capability and looking for a Product Analytics Manager to take ownership of key product workstreams. You'll report into the Director of Data and lead a small team of experienced analysts, acting as the analytical partner to Product, Marketing, and Partnerships to shape how data drives … Product Analysts + Insight Analyst Building clear product metrics, experimentation frameworks and dashboards Influencing senior non-technical stakeholders with clear, actionable insight Partnering with data engineering & data science to improve tooling and data quality Skills and experience: Strong SQL and familiarity with product analytics tools (Amplitude ...

Analysts to support large-scale integration and transformation across Personal Lines and Claims. You'll work with cross-functional teams to map processes, shape data and technology change, and ensure delivery lands cleanly into the business. Workstreams: Claims & Personal Lines: BA support across core insurance processes and change initiatives. … Analysis for upgrades/migrations; experience here is a strong plus. GenAI - Next Best Action: Define use-cases and requirements for decisioning in Claims. Data Automation (Snowflake): Help migrate DLG data to Snowflake and streamline pipelines. Big Data programmes: Personal Lines data, Claims data ...

Palantir Foundry Consultant You'll work as a hands-on Palantir Foundry consultant, helping to design, build and support data and application workflows on the platform. You'll work closely with senior Foundry engineers and architects, contribute to technical decisions, and collaborate directly with business stakeholders as you grow … into owning areas end-to-end. Core Responsibilities Foundry Solution Delivery Contribute to solution design and implementation across: Data integration (Pipeline Builder/code-based pipelines, connectors, incremental loads). Ontology modelling (objects, relationships, basic semantics, versioning). Application layer (Workshop, Code Repositories, OSDK/APIs, Actions, AIP/ ...

Data Engineer £700 - £750 per day inside IR35 6-month contract Hybrid working in London We're working with a global healthcare and AI research organisation at the forefront of applying data engineering and machine learning to accelerate scientific discovery. Their work supports large-scale, domain-specific … datasets that power research into life-changing treatments. They're now looking for a GCP Data Engineer to join a multidisciplinary team responsible for building and operating robust, cloud-native data infrastructure that supports ML workloads, particularly PyTorch-based pipelines. The Role You'll focus on designing, building ...

Senior Snowflake Data Engineer Location: Remote UK Employment Type: Full-time About the Role We are looking for an experienced Senior Snowflake Data Engineer to design, build, and optimise data pipelines using modern engineering practices. This role involves working with Snowflake, dbt, and Python, implementing scalable … solutions and driving best practices in data engineering and DevOps. About the role: Develop and optimise high-performance data pipelines in Snowflake Build modular, reusable dbt models with comprehensive testing and documentation Implement test-driven development and data quality checks Configure CI/CD pipelines ...

Senior Snowflake Data Engineer Location: Remote UK Employment Type: Full-time About the Role We are looking for an experienced Senior Snowflake Data Engineer to design, build, and optimise data pipelines using modern engineering practices. This role involves working with Snowflake, dbt, and Python, implementing scalable … solutions and driving best practices in data engineering and DevOps. About the role: Develop and optimise high-performance data pipelines in Snowflake Build modular, reusable dbt models with comprehensive testing and documentation Implement test-driven development and data quality checks Configure CI/CD pipelines ...

have exiting contract job opportunity for Data Engineer for leading airline client. Role Purpose The Data Engineer will design, build, and maintain robust data pipelines and architectures to enable AI-driven solutions for business, ensuring frameworks can scale across all OpCos. This role demands consultancy-level technical … discipline. Contract - 6 months Location - around Heathrow Hybrid - 2 to 3 days onsite Rate - Flexible day rate (inside IR35) Key Responsibilities Develop and optimize data pipelines for ingestion, transformation, and storage. Ensure data quality, integrity, and security across systems. Collaborate with Data Scientists and Analysts to enable ...

About the RoleWe are seeking a Databricks Data Engineer with strong expertise in designing and optimising large-scale data engineering solutions within the Databricks Data Intelligence Platform. This role is ideal for someone passionate about building high-performance data pipelines and ensuring robust data governance across modern cloud environments.Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning ...

About the RoleWe are seeking a Databricks Data Engineer with strong expertise in designing and optimising large-scale data engineering solutions within the Databricks Data Intelligence Platform. This role is ideal for someone passionate about building high-performance data pipelines and ensuring robust data governance across modern cloud environments. Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning ...

Engineering Lead - Anti-Fraud Systems | Global Financial Technology | Hybrid We're partnering with a global financial asset manager on a key leadership hire - an Engineering Lead to spearhead the design, development, and modernization of cutting-edge transaction monitoring and fraud detection systems. This is a rare opportunity … base including a package of up to £170,000 you will be based out of their City of London offices. The Role: As Engineering Lead, you'll guide a talented team of engineers within the Anti-Fraud Engineering function, part of the company's wider Security, Fraud ...

Data Engineer (SC) Croydon - 2-4 days per month on site £500/day outside IR-35 Contract until the end of the financial year We are seeking an experienced AWS Data Engineer to support a major government programme delivering secure, scalable data solutions. Key Responsibilities Design … implement data pipelines on AWS using services such as Glue, Lambda, S3, and Redshift. Develop ETL processes and optimise data workflows for performance and security. Collaborate with analysts and architects to ensure compliance with government security standards. Troubleshoot and resolve issues in complex cloud environments. Essential Skills Strong ...

Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine Learning … Transformers. Experience building, training, and deploying machine learning models for classification, regression, clustering, and NLP tasks. Understanding of model evaluation metrics, hyperparameter tuning, feature engineering, and MLOps practices for production deployment. Generative AI & LLM Integration - Proficient in working with Large Language Models including OpenAI GPT models, Anthropic Claude, Azure ...

Python programming including object-oriented design, asynchronous programming, error handling, and writing clean, maintainable code. Experience with key libraries including Pandas, NumPy for data manipulation, requests and APIs for integrations, asyncio for concurrent processing, and building robust automation scripts with proper logging, testing (pytest), and documentation. AI & Machine Learning … Transformers. Experience building, training, and deploying machine learning models for classification, regression, clustering, and NLP tasks. Understanding of model evaluation metrics, hyperparameter tuning, feature engineering, and MLOps practices for production deployment. Generative AI & LLM Integration - Proficient in working with Large Language Models including OpenAI GPT models, Anthropic Claude, Azure ...

Data Engineer - Active SC, Databricks, PySpark Up to £475 per day (Inside IR35) Remote/London 6 months My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver and optimise Data engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with Azure ...

Data Engineer - Active SC, Databricks, PySpark Up to £475 per day (Inside IR35) Remote/London 6 months My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver and optimise Data engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with Azure ...

Data Engineer (Python) - Leading Asset Manager | London (Hybrid) Brand-new team. High autonomy. Big impact and high bonus! A top Asset Manager is building a new data function from scratch , and they need a sharp Data Engineer to help define and deliver their future data strategy. … small but growing team! Hybrid: 3 days in London office, 2 days WFH (flexible when needed). The Role Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ...

case definition through to high-level architecture and platform design. The role covers areas such as Predictive AI, Machine Learning and Generative AI, MLOps, data pipelines and modern AI platforms, across both cloud and private infrastructure. Alongside customer work, youll contribute to the development of AI offerings, standards … mentoring other architects within the wider team. Key Responsibilities Act as the AI subject matter expert in customer engagements, working directly with business stakeholders, data teams and IT operations. Lead discovery and design of AI strategies, governance models and platform architectures aligned to business outcomes. Design ...

Performance Analyst (Data Visualisation Specialist) - DV Cleared Location: London Contract: Initial 12 months Clearance: DV Clearance is essential About the Role We are seeking a proactive and highly skilled Performance Analyst with a strong specialism in data visualisation to join our high-performing Performance & Insights team. This role … pivotal in driving practical insights from data and supporting evidence-based decision-making at the highest level. You will play a key role in: Developing data visualisation products that make complex information accessible and highlight trends across datasets. Surfacing insights to enable data-driven decisions by senior ...