151 to 175 of 281 Data Engineering Jobs in the City of London

I am working with a global data and AI consultancy that is expanding its Data Management practice and looking to bring on a Data Solutions Architect with deep expertise in Google Cloud Platform (GCP). This is a strategic, client-facing role where you will partner with senior stakeholders to modernise data platforms, accelerate cloud transformation … and drive measurable business outcomes. You’ll join a collaborative environment focused on delivering enterprise-scale data solutions across banking and financial services. With increasing demand for cloud-native architectures and data-driven innovation, this is a fantastic opportunity to lead high-impact engagements and shape future-state data strategies. As part of this role, you will … be responsible for: Leading technical solution design and delivery for large-scale data platform projects using GCP and BigQuery Supporting pre-sales engagements by translating client requirements into technical solutions Take ownership of cloud migration and data platform modernization strategies Undertake data modelling tasks with a focus on long-term maintainability and scalability Designing robust ETL/ More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and … cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks (including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost … management and efficient Databricks resource usage. Integrating data from on-prem and cloud sources using tools like Qlik Replicate (CDC). Supporting future phases involving data science and machine learning enablement. Tech Environment Platform: Azure Core Tools: Databricks, Delta Live Tables, Qlik Replicate (CDC) Architecture: Hybrid (on-prem + cloud) Data Modes: Real-time streaming & batch jobs More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and … cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks (including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost … management and efficient Databricks resource usage. Integrating data from on-prem and cloud sources using tools like Qlik Replicate (CDC). Supporting future phases involving data science and machine learning enablement. Tech Environment Platform: Azure Core Tools: Databricks, Delta Live Tables, Qlik Replicate (CDC) Architecture: Hybrid (on-prem + cloud) Data Modes: Real-time streaming & batch jobs More ❯

BI Engineer London - Hybrid up to £48k + Benefits Organisation: Global Food & Beverage (FTSE 250) TRIA are supporting a global Food & Beverage client who are building our their BI engineering capability and are on a mission to transform how data is used across the business. This new role offers the chance to own and define BI standards, bridge … the gap between BI and Data Engineering, and take ownership of Power BI licensing and governance. What you’ll be doing: Champion BI best practices across the organisation Act as the bridge between the BI team and Data Engineers Own Power BI licensing, governance, and rollout Build and optimise data pipelines Develop insightful dashboards and reports … using Power BI and DAX Help shape a data-driven culture in a business where no one currently owns BI! What we’re looking for: Strong technical background in BI and data engineering concepts Proven experience with Power BI and DAX Understanding of data pipelines and how they support reporting Ability to influence and educate stakeholders More ❯

BI Engineer London - Hybrid up to £48k + Benefits Organisation: Global Food & Beverage (FTSE 250) TRIA are supporting a global Food & Beverage client who are building our their BI engineering capability and are on a mission to transform how data is used across the business. This new role offers the chance to own and define BI standards, bridge … the gap between BI and Data Engineering, and take ownership of Power BI licensing and governance. What you’ll be doing: Champion BI best practices across the organisation Act as the bridge between the BI team and Data Engineers Own Power BI licensing, governance, and rollout Build and optimise data pipelines Develop insightful dashboards and reports … using Power BI and DAX Help shape a data-driven culture in a business where no one currently owns BI! What we’re looking for: Strong technical background in BI and data engineering concepts Proven experience with Power BI and DAX Understanding of data pipelines and how they support reporting Ability to influence and educate stakeholders More ❯

specialize in providing a seamless recruitment experience for clients and candidates, fostering innovation and professional growth. Our client is an established fintech scale-up transforming how digital platforms use data to support smarter financial decisions. They’ve grown rapidly across the UK, Europe, and North America, with backing from a respected investment group. Their culture is data-driven … Role We’re looking for a Senior Analytics Engineer to help build and evolve a world-class analytics environment. You’ll take ownership of designing, developing, and maintaining scalable data pipelines and models that power decision-making across multiple business areas. This is a hands-on technical role where you’ll bridge data engineering and analytics, working … closely with teams in product, finance, and technology to translate complex business questions into accessible, trustworthy datasets and visualisations. What You’ll Do Build and optimise robust data models in SQL and dbt Develop automated data pipelines and ensure strong data governance standards Partner with analysts, product managers, and engineers to develop data solutions and dashboards More ❯

specialize in providing a seamless recruitment experience for clients and candidates, fostering innovation and professional growth. Our client is an established fintech scale-up transforming how digital platforms use data to support smarter financial decisions. They’ve grown rapidly across the UK, Europe, and North America, with backing from a respected investment group. Their culture is data-driven … Role We’re looking for a Senior Analytics Engineer to help build and evolve a world-class analytics environment. You’ll take ownership of designing, developing, and maintaining scalable data pipelines and models that power decision-making across multiple business areas. This is a hands-on technical role where you’ll bridge data engineering and analytics, working … closely with teams in product, finance, and technology to translate complex business questions into accessible, trustworthy datasets and visualisations. What You’ll Do Build and optimise robust data models in SQL and dbt Develop automated data pipelines and ensure strong data governance standards Partner with analysts, product managers, and engineers to develop data solutions and dashboards More ❯

Data and Application Engineer 📍 Hybrid – 2 days/week in London 💰 Up to £65,000 + Bonus + Benefits Are you passionate about building data-driven solutions that empower business decisions? Our dedicated customer are looking for a Data and Application Engineer to join their dynamic team and help shape the future of their data strategy. … Your Role: You’ll collaborate across the business to deliver high-impact data, applications, and services. From designing ETL pipelines to automating key processes, you’ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong skills in Azure Data Factory, Databricks … Unity Catalogue, and SQL Server Practical knowledge of data modelling and ETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A collaborative, problem-solving mindset 💡 What You’ll Do: Build strong stakeholder relationships to shape effective data solutions Design and implement data models and ETL pipelines Develop and More ❯

Data and Application Engineer 📍 Hybrid – 2 days/week in London 💰 Up to £65,000 + Bonus + Benefits Are you passionate about building data-driven solutions that empower business decisions? Our dedicated customer are looking for a Data and Application Engineer to join their dynamic team and help shape the future of their data strategy. … Your Role: You’ll collaborate across the business to deliver high-impact data, applications, and services. From designing ETL pipelines to automating key processes, you’ll be at the heart of our data transformation journey. 🎯 What We’re Looking For: Proven experience in data engineering and solution design Strong skills in Azure Data Factory, Databricks … Unity Catalogue, and SQL Server Practical knowledge of data modelling and ETL development Hands-on coding and development with a focus on quality Excellent communication and stakeholder engagement skills A collaborative, problem-solving mindset 💡 What You’ll Do: Build strong stakeholder relationships to shape effective data solutions Design and implement data models and ETL pipelines Develop and More ❯

the flexibility of working from home. About Our Client: A forward-thinking boutique advisory firm, delivering impactful solutions to help financial institutions modernise, innovate, and stay competitive. Whether driving data-driven insights, implementing AI solutions, or architecting complex enterprise platforms, you’ll be at the heart of projects that influence the way these industries operate. Role Highlights: Position: Solutions … to £95,000 + bonus + benefits What You’ll Do: Work with clients to understand business goals, technical requirements, and regulatory considerations. Design and deliver innovative solutions — from data platforms, AI/ML models, and analytics pipelines to enterprise-grade architectures for banking, insurance, and trading systems. Lead or contribute to teams delivering transformation projects such as core … digital integration. What We’re Looking For: Proven experience in Financial Services, Insurance, Capital Markets, or Core Banking. Solution Architecture (designing scalable, secure, and high-performance enterprise systems), or Data/AI (data engineering, data science, AI/ML, analytics solutions). Strong communication skills with the ability to engage business and technical stakeholders. Comfortable working More ❯

establish Analytics engineers best practices Helping the client migrate from tableau to omni Work with our clients’ teams to address their business challenges, define successful analytics outcomes and develop data models to address them. Collaborate with data engineers, analytics engineers, and other analytics team members to define the scope and requirements of analytical projects. Stay up to date … with the latest technologies and tools in analytics engineering and contribute to the growth of Lenstra’s analytics capabilities. Skills needed for the role Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, Statistics, or related field. 4+ years of experience in data engineering, analytics engineering, or a related field. Excellent analytical and … with the ability to work in a team environment. Ability to manage multiple priorities and work effectively. Strong experience with dbt and Snowflake. Experience with Omni implementation Experience with data modelling, ELT processes, and data warehousing. Familiarity with data visualisation tools such as Looker, Power BI, or similar. Fluent in English Application process an introductory call with More ❯

establish Analytics engineers best practices Helping the client migrate from tableau to omni Work with our clients’ teams to address their business challenges, define successful analytics outcomes and develop data models to address them. Collaborate with data engineers, analytics engineers, and other analytics team members to define the scope and requirements of analytical projects. Stay up to date … with the latest technologies and tools in analytics engineering and contribute to the growth of Lenstra’s analytics capabilities. Skills needed for the role Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, Statistics, or related field. 4+ years of experience in data engineering, analytics engineering, or a related field. Excellent analytical and … the ability to work in a team environment. Ability to manage multiple priorities and work effectively. Strong experience with dbt and Snowflake . Experience with Omni implementation Experience with data modelling, ELT processes, and data warehousing. Familiarity with data visualisation tools such as Looker , Power BI , or similar. Fluent in English Application process an introductory call with More ❯

Senior Data Engineer - Python, SQL, Airflow, BigQuery, DBT, GCP I've partnered with a high growth Product led tech company based in Central London, who are expanding their Data function, and are looking for a highly skilled, Senior Data Engineer to join their team. In this role, you'll be reporting directly to the Head of Engineering, where the Infrastructure and Data Platform will be the focus, building robust and highly scalable Data Pipelines, whilst working with stakeholders across the business, to help make data driven decisions. Senior Data Engineer - Python, SQL, Airflow, BigQuery, DBT, GCP Key skills and experience required: 4+ years of experience in Data Engineering Python & SQL … GCP BigQuery Airflow DBT Familiarity with Data Ingestion (ideally in a SaaS context) Product mindset This role is a hybrid role with 3-days a week required in Central London offices Base salary of £75k-£100k depending on skills and experience Bonus + excellent benefits package included Apply for more information! Senior Data Engineer - Python, SQL, Airflow, BigQuery More ❯

Senior Data Scientist | Lead Data Scientist | Data Engineering | Machine Learning | Cloud Computing | SC Cleared or Clearable | 2 days a week | £85,000 plus 15% bonus I am currently working with a brilliant consultancy with deep expertise in their field of Data and Cyber Security solutions, predominantly with Central Government organisations but they also have strong … a result they are involved in some of the most challenging yet rewarding large scale technical projects in the country. They are currently looking for a Senior or Lead Data Scientist, this will be a blend of client facing skills aka, the ability to understand business problems, create a novel models/solutions to help that client and communicate … clearly with them the solution you have found, this combined with strong analytics/machine learning skills and a base understanding of engineering principles is the core of the role. This role will focus on you being the main POC for major clients combined with technical leadership of the wider team across various projects. Key Skills Excellent knowledge of More ❯

Senior Data Scientist | Lead Data Scientist | Data Engineering | Machine Learning | Cloud Computing | SC Cleared or Clearable | 2 days a week | £85,000 plus 15% bonus I am currently working with a brilliant consultancy with deep expertise in their field of Data and Cyber Security solutions, predominantly with Central Government organisations but they also have strong … a result they are involved in some of the most challenging yet rewarding large scale technical projects in the country. They are currently looking for a Senior or Lead Data Scientist, this will be a blend of client facing skills aka, the ability to understand business problems, create a novel models/solutions to help that client and communicate … clearly with them the solution you have found, this combined with strong analytics/machine learning skills and a base understanding of engineering principles is the core of the role. This role will focus on you being the main POC for major clients combined with technical leadership of the wider team across various projects. Key Skills Excellent knowledge of More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and upskilling … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real More ❯

Senior Data Engineer – Winchester/London (Hybrid) - £84,000 + 10% bonus 1-2dpw in office | Greenfield Enterprise Data Platform Build | Flexible Working | Private Medical Ada Meher are working with the market leader in Digital Telecommunication & Broadcasting technology solutions as they recruit for a Senior Data Engineer to join them on their migration project from on … prem to an AWS based Enterprise Data Platform. The successful candidate will be working hands on with batch and streaming pipelines, designing systems from scratch and taking a more strategic view of the future roadmap.The business are flexible in nature, with a commitment to work-life balance that allows employees to work the hours that suit them around life … a presence in either the Winchester or Central London offices 1-2 days a week – based business need. To Be Considered: Demonstrable expertise and experience working on large-scale Data Engineering projects Strong experience in Python/PySpark, Databricks & Apache Spark Hands on experience with both batch & streaming pipelines Strong experience in AWS and associated tooling (Eg, S3 More ❯

models) for real-world enterprise use cases. Build and fine-tune LLM-based applications such as: Chatbots Document Q&A systems Report generators Code assistants Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or … through model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

models) for real-world enterprise use cases. Build and fine-tune LLM-based applications such as: Chatbots Document Q&A systems Report generators Code assistants Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or … through model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. -Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). -Strong understanding of data engineering, data pipelines, and ETL workflows. -Excellent problem-solving, communication, and stakeholder engagement skills. -Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

Principal Data Engineer – Winchester/London (Hybrid) - £84,000 + 10% bonus 1-2dpw in office | Greenfield Enterprise Data Platform Build | Flexible Working | Private Medical Ada Meher are working with the market leader in Digital Telecommunication & Broadcasting technology solutions as they recruit for a Principal Data Engineer to join them on their migration project from on … prem to an AWS based Enterprise Data Platform. The successful candidate will be working hands on with batch and streaming pipelines, designing systems from scratch and taking a more strategic view of the future roadmap.The business are flexible in nature, with a commitment to work-life balance that allows employees to work the hours that suit them around life … a presence in either the Winchester or Central London offices 1-2 days a week – based business need. To Be Considered: Demonstrable expertise and experience working on large-scale Data Engineering projects Strong experience in Python/PySpark, Databricks & Apache Spark Hands on experience with both batch & streaming pipelines Strong experience in AWS and associated tooling (Eg, S3 More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images, video … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience More ❯

We’re hiring an AI Data Engineer to turn 3D assets and visuals into high-quality datasets for next-gen AI in digital play. Own the full data pipeline and help build scalable, creative systems at the crossroads of AI, data, and fun RESPONSIBILITIES Design and operate data ingestion pipelines for 3D assets, geometry, images, video … annotation vendors, and automate quality checks to ensure scalable, reliable datasets. Define schemas and metadata for digital assets, maintaining catalogues, lineage, and versioning to ensure reproducibility and governance. Enforce data quality, drift detection, and compliance (GDPR/COPPA), including watermarking and traceability to safeguard IP and user privacy. Collaborate with AI infrastructure engineers to optimize data storage and … compute performance for large-scale processing. Work with AI engineers to define data specifications, support experimentation, and integrate active learning loops that improve AI models over time. REQUIREMENTS 2 years of proven experience in data engineering for ML/AI, with strong proficiency in Python, SQL, and distributed data processing (e.g., PySpark). Hands-on experience More ❯

models) for real-world enterprise use cases. Build and fine-tune LLM-based applications such as: - Chatbots - Document Q&A systems - Report generators - Code assistants - Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or … through model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯

models) for real-world enterprise use cases. Build and fine-tune LLM-based applications such as: - Chatbots - Document Q&A systems - Report generators - Code assistants - Summarization tools Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or … through model compression, quantization, and API optimization. Ensure compliance with AI ethics, security, and governance standards. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Pinecone, Weaviate, FAISS, Chroma) for semantic search and retrieval. Partner with business stakeholders to identify and shape impactful … Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. Knowledge of MLOps tools and practices (e.g., MLflow, Kubeflow, Vertex AI, Azure ML). Strong understanding of data engineering, data pipelines, and ETL workflows. Excellent problem-solving, communication, and stakeholder engagement skills. Bachelor's or Master's degree in Computer Science, AI/ML, Data More ❯