1 to 25 of 37 Senior Data Engineer Jobs in the City of London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing … specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing … specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data More ❯

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. … This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data Engineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or … If you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write More ❯

Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior Data Engineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. … This role suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced Data Engineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or … If you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior Data Engineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. … You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Senior Data Engineer (SQL BigQuery GCP) London/WFH to £110,000 Are you a data technologist with Media Streaming experience? You could be progressing your career in a senor, hands-on role at one of Europe's most successful streaming and social media platforms. What's in it for you: Salary to £110k Employee stock … of the time if desired (x1 month in London) A sociable office environment with free snacks, drinks and lunch if you are in the office Your role: As a Senior Data Engineer you'll design, build and maintain high-performance services for content modelling, serving and integration, develop data pipelines (both batch and streaming) using cloud … native tools and collaborate on rearchitecting the content model to support rich metadata. You'll also build and implement APIs and data services to expose the data to other teams across the business and work with IaC (Terraform) and CI/CD pipelines for deployment and automation. Location/WFH: You'll be able to work from home More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic … Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with More ❯

Senior Data Engineer - Azure, Healthcare A Global Healthcare Leader based in Burton Upon Trent is currently searching for a Senior Data Engineer to help support a greenfield implementation of Databricks and further support the advancement of their modern data platform. The successful applicant will work closely with the Director of Analytics and Strategic … Data Manager and be responsible for implementing data pipelines in Azure Data Factory and Azyre Databricks, supporting Darewhaoure implementation and ETL process. Location: Hybrid in London Salary: £55,000 to £65,000 + Benefits To be considered: Minimum 3 years of experience working as a Data Engineer within an Azure Environment. Prior experience working with More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next … generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer | Modern Data Platforms | AWS | Generative AI Location: Flexible London-based | Hybrid No sponsorship Are you passionate about shaping the future of data infrastructure and driving digital transformation? We’re partnering with a leading organisation at the forefront of innovation, leveraging cutting-edge technologies to modernise their data landscape and build next … generation data platforms. They’re now looking for an experienced Senior Data Engineer to join a forward-thinking team and play a key role in advancing their cloud and analytics capabilities across multiple business domains, including Finance, Regulatory, Legal and Sustainability. What You’ll Be Doing Design, develop, test and support robust data-driven solutions … scalable technical solutions, working closely with architects and cross-functional teams. Build sophisticated reporting solutions and drive the adoption of generative AI to enable intuitive self-service analytics. Enhance data engineering processes through automation, CI/CD pipelines and optimized ETL/ELT workflows. Experiment with new tools, technologies and approaches to support the organisation’s analytics and insights More ❯

Senior Data Engineer – Winchester/London (Hybrid) - £84,000 + 10% bonus 1-2dpw in office | Greenfield Enterprise Data Platform Build | Flexible Working | Private Medical Ada Meher are working with the market leader in Digital Telecommunication & Broadcasting technology solutions as they recruit for a Senior Data Engineer to join them on their … migration project from on-prem to an AWS based Enterprise Data Platform. The successful candidate will be working hands on with batch and streaming pipelines, designing systems from scratch and taking a more strategic view of the future roadmap.The business are flexible in nature, with a commitment to work-life balance that allows employees to work the hours that … a presence in either the Winchester or Central London offices 1-2 days a week – based business need. To Be Considered: Demonstrable expertise and experience working on large-scale Data Engineering projects Strong experience in Python/PySpark, Databricks & Apache Spark Hands on experience with both batch & streaming pipelines Strong experience in AWS and associated tooling (Eg, S3, Glue More ❯

Senior Data Engineer London (Hybrid) Up to £80k DOE About the Company We’re partnered with a rapidly scaling AI-driven SaaS business that helps global enterprises unlock the potential of their data. They are entering a really exciting next phase of expansion - scaling their platform, deepening automation and developing their AI solutions. About the Role This … business is looking to hire a very talented Senior Data Engineer to take a leading role in building and scaling the data foundations of the platform. You’ll combine strong SQL and Python skills with a DevOps mindset, architecting pipelines, automating workflows, and ensuring AI outputs are production-ready. Requirements 3+ years’ experience in Data Engineering or Data Platform development Experience working with First-Party Data Strong SQL and Python fluency (data transformations, orchestration, automation) Expertise in data modelling (dimensional, event-based, ML-aligned) Experience with helping to build ML models and orchestrating into production Familiarity with cloud ecosystems - Azure, AWS, or GCP Experience with CI/CD tools (Azure More ❯

Senior Data Engineer London (Hybrid) Up to £80k DOE About the Company We’re partnered with a rapidly scaling AI-driven SaaS business that helps global enterprises unlock the potential of their data. They are entering a really exciting next phase of expansion - scaling their platform, deepening automation and developing their AI solutions. About the Role This … business is looking to hire a very talented Senior Data Engineer to take a leading role in building and scaling the data foundations of the platform. You’ll combine strong SQL and Python skills with a DevOps mindset, architecting pipelines, automating workflows, and ensuring AI outputs are production-ready. Requirements 3+ years’ experience in Data Engineering or Data Platform development Experience working with First-Party Data Strong SQL and Python fluency (data transformations, orchestration, automation) Expertise in data modelling (dimensional, event-based, ML-aligned) Experience with helping to build ML models and orchestrating into production Familiarity with cloud ecosystems - Azure, AWS, or GCP Experience with CI/CD tools (Azure More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯

Lead Data Engineer £90,000–£100,000 Central London | Hybrid (3 days on-site) A leading European intellectual property firm is seeking a "Lead Data Engineer" to join its Technology & Innovation team. The firm partners with some of the world’s most innovative and successful organisations, helping to improve lives by supporting creativity, technology, and progress. … diversity, inclusion, and social mobility, and actively champions wellbeing and community engagement across all areas of the business. 🚀 The Opportunity Reporting to the Director of Technology & Innovation, the "Lead Data Engineer" will play a pivotal role in shaping the firm’s data and analytics landscape. The successful candidate will lead a high-performing team responsible for designing … building, and optimising scalable, cloud-based data platforms that drive business intelligence, AI innovation, and data-informed decision-making across the firm. This senior role combines hands-on technical expertise with strategic leadership, offering the opportunity to define the data vision and enable meaningful business transformation. Key Responsibilities Lead the design and implementation of a modern More ❯

Lead Data Engineer £90,000–£100,000 Central London | Hybrid (3 days on-site) A leading European intellectual property firm is seeking a "Lead Data Engineer" to join its Technology & Innovation team. The firm partners with some of the world’s most innovative and successful organisations, helping to improve lives by supporting creativity, technology, and progress. … diversity, inclusion, and social mobility, and actively champions wellbeing and community engagement across all areas of the business. 🚀 The Opportunity Reporting to the Director of Technology & Innovation, the "Lead Data Engineer" will play a pivotal role in shaping the firm’s data and analytics landscape. The successful candidate will lead a high-performing team responsible for designing … building, and optimising scalable, cloud-based data platforms that drive business intelligence, AI innovation, and data-informed decision-making across the firm. This senior role combines hands-on technical expertise with strategic leadership, offering the opportunity to define the data vision and enable meaningful business transformation. Key Responsibilities Lead the design and implementation of a modern More ❯

Location - London, Bristol or Manchester (1 day a month onsite) Duration - 6 months Rate - £550 - £600pd (inside ir35) As a Data Engineer in the Cyber and Domains Protection Team you will: Work within an Agile team to support the development of dashboards and build automated reports to meet the needs of technical and non-technical users Work with … the data analyst and user researcher to update relevant data models to allow business intelligence data to meet the organisation's specific needs Develop business intelligence reports that can be automated, reused and shared with users directly Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems Build accessible data for analysis Deliver data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future-proof Investigate problems in systems, processes and services This role aligns to the Data Analyst role in the Government Digital and Data Profession Capability Framework. At this role level, your skills include: Applying statistical and analytical tools More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering within a … forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL More ❯

Senior Data Engineer – Insurance Sector Location: Hybrid (London-based with flexible working) Salary: £85K -£100K – this is dependent on skills and experience Join a growing data team that’s transforming how the insurance industry uses data to make smarter, faster decisions. As a Senior Data Engineer , you’ll design and deliver scalable … high-performing data solutions that power analytics, reporting, and risk insights across the business. You’ll work closely with analysts, actuaries, and underwriters to build pipelines, models, and architectures that bring structure, speed, and accuracy to complex insurance data. This is a fantastic opportunity to make a real impact while shaping the future of data engineering within a … forward-thinking organisation. What You’ll Be Doing Partnering with analysts and product owners to turn business needs into scalable data solutions. Designing and maintaining robust data pipelines and models for analytics and reporting. Applying best practices in data architecture, security, and performance. Working with modern tools including Azure, Databricks, Python, Azure DevOps, Unity Catalog, and SQL More ❯

Senior Data Engineer - London - £85-90K - Investment Management/Asset Management Power BI/MS Fabric/SQL/Python # A Senior Data Engineer is required to join an Investment Management client in London. Ideally you will have have Investment or Asset Management experience. We’re looking for someone who brings the … following skills and experiences: Proven experience in managing complex databases and developing API interfaces. Strong proficiency in SQL and Python for data processing and automation. Ability to handle large-scale data operations involving millions of data points daily. Advanced Excel, SQL, and experience of reporting and business intelligence tools preferably Power BI. Experience in leading projects. Apply More ❯

Senior Data Engineer - London - £85-90K - Investment Management/Asset Management Power BI/MS Fabric/SQL/Python # A Senior Data Engineer is required to join an Investment Management client in London. Ideally you will have have Investment or Asset Management experience. We’re looking for someone who brings the … following skills and experiences: Proven experience in managing complex databases and developing API interfaces. Strong proficiency in SQL and Python for data processing and automation. Ability to handle large-scale data operations involving millions of data points daily. Advanced Excel, SQL, and experience of reporting and business intelligence tools preferably Power BI. Experience in leading projects. Apply More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time More ❯

Senior Data Engineer - Hybrid - Contract - Outside IR35 Our client is expanding their core data engineering function and hiring two Senior Data Engineers to strengthen a modern, scalable data platform. Both will be Databricks specialists, with one role focused on deep technical delivery and the other combining hands-on engineering with team leadership and … Live Tables (DLT) pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and … automate deployments. (For leadership-focused role) Mentor and upskill engineers, define coding standards, and embed engineering excellence across the team. What’s Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time More ❯

Up to £75k 1 day per week onsite Central London Senior Data Engineer Opportunity: Permanent Salary: Up to £75k Hybrid: 1 day per week onsite Office Location: Central LondonOur client, a UK-based fintech operating an AI-powered intelligent commerce platform, is seeking a Senior Data Engineer to build and maintain the data infrastructure that drives AI-enabled decision-making across their global operations. You'll design the data systems that underpin both strategic business intelligence and advanced AI capabilities. Key Responsibilities Design and build data warehouse solutions that support business objectives with optimal performance Develop, implement, and maintain robust ELT pipelines consuming data from internal systems and external … partners Partner with business stakeholders and customers to unlock data insights and build impactful analytical models Investigate and resolve system defects, respond to production incidents, and conduct thorough code reviews Provide technical leadership by staying current with emerging technologies and mentoring team members Technical Skills Strong expertise in SQL and database architecture Practical experience with data warehousing platforms More ❯