1 to 25 of 74 Senior Data Engineer Jobs in London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing … specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing … specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing … specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform … for economic data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing … specifically Azure), and experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

Senior Data Engineer (Python AWS Data Lake) London/WFH to £80k Are you a data technologist with fluent Python coding skills who enjoys working with and continually learning new technologies? You could be progressing your career in a senior, hands-on role at a 'Tech for Good' company that is enabling life changing … education to be accessed by millions of students across the globe (currently 22 countries and growing). As a Data Engineer you'll help to design, build and operate the data pipelines and data services that power learning experiences. Collaborating with software engineers, data scientists and product managers, you will grow your expertise while contributing … experiences as well as reporting and analytics requirements across the business as it scales to 10's of millions of students. Typically you'll be developing and maintaining reliable data pipelines for both real-time streaming and batch workloads, assisting with the evolution of the Lakehouse, collaborating with analytics, product and machine learning teams to make data accessible More ❯

Senior Data Engineer (Python AWS Data Lake) London/WFH to £80k Are you a data technologist with fluent Python coding skills who enjoys working with and continually learning new technologies? You could be progressing your career in a senior, hands-on role at a "Tech for Good" company that is enabling life changing … education to be accessed by millions of students across the globe (currently 22 countries and growing). As a Data Engineer you'll help to design, build and operate the data pipelines and data services that power learning experiences. Collaborating with software engineers, data scientists and product managers, you will grow your expertise while contributing … experiences as well as reporting and analytics requirements across the business as it scales to 10's of millions of students. Typically you'll be developing and maintaining reliable data pipelines for both real-time streaming and batch workloads, assisting with the evolution of the Lakehouse, collaborating with analytics, product and machine learning teams to make data accessible More ❯

Senior Data Engineer (Python AWS Data Lake) London/WFH to £80k Are you a data technologist with fluent Python coding skills who enjoys working with and continually learning new technologies? You could be progressing your career in a senior, hands-on role at a 'Tech for Good' company that is enabling life changing … students across the globe (currently 22 countries and growing). Make sure to apply with all the requested information, as laid out in the job overview below. As a Data Engineer you'll help to design, build and operate the data pipelines and data services that power learning experiences. Collaborating with software engineers, data scientists … experiences as well as reporting and analytics requirements across the business as it scales to 10's of millions of students. Typically you'll be developing and maintaining reliable data pipelines for both real-time streaming and batch workloads, assisting with the evolution of the Lakehouse, collaborating with analytics, product and machine learning teams to make data accessible More ❯

the relevant skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage … processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into … the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed Transforms raw More ❯

Senior Data Engineer Opportunity Salary: Up to £75k (Based on candidate experience) + Excellent benefits Work commute Model: Mostly remote with just 1 day per week on-site Location: London/Portsmouth Job Type: Permanent Ready to Shape the Future of Data? My client is a leading UK-based IT services and consulting company seeking an … experienced Senior Data Engineer who thrives on building robust, scalable systems that unlock the true potential of enterprise data. This is your opportunity to join their cutting-edge AI & Data team as a Senior Data Engineer . What you'll Be Doing Build & Optimise : Take ownership of Starburst (Trino) and Dell Data Lakehouse deployments, turning complex data ecosystems into seamless, high-performance platforms Connect Everything : Create unified data experiences by integrating diverse data sources across multiple environments Performance Mastery : Fine-tune containerised solutions for maximum scalability and lightning-fast query performance Secure by Design : Implement bulletproof security frameworks and ensure rock-solid compliance across all data touchpoints More ❯

Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP OB have partnered with a UK FinTech Unicorn, who's Data function is undergoing rapid growth, and in-turn are looking to grow their Data team, with 2 highly skilled Data Engineers. You'll be working on shaping the companies Data function, driving Data best practices, and collaborate with a variety of stakeholders to ensure the company are making Data driven decisions. Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP Tech Stack: Python & SQL DBT, AirFlow & BigQuery AWS/GCP ETL Pipelines Base salary of £90k-£115k depending on skills and … package including a sizeable bonus and stock options Hybrid working in Central London with 3-days a week required You must be UK based, and sadly sponsorship is unavailable Senior Data Engineer - FinTech Unicorn - Python, SQL, DBT, Airflow, AWS/GCP More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst … installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations, overseeing environment setup, configuration … maintenance, upgrades, and ensuring optimal performance. Configure various server and application settings and parameters. Integrate Starburst with various data sources to create a unified data platform. Design and tune the container solution for performance and scalability. Set up and configure data catalogs in various modes. Implement robust security controls for data access, ensure compliance with data More ❯

Senior Data Engineer Hybrid working - 1 day a week onsite in either London or Portsmouth Permanent - Up to £75k Overview: We are seeking a talented Senior Data Engineer specialising in Starburst (Trino) and Dell Data Lakehouse to join our AI & Data team. You will be responsible for deploying, maintaining and optimising Starburst … installations & Dell Data Lakehouse, enabling our clients to seamlessly access their data across multiple platforms. The ideal candidate will have excellent communication skills, an advanced understanding of Starburst & Dell Data Lakehouse, and proficiency with troubleshooting and root cause analysis. Responsibilities: Deploy and manage Starburst Enterprise/Galaxy and Dell Data Lakehouse installations, overseeing environment setup, configuration … maintenance, upgrades, and ensuring optimal performance. Configure various server and application settings and parameters. Integrate Starburst with various data sources to create a unified data platform. Design and tune the container solution for performance and scalability. Set up and configure data catalogs in various modes. Implement robust security controls for data access, ensure compliance with data More ❯

Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques … and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and … NoSQL databases. Experience with data quality and data governance processes. Experience with version control systems (e.g., Git). Experience with Agile development methodologies. Excellent communication, interpersonal, and problem-solving skills. Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs). Experience with data visualisation tools (e.g., Tableau, Power BI). Experience with DevOps tools and More ❯

Senior Data Engineer Salary up to £65,000 Remote First, in office 1 x a month This retailer is scaling their digital and analytics capabilities, they are looking for a Senior Data Engineer with deep expertise in the Azure ecosystem to help architect and optimise their modern data platform. In this critical role … you’ll design and maintain secure, scalable, and high-performance data pipelines and storage solutions. Working cross-functionally, you’ll enable data-driven decision-making across the business – from supply chain to customer insights. What You’ll Be Doing Design and manage scalable data pipelines using Azure Data Factory, Synapse Analytics, and Databricks. Optimise and structure … Azure Data Lake Storage Gen2 for performance, security, and scalability. Develop efficient data wrangling processes for structured and semi-structured data. Use SQL and Python to build robust data transformations and pipelines. Implement best practices in data governance and security using tools like Azure Key Vault, RBAC, Purview, and monitoring frameworks. Collaborate with analysts, BI developers More ❯

Senior Data Engineer Salary up to £65,000 Remote First, in office 1 x a month This retailer is scaling their digital and analytics capabilities, they are looking for a Senior Data Engineer with deep expertise in the Azure ecosystem to help architect and optimise their modern data platform. In this critical role … you’ll design and maintain secure, scalable, and high-performance data pipelines and storage solutions. Working cross-functionally, you’ll enable data-driven decision-making across the business – from supply chain to customer insights. What You’ll Be Doing Design and manage scalable data pipelines using Azure Data Factory, Synapse Analytics, and Databricks. Optimise and structure … Azure Data Lake Storage Gen2 for performance, security, and scalability. Develop efficient data wrangling processes for structured and semi-structured data. Use SQL and Python to build robust data transformations and pipelines. Implement best practices in data governance and security using tools like Azure Key Vault, RBAC, Purview, and monitoring frameworks. Collaborate with analysts, BI developers More ❯

Senior Data Engineer London | Permanent | Full-Time | Hybrid Working An excellent opportunity has arisen for a Senior Data Engineer to join a respected, international insurance and analytics organisation. In this role, you will design, develop, and maintain data solutions that enhance underwriting and claims decision-making, support operational improvements, and drive data-driven strategies across multiple specialty lines. This position is ideal for an experienced data engineering professional with strong insurance sector knowledge, looking to make a significant impact in a high-profile analytics function. About the Team The data and analytics team works across multiple international specialty lines, including cyber, energy, equine, marine, professional and financial risks, trade … credit, political risk and surety, and international casualty. Its remit covers: Data engineering and analytics Portfolio management Pricing model development The team is embedded within underwriting operations and plays a key role in achieving profitability and performance targets. What You'll Bring A collaborative, proactive, and solutions-focused mindset. Ability to influence and engage with stakeholders to ensure data More ❯

Senior Data Engineer UK Remote, £500/day, Outside IR35 A Senior Data Engineer is required by fast-growing HealthTech/Tech for Good start-up. This is a 3-month contract initially with scope for extension. In this role, you will design, build, and maintain robust data pipelines using streaming and batch … processing technologies and help to lead the modernization of their data lakehouse. You will implement and manage secure cloud infrastructure using AWS, championing a culture of data quality, security, and technical excellence. Key Responsibilities: Architect and maintain data pipelines (streaming & batch) Build and manage scalable data storage solutions (data lakehouse) Design and maintain secure AWS … cloud infrastructure Implement and manage CI/CD and DevOps pipelines Champion data quality, security, and best practices Collaborate with cross-functional teams Implement and manage MLOps capabilities Essential Skills: Advanced Python programming skills Expertise in data engineering tools and frameworks (Apache Flink) Hands-on AWS experience (Serverless, CloudFormation, CDK) Strong understanding of containerization, CI/CD, and More ❯

Senior Data Engineer Salary: around £75k-85k - plus a very attractive on top Location: London or Leeds - relaxed about hybrid working, if preferred About Us Sports forecasting company specializing in developing player level, play-by-play simulators that generate highly accurate, near-instant outcome projections for sporting events. Since its establishment, the company has focused on serving … has grown into a globally recognized leader in sports modelling and analytics. Purpose of role: The purpose of this role is to design, build, and maintain scalable and efficient data transformation workflows that empower the business with actionable insights and impactful visualisations. This role bridges the gap between data engineering and business intelligence by owning the transformation layer … and enabling clear, trusted, and timely analytics across the organisation. The successful candidate will have a strong grasp of modern data modelling practices, analytics tooling, and interactive dashboard development in Power BI and Plotly/Dash. Key responsibilities: Designing and maintaining robust data transformation pipelines (ELT) using SQL, Apache Airflow, or similar tools. Building and optimizing data More ❯

Senior Data Engineer Salary: around £75k-85k - plus a very attractive on top Location: London or Leeds - relaxed about hybrid working, if preferred About Us Sports forecasting company specializing in developing player level, play-by-play simulators that generate highly accurate, near-instant outcome projections for sporting events. Since its establishment, the company has focused on serving … has grown into a globally recognized leader in sports modelling and analytics. Purpose of role: The purpose of this role is to design, build, and maintain scalable and efficient data transformation workflows that empower the business with actionable insights and impactful visualisations. This role bridges the gap between data engineering and business intelligence by owning the transformation layer … and enabling clear, trusted, and timely analytics across the organisation. The successful candidate will have a strong grasp of modern data modelling practices, analytics tooling, and interactive dashboard development in Power BI and Plotly/Dash. Key responsibilities: Designing and maintaining robust data transformation pipelines (ELT) using SQL, Apache Airflow, or similar tools. Building and optimizing data More ❯

Senior Data Engineer Salary: around £75k-85k - plus a very attractive on top Location: London or Leeds - relaxed about hybrid working, if preferred About Us Sports forecasting company specializing in developing player level, play-by-play simulators that generate highly accurate, near-instant outcome projections for sporting events. Since its establishment, the company has focused on serving … has grown into a globally recognized leader in sports modelling and analytics. Purpose of role: The purpose of this role is to design, build, and maintain scalable and efficient data transformation workflows that empower the business with actionable insights and impactful visualisations. This role bridges the gap between data engineering and business intelligence by owning the transformation layer … and enabling clear, trusted, and timely analytics across the organisation. The successful candidate will have a strong grasp of modern data modelling practices, analytics tooling, and interactive dashboard development in Power BI and Plotly/Dash. Key responsibilities: Designing and maintaining robust data transformation pipelines (ELT) using SQL, Apache Airflow, or similar tools. Building and optimizing data More ❯

Senior Data Engineer Salary: around £75k-85k - plus a very attractive on top Location: London or Leeds - relaxed about hybrid working, if preferred About Us Sports forecasting company specializing in developing player level, play-by-play simulators that generate highly accurate, near-instant outcome projections for sporting events. Since its establishment, the company has focused on serving … has grown into a globally recognized leader in sports modelling and analytics. Purpose of role: The purpose of this role is to design, build, and maintain scalable and efficient data transformation workflows that empower the business with actionable insights and impactful visualisations. This role bridges the gap between data engineering and business intelligence by owning the transformation layer … and enabling clear, trusted, and timely analytics across the organisation. The successful candidate will have a strong grasp of modern data modelling practices, analytics tooling, and interactive dashboard development in Power BI and Plotly/Dash. Key responsibilities: Designing and maintaining robust data transformation pipelines (ELT) using SQL, Apache Airflow, or similar tools. Building and optimizing data More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯

a different format of this document, please get in touch with at UKI.recruitment@tcs.com or call TCS London Office number 02031552100 with the subject line: “ Application Support Request” Role: Senior GCP Data Engineer. Job Type: Permanent Location: London, UK (Hybrid - 2 days WFO) Number of hours: 40 hours per week – full time We have an exciting opportunity for … you as a GCP Data Engineer. Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and … innovation and thought leadership. Gain access to endless learning opportunities. Lead projects and inspire both colleagues and stakeholders. Lead a team and their technical growth. The Role As a Senior GCP Data Engineer you will be responsible for providing top-tier data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key More ❯