1 to 25 of 43 Senior Data Engineer Jobs in London

Senior Data Engineer/Technical Lead Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Bonus An excellent opportunity is available for a Senior Data Engineer/Technical Lead looking to move into a Management/Leadership position. This is an exciting newly created hands-on Data Engineer Managers post that will be responsible for leading and mentoring a small team of Data Engineers whilst overseeing data platform development and optimisation. Our client is a well-established and rapidly growing global ecommerce business with its headquarters based in London. Having implemented a new MS Fabric based Data platform, the need is now to scale … up to meet the demand to deliver data driven insights and strategies right across the business globally. The role will require someone that's happy to be hands-on (potentially up to 50% of the time) as you'll be troubleshooting, doing code reviews, steering the team through deployments, acting as an escalation point for technical issues etc. Key More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the … development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an experienced Data Engineer within financial services environments You have expertise with AWS including More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the … development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: * You are an experienced Data Engineer within financial services environments * You have expertise with AWS including More ❯

company that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … We're underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP, but we also work on systems More ❯

the relevant skills and experience, we're looking for people who are innovative, commercial and value the work that they do. Our London office is currently looking for a Senior Data Engineer. The Role The Senior Data Engineer will be responsible for designing, developing, and maintaining the infrastructure and systems required for data storage … processing, and analysis. They play a crucial role in building and managing the data pipelines that enable efficient and reliable data integration, transformation, and delivery for all data users across the enterprise. Key Responsibilities Designs and develops data pipelines that extract data from various sources, transform it into the desired format, and load it into … the appropriate data storage systems Collaborates with data scientists and analysts to optimize models and algorithms for data quality, security, and governance Integrates data from different sources, including databases, data warehouses, APIs, and external systems Ensures data consistency and integrity during the integration process, performing data validation and cleaning as needed Transforms raw More ❯

Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Strong proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques … and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and … NoSQL databases. Experience with data quality and data governance processes. Experience with version control systems (e.g., Git). Experience with Agile development methodologies. Excellent communication, interpersonal, and problem-solving skills. Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs). Experience with data visualisation tools (e.g., Tableau, Power BI). Experience with DevOps tools and More ❯

Data Engineer | Python | SQL | AWS | Terraform | Docker Senior Data Engineer Up to £105,000 + Equity & Benefits London - Fully-remote Method Resourcing have partnered with a rapidly scaling SaaS business to help them find their first Data Engineering hire. This is a fantastic time to be joining a business with ambitious plans for their … technology over the coming years. You will be an IC-level member of the technical team, with responsibility for the development, scaling and ownership of their data estate. On top of data storage solutions and pipeline development. We are looking for a highly experienced Data Engineer who can demonstrate strong technical acumen in: Significant experience as … a Data Engineer - Ideally as an IC, or part of a small team Python and SQL fluency Expertise in AWS, particularly managed storage solutions Cloud infrastructure such as Docker, K8s and Terraform We are offering this role at a range of up to £105,000 for the right candidate. This is a fully-remote role. RSG Plc is More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … with direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … Your work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … with direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … Your work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … with direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … Your work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … with direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … Your work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior AWS Data Engineer - Greenfield Market Data Platform | London | Vice President Level Location: London - Canary Wharf (Hybrid: 2-3 days/week in office) Salary: Up to around £120,000 + Bonus + Benefits Employment Type: Permanent Industry: Financial Services We're working with a prestigious financial services client on a greenfield data engineering opportunity … that's set to transform how market data is accessed and used across the business. This is a rare chance to join a high-impact initiative at its inception, designing and building a cutting-edge Market Data Store (MDS) platform using the latest cloud technologies. This individual contributor role is ideal for a hands-on Senior Data Engineer who thrives in technically complex environments and enjoys solving large-scale data pipeline challenges. You'll work with tools like AWS Glue, PySpark, Iceberg, Databricks, and Snowflake , collaborating with data scientists and stakeholders across multiple business units. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures. Implement secure and efficient data More ❯

Senior AWS Data Engineer - Greenfield Market Data Platform | London | Vice President Level Location: London - Canary Wharf (Hybrid: 2-3 days/week in office) Salary: Up to around £120,000 + Bonus + Benefits Employment Type: Permanent Industry: Financial Services We're working with a prestigious financial services client on a greenfield data engineering opportunity … that's set to transform how market data is accessed and used across the business. This is a rare chance to join a high-impact initiative at its inception, designing and building a cutting-edge Market Data Store (MDS) platform using the latest cloud technologies. This individual contributor role is ideal for a hands-on Senior Data Engineer who thrives in technically complex environments and enjoys solving large-scale data pipeline challenges. You'll work with tools like AWS Glue, PySpark, Iceberg, Databricks, and Snowflake , collaborating with data scientists and stakeholders across multiple business units. Key Responsibilities: Design, build, and maintain scalable data pipelines and architectures. Implement secure and efficient data More ❯

About the role: We're looking for a Senior Data Engineer to join the Data & Analytics team at Holland & Barrett. This is a high-impact, mid-seniority role within our growing data function, where you'll design, build, and scale modern data solutions on AWS. You'll work closely with cross-functional teams including … Data Science, BI, and Product Analytics to develop cloud-native, scalable data infrastructure powering advanced analytics and machine learning. As a Senior Engineer, you'll not only deliver code — you'll take ownership, lead small teams, mentor others, and contribute to shaping our engineering culture and best practices. You'll join a team of Data Engineers, reporting to the Senior Data Engineering Manager. You'll work alongside Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI/CD More ❯

Senior AWS Data Engineer I am working with a leading organisation that is embarking on a greenfield initiative to revolutionise how their data is accessed and utilised. As part of this transformation, they're looking for a highly skilled Senior AWS Data Engineer to join their team and help design and build a … cutting-edge data platform. This is a rare opportunity to work on a high-impact project, collaborating with multiple business units and leveraging modern technologies such as Databricks and Snowflake. You'll be at the forefront of solving complex data pipeline challenges while contributing to strategic data architecture decisions. As part of this role, you will be … responsible for some of the following areas: Design and build scalable data pipelines using AWS technologies Collaborate with cross-functional teams to deliver robust data solutions Implement best practices for data governance, quality, and security Process and analyse large datasets using Python and SQL Support the deployment and optimisation of data platforms including Databricks and Snowflake More ❯

Senior AWS Data Engineer I am working with a leading organisation that is embarking on a greenfield initiative to revolutionise how their data is accessed and utilised. As part of this transformation, they're looking for a highly skilled Senior AWS Data Engineer to join their team and help design and build a … cutting-edge data platform. This is a rare opportunity to work on a high-impact project, collaborating with multiple business units and leveraging modern technologies such as Databricks and Snowflake. You'll be at the forefront of solving complex data pipeline challenges while contributing to strategic data architecture decisions. As part of this role, you will be … responsible for some of the following areas: Design and build scalable data pipelines using AWS technologies Collaborate with cross-functional teams to deliver robust data solutions Implement best practices for data governance, quality, and security Process and analyse large datasets using Python and SQL Support the deployment and optimisation of data platforms including Databricks and Snowflake More ❯

combine private and commercial banking, wealth planning and investment management. We believe in traditional relationship and service-led banking powered by modern technology. Job purpose Develop and maintain complex data systems that support the Bank's operations and reporting needs, ensuring they meet all essential data requirements, following strong engineering and automation best practices and collaborating with the … Technical Lead for Data Engineering to develop innovative solutions that address business needs. As a Senior Data Engineer this person will also play a key role in the development of less experienced members of the team day to day. To place the interests of customers at the centre of all activities, act in a way that … is consistent with achieving good outcomes for consumers; and to comply with the FCA and PRA's Conduct Rules. Key Responsibilities The development of data ingest, transformation, analytics, and data publishing pipelines, facilitating complex data transformations to meet business requirements, ensuring optimal performance and efficiency of the data platform. Support for the live platform day to More ❯

Senior AWS Data Engineer - London - £125,000 Please note - this role will require you to work from the London based office. You must have the unrestricted right to work in the UK to be eligible for this role. This organisation is not able to offer sponsorship. An exciting opportunity to join a greenfield initiative focused on transforming … how market data is accessed and utilised. As a Senior AWS Data Engineer, you'll play a key role in designing and building a cutting-edge data platform using technologies like Databricks, Snowflake, and AWS Glue. Key Responsibilities: Build and maintain scalable data pipelines, warehouses, and lakes. Design secure, high-performance data architectures. … Develop processing and analysis algorithms for complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and analysis. Deep understanding of data governance More ❯

Senior AWS Data Engineer - London - £125,000 Please note - this role will require you to work from the London based office. You must have the unrestricted right to work in the UK to be eligible for this role. This organisation is not able to offer sponsorship. An exciting opportunity to join a greenfield initiative focused on transforming … how market data is accessed and utilised. As a Senior AWS Data Engineer, you'll play a key role in designing and building a cutting-edge data platform using technologies like Databricks, Snowflake, and AWS Glue. Key Responsibilities: Build and maintain scalable data pipelines, warehouses, and lakes. Design secure, high-performance data architectures. … Develop processing and analysis algorithms for complex data sets. Collaborate with data scientists to deploy machine learning models. Contribute to strategy, planning, and continuous improvement. Required Experience: Hands-on experience with AWS data tools: Glue, PySpark, Athena, Iceberg, Lake Formation. Strong Python and SQL skills for data processing and analysis. Deep understanding of data governance More ❯

fast-evolving Lloyds managing agent thats leading the way across multiple lines, including Property, Casualty, and Specialty. As part of a major transformation, theyre building a modern, business-driven data platform from the ground up and theyre looking for a Senior Data Engineer to help shape it. About the Business This Lloyds managing agent is authorised … and regulated by the PRA and FCA, managing a high-performing syndicate. They are known for underwriting excellence and are investing heavily in data and technology to support their long-term growth. Why this role? You'll play a key role in delivering a robust, scalable data platform that unlocks better MI, improves data quality, and drives … automation across the business. Youll work closely with teams across Actuarial, Finance, and IT helping to bring their data needs to life. This is a genuinely exciting opportunity to influence the data direction of a Lloyds business, not just maintain it. Key responsibilities: Design and build Data Lake and Data Warehouse solutions Create scalable, automated batch More ❯

At Macquarie, our Data Services Team drives innovation by delivering a diverse suite of data products that empower data-driven decision-making and enhance operational efficiency. With a strong focus on engineering, data science, and analytics, the team delivers innovative solutions that empower business users, primarily trading teams, to tackle complex challenges and unlock new opportunities. … unbroken profitability. You'll be part of a friendly and supportive team where everyone-regardless of role-contributes ideas and drives outcomes. What role will you play? As a Data Platform Engineer, you will play a pivotal role in designing, building, and optimising a cutting-edge, petabyte-scale data platform powered by modern cloud technologies. You will … manage and enhance a petabyte-scale Data Lake and create secure, efficient, and scalable environments for our data platforms. Leveraging cloud-native technologies and AWS tools such as AWS S3, EKS, Glue, Airflow, Trino, and Parquet, you will prepare to adopt Apache Iceberg for greater performance and flexibility. You'll address high-performance data workloads, ensuring seamless More ❯

VP AWS Data Engineer - Strategic Data Leadership - London - Hybrid Are you a visionary data engineering leader ready to architect the future of market data infrastructure? A global financial institution is seeking a Vice President - AWS Data Engineering to spearhead the development of a next-generation Market Data Store (MDS). This greenfield initiative … offers a rare opportunity to shape the platform from the ground up, leveraging technologies like Databricks, Snowflake, and AWS Glue to solve one of the most complex data challenges in banking. What makes this role stand out? Strategic ownership of a high-impact data platform initiative. Influence cross-functional teams and senior stakeholders. Drive innovation in data architecture, governance, and analytics. Collaborate with data scientists to deploy machine learning models. Gain visibility across multiple business units and sectors. Key responsibilities: Lead the design and implementation of scalable, secure data pipelines and architectures. Define and enforce best practices in data governance, quality, and security. Guide the development of advanced data processing and analysis More ❯

VP AWS Data Engineer - Strategic Data Leadership - London - Hybrid Are you a visionary data engineering leader ready to architect the future of market data infrastructure? A global financial institution is seeking a Vice President - AWS Data Engineering to spearhead the development of a next-generation Market Data Store (MDS). This greenfield initiative … offers a rare opportunity to shape the platform from the ground up, leveraging technologies like Databricks, Snowflake, and AWS Glue to solve one of the most complex data challenges in banking. What makes this role stand out? Strategic ownership of a high-impact data platform initiative. Influence cross-functional teams and senior stakeholders. Drive innovation in data architecture, governance, and analytics. Collaborate with data scientists to deploy machine learning models. Gain visibility across multiple business units and sectors. Key responsibilities: Lead the design and implementation of scalable, secure data pipelines and architectures. Define and enforce best practices in data governance, quality, and security. Guide the development of advanced data processing and analysis More ❯

Role: Senior Cloud Data Engineer Location: London, 3 days per week on site required Duration: 6-month contract Rate: Via umbrella About the Client Join a global leader in financial technology and payments innovation , powering millions of transactions every day across the world. This organisation is at the forefront of digital transformation in payments, driving innovation and … that shape the future of commerce. Their culture is collaborative, forward-thinking, and dynamic, offering an environment where talented individuals can make a real impact. The Opportunity As a Senior Cloud Data Engineer , you will be joining the Data Platform Team , a core function that underpins mission-critical infrastructure for the business. You'll play a … exciting opportunity to deliver high-impact work at the heart of the payments industry. Key Responsibilities Collaborate with stakeholders to define business and technical requirements. Design and implement scalable data workflows and lifecycle management solutions. Ensure data quality, security, compliance, and retention policies are upheld. Support encryption, archiving, and audit readiness. Promote best practices and knowledge sharing across More ❯

Role: Senior Cloud Data Engineer Location: London, 3 days per week on site required Duration: 6-month contract Rate: Via umbrella About the Client Join a global leader in financial technology and payments innovation , powering millions of transactions every day across the world. This organisation is at the forefront of digital transformation in payments, driving innovation and … that shape the future of commerce. Their culture is collaborative, forward-thinking, and dynamic, offering an environment where talented individuals can make a real impact. The Opportunity As a Senior Cloud Data Engineer , you will be joining the Data Platform Team , a core function that underpins mission-critical infrastructure for the business. You'll play a … exciting opportunity to deliver high-impact work at the heart of the payments industry. Key Responsibilities Collaborate with stakeholders to define business and technical requirements. Design and implement scalable data workflows and lifecycle management solutions. Ensure data quality, security, compliance, and retention policies are upheld. Support encryption, archiving, and audit readiness. Promote best practices and knowledge sharing across More ❯