51 to 75 of 338 Data Engineer Jobs in London

Azure, data bricks, data engineer, SC cleared YOU MUST HOLD A CURRENT AND VALID SC CLEARANCE TO BE CONSIDERED FOR THIS ROLE My client, a leader in the public sector, is seeking an SC CLEARED data scientist/data engineer to join their established team. You will work on a hybrid basis, with … days a week onsite in the London office. As a data scientist in the Data Science team , you will work independently and have a good understanding of a range of topics, including data science techniques, delivery methods and stages (such as minimal viable products), tools and technologies. At this role level, you will: develop complex solutions using … a range of data science techniques, whilst understanding any ethical considerations understand the role and benefits of data science within the organisation support capability building within the organisation collaborate with others to develop data science solutions and outputs supporting the organisation prepare and manipulate data, and perform complex analytics present and communicate effectively This role is More ❯

Role: Lead Data Engineer Salary: £85,000 - £95,000 + bonus (flexible for the right hire) Location: South Kensington, London Working Policy: Primarily office-based (4 days a week) - some flexibility possible I'm working with a global player in the shipping and commodities market , helping businesses move goods like oil, coal and grain by sea. Their clients … and this team transforms complex datasets into clear dashboards and predictive models to give brokers an edge in the market. They're now looking for a Lead Analytics/Data Engineer to take ownership of building and scaling their centralised data platform (likely Snowflake), manage a junior engineer, and drive the design of future data flows, architecture and analytics across the business. You'll work closely with research and senior leaders, giving you autonomy to shape the company's data strategy and propose new ideas. The role will involve: Leading on data engineering projects, building out the Snowflake-based data warehouse and pipelines Managing and mentoring a junior engineer Supporting More ❯

Vacancy for Data Engineer at The UK National Archives Vacancy for Data Engineer at The UK National Archives London Full-Time The National Archives is looking for an experienced Data Engineer with in-depth experience in data design and engineering to help build the next generation of digital archiving services. We are currently … creating new digital services to help our users send public data and records to the archive and preserve this nationally important resource for the future. We have the ambition to do more to structure, enrich and analyse that data to make it easier to find, use and understand and open up new access routes for a wider range … build your understanding of developing technologies that can be applied to enhance understanding of archival content and enable access and re-use of public data. ABOUT YOU: As our Data Engineer, you will have a strong background in creating models and schemas, managing and enriching data, constructing data products and services, and integrating them into systems More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data-driven business insights … Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models using Data Vault and Dimensional modelling methods … Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data-driven business insights … Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models using Data Vault and Dimensional modelling methods … Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements More ❯

Main purpose of job: Responsible for facilitating the implementation of the data strategy, under the strategic direction of the Data Steering Group, through iterative technical delivery of a modern data platform solution that provides the business with the following: Improved data quality and consistency, More readily and reliably accessible MI, Enhanced data-driven business insights … Leveraging of digitalisation and automated solutions to achieve greater resource and process efficiencies. This will include contributing towards the design and building of a modern Data platform solution to handle large and complex data sets. Key tasks: Design Data Lake and Data Warehouse solutions Design Data Models using Data Vault and Dimensional modelling methods … Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements More ❯

Snr Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Job ID: Amazon Web Services Japan GK AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and … best practices and conduct skills transfer workshops. AWS consultants collaborate with customers and partners to address security and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS, we're looking … hands-on keyboard capacity, technical leadership experience, and ability to learn fast in a fast paced environment. They will focus on customer solutions that enables customers to be a data-first organization. Key job responsibilities Expertise - Collaborate with AWS field sales, pre-sales, training and support teams to help partners and customers learn and use AWS services such as More ❯

Contract Data Engineer £450-£480/day Outside IR35 6 Months Hybrid (London) A leading infrastructure investment firm is embarking on a complete rebuild of its data platform, starting with a greenfield Snowflake data warehouse, hosted in Azure. Backed by C-Suite sponsorship, this is a rare opportunity to take ownership of a major transformation project … at its foundation. This role will support the existing Lead Data Engineer to ensure the back-end data stack continues to evolve in line with business needs, architectural best practices, and modern engineering standards. THE ROLE: As Data Engineer, you will: Support the Lead Data Engineer in driving development of the back-end … stack. Own key elements of the Snowflake data warehouse build (greenfield project). Work closely with a consultant architect to implement a scalable, secure data platform. Engage with senior business stakeholders including COO, CFO, and Head of FP&A. Design robust ingestion pipelines, transformation logic, and QA frameworks. Potentially manage and mentor a junior engineer over time. More ❯

Our client is a globally renowned Consumer Electronics brand with a huge online presence and are looking for a Data Engineer to join their small but expanding big data analytics capability based in Central London. The Data Engineer will be responsible for providing analytical and development services on their large scale data sets with … a range of teams on an international scale, complementing their existing SQL and ETL statistical environment. Working closely with the agile data analysis teams, you will need to ensure their reusable data assets build in a regular, efficient manner. This is an exciting opportunity to join one of the most recognisable technology brands in the world and work … with highly complex, large scale data sets and there's an excellent salary/package on offer. Cornwallis Elt is an Employment Agency and has been listed 3 times in The Sunday Times Virgin Fast Track 100 of the UK s fastest growing private companies, as well as in the Recruitment International Top 250, Top 50 in IT and More ❯

that combines expertise across clinical, technical, commercial, and operational domains. We're solving real problems for patients and health systems-and growing fast. ️ What You'll Do as a Data Engineer We're looking for a Data Engineer to play a key role in the next phase of our platform evolution. This is a hybrid role … with your time split equally: 50% with the Data team, focusing on our analytics stack and the quality of data we ingest and produce. 50% with the Platform Engineering team, helping shape the backend systems that support safe, scalable healthcare delivery. Some things you'll do as a Data Engineer Architect and build scalable data infrastructure - You'll contribute to the design and implementation of robust data pipelines that can handle our rapid growth, with a focus on event based architectures rather than traditional ETL methods Drive our cloud migration strategy - Contribute to the transition from GCP to AWS, migrating our data warehouse from BigQuery to Redshift, supporting our analysts, migrate our More ❯

exploding and we need your skills to support us on this exciting journey! Don't look back and submit your application before the opportunity passes you by Department: Analytics & Data Reporting to: Lead Data Engineer Who we are We're part of Super Group, the NYSE-listed digital gaming company behind some of the world's leading … re on a mission to create extraordinary experiences for our customers, and we believe that your unique skills, passion and superdrive will help us achieve our vision. As a Data Engineer you'll play a vital role in leveraging cutting-edge data technologies in Azure to drive innovation across our industry-leading brands. Design and develop robust … data frameworks, power real-time data pipelines, and create data services that deliver actionable insights to our global customer base. At Betway, we foster a culture of innovation and continuous improvement. Collaborate with a diverse team of experts, embrace technical challenges, and unleash your creativity. Thrive in an environment that values authenticity, responsibility, and the thrill of More ❯

Sr. Data Engineer, Prime Video Growth and Commerce Analytics Job ID: Amazon Development Centre (London) Limited Prime Video is a first-stop entertainment destination offering customers a vast collection of premium programming in one app available across thousands of devices. Prime and non-prime members can customize their viewing experience and find their favorite movies, series, documentaries, and … are fast-paced, challenging, and varied. You'll also be able to experiment with new possibilities, take risks, and collaborate with remarkable people. Key job responsibilities As a Sr. Data Engineer, you will develop new data engineering patterns that leverage new cloud architectures, and will extend or migrate existing data pipelines to the architectures as needed. … You will be responsible for designing and implementing the complex ETL pipelines in data warehouse platform and other BI solutions to support the rapidly growing and dynamic business demand for data, and use it to deliver the data as service which will have an immediate influence on day-to-day decision making at Prime Video. You will More ❯

Lead Data Engineer As a Lead Data Engineer, you'll be instrumental in driving innovation through advanced analytics, AI, cloud technologies, and data science. You will help build a new Data & Analytics function and unified data platform. Key Responsibilities: * Develop and execute a data engineering strategy that aligns with organisational goals and … technological advancements. * Design and implement a scalable, reliable, and cost-efficient modern cloud data platform. * Build and maintain robust ETL/ELT pipelines for processing and managing large volumes of structured and unstructured data. * Create and manage Power BI dashboards, reports, and data models to provide strategic insights. * Integrate cutting-edge technologies like AI, real-time analytics, and … automation into our data infrastructure. * Lead operational AI initiatives, including the development of machine learning models for predictive analytics. Technical Skills: * Proficiency in cloud platforms (Azure, AWS, or GCP) and data processing services. * Advanced skills in Power BI, including DAX, Power Query, and data modelling. * Strong programming abilities in Python, SQL, and/or Scala. * Expertise in More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure, and aligned … with the strategic goals of the energy business. In addition to hands-on engineering, you will play a pivotal role supporting the data architecture roadmap, mentoring junior engineers, and driving innovation in data-driven decision-making across the Natural Gas and Power value chain. This role reports to the Data Engineer Lead. Main Responsibilities Data Architecture & Engineering Leadership Architect and implement robust, scalable, and secure data pipelines and platforms tailored to the needs of Natural Gas and Power trading, including real-time market data ingestion, time-series storage, and high-frequency analytics. Lead the design and governance of data models that support complex trading strategies, asset optimization, and regulatory reporting. Ensure More ❯

This is an exciting contract opportunity for an SC Cleared Azure Data Engineer with a strong focus on Databricks to join an experienced team in a new customer engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery of advanced Databricks solutions … within the Azure ecosystem. Responsibilities: Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables. Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions. Drive best practices for data engineering. Help clients realise the potential of data science, machine learning, and scaled data processing within Azure/… and support their personal development. Take ownership for the delivery of core solution components. Support with planning, requirements refinements, and work estimation. Skills & Experiences: Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with More ❯

Lead data engineers at Thoughtworks develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. They might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing … overseeing a program inception to build a new product. Alongside hands-on coding, they are leading the team to implement the solution. Job responsibilities You will lead and manage data engineering projects from inception to completion, including goal-setting, scope definition and ensuring on-time delivery with cross team collaboration. You will collaborate with stakeholders to understand their strategic … objectives and identify opportunities to leverage data and data quality. You will design, develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You will be responsible to create, design and develop intricate data processing pipelines, addressing clients' most challenging problems. You will collaborate with data More ❯

LBANK, Gett, Kaizen Gaming, and TransferGo. Our products are recognised by industry leaders like Gartner's Magic Quadrant, Forrester Wave and Frost Radar. Our tech stack: Superset and similar data visualisation tools. ETL tools: Airflow, DBT, Airbyte, Flink, etc. Data warehousing and storage solutions: ClickHouse, Trino, S3. AWS Cloud, Kubernetes, Helm. Relevant programming languages for data engineering … tasks: SQL, Python, Java, etc. What you will be doing: Designing and developing scalable and efficient data pipelines, ETL processes, and data integration solutions to support data ingestion, processing, and storage needs. Ensuring data quality and reliability by implementing data validation, data cleansing, and data quality monitoring processes. Optimising database performance by tuning … queries, implementing indexing strategies, and monitoring and analysing system performance metrics. Collaborating with cross-functional teams to gather requirements, understand data needs, and develop data solutions that align with business objectives. Staying up-to-date with emerging technologies and industry trends in data engineering, and identifying opportunities for process improvements and tool enhancements. Establishing and enforcing best More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking … for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including … CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks. Integrate More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking … for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including … CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks. Integrate More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking … for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including … CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks. Integrate More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking … for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including … CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks. Integrate More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking … for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including … CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks. Integrate More ❯

Location: Central London (Hybrid - 3 days in office) Salary: Up to £62,000 per annum Contract Type: Fixed Term (18 months) Are you a skilled Data Engineer looking to make a real impact in a world-renowned cultural institution? We're working with a prestigious organisation undergoing a major digital and data transformation - and they're looking … for a hands-on Data Engineer to help build the foundations of their future data estate. This is a unique opportunity to join a high-impact transformation programme at a pivotal moment. You'll play a key role in designing and building robust, scalable data pipelines that bring together data from across the organisation - including … CRM, HR, Finance, and Commercial systems - into clean, trusted, and AI-ready datasets. You'll be part of a growing data team, working closely with architects, analysts, and business stakeholders to unlock insights and enable innovation. What You'll Be Doing: Design and build robust, automated data pipelines using Azure Data Factory, Synapse, dbt, and Databricks. Integrate More ❯

We're hiring a Senior Data Engineer (Genetics) to join us on 12 months FTC to support Maternity Cover. This role will be working within our Bioinformatics Team working on genetic data and building pipelines to process, control and create data releasees for Researchers. Our Future Health is the UK's largest ever health research programme … make new discoveries about human health and diseases. So future generations can live in good health for longer. What You'll Be Doing: Support the build of production-level data pipelines from data providers to our primary data store and Trusted Research Environment. Work closely with the Lead Data Engineer on key designs and features. … Build and maintain pipelines which meets the requirements for our end users and builds well curated, accessible and quality controlled data for analysis. Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of standards. Work to promote the adoption of best practises across the squad (unit testing, CI/CD More ❯

Senior Analytics Data Engineer - Snowflake & DBT (Contract) Location: London/Hybrid (2 days a week in the office) Contract Length: 6 Months (with possible extension) Rate: Negotiable Ref: J12991 Are you a seasoned Data Engineer with a passion for designing scalable solutions and transforming how businesses harness the power of data? This is an exciting … opportunity to play a pivotal role in building a modern, enterprise-wide data platform for a global insurance leader undergoing a major back-office transformation. Following years of global growth and an ambitious digital transformation programme, a Data Team is being created, tasked with delivering an enterprise data platform, instilling best in class data governance, and … enabling smarter, faster decision making through high quality data solutions. This contract role is central to the initiative. As a Senior Analytics Data Engineer, you will support the definition, delivery, and optimisation of robust, cloud based data engineering pipelines and models. You'll be a trusted technical advisor, collaborating across business and technology teams to ensure More ❯