26 to 50 of 188 Data Engineer Jobs in the Thames Valley

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines, ensure data quality and governance, and collaborate across cross-functional teams … to deliver high-performance data platforms in production environments. This role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data feeds from … diverse sources. Manage data pipelines for analytics and operational use , ensuring data integrity, timeliness, and accuracy across systems. Implement data quality tools and validation frameworks within transformation pipelines. Data Processing & Optimization: Build efficient, high-performance systems by leveraging techniques like data denormalization , partitioning , caching , and parallel processing . Develop stream-processing applications using Apache Kafka More ❯

Job Title: Senior Data Engineer Key Requirements: 4-8 years of experience from tier 1 or 2 big tech companies Job Location: Abu Dhabi, UAE Benefits: Work with cutting-edge technology through modern infrastructure and automation projects Thrive in a growth-focused environment that prioritizes learning, innovation, and career development Competitive salary and a comprehensive benefits package Job … Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines, ensure data quality and governance, and collaborate across cross-functional teams to deliver high-performance data platforms in production environments. This … role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data feeds from diverse sources. Manage data pipelines for analytics and operational use More ❯

robot HMND 01 is a next-gen labour automation unit, providing highly efficient services across various use cases, starting with industrial applications. We are looking for Senior/Lead Data Engineer to join our team based in London, UK. Our Mission At Humanoid we strive to create the world’s leading, commercially scalable, safe, and advanced humanoid robots … labour needs. Responsibilities Curate, preprocess, and manage large datasets used for training humanoid robots — projected to reach hundreds of terabytes by 2025. Ensure the quality, accuracy, and consistency of data across multiple projects. Collaborate with machine learning teams to design data pipelines that support efficient training workflows. Develop and maintain data quality metrics reporting systems. Implement best … practices for data management, including versioning, security, and compliance. Expertise Bachelor’s or Master’s degree in Data Science, Computer Science, or a related field. 5+ years of experience in data engineering and data quality. Strong proficiency in Python/Java, SQL, and data processing frameworks including Apache Spark. Knowledge of machine learning and its More ❯

Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and their … each policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. … Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development, and analytics. Optimising pipelines, frameworks, and systems More ❯

Social network you want to login/join with: We have partnered with a company that empowers underwriters to serve their insureds more effectively. They are using advanced data intelligence tools to rebuild the way that underwriters share and exchange risk. With a current focus on the small and medium-sized businesses that power our global economy and their … each policy to deliver unprecedented insight into insurance pools, and their speciality portfolio is fully diversified with very low catastrophe, aggregation or systemic risk. The Role: Designing and implementing data pipelines and models, ensuring data quality and integrity. Solving challenging data integration problems, utilising optimal patterns, frameworks, query techniques, sourcing from vast and varying data sources. … Building, maintaining, and optimising our Data Warehouse to support reporting and analytics needs. Collaborating with product managers, business stakeholders and engineers to understand the data needs, representing key data insights in a meaningful way. Staying up-to-date with industry trends and best practices in data modelling, database development, and analytics. Optimising pipelines, frameworks, and systems More ❯

Location: London – Mostly remote initially Salary: £35k - £50k depending on experience Employment Type: Full-time About Us: At Kolayo, we're dedicated to building innovative, data-driven solutions that empower businesses and organisations to make smarter, faster decisions. We specialise in developing cutting-edge technologies and having recently secured funding to accelerate our growth. We are looking for a … highly skilled Full Stack Developer with expertise primarily in database design and administration, Python and React to help us deliver exceptional, data-centric applications. Join us in making an impact while growing your career in a fast-paced and collaborative environment. Role Overview: We are looking for a developer with strong foundational knowledge of database design and web applications. … In this role, you'll be working on a range of projects from data modelling, server administration, building the front and back end of web apps and working with clients to integrate their systems into our analytical model. You will also need to be adaptable and love learning new technologies as we on-board clients with a range of More ❯

AWS Data Engineer Support | S2 | Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity for an AWS Data Engineer Support to join our team of analysts to create the data and insights which … support the functional areas of the bank. You'll play a key role understanding the types of models and data frameworks that support the business strategies around our data assets. This will require excellent communication skills, functional awareness and an excellent analytical capability. The difference you'll make: Driving and maintaining our AWS-hosted solutions Engaging in the … design, development and maintenance of systems Ensuring stable deployment, debugging and execution of various initiatives Collaborating with others and analysing to source and build understanding of relevant data Working in an agile manner, ensuring the outputs required are in line with stakeholder expectations and delivered on-time What you'll bring: These are the essential requirements you need to More ❯

About Role: As a Data Engineer, you will play a crucial role in designing, developing, and maintaining data architecture and infrastructure. The successful candidate should possess a strong foundation in Python, Pyspark, SQL, and ETL processes, with a demonstrated ability to implement solutions in a cloud environment. Position - Sr Data Engineer Experience - 6-9 Years … Location - London Job Type - Hybrid, Permanent Mandatory Skills: Design, build, maintain data pipelines using Python, Pyspark and SQL Develop and maintain ETL processes to move data from various data sources to our data warehouse on AWS/AZURE/GCP . Collaborate with data scientists, business analysts to understand their data needs & develop solutions … that meet their requirements. Develop & maintain data models and data dictionaries for our data warehouse. Develop & maintain documentation for our data pipelines and data warehouse. Continuously improve the performance and scalability of our data solutions. Qualifications: Minimum 6+ years of Total experience. At least 4+ years of Hands on Experience using The Mandatory skills More ❯

London/Hybrid | 💷 £750/day | 🗓 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and operations teams. … This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred) Partnering closely with data analysts, quants, and … tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data Engineer Deep Python and Spark/Databricks expertise Financial services More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. You … will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use of Microsoft Fabric and Synapse … analytics platform. • Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers. Experience required • Dynamic and hands-on leader who excels in managing and coaching a team. • Thrives in a collaborative environment and adapts to changing priorities with ease. • Excellent communication and presentation skills, capable of conveying complex ideas More ❯

Join a Leading Growth business on its transformative journey to become the UK's most recommended businesses in their industry Lead Data Engineer Salary: £70-90k Location: Reading – Hybrid Benefits: Competitive Role Overview: As Lead Data Engineer , you will be part of the Corporate Data team, reporting directly to the Senior Leadership team. You … will lead a small team of data engineers, overseeing the design, build, and maintenance of the infrastructure and systems that collect, store, and process corporate data for reporting and analysis. Key Responsibilities: • Lead and manage a team of data engineers. • Design, build, and maintain data infrastructure and systems. • Ensure effective use of Microsoft Fabric and Synapse … analytics platform. • Collaborate with various stakeholders, including Data and Systems owners, Data Analysts, Data Architects, Infrastructure Architects, and external suppliers. Experience required • Dynamic and hands-on leader who excels in managing and coaching a team. • Thrives in a collaborative environment and adapts to changing priorities with ease. • Excellent communication and presentation skills, capable of conveying complex ideas More ❯

Lead Data Engineer | Location: London (Hybrid - 1-2 day a month in office) | Salary: £90,000-£110,000 | London Market Insurance The Opportunity Are you passionate about building cutting-edge data platforms that drive business growth? Our client is seeking who is a Speciality Insurer a skilled and motivated Lead Data Engineer with Insurance experience … to play a key role in the creation of a brand-new data platform within the Azure ecosystem and Databricks . This is an exciting opportunity to be at the forefront of data innovation, working within a newly formed Data & Analytics team in a long standing London Market Insurer . You’ll help shape the data strategy, improve data quality, and empower the business to make data-driven decisions. As a Lead Data Engineer, you'll work closely with both technical and business stakeholders, leveraging your expertise to design, develop, and optimize a high-performance data platform built on Databricks . This platform will be built to scale, incorporating the More ❯

Principal Data Engineer Salary: £100,000 + 15% Bonus Location: Central London, 2 days in office We’re hiring on behalf of our client, a global leader in personalized photo products, for an experienced Principal Data Engineer to join their UK data & ML team. This is a senior hands-on leadership role driving data platform strategy and engineering standards as they evolve toward de-centralised data and ML adoption. Role overview: You’ll play a central role in re-architecting and scaling their data platform to meet growing business and customer needs. This includes building robust, observable data pipelines, ensuring data trustworthiness, and mentoring a team of engineers while … collaborating closely with Product, Ops, and Marketing stakeholders. Key responsibilities: Lead design and build of scalable, cloud-native data solutions with best-in-class governance and observability Define technical principles and data engineering standards across distributed teams Coach data and analytics engineers on SDLC best practices (CI/CD, testing, versioning) Contribute to strategic planning and technical More ❯

login/join with: Largely remote - 1 day per month in the office Salary up to £55,000 + Bonus + Benefits We are looking for a hands-on Data Engineer/Migration Engineer to support the migration of CRM data from various OpCo's, using a variety of legacy source systems, into the Microsoft Dynamics … Customer Engagement (CE) platform. You will be responsible for extracting, transforming, cleansing, and loading data , ensuring quality and consistency throughout the process. This role is ideal for someone with a strong technical background in data engineering and experience with Microsoft/Azure data tools, particularly in a CRM or Dynamics/D365 environment. In the medium term … there will be scope and opportunity to build modern, cloud-native data solutions using Azure Synapse or Microsoft Fabric. Key Responsibilities As the sole Data Engineer for this programme of work, perform ETL (Extract, Transform, Load) processes to migrate data into D365 CE modules (e.g., Sales, Customer Service, Field Service). Work with data from More ❯

login/join with: Largely remote - 1 day per month in the office Salary up to £55,000 + Bonus + Benefits We are looking for a hands-on Data Engineer/Migration Engineer to support the migration of CRM data from various OpCo's, using a variety of legacy source systems, into the Microsoft Dynamics … Customer Engagement (CE) platform. You will be responsible for extracting, transforming, cleansing, and loading data , ensuring quality and consistency throughout the process. This role is ideal for someone with a strong technical background in data engineering and experience with Microsoft/Azure data tools, particularly in a CRM or Dynamics/D365 environment. In the medium term … there will be scope and opportunity to build modern, cloud-native data solutions using Azure Synapse or Microsoft Fabric. Key Responsibilities As the sole Data Engineer for this programme of work, perform ETL (Extract, Transform, Load) processes to migrate data into D365 CE modules (e.g., Sales, Customer Service, Field Service). Work with data from More ❯

Data Engineer - Python, SQL, DBT, DWH, Airflow, Kafka, Snowflake - Challenger Digital Bank Location: London (Hybrid, 2 days per week in office) Type: Permanent Salary: Competitive + 20% bonus + excellent benefits Are you a Data Engineer ready to shape the future of a digital-first banking experience? Join a fast-growing start-up challenger bank where … data is at the core of every decision. You’ll play a key role in building the bank’s next-generation data infrastructure and enable insight-led growth from the ground up. What you will be doing: Build and optimise robust data pipelines using Python , Kafka , Airflow , and DBT Design and manage Snowflake data warehouse objects … to support scalable analytics Write clean and efficient SQL to support reporting, dashboards and data products Collaborate across engineering, analytics and product teams to enable data-driven decisions Drive data quality, performance and governance through best practice and documentation Support A/B testing, automation, and analytics innovation projects What we are looking for: Strong hands-on More ❯

We're on the hunt for a Senior Data Engineer/Database Specialist to join our growing team at Reward, where data isn’t just a by-product — it’s at the heart of everything we do. As we scale our loyalty platform across global markets, our data infrastructure needs to be smarter, faster, and more … impactful than ever before. That’s where you come in. 🔍 What you’ll be doing: Leading the design and migration of ETL pipelines and data warehouses into cloud environments (AWS) Working with technical and non-technical stakeholders to scope and build insightful reporting and data solutions Creating robust QA processes and automating repetitive data tasks Supporting and … mentoring junior analysts (1 direct report) Acting as a go-to for clean, optimised, efficient SQL Supporting second-line data queries and ensuring SLAs are met Continuously improving how we handle, transform and deliver data across the business 🧠 What you bring: 5+ years of hands-on experience with relational databases (500,000+ customers) Strong SQL (including performance tuning More ❯

Because we're breaking new ground, it often means that we're working on new technological challenges. We are building in-house banking products using modern technologies. Role Description Data is a key asset to Allica and is deeply embedded in all our teams and products. With data, we assist and work with Finance, Operations, Credit Risk, Product … and Management. We are looking for ambitious and curious people who can help us understand our data better, contribute to building robust data pipelines, and help model our data so that stakeholders and team members can extract better insights from it. You will be an integral part of the data engineering team, building and developing the … tooling and pipelines that form our data ingestion and modelling machine for our partnership agreements. Principal Accountabilities Understand our data landscape and architecture. Strong skillset in data modelling. Build and maintain data pipelines. Work with the team to engineer tools based on data requirements, manage development from prototyping to productioniSing. Identify, design, and implement More ❯

twentyAI are partnering with a globally renowned law firm currently undergoing a major digital and data transformation. With a deep-rooted legacy in legal excellence and a strong global footprint, the firm is currently modernising their data capability and building a new data platform. About the Role You will be part of a diverse group of engineers … and machine learning experts, working with cutting-edge Azure cloud technologies, including Microsoft Fabric and related services. Your mission is to design reliable, efficient data pipelines that enable the business to access trusted, well-structured data. You will also focus on building and scaling the core data infrastructure that supports advanced analytics and machine learning efforts across the … business. Responsibilities Design and develop end-to-end data pipelines that ingest, transform, and prepare data for analytics and machine learning workflows. Work with Infrastructure as Code, primarily Terraform, to automate and manage cloud infrastructure, enabling repeatable and reliable deployment processes. Collaborate closely with data scientists, MLEs, and business teams in an agile environment to deliver data More ❯

of 282 officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner in compliance with Data regulations. … The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI) colleagues to deliver reporting products to the business. Provide data More ❯

Data Engineer Location: London (4 days/week on-site) Type: Contract (Outside IR35) Duration: 6 months A leading physical commodities trading firm is seeking a Data Engineer for a 6-month contract (Outside IR35). You’ll work on-site in London 4 days per week, building and optimizing data pipelines in a fast … paced, data-driven trading environment. Responsibilities: Build and maintain scalable data pipelines (ETL/ELT) Support data users with ingestion, debugging, and navigation Integrate data from diverse sources (structured & unstructured) Monitor and ensure data quality Maintain and improve existing production processes Develop dashboards and visualizations Work closely with data scientists and stakeholders Follow CI …/CD and code best practices (Git, testing, reviews) Tech Stack & Experience: Strong Python (Pandas), PySpark, and SQL skills Cloud data tools (Azure Data Factory, Synapse, Databricks, etc.) Data integration experience across formats and platforms Strong communication and data literacy Nice to Have: Commodities/trading background Experience with data lakes and open-source data More ❯

Senior Data Engineer London/Hybrid 2 days per week Permanent Salary: Up to £90,000 We have partnered with a leading investment firm who are seeking a Senior Data Engineer. They have garnered a strong reputation in delivering solutions across the full investment life cycle. They are looking for a skilled and hands-on Senior Data Engineer to design and build scalable data pipelines to support evolving business and technology needs. This is a key role and will contribute significantly to the company's vision of becoming a data-centric organisation. The ideal candidate will have demonstrable experience with the modern Azure tech stack and a deep understanding of ingesting and transforming … data from diverse internal and external sources. Key Responsibilities: Design and implement robust data solutions to support a modern cloud-native data warehouse. Provide technical leadership and identify effective solutions for complex data-related challenges. Perform and participate in peer reviews of design, code, and tests, ensuring high-quality development standards. Promote clean, efficient, and maintainable More ❯

Senior Databricks Data Engineer | Energy Trading - Contract My client is an Energy Trading Client based in the UK who are looking to appoint a Senior Databricks Data Engineer to help modernise their data infrastructure and deliver end-to-end solutions that drive business value. This is a high-impact role working across data strategy … architecture, and engineering to deliver cloud-first solutions within a global trading environment. Role: Key Responsibilities: Design and build data foundations and scalable solutions to support the business in becoming data-driven. Champion and implement Data Foundation initiatives in line with strategic programmes. Translate vision and data strategy into practical, high-value engineering solutions. Serve as … a subject matter expert, mentoring junior engineers and collaborating with business and technical stakeholders. Coordinate incident, problem, and change management processes. Present data-driven insights and architectural decisions to senior stakeholders. Drive efficiency across data projects to improve speed, reduce cost, and maximize value. Contribute to internal communities of excellence and practice (CoE, CoP). Skills Needed: Experience More ❯

Data Engineer Amersham – Hybrid £45,000 - £50,000 VIQU have partnered with a UK retail company who are looking to recruit a Data Engineer to play a critical part in the leveraging of data to drive insights, optimise business performance and support decision making. Key Responsibilities of the Data Engineer: Develop, maintain, and … optimise data pipelines and integration workflows across various platforms, including SQL Server and cloud environments. Collaborate with cross-functional teams to gather requirements and deliver tailored data solutions. Build and refine automated data processes ensuring data accuracy and availability for reporting and analysis. Support the rollout of an Azure-based data lake, working alongside external … SSIS and SSRS. Produce and enhance interactive reports and dashboards, facilitating clear communication of insights to non-technical users. Assist in training end users and provide ongoing support for data tools and systems. Participate in peak reporting cycles and ad hoc data requests as needed. Key Requirements of the Data Engineer: Strong expertise in SQL, SSIS More ❯

Data Engineer – Azure | Permanent | UK – Hybrid Our client, a leading organisation within the Financial Services space, is seeking a talented Data Engineer to join their high-performing team. This is an exciting opportunity for a skilled data professional to play a critical role in modernising legacy platforms, delivering robust data solutions, and contributing to … business-wide insight initiatives. As a Data Engineer, you will be instrumental in implementing new technologies, designing and maintaining scalable ETL processes, and developing and administering cloud-based data platforms. This role requires a proactive individual with a passion for data quality, cloud technologies, and continuous improvement. Key Responsibilities: Design, build, and maintain high-performance data pipelines and APIs. Collaborate cross-functionally to understand business needs and align data strategies accordingly. Assemble and optimise large, complex data sets from diverse sources using SQL, dbt, and Azure technologies. Champion data quality and promote a data-as-a-product mindset. Define and document technical architecture, including cloud solutions and system diagrams. Develop and More ❯