101 to 125 of 170 Data Engineer Jobs in the South East

Power BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental data into actionable insight. … What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align technical and business goals. Lay the groundwork for More ❯

Power BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental data into actionable insight. … What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align technical and business goals. Lay the groundwork for More ❯

Data Engineer - Award-Winning AI SaaS platform We're partnered with a pioneering SaaS company that's transforming their industry through cutting-edge AI and data technology. With a multi-award-winning platform and a client base that includes global household names, this is a rare opportunity to join a high-growth tech business that blends startup … agility with enterprise stability. We're looking for a passionate Data Engineer who is experienced with AI tooling - including building Gen AI agents in-product - to join their growing Data Engineering ream. Why You'll Love This Role: Tech at Scale : Work with hundreds of millions of data points daily, using distributed systems and advanced machine … London office if you prefer Exceptional Benefits : From unlimited holiday and private healthcare to stock options and paid parental leave. What You'll Be Doing: Build and maintain scalable data pipelines using Spark with Scala and Java, and support tooling in Python Design low-latency APIs and asynchronous processes for high-volume data. Collaborate with Data Science and More ❯

plans to achieve this for a 7th time across the coming period. Due to these increasing levels of high activity, they are generating more and more customer and performance data than ever before and are embarking on a key project to best manage & utilise this. An agile and robust data management and utilisation plan will be key to … the attainment of this. Our client is therefore seeking an individual who will play an integral role in building & maintaining the businesses core data infrastructure & to deliver on the demands as outlined below. You will work closely with the lenders Chief Mortgage Officer & Senior Data Lead within the role. This is also a role that comes with plenty … of progression potential for those that are successful in the role. About the Role As a Data Engineer, you will play a key role in building and maintaining the business’s core data infrastructure. Working closely with the Chief Mortgage Officer, Senior Data Lead and Market Analysts you will enable scalable reporting, clean data flows More ❯

My client is based in the London area, is currently looking to recruit an experienced Data Engineer to join their AI Analytics team. They are one of the leaders within the AI space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are … demand and cutting-edge technology on the market right now. Main Responsibilities Develop scalable systems and reusable components that serve as reference points for new team members. Create efficient data workflows using distributed computing tools, particularly for large-scale processing and aggregation. Build responsive, asynchronous APIs and backend processes capable of handling high data volumes with minimal delay. … Utilise AI-powered development tools to enhance productivity and code quality. Collaborate within Agile teams to refine and monitor data collection systems using Scala and Java. Apply sound engineering principles such as test-driven development and modular design. Preferred Background Hands-on experience with Spark and Scala in commercial environments. Familiarity with Java and Python. Exposure to distributed data More ❯

and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and observability. • Mentor junior engineers More ❯

and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and observability. • Mentor junior engineers More ❯

and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and observability. • Mentor junior engineers More ❯

Data Engineer (Snowflake & Airflow) London/Edinburgh 6 Month Contract Via Umbrella Our UK leading banking client are looking for a Data Engineer to join their team on an initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Comfortable with GIT and version control. Knowledge of older coding standards More ❯

Data Platform EngineerLondon - Hybrid£80,000-£90,0000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company offering a … for further progression!This company are a bleeding-edge technology business driving innovation across the global financial services sector. Their platform processes vast amounts of real-time and batch data, supporting business critical reporting and analytics. With a strong culture rooted in integrity, creativity, and technical excellence, they've become a trusted partner across a wide range of businesses.In … performance of large-scale date pipelines built on AWS, Apache Flink, Kafka, and Python. You'll play a key role in diagnosing incidents, optimising system behaviour, and ensuring reporting data is delivered on time and without failure.The ideal candidate will have a strong experience working with streaming and batch data systems, a solid understanding of monitoring a observability More ❯

About the role: We're looking for a Senior Data Engineer to join the Data & Analytics team at Holland & Barrett. This is a high-impact, mid-seniority role within our growing data function, where you'll design, build, and scale modern data solutions on AWS. You'll work closely with cross-functional teams including Data Science, BI, and Product Analytics to develop cloud-native, scalable data infrastructure powering advanced analytics and machine learning. As a Senior Engineer, you'll not only deliver code — you'll take ownership, lead small teams, mentor others, and contribute to shaping our engineering culture and best practices. You'll join a team of Data Engineers, reporting … to the Senior Data Engineering Manager. You'll work alongside Associates, Mid-level Engineers, and Senior/Principal engineers. What You'll Do: Design, build, and scale data pipelines and services using AWS Glue, Lambda, Step Functions, S3, EMR, Athena, and more. Lead projects involving serverless, event-driven architectures and CI/CD workflows (GitLab CI). Write More ❯

The Role: As a Data Platform Engineer in a highly regulated environment, you will be responsible for designing, building, and maintaining secure and scalable data infrastructure that supports both cloud and on premises platforms. You will play a key role in ensuring that all data systems comply with industry regulations and security standards while enabling efficient … access for analytics and operational teams. A strong command of Apache NiFi is essential for this role. You will be expected to design, implement, and maintain data flows using NiFi, ensuring accurate, efficient, and secure data ingestion, transformation, and delivery. You should be adept at identifying and resolving issues within NiFi flows, managing performance bottlenecks, and implementing robust … error handling strategies. Youll work closely with cross-functional teams including data architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. Were looking for candidates with More ❯

As data engineer, you will contribute to the development of a robust, validated and easily accessible data foundation instrumental in facilitating new analytical workflows and applications. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to … develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and outputs Set up monitoring and ensure data health for outputs What we … are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness program 25 days annual leave Hybrid working arrangements More ❯

As data engineer, you will contribute to the development of a robust, validated and easily accessible data foundation instrumental in facilitating new analytical workflows and applications. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to … develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and outputs Set up monitoring and ensure data health for outputs What we … are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness program 25 days annual leave Hybrid working arrangements More ❯

As data engineer, you will contribute to the development of a robust, validated and easily accessible data foundation instrumental in facilitating new analytical workflows and applications. About us Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to … develop and build a successful career. Core Responsibilities Establishing new data integrations within the data foundation Conduct ETL activities as conducted by SMEs Configuring connections to other datasets within the data foundation Collaborate with SMEs to create, test and validate data models and outputs Set up monitoring and ensure data health for outputs What we … are looking for Proficiency in Python, with experience in Apache Spark and PySpark Previous experience with data analytics softwares Ability to scope new integrations and translate user requirements into technical specifications What’s in it for you? Base salary of £50,000-£60,000 £5000 a year professional development budget Wellness program 25 days annual leave Hybrid working arrangements More ❯

foster innovation and collaboration. We are committed to cultivating a community of excellence through trust, innovation, and resilience, valuing diverse experiences and expertise. Requirements The Role: We seek a Data Engineer to develop and deploy a data platform supporting AI initiatives at EIT. You will be responsible for building scalable data infrastructure and pipelines, collaborating with … multidisciplinary teams. Key Responsibilities: Design and implement scalable data pipelines and infrastructure Develop data processing systems using cloud technologies Optimize data storage and retrieval for AI applications Support AI/ML model development and deployment Evaluate and adopt new data technologies Collaborate with scientists, researchers, and operational teams Qualifications & Experience: Extensive Python programming experience in enterprise … environments Knowledge of data modeling, ETL, data warehousing, and SQL Cloud computing experience Strong communication skills Innovative mindset and ability to solve challenges creatively Ability to work in a fast-paced, startup-like environment Nice to have: Familiarity with AI/ML workflows Experience with Docker/Kubernetes Knowledge of Git and CI/CD Proficiency in Linux More ❯

The contract market is gradually picking up again. This is an opportunity for an [AWS] Data Engineer to work on an exciting, public sector project alongside prominent Departments in the UK Central Government. This role is for a skilled technical Data Engineer looking to a more consultative, yet hands on position. Please note: Active SC Clearance … be proactive and curious in addition to standard tech would be ideal for the role. Tech Stack: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL), Glue, Glue Data Catalog Python Current frontend is Tableau but experience with any of them will be interchangeable DevOps experience a bonus e.g. Terraform, Drone, Kubernetes cluster management for microservice style API … data consumption Contract Summary: Must have active SC Clearance Outside IR35 6 Month Contract Hybrid - Initially 2 Days a Week On Site London Based Government | Public Sector If your skills match the requirements of this role or you know someone who does, apply or feel free to get in touch with | Reasonable Adjustments: Respect and equality are core values More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key business stakeholders … to drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define and … implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with strategic objectives. Build deep More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key business stakeholders … to drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define and … implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with strategic objectives. Build deep More ❯

Data Cabling Engineer Location: Covering the Milton Keynes area Salary: £25k- £35k basic, Negotiable, DOE + Overtime & Vehicle Contract: Permanent, Full Time The Benefits awarded to the successful Cabling Engineer: Competitive salary Company van & mobile phone for lead engineers Uniform and tools provided Excellent overtime rates Annual leave plus public holidays On-going training and career progression … Social events KMH Group is a dynamic and expanding company which provides advanced Telecommunications, Data and Cabling solutions, predominantly, to blue-chip corporate clients throughout the UK. We are looking for a hard-working Engineers, with Data Cabling experience to work within the Installations and Planning Department, responsible for installing networks and cabling to existing and new, large … stability, a technical challenge, on-going training and product cross-training along with the opportunity of staff investment and a friendly, team orientated working environment The Role of the Data Cabling Engineer: Work from construction drawings, reading job diagrams, scopes and specifications Installations of network and structured cabling (Cat5/5e/6 & Fibre) Termination of cables on More ❯

Senior Data Engineer Opportunity to work on an AI-powered platform Salary up to £110k + Private Medical Insurance + Share Options Hybrid working from our London HQ (Paddington) Tech stack: Python, Scala, SQL, AWS, Spark If you'd prefer to keep your CV and personal data private, feel free to WhatsApp your details or CV directly … transform the way our industry operates. WHAT YOU WILL BE DOING As a key member of our tech team, you will take ownership of building Fornax - our AI-powered data migration platform. This system is designed to seamlessly transfer data from outdated legacy systems into our own platform, enabling rapid onboarding of new clients and driving our continued … growth. ESSENTIAL SKILLS Strong SQL querying skills Proven experience in data migrations and data pipeline development Proficiency in writing clean, maintainable code and collaborating effectively within a team environment TO BE CONSIDERED Please apply online or email me directly at .For further information, call me on . By applying for this role, you are giving express consent for More ❯

Data Platform Engineer | London (3 days onsite) | 6 Month Contract | Inside IR35 We are looking for an experienced Data Platform Engineer to join a forward thinking infrastructure and data optimisation team. In this role you'll be responsible for analysing storage consumption patterns, working closely with development teams to rightsize databases, and implementing automated data archiving and tiering strategies as part of a broader data lifecycle management initiative. Location: London (3 days onsite) Contract: 6-months (IIR35) Rate: £550-650 (depending on experience) Start date: ASAP Key responsibilities: Analyse application-level storage usage and consumption trends Identify optimisation opportunities and collaborate with dev teams to implement storage efficiency improvements Lead and implement automated … data archiving, tiering, and lifecycle management solutions Support database rightsizing efforts and help reduce infrastructure costs Contribute to the design of scalable, efficient data platforms aligned with business and compliance needs Required Experience: Strong background in data platform engineering , database management, or storage optimisation Experience with application-level storage analysis and performance tuning Familiarity with automated data More ❯

science performed at Diamond. Our software systems facilitate operations at all levels, including the low-level control of synchrotron and beamline hardware, the planning, execution and monitor of experiments, data archiving and retrieval, data processing and visualisation, the application for beamtime, and capture of remote experiment plans and samples. Our software engineers work alongside our scientists to develop … innovative and robust solutions to keep Diamond at the forefront of scientific research. About the Data Acquisition Group The Data Acquisition (DAQ) group develops software to interface with and control the hardware which allows experiments to be performed and monitored as well as guiding the end user to tools for data reduction and analysis. The group works … closely with scientists, controls, data analysis and information management engineers to continuously develop and improve software solutions for scientific data acquisition and on-the-fly monitoring and data analysis. The current DAQ software platform is a client-server application called GDA (Generic Data Acquisition) which is written in Java and uses the Eclipse RCP framework. To More ❯

science performed at Diamond. Our software systems facilitate operations at all levels, including the low-level control of synchrotron and beamline hardware, the planning, execution and monitor of experiments, data archiving and retrieval, data processing and visualisation, the application for beamtime, and capture of remote experiment plans and samples. Our software engineers work alongside our scientists to develop … innovative and robust solutions to keep Diamond at the forefront of scientific research. About the Data Acquisition Group The Data Acquisition (DAQ) group develops software to interface with and control the hardware which allows experiments to be performed and monitored as well as guiding the end user to tools for data reduction and analysis. The group works … closely with scientists, controls, data analysis and information management engineers to continuously develop and improve software solutions for scientific data acquisition and on-the-fly monitoring and data analysis. The current DAQ software platform is a client-server application called GDA (Generic Data Acquisition) which is written in Java and uses the Eclipse RCP framework. To More ❯

science performed at Diamond. Our software systems facilitate operations at all levels, including the low-level control of synchrotron and beamline hardware, the planning, execution and monitor of experiments, data archiving and retrieval, data processing and visualisation, the application for beamtime, and capture of remote experiment plans and samples. Our software engineers work alongside our scientists to develop … innovative and robust solutions to keep Diamond at the forefront of scientific research. About the Data Acquisition Group The Data Acquisition (DAQ) group develops software to interface with and control the hardware which allows experiments to be performed and monitored as well as guiding the end user to tools for data reduction and analysis. The group works … closely with scientists, controls, data analysis and information management engineers to continuously develop and improve software solutions for scientific data acquisition and on-the-fly monitoring and data analysis. The current DAQ software platform is a client-server application called GDA (Generic Data Acquisition) which is written in Java and uses the Eclipse RCP framework. To More ❯