Lead Data Engineer Jobs in the UK excluding London

1 to 25 of 28 Lead Data Engineer Jobs in the UK excluding London

Lead Data Engineer Databricks - Leeds

Leeds, West Yorkshire, England, United Kingdom
Noir
Lead Data Engineer (Databricks) - Leeds (Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead Data Engineer, Team Lead, Technical Lead, Senior Data Engineer, Data Engineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead Data Engineer with significant Databricks experience as well as leadership responsibility to run … an exceptional Agile engineering team and provide technical leadership through coaching and mentorship. We are seeking a Lead Data Engineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a More ❯
Employment Type: Full-Time
Salary: £55,000 - £70,000 per annum
Posted:

Data Lead / Business Intelligence & Insights Manager / Data Engineer

Bedford, Bedfordshire, South East, United Kingdom
Hybrid / WFH Options
AWD Online
Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the companys data strategy, build … can be based in either UK or Portugal Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI … Developers and Data Analysts. Working as the Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer youll be the driving force behind ensuring the companys data is accurate, secure, and fully leveraged. As the Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer youll More ❯
Employment Type: Permanent, Work From Home
Salary: £75,000
Posted:

Data Lead / Business Intelligence & Insights Manager / Data Engineer

Bedford, Bedfordshire, England, United Kingdom
Hybrid / WFH Options
AWD online
Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI Developers and Data Analysts is required for a well-established company based in Bedford, Bedfordshire. IS THIS YOU? Can you lead the company’s data strategy … can be based in either UK or Portugal – Local Salary Ranges Will Apply JOB TYPE: Full-Time, Permanent JOB OVERVIEW We have a fantastic new job opportunity for a Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer who has proven leadership in a technology environment, managing teams of Data Engineers, BI … Developers and Data Analysts. Working as the Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer you’ll be the driving force behind ensuring the company’s data is accurate, secure, and fully leveraged. As the Data Lead/BI Business Intelligence & Insights Manager/Principal Data Engineer More ❯
Employment Type: Full-Time
Salary: £62,000 - £75,000 per annum
Posted:

Lead Data Engineer

Reading, Berkshire, South East, United Kingdom
Hybrid / WFH Options
Bowerford Associates
We are searching for an experienced Lead Data Engineer for an exciting data-driven business with multiple office locations across the UK. The role is offered as a remote position, but you MUST be based in the UK to be considered for the opportunity. In this role you will be involved in determining the future direction … and impact of data engineering within the business. This is an extremely exciting Lead Data Engineering role, a fantastic opportunity for an experienced, innovative and hands-on data professional to help shape our client's products and solutions. Reporting directly to the Head of Data Engineering, you will play a crucial role in driving the … team's vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions. This is a fantastic opportunity for highly skilled and motivated Lead Data Engineer with strong expertise in data More ❯
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Lead Data Engineer - Enterprise Data Provisioning

Manchester, Lancashire, United Kingdom
Lloyds Banking Group
JOB TITLE: Lead Data Engineer SALARY: £90,440 - £ 106,440 LOCATION: Bristol or Manchester HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in the Bristol or Manchester office. About this opportunity Are you currently managing a Data Engineering team and looking for a new challenge? We're seeking an experienced Lead Data Engineer who can bring both strong management skills and hands-on data experience to mentor, manage, and grow teams while building data products using modern technologies. Data is one of our key assets. In a world of Big Data, Data Engineers are fundamental to unlocking safe, timely, scalable, and controlled access to it … at enterprise scale. As a Lead Data Engineer you'll be responsible for leading the teams producing/curating (designing, developing, moving, transforming, testing, and maintaining) Data Products. This enables consumers to ingest, transform, store, and analyse our data to gain insight and drive value for our customers, regulators, shareholders and colleagues. A strong background More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer - Enterprise Data Provisioning

Bristol, Gloucestershire, United Kingdom
Lloyds Banking Group
JOB TITLE: Lead Data Engineer SALARY: £90,440 - £ 106,440 LOCATION: Bristol or Manchester HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in the Bristol or Manchester office. About this opportunity Are you currently managing a Data Engineering team and looking for a new challenge? We're seeking an experienced Lead Data Engineer who can bring both strong management skills and hands-on data experience to mentor, manage, and grow teams while building data products using modern technologies. Data is one of our key assets. In a world of Big Data, Data Engineers are fundamental to unlocking safe, timely, scalable, and controlled access to it … at enterprise scale. As a Lead Data Engineer you'll be responsible for leading the teams producing/curating (designing, developing, moving, transforming, testing, and maintaining) Data Products. This enables consumers to ingest, transform, store, and analyse our data to gain insight and drive value for our customers, regulators, shareholders and colleagues. A strong background More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer

Leeds, West Yorkshire, England, United Kingdom
Hybrid / WFH Options
Robert Walters
Lead Data Engineer- AWSLeeds (Hybrid) About the Business: Our client is a nationally recognised leader in their industry, operating across the UK with a reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support business-wide transformation and insights. This is a … greenfield opportunity to help shape the future of data engineering in a complex, large-scale environment. The Role: We are seeking an experienced Lead Data Engineer to play a pivotal role in the design, build, and implementation of a new enterprise data platform. The business is currently migrating to AWS, and you will lead the development of a new data lake and associated pipelines, ensuring robust, scalable, and secure data solutions are delivered. You will work closely with architects, analysts, and data scientists, guiding best practices, mentoring engineers, and embedding a modern data engineering culture within the team. Key Responsibilities: Lead the design and delivery of the business More ❯
Employment Type: Full-Time
Salary: £80,000 - £90,000 per annum
Posted:

Lead Data Engineer

Yorkshire, United Kingdom
Hybrid / WFH Options
Anson Mccade
Lead Data Engineer ££64,000 GBP Hybrid WORKING Location: Leeds, Yorkshire and the Humber - United Kingdom Type: Permanent This is an exciting opportunity for a skilled Lead Data Engineer to advance their career while remaining deeply technical. The role offers a clear path for progression without requiring a move into management or sales, allowing … individuals to focus on what they do best-engineering high-quality, scalable data solutions. Why Join? This organisation values continuous learning and personal growth. Team members benefit from a dedicated learning allowance, enabling them to shape their own development journey. Paid overtime and a strong emphasis on work-life balance ensure that individuals are recognised and supported-especially during … demanding projects. The business is committed to employee wellbeing and fosters a positive, inclusive culture. Role Overview The Lead Data Engineer will take a hands-on technical leadership role, guiding the delivery of high-impact solutions within cloud-based environments. This position is ideal for professionals who are passionate about modern data engineering and want to More ❯
Employment Type: Permanent, Work From Home
Posted:

Lead Data Engineer

Gloucester, Gloucestershire, England, United Kingdom
Hybrid / WFH Options
Searchability NS&D
Gloucester location - hybrid working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL, Team Leadership Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission-critical solutions that … help keep the nation safe, secure, and prosperous. You'll work with cutting-edge technologies, including AI/Data Science, Cyber, Cloud, DevOps/SRE, and Platform Engineering. They have long-term contracts secured across the latest customer framework and are set for significant growth. What will the Lead Data Engineer be Doing? You will develop … mission-critical data solutions for National Security clients, working with cutting-edge technologies such as AI/DS, Cyber, Cloud, DevOps/SRE, and Platform Engineering. You'll collaborate directly with customers across National Security, Defence, and Intelligence to solve complex, high-stakes challenges. The role involves designing and implementing sophisticated data pipelines to connect operational systems with More ❯
Employment Type: Full-Time
Salary: £65,000 - £85,000 per annum
Posted:

Lead Data Engineer

London, South East, England, United Kingdom
Precise Placements
Lead Data Engineer - Shape the Future of Data & Analytics - Azure I am currently recruiting for an exciting Lead Data Engineer role with a leading organisation undergoing a major digital transformation . This is a fantastic opportunity to define and lead the data engineering strategy, building a scalable, insight-driven data infrastructure that leverages AI, cloud technologies, and advanced analytics to drive business success. Why Apply? High-Impact Role : Take ownership of data platform development, ensuring scalability, reliability, and efficiency. Technical Innovation : Work at the intersection of AI, machine learning, and real-time analytics , integrating cutting-edge technologies. Leadership & Strategy : Lead a team of data engineers and … analysts , collaborating with senior stakeholders to drive a data-driven culture . Key Responsibilities: Design and implement a modern cloud data platform (Azure) to support scalable analytics. Build ETL/ELT pipelines to process structured and unstructured data, enabling real-time insights. Develop and maintain Power BI dashboards, forecasting models, and business intelligence tools . Establish data More ❯
Employment Type: Full-Time
Salary: £90,000 - £100,000 per annum
Posted:

Lead Data Engineer

Stockton-on-Tees, Cleveland, England, United Kingdom
Reed
We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You will … provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a culture of innovation … collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting More ❯
Employment Type: Full-Time
Salary: £65,000 - £75,000 per annum, Inc benefits
Posted:

Lead Data Engineer

Stockton-on-Tees, County Durham, United Kingdom
Reed Technology
We are looking for a highly skilled and motivated Lead Data Engineer to join our growing data team. In this role, you will lead a small team of Data Engineers and Analysts, driving the design, development, and maintenance of scalable, secure, and high-performance data solutions on the Microsoft Azure platform. You will … provide hands-on technical leadership while shaping the strategic direction of the data infrastructure to support analytics, reporting, and business intelligence across the organisation. Location: Stockton on Tees Department: Data & Analytics Employment Type: Full-Time/Permanent/Hybrid Key Responsibilities Lead and mentor a team of Data Engineers/Analysts, fostering a culture of innovation … collaboration, and continuous improvement. Design, build, and optimise data pipelines, data models, and data warehouses using Azure Synapse Analytics, Azure Data Factory, and Azure SQL. Ensure the reliability and performance of data pipelines and infrastructure. Collaborate with stakeholders and analysts to deliver impactful dashboards and reports using Power BI. Provide technical guidance and support, acting More ❯
Employment Type: Permanent
Salary: £65000 - £75000/annum
Posted:

Lead Data Engineer

Edinburgh, Midlothian, Scotland, United Kingdom
Hybrid / WFH Options
Motability Operations
Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a … focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using … Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new More ❯
Employment Type: Permanent, Part Time, Work From Home
Posted:

Lead Data Engineer

Bristol, Avon, South West, United Kingdom
Hybrid / WFH Options
Motability Operations
Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a … focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using … Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new More ❯
Employment Type: Permanent, Part Time, Work From Home
Posted:

Lead Cloud Data Engineer

Liverpool, Merseyside, North West, United Kingdom
Hybrid / WFH Options
Forward Role
Lead Cloud Data Engineer – Liverpool – Hybrid - £70k A well-established professional services business that's modernising their data infrastructure and embracing cloud-first technologies are looking for a Lead Cloud Data Enigneer. Based Liverpool City Centre, they're investing significantly in their data capabilities to enhance client services, improve operational efficiency, and drive … strategic decision-making through advanced analytics and robust data management practices. The Role They're looking for an exceptional Lead Cloud Data Engineer to spearhead their data engineering initiatives and drive technical excellence across their cloud infrastructure. You'll be architecting sophisticated data solutions that power critical business operations whilst leading a talented team … of engineers. This is an outstanding opportunity for someone who's passionate about cutting-edge technology and wants to shape the future of enterprise data management. What's on offer: Up to £70k DOE Hybrid working from their Liverpool office – 3 days on site Opportunity to work with industry-leading cloud technologies Leadership role with genuine career progression prospects More ❯
Employment Type: Permanent, Work From Home
Salary: £70,000
Posted:

Lead Data Engineer

London, South East, England, United Kingdom
Harnham - Data & Analytics Recruitment
Role: Lead Data Engineer Salary: £85,000 - £95,000 + bonus (flexible for the right hire) Location: South Kensington, London Working Policy: Primarily office-based (4 days a week) - some flexibility possible I'm working with a global player in the shipping and commodities market , helping businesses move goods like oil, coal and grain by sea. Their … weather, and more - and this team transforms complex datasets into clear dashboards and predictive models to give brokers an edge in the market. They're now looking for a Lead Analytics/Data Engineer to take ownership of building and scaling their centralised data platform (likely Snowflake), manage a junior engineer, and drive the design … of future data flows, architecture and analytics across the business. You'll work closely with research and senior leaders, giving you autonomy to shape the company's data strategy and propose new ideas. The role will involve: Leading on data engineering projects, building out the Snowflake-based data warehouse and pipelines Managing and mentoring a junior More ❯
Employment Type: Full-Time
Salary: £85,000 - £95,000 per annum, Inc benefits
Posted:

Lead Data Engineer

Morley, Ilkeston, Derbyshire, England, United Kingdom
VIQU IT Recruitment
Lead Data Engineer Leading UK Logistics OrganisationHybrid Working, £66,000 - £75,000 + Bonus We’re looking for an exceptional Lead Data Engineer to join one of the UK’s largest and most innovative organisations. This is a unique opportunity to combine technical leadership with hands-on development, working with cutting-edge technologies to … shape the future of logistics. You must have line-managment experience to be considered for this role. What You’ll Do: Lead the technical direction of our Databricks Common Data Platform Drive hands-on development with high-quality Python and SQL code Mentor and coach a distributed team of data engineers Champion CI/CD and automated … testing best practices Collaborate with cross-functional teams to align with Evri’s data strategy Maintain system resilience and accurate documentation Identify and implement cost optimisation strategies Establish data governance frameworks for secure data handling Support developer interviews and contribute to team growth Work closely with the Head of Data Engineering to align with strategic goals More ❯
Employment Type: Part-Time
Salary: £66,000 - £75,000 per annum
Posted:

Lead / Senior Data Engineer, Databricks, Home Based

Sheffield, South Yorkshire, Yorkshire, United Kingdom
Hybrid / WFH Options
Fdo Consulting Limited
Databricks Data Engineer (roles available at Lead, Senior and Mid Level), £ 50000 - 85000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work … with the Data Architects and Data team to determine technical delivery and functionality. Design data solutions based on optimal performance, scalability and reliability. Create, optimise and maintain logical and physical data models, including data warehouses and data lakes. Design and manage the data integration process. Work with the team to improve their skills More ❯
Employment Type: Permanent, Work From Home
Salary: £80,000
Posted:

Lead Data Engineer Enterprise Retail Tech Microsoft Fabric Hybrid

Newcastle Upon Tyne, Tyne and Wear, England, United Kingdom
Hybrid / WFH Options
Opus Recruitment Solutions Ltd
Lead Data Engineer | Enterprise Retail Tech | Newcastle – Hybrid Salary & Benefits - £70,000 to £85,000 + 34 days annual leave, health, cycle to work, staff discounts A cutting-edge retailer at the intersection of tech and luxury fashion is on the hunt for a Lead Data Engineer to spearhead its growing data platform … UK's fastest expanding—offers a dynamic, digitally driven environment where innovation is the heartbeat of everything they do.This is your chance to own and evolve an enterprise-scale data ecosystem, with Fabric at its core, and help shape the next generation of insight delivery for a global audience. What You’ll Tackle Leading a new in-house Data Engineering function focused on Fabric integration Designing and evolving robust architectures using Fabric components—Data Warehouses, Lakehouses, Real-Time Analytics & Pipelines Building scalable, cloud-first data models tailored to retail operations and customer intelligence Driving end-to-end development across Azure and Microsoft Fabric environments Managing technical delivery across cross-functional teams and third-party collaborators Embedding More ❯
Employment Type: Full-Time
Salary: £70,000 - £85,000 per annum
Posted:

Lead Azure Data Engineer

London, South East, England, United Kingdom
Tenth Revolution Group
Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting … through cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … closely with BI and Analytics teams, you'll help evolve our data warehouse and implement best-in-class engineering practices across Azure. Key Responsibilities Build and enhance ETL/ELT pipelines in Azure Databricks Develop facts and dimensions for financial reporting Collaborate with cross-functional teams to deliver robust data solutions Optimize data workflows for performance and More ❯
Employment Type: Contractor
Rate: £500 - £600 per day
Posted:

Lead Data Engineer

London, South East, England, United Kingdom
Hybrid / WFH Options
Method Resourcing
Data Engineer | Fabric | Azure | Python | SQL | PySpark Senior Data Engineer - Up to £90,000 Hybrid Working - 1 day per fortnight in office Method Resourcing are thrilled to be partnering with a rapidly scaling business who are preparing to embark on a greenfield Fabric implementation to unify data platforms and analytics across the business. To achieve … this, they are looking to hire an experience Data Engineer with proven experience delivering Fabric in a prior engagement. You will lead on the design, development and delivery of this end-to-end project and define the future roadmap for the business. The ideal candidate will have commercial hands-on experience implementing Fabric into a business and More ❯
Employment Type: Full-Time
Salary: £80,000 - £90,000 per annum
Posted:

Lead AWS Data Engineer / Architect - Databricks - London

London, South East, England, United Kingdom
Hybrid / WFH Options
Tenth Revolution Group
Lead AWS Data Engineer/Architect - Databricks - LondonI'm working with a globally renowned financial services client that are looking for a seasons Data professional. My client are seen as leaders and pioneers within their relative field but also, a very well known house hold name. They have operations in near enough every country and despite … having such a huge presence globally, they still pride themselves on having their employees at the heart of every bit of success. This has lead them onto winning multiple awards such as being named in the top 100 best companies to work for along side many other outstanding accolades. This is a hands on technical role. The successful applicant … will be building and maintaining AWS Data pipelines and infrastructure. This is while working with cross functional teams to design best in Class data solutions across the business. As a business, they are very mature within their data services however, there is always room for improvements so we're looking for an expert to not look to More ❯
Employment Type: Full-Time
Salary: £100,000 - £130,000 per annum
Posted:

AWS Lead Data Engineer

slough, south east england, united kingdom
HCLTech
Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in … PySpark, Glue, Athena, AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and More ❯
Posted:

AWS Lead Data Engineer

london, south east england, united kingdom
HCLTech
Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in … PySpark, Glue, Athena, AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and More ❯
Posted:

AWS Lead Data Engineer

london (city of london), south east england, united kingdom
HCLTech
Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in … PySpark, Glue, Athena, AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data quality, lineage, and More ❯
Posted:
Lead Data Engineer
the UK excluding London
10th Percentile
£65,000
25th Percentile
£67,688
Median
£75,000
75th Percentile
£93,750
90th Percentile
£102,410