Lead DataEngineer (Databricks) - Leeds (Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead DataEngineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide … technical leadership through coaching and mentorship. We are seeking a Lead DataEngineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge More ❯
Senior DataEngineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: PermanentWe’re looking for a Senior DataEngineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is an … excellent opportunity for a Senior DataEngineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight.The Senior DataEngineer will take ownership of developing and integrating data pipelines across the business, supporting enterprise … reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured More ❯
Hessle, North Humberside, North East, United Kingdom
Consortium Professional Recruitment
Senior DataEngineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We're looking for a Senior DataEngineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is … an excellent opportunity for a Senior DataEngineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior DataEngineer will take ownership of developing and integrating data pipelines across the business … supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs More ❯
Senior DataEngineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience ContractType: Permanent We’re looking for a Senior DataEngineer with strong experience in Azure Data Factory, Business Intelligence and data strategy to join a forward-thinking organisation modernising its data ecosystem. This is … an excellent opportunity for a Senior DataEngineer who can bridge the gap between technology and business, ensuring that data from systems such as SAP, Salesforce and factory production feeds is connected, structured and leveraged for meaningful insight. The Senior DataEngineer will take ownership of developing and integrating data pipelines across the business … supporting enterprise reporting and enabling smart decision-making through Power BI and Azure-based solutions. Key Responsibilities Design, build and maintain robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs More ❯
Employment Type: Permanent
Salary: £55000 - £65000/annum £55,000 to £65,000 + Benefits Packag
bradford, yorkshire and the humber, united kingdom
Noir
Lead DataEngineer (Databricks) - Leeds (Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead DataEngineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide … technical leadership through coaching and mentorship. We are seeking a Lead DataEngineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
london (city of london), south east england, united kingdom
Mastek
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
CONTRACT DATAENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATAENGINEER WITH eDV CLEARANCE Contract job opportunity for a DataEngineer National Security client Palantir Foundry Outside IR35 Central London based organisation in an easily accessible location To apply please call/or email … WHO WE ARE? We are recruiting a contract DataEngineer to work with a National Security SME in central London. Due to the nature of the work, you must hold enhanced DV Clearance. WE NEED THE DATAENGINEER TO HAVE.... Current enhanced DV Security Clearance Experience with big data tools such as Hadoop, Cloudera or … Scrum environment with tools such as Confluence/Jira Experience in design, development, test and integration of software Willingness to learn new technologies IT WOULD BE NICE FOR THE DATAENGINEER TO HAVE.... Cloud based architectures Microservice architecture or server-less architecture Messaging/routing technologies such as Apache Nifi/RabbitMQ TO BE CONSIDERED.... Please either apply More ❯
BIG DATAENGINEER - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A BIG DATAENGINEER WITH DV CLEARANCE Permanent job opportunity for a Big DataEngineer Leading National Security & Defence SME Salary up to £80,000 plus clearance bonus London based organisation in an easily accessible location To … apply please call or email WHO WE ARE? We are recruiting multiple Big Data Engineers to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold DV or enhanced DV Security Clearance. WHAT WILL THE BIG DATAENGINEER BE DOING? You will be joining a leading SME who is … working hard to support National Security projects within UK Govt. Departments in London. As part of a team, you will be responsible for implementing Big Data Solutions in Mission-Critical areas. WE NEED THE BIG DATAENGINEER TO HAVE.... Current DV clearance - Standard or Enhanced Must have experience with big data tools such as Hadoop, Cloudera More ❯
Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior DataEngineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. This role … suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced DataEngineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or Tech company … you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯
Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior DataEngineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. This role … suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced DataEngineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or Tech company … you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯
Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior DataEngineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. This role … suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced DataEngineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or Tech company … you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯
london (city of london), south east england, united kingdom
Talent Insights Group
Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior DataEngineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. This role … suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced DataEngineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or Tech company … you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯
Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) London/Hybrid 70-80k base plus super and equity A fast-growing, data-driven organisation is seeking a Senior DataEngineer to design, build, and maintain scalable data infrastructure and workflows that power analytics and decision-making across the business. This role … suits an engineer who’s passionate about data warehousing, data operations, and cloud infrastructure, with strong technical foundations and a focus on delivering robust, production-ready solutions. This will suit an experienced DataEngineer with a passion for the modern tech stack and an appetite for AI, ideally from a start-up or Tech company … you’re proactive, ambitious and ready to join a rocketship that’s well and truly taking off, this one is for you! Day to day responsibilities for the Senior DataEngineer ( SQL/BigQuery/Airflow/Terraform ) include : Build and maintain data pipelines and warehouse solutions using BigQuery (or similar cloud platforms). Write high-performance More ❯
Job summary The Clinical DataEngineer will be instrumental in driving the Health Data Institute's mission to leverage data for improved healthcare outcomes. Collaborating with the Principal Data Scientist, Head of Data Science & Advanced Analytics, multidisciplinary teams and Industry Partners, the Clinical DataEngineer will design, build, and operationalise robust data engineering and AI solutions that power advanced analytics and AI initiatives across the Trust and beyond. This position requires strong technical capability in SQL, data pipeline architecture, statistical analysis, machine learning, and predictive analytics, combined with a sound understanding of clinical and operational environments. The Clinical DataEngineer will be responsible for developing high-quality health … datasets, enhancing data infrastructure, and advising internal teams on best practices in data engineering and analytics. As a technical lead and trusted advisor, the Clinical DataEngineer will help curate bespoke datasets for Advanced Analytics, design and develop AI solutions, shape AI policy, support service innovation, and ensure all solutions align with the Trust's Digital More ❯
About The Role Job level: 10 Deadline for applications: 11:59pm on Sunday 26th October. Were looking for a Lead DataEngineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising and sharing opportunities to … reuse data flows where possible. Coordinate teams and set best practices and standards when it comes to data engineering principles. Champion data engineering across projects and clients. Responsibilities Lead by example, holding responsibilities for team culture, and how projects deliver the most impact and value to our clients. Be accountable for the strategic direction, delivery and growth … mid- to long-term delivery cycles (612 months), ensuring that near-term work supports broader programme and client objectives. About You Professional knowledge and experience Essential Proven experience in data engineering, data integration and data modelling Expertise with cloud platforms (e.g. AWS, Azure, GCP) Expertise with modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with More ❯
hastings, south east england, united kingdom Hybrid / WFH Options
Stratospherec Limited
Lead/Senior DataEngineer – Global Software Company – ideally hybrid 2 to 4 days a month in Hastings, East Sussex – up to 70K plus an extensive benefits package. Stratospherec is delighted to be recruiting for a Lead/Senior DataEngineer with strong leadership and mentoring expertise to join the talented data services team at … our client, a leading global software technology company based in East Sussex. This is a unique opportunity for a 'hands on' Lead/Senior DataEngineer who is able to demonstrate previous proven success leading on strategy and deliverables for a number of years at an end client. Additionally, you should have proven leadership and mentoring experience, with … a high level of competency in Microsoft Azure data tools, particularly Microsoft Fabric, with an emphasis on OneLake and Data Factory. In this exciting Lead/Senior DataEngineer role, you will have a significant impact on company strategy, building out the company's processes to collect, manage and convert raw data to evaluate and More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
London, England, United Kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
london, south east england, united kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
Leeds, West Yorkshire, England, United Kingdom Hybrid / WFH Options
Robert Walters
Senior DataEngineer - Greenfield AWS Role Leeds (Hybrid) £75,000-£85,000 Our client is a nationally recognised leader in their industry, operating across the UK with a strong reputation for innovation and excellence. As part of their continued investment in data, they are building a high-performing data function to support enterprise-wide transformation and … insight-driven decision-making. The Role: We are seeking a Senior DataEngineer to play a key role in the design, build, and implementation of a new enterprise data platform as the business migrates to AWS. You will work closely with architects, analysts, and data scientists to develop robust, scalable, and secure data solutions that … enable analytics, AI, and advanced insights. This role is ideal for an ambitious engineer who wants to take ownership of technical delivery and grow into a Lead DataEngineer position within 12-18 months as the team expands through the next phase of the company's data strategy. Senior DataEngineer Responsibilities: Contribute to More ❯