Lead DataEngineer (Databricks) - Leeds (Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer, Python, PySpark, SQL, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI/CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform, AWS CDK, AWS CloudFormation, Azure, Lead DataEngineer, Team Lead, Technical Lead, Senior DataEngineer, DataEngineer) Our client is a global innovator and world leader with one of the most recognisable names within technology. They are looking for a Lead DataEngineer with significant Databricks experience as well as leadership responsibility to run an exceptional Agile engineering team and provide … technical leadership through coaching and mentorship. We are seeking a Lead DataEngineer capable of leading client delivery, ensuring the highest standards. This will include working with architects, creating automated tests, instilling a culture of continuous improvement and setting standards for the team. You will be responsible for building a greenfield modern data platform using cutting-edge More ❯
City Of Westminster, London, United Kingdom Hybrid / WFH Options
Additional Resources
An opportunity has arisen for a Senior DataEngineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior DataEngineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior DataEngineerMore ❯
Westminster, City of Westminster, Greater London, United Kingdom Hybrid / WFH Options
Additional Resources
An opportunity has arisen for a Senior DataEngineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior DataEngineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior DataEngineerMore ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Additional Resources Ltd
An opportunity has arisen for a Senior DataEngineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior DataEngineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. This is … role with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating infrastructure … using Infrastructure-as-Code tools such as Terraform and Ansible. Ensuring system reliability through observability, monitoring, and proactive issue resolution. Collaborating with cross-functional teams to align data solutions with wider business needs. Supporting the continuous improvement of processes, deployment, and data quality standards. What We Are Looking For: Previously worked as a Senior DataEngineerMore ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
london (city of london), south east england, united kingdom
Mastek
Job Title: Senior DataEngineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior DataEngineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic … data. This platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior DataEngineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and … experience working with large datasets. Key Responsibilities : Data Pipeline Development & Optimisation: Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and More ❯
of the largest geospatial businesses in the UK. The new division provides a compelling capability that covers the full geospatial lifecycle, from strategy and consultancy to powerful software and data as a service. Geospatial data significantly underpins the division’s current and future revenues. Within the Division’s Data & Research Team, the DataEngineer role … is responsible for designing, building and optimising our data pipelines and infrastructure, ensuring that the curation, delivery and value added use of our geospatial data catalogue is undertaken to a high quality. Working with the 3 sub teams of Research & Innovation, Data Delivery and Data Management you will ensure we provide quality assured data products … and services to our customers, maximising the potential for automation of our data pipelines, contributing to the development of new and existing data products and services and supporting our research and innovation projects. Continuous improvement is key to our success and you will directly contribute to the enhancement of our systems and processes as well as the adoption More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Involved Solutions
Senior DataEngineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior DataEngineer to join their growing Data & Middleware function, driving innovation and excellence … across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior DataEngineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance, and best-in-class engineering … standards Leverage Databricks, Spark, and modern cloud platforms (Azure/AWS) to deliver clean, high-quality data for analytics and operational insights Lead by example on engineering excellence, mentoring junior engineers and driving adoption of DevOps and CI/CD best practices within the data function Contribute to the evolution of a modern event-sourcing architecture, enabling efficient More ❯
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the … lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience … with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience building data pipelines please apply, or send your CV directly to DataEngineer/PostgreSQL/ More ❯
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the … lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience … with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk DataEngineer/ More ❯
City of London, London, United Kingdom Hybrid / WFH Options
Acquired Talent Ltd
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the … lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience … with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk DataEngineer/ More ❯
london, south east england, united kingdom Hybrid / WFH Options
Acquired Talent Ltd
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to 575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the … lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience … with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk DataEngineer/ More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Acquired Talent Ltd
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the … lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience … with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk DataEngineer/ More ❯
london (city of london), south east england, united kingdom Hybrid / WFH Options
Acquired Talent Ltd
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to 575 per day Location: Hybrid Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the … lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience … with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience building data pipelines please apply, or send your CV directly to callum@acquiredtalent.co.uk DataEngineer/ More ❯
DataEngineer/PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform For a complete understanding of this opportunity, and what will be required to be a successful applicant, read on. DataEngineer (Outside IR35 Contract role) Determination: Outside IR35 Day Rate: Up to £575 per day Location: Hybrid … Zone 1 Duration: 3 months (initial) Job Title: DataEngineer About the role: We're on the lookout for an experience DataEngineer for a SaaS Scale-up in the tech for good space. You'll be involved in the full end-to-end process, building data pipelines and dashboards. DataEngineer/… PostgreSQL/SQL/Data Pipelines/Apache Superset/PowerBI/Tableau/Terraform Requirements: 5+years' experience with PostgresSQL, SQL & Terrform Demonstrable experience with building data pipelines from scratch 3+ years' Dashboarding/Building Dashboards, (Apache Superset/PowerBI/Tableau) Experience with building report templates. If you are an experienced dataengineer with experience More ❯
hastings, south east england, united kingdom Hybrid / WFH Options
Stratospherec Limited
Lead/Senior DataEngineer – Global Software Company – ideally hybrid 2 to 4 days a month in Hastings, East Sussex – up to 70K plus an extensive benefits package. Stratospherec is delighted to be recruiting for a Lead/Senior DataEngineer with strong leadership and mentoring expertise to join the talented data services team at … our client, a leading global software technology company based in East Sussex. This is a unique opportunity for a 'hands on' Lead/Senior DataEngineer who is able to demonstrate previous proven success leading on strategy and deliverables for a number of years at an end client. Additionally, you should have proven leadership and mentoring experience, with … a high level of competency in Microsoft Azure data tools, particularly Microsoft Fabric, with an emphasis on OneLake and Data Factory. In this exciting Lead/Senior DataEngineer role, you will have a significant impact on company strategy, building out the company's processes to collect, manage and convert raw data to evaluate and More ❯
London, England, United Kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
City of London, London, England, United Kingdom Hybrid / WFH Options
Client Server Ltd
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
london, south east england, united kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
slough, south east england, united kingdom Hybrid / WFH Options
Client Server
Senior DataEngineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy DataEngineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on DataEngineer role. … As a Senior DataEngineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You'll collaborate … directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you: You are an More ❯
Azure/Databricks DataEngineer x2 - UK Wide (Hybrid Working) £72,000-£80,000 Duties As a Databricks DataEngineer with an Azure focus, you will be an integral part of our team dedicated to building scalable and secure data platforms. You will leverage your expertise in Databricks, Apache Spark, and Azure to design, develop … and implement data warehouses, data lakehouses, and AI/ML models that fuel our data-driven operations. Skills/Experience Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Develop and maintain secure data warehouses … and data lakehouses: Implement data models, data quality checks, and governance practices to ensure reliable and accurate data. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive models and drive business insights. Monitor and optimize data pipelines and infrastructure: Analyze performance metrics More ❯
Newcastle Upon Tyne, Tyne and Wear, England, United Kingdom
Noir
DataEngineer - FinTech - Newcastle (Tech stack: DataEngineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, DataEngineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle and are looking … for a talented DataEngineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a DataEngineer, you will take responsibility for the development of high-quality pipelines that process and manage large volumes of data from a range … of external and internal sources. You'll play a key role in enhancing and maintaining their central data platform, ensuring the smooth delivery of information that supports investment decision-making. Working closely with stakeholders across the business, you'll help shape how data is accessed, tested, and leveraged to maximise value. The successful candidate will bring More ❯