126 to 146 of 146 Data Lake Jobs in England

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Contract Data Engineer - Global Bank Location: Hybrid (London or Edinburgh preferred)?? Duration: 6-12 months? Day Rate: Competitive via Umbrella A leading global bank is seeking a skilled Data Engineer to join its next-generation data and AI transformation programme. This contract role offers the chance to work on high-impact initiatives, including powering … intelligent chatbots and AI-driven analytics across the organisation. Key Responsibilities: Design, build, and maintain scalable ETL data pipelines to support AI, chatbot, and analytics use cases. Collaborate with data scientists, ML engineers, and product teams to deliver clean, reliable data for model training and real-time inference. Enable chatbot platforms by integrating structured … and unstructured data sources for conversational AI applications. Develop and maintain Tableau dashboards to support data storytelling and operational insights. Optimise data workflows across cloud and on-prem environments, ensuring performance and reliability. Skills & Experience: Strong experience in ETL pipeline development using tools like Apache Airflow, Informatica, or similar. Advanced SQL skills and experience More ❯

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable, and test-driven code delivery.Key Responsibilities Develop and … ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data loads. Build and manage containerised environments using Docker for consistent development, testing, and deployment. Develop configurable, parameter … reusable data solutions. Integrate Azure services, including: Azure Functions for serverless transformation logic Azure Key Vault for secure credential management Azure Blob Storage for data lake operations What We're Looking For Proven experience in Python, PySpark, and Delta Lake. SC Cleared Strong knowledge of Behave for test-driven development. Experience with Docker and containerised More ❯

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable, and test-driven code delivery. Key Responsibilities Develop … ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data loads. Build and manage containerised environments using Docker for consistent development, testing, and deployment. Develop configurable, parameter … reusable data solutions. Integrate Azure services, including: Azure Functions for serverless transformation logic Azure Key Vault for secure credential management Azure Blob Storage for data lake operations What We're Looking For Proven experience in Python, PySpark, and Delta Lake. SC Cleared Strong knowledge of Behave for test-driven development. Experience with Docker and containerised More ❯

skills in Python , SQL , and optionally Java/Scala Hands-on experience with Palantir Foundry tools , including: Code Repositories, Pipeline Builder, Code Workbook Ontology Management, Contour, Solution Designer, Data Lineage Data Health, Data Connections, Egress Policies Experience in end-to-end solution development , from planning to scaling Strong understanding of data architecture … including data lakes, warehousing, schema design, and performance optimization Excellent communication and stakeholder management skills Ability to work in fast-paced, ambiguous environments and learn new tools quickly Package for the Palantir Forward Deployed Engineer, Palantir FDE Paying up to £1300 per day More ❯

Data Analyst (Athena) - Active SC essential Westminster or Croydon - approx 2 days per month on site Initial contract until the end of the financial year - extension possible We are looking for an experienced AWS/Athena Data Analyst to support a high-profile government project. The role involves designing, developing, and optimising data queries … and analytics solutions using AWS services, with a strong focus on Athena and S3-based data lakes. Key responsibilities: Develop and maintain SQL queries in AWS Athena for large-scale datasets Optimise data retrieval and ensure efficient performance across AWS environments Collaborate with stakeholders to translate business requirements into actionable insights Work with AWS services such … as Glue, Lambda, and S3 for ETL and data processing Ensure compliance with government data security and governance standards Essential skills: Strong proficiency in SQL and AWS Athena Hands-on experience with AWS data services (Glue, S3, Lambda) Knowledge of data modelling and performance tuning Excellent analytical and problem-solving skills Ability More ❯

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge projects using emerging technologies like Microsoft Fabric and Azure Databricks. … We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor a team of Technical Consultants, driving engagement, growth, and alignment with our culture. Oversee resource planning, scheduling, and performance management. Collaborate … Project Management teams to scope and deliver projects. Ensure consistent delivery of technical solutions aligned with best practices and standards. Support technical delivery when needed, including designing scalable data solutions in Microsoft/Azure environments. Contribute to innovation through cloud migrations, data lakes, and robust ETL/ELT solutions. What We're Looking For Hands-on More ❯

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge projects using emerging technologies like Microsoft Fabric and Azure Databricks. … We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor a team of Technical Consultants, driving engagement, growth, and alignment with our culture. Oversee resource planning, scheduling, and performance management. Collaborate … Project Management teams to scope and deliver projects. Ensure consistent delivery of technical solutions aligned with best practices and standards. Support technical delivery when needed, including designing scalable data solutions in Microsoft/Azure environments. Contribute to innovation through cloud migrations, data lakes, and robust ETL/ELT solutions. What We're Looking For Hands-on More ❯

Location: Leicester | Hybrid Working Available Type: Permanent Salary: £45 - 52k + Benefits Overview A forward-thinking organisation is looking for a skilled SQL Database Administrator to join its Data Services team. This is a hands-on role focused on maintaining, securing, and optimising both on-premise and cloud-based data environments. You'll be working with … a modern tech stack, contributing to transformation projects, and helping shape the future of data infrastructure. The Role You'll be responsible for the day-to-day management of SQL Server and Azure-based data systems, supporting ETL processes, and driving improvements across data platforms. This is a great opportunity for someone who enjoys … solving problems, improving systems, and working collaboratively across teams. Key Responsibilities Maintain and manage SQL Server and Azure data environments Ensure data system security, patching, and performance tuning Support ETL services and data operations Analyse and remediate legacy data structures Contribute to transformation and change initiatives Identify opportunities to improve data More ❯

based data platforms, supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing, and environmental promotion workflows. Expert-level knowledge of … Terraform for provisioning Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash, or PowerShell, with experience developing automation scripts … deployment utilities, and system health monitoring tools. Experience designing and implementing monitoring, logging, and observability solutions for data pipelines running in Azure Databricks, including cluster/job metrics, cost telemetry, and platform-level operational dashboards. Strong communication, documentation, and stakeholder management skills, collaborating effectively with technical and business teams. Understanding FinOps practices, including monitoring Azure cost drivers, analyzing More ❯

domain expertise (asset/wealth management), architectural leadership, and transformation technology experience. The ideal candidate will be responsible for shaping and delivering strategic modernisation efforts, spanning core platforms, data and digital initiatives, and AI-driven innovation in alignment with regulatory, operational, and customer-focused priorities with a key focus on Change the Bank (CTB) . The Opportunity Strategic … engagement platforms (e.g., advisor portals, investor dashboards, digital onboarding, portfolio analytics). Support rationalisation and integration of fragmented technology estates resulting from mergers, acquisitions, or platform expansion. AI & Data Strategy Enablement Identify and drive AI and data-driven use cases relevant to investment advisory, client servicing, risk management, and operational automation (e.g., hyper-personalisation, RPA, document … intelligence, GenAI for regulatory reporting or client communications). Collaborate with data and analytics teams to modernise the data estate, including data lakes, master data governance, lineage tracking, and real-time insights. Programme Oversight Serve as the technology lead or architect across large transformation initiatives, guiding multi-disciplinary teams in agile or More ❯

Join a fast-growing technology and engineering consultancy on a mission to become the UK’s leading name in engineering excellence. We’re looking for a Data Engineer who is passionate about technology, eager to sharpen their coding skills, and ready to make an impact in a collaborative, innovative environment. Data Engineer – Full Training on AWS … to upskill in cloud technologies. Exposure to cutting-edge projects across diverse industries. A supportive team culture focused on learning and growth. Your Day-to-Day Build modern data platforms and services using DevOps practices. Work on large-scale distributed workloads, batch and streaming pipelines, and implement robust monitoring solutions. Collaborate with architects, consultants, and client stakeholders to … help businesses unlock the power of their data. Contribute to internal projects and ongoing training to expand your expertise. What We’re Looking For Experience building data pipelines using Spark or Pandas . Familiarity with major cloud platforms (AWS, Azure, or GCP). Understanding of big data tools (EMR, Databricks, DataProc). Knowledge of data More ❯

About the Role Are you ready to blend expert Microsoft Stack engineering with a mission that truly matters? Barnardo's is embarking on an ambitious, long-term Digital, Data, and Technology (DDaT) strategy focused on automation, integration, and AI. As a key Integration and Application Engineer , you will be pivotal in building the technical foundations that will dramatically … particularly within the Microsoft Ecosystem. Essential Expertise: Microsoft Dynamics 365 F&O: Strong operational support experience, including understanding of core workspaces (Sales, Purchase, General Ledger, HR) and D365 Data Management skills. Azure Integration & DevOps: Expert knowledge of Azure Integration Services , and strong experience with CI/CD pipelines … Azure DevOps, Terraform, BICEP, and AzureCLI . Microsoft Stack Mastery: Expert knowledge of the full Microsoft Stack, including Power Platform (Power Automate, Power Apps, CoPilot), Azure (Data Lake, Synapse), and M365 (Office, SharePoint) . Integration Skills: Proven ability to design, build, and manage APIs and link external APIs (Azure AD Applications) to D365/M365. Experience: Demonstrated More ❯

Integrations using API based policies ITIL 4 UK Public Sector deals Familiarity with: AI(Ops), Intelligent Automation, Lean and Analytics Experience with tooling for Discovery, Monitoring and Patching Data lakes Modern Catalog Management ServiceNow, SMAX or Remedy is a plus UK Security Clearance: At least SC More ❯

We are searching for one of our key clients a Senior Data Platform Engineer to support and optimise large scale data ecosystems across PostgreSQL, Snowflake and Greenplum. This is a high-impact role within a modern digital environment, ideal for someone who thrives on complex data challenges and enterprise-grade engineering. Youll be responsible … for designing scalable data models, optimising performance across multiple database technologies, and enabling seamless data ingestion pipelines. Expect to work in a cloud-driven setting with Azure, modern tooling, and critical data platforms that underpin major transformation programmes. Key skills required Deep knowledge of PostgreSQL, Snowflake and Greenplum Snowflake internals, schemas, modelling, data lakes and integration patterns Data ingestion using Informatica, Talend and similar ETL tooling Strong experience handling JSON, XML, CSV and multi-source datasets Patroni expertise for HADR and streaming replication Backup, recovery, tuning and optimisation across Postgres, Snowflake and Greenplum Understanding of Azure environments If youre ready to join a forward-thinking organisation delivering enterprise-level More ❯

workflows. Ensure reliability, scalability, observability, and security of production systems and ML infrastructure. Automate deployment, orchestration, and environment management using modern DevOps tooling. Collaborate closely with software engineers, data scientists, and product teams to bring ML-powered features to production. Proactively detect, troubleshoot, and resolve infrastructure and model performance issues. Stay up to date with industry best practices … tools (Docker, Kubernetes). Solid understanding of CI/CD systems (e.g., GitHub Actions, GitLab CI, ArgoCD) and infrastructure-as-code tools (e.g., Terraform, Helm). Familiarity with data engineering concepts such as ETL pipelines, data lakes, and large-scale batch/stream processing. Ability to design scalable, secure, and observable systems in fast-moving environments. More ❯