17 of 17 Contract Data Lake Jobs in the UK excluding London

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Arcitecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

Data Architect (Azure) 6 Month Contract UK Based Via Umbrella Our UK leading life and pensions client are looking for a Data Architect to joun their team on an initial 6 month contract. Key Responsibilities Data Architecture & Design Define and maintain enterprise data architecture standards, models, and frameworks. Design data solutions leveraging Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Data Integration & ETL Develop and optimize data pipelines for ingestion, transformation … best practices in data architecture. Required Skills & Experience Technical Expertise Extensive experience with Azure Data Services: Data Factory, Databricks, Synapse, Data Lake, Azure SQL. Strong understanding of data modeling, data warehousing, and distributed computing. Proficiency in Python, SQL, and Spark for data engineering tasks. Financial More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support … data ingestion, transformation, and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. … Microsoft Azure. Strong expertise in data modelling, data warehousing, and ETL development. Hands-on experience with Azure Data Factory, Azure Data Lake, and Azure SQL Database. Exposure to big data technologies such as Hadoop, Spark, and Databricks. Experience with Azure Synapse Analytics or Cosmos DB. Familiarity with data More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data governance, security … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

Data Engineer (Databricks & Azure) - 3-Month Rolling Contract Rate: £400-£450 per day Location: Remote IR35 Status: Outside IR35 Duration: Initial 3 months (rolling) About the Company Join a leading Databricks Partner delivering innovative data solutions for enterprise clients. You'll work on cutting-edge projects leveraging Databricks and Azure to transform data into … for performance and reliability. Essential Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability to work independently in a … remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking for a flexible, remote opportunity with a Databricks Partner , we'd love to hear from you More ❯

Design and automate the deployment of Cloudera CDP components (Data Lake, Data Hubs, Data Services) using Terraform . Build and maintain CI/CD pipelines using GitHub Actions for infrastructure and data pipeline automation Collaborate with data engineering teams to integrate CDP with existing Big Data workflows. … in the cluster. Employ security using an authentication and authorization system such as Kerberos. Knowledge of changes required for migrating to Cloudera cloud version CDP Knowledge of Cloudera data services (CDW, CDE, CDF, CAI) Design Native Cloud Application Architectures and optimize applications for AWS Network connectivity, Direct Connect, VPN, VPC, Security group, NACL, Route 53 Must have in … VPC, Subnet, segmentation strategies. Environment and application automation CloudFormation and third-party automation approach/strategy AWS Cost Management and Optimization Job requirements Extensive experience with Cloudera cloud data platform (CDP) and CDP Services and Big data knowledge. Proficiency in Terraform for infrastructure as code (IaC). Strong hands-on experience with Cloudera CDP and Hadoop More ❯

Azure Data Engineer - 3-Month Contract - £450-£500/day - Outside IR35 Location: Remote (UK-based) Duration: 3 months Rate: £400-£450 per day (Outside IR35) Role Overview We are looking for an experienced Azure Data Engineer to join a short-term project focused on building and optimising cloud-based data solutions. This role … requires strong technical expertise in Azure services and modern data engineering practices, with the ability to deliver high-quality solutions in a fast-paced environment. Key Responsibilities Design and implement scalable data pipelines using Azure Data Factory , Databricks , and Synapse Analytics . Develop and optimise ETL processes for structured and semi-structured data. Work … Proven experience as an Azure Data Engineer in enterprise environments. Strong hands-on expertise with Azure Data Factory , Databricks , Synapse , and Azure Data Lake . Proficiency in SQL , Python , and PySpark . Experience with data modelling , ETL optimisation , and cloud migration projects . Familiarity with Agile delivery and CI/CD More ❯

GP/PSG DBA (good to know Snowflake) Key Responsibilities: * Candidate will have extensive working knowledge on PostgreSQL, Snowflake and Greenplum databases. * Snowflake internals and integration with other data processing technologies. * Data lakes, data structures and data models suited to Snowflake architecture. * Snowflake modelling - roles, schemas and databases. * Experience of building data ingestion pipelines with tools like Informatica, Talend etc. * Effective management of data from various sources like JSON, XML, CSV etc. * Expertise in Patroni for HADR and streaming replication. * Strong knowledge of Postgres/Greenplum database backup and recovery strategies. * Proven experience in performance tuning and optimization for Postgres/Snowflake and Greenplum. * Develop and maintain backup … strategies to ensure data integrity and availability. * Manage day-to-day activities such as database provisioning, maintenance, and upgrades in Postgres. * Perform data migrations using gpcopy and other tools, minimizing downtime and data loss. * Manage database bloat and leverage statistics for performance optimization. * Understand and utilize GPTEXT for troubleshooting complex issues. * Leverage Greenplum utilities More ❯

Azure Data Engineer (Databricks Specialist) About the Role We are seeking an experienced Azure Data Engineer with a strong focus on Databricks to join our team on a 3-month contract. This role is fully remote and outside IR35, offering flexibility and competitive day rates. You will play a key role in designing, building, and optimising … scalable data solutions in Azure, with Databricks at the core of the project. Responsibilities* Design and implement data pipelines using Azure Databricks.* Collaborate with developers, analysts, and DevOps teams to ensure smooth data integration.* Optimise performance of large-scale data processing workloads.* Work with stakeholders to understand application state and data … governance, security, and compliance. Key Skills & Experience* Proven experience as an Azure Data Engineer.* Strong hands-on expertise with Databricks - 5+ years experience (PySpark, notebooks, clusters, Delta Lake).* Solid knowledge of Azure services (Data Lake, Synapse, Data Factory, Event Hub).* Experience working with DevOps teams and CI/CD pipelines. More ❯

About the RoleWe are seeking a Databricks Data Engineer with strong expertise in designing and optimising large-scale data engineering solutions within the Databricks Data Intelligence Platform. This role is ideal for someone passionate about building high-performance data pipelines and ensuring robust data governance across … modern cloud environments.Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads. Implement data quality … with Databricks Unity Catalogue and governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management. Integrate Databricks solutions with Azure services such as Azure Data Lake More ❯

Data Engineer - Active SC, Databricks, PySpark Up to £475 per day (Inside IR35) Remote/London 6 months My client is an International Consultancy who are recruiting for an Data Engineer with Active Security Clearance (SC) and strong Databricks and Azure experience to deliver … and optimise Data engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions Familiarity with CI/CD for Databricks deployments Strong troubleshooting in distributed Data environments Excellent communication and collaboration skills Nice to have: Immediate availability Experience with enterprise-scale Databricks environments Knowledge of Azure Synapse, Power BI and cost optimisation strategies If you're interested in this role, click More ❯

Contract Data Engineer - Global Bank Location: Hybrid (London or Edinburgh preferred)?? Duration: 6-12 months? Day Rate: Competitive via Umbrella A leading global bank is seeking a skilled Data Engineer to join its next-generation data and AI transformation programme. This contract role offers the chance to work on high-impact initiatives, including powering … intelligent chatbots and AI-driven analytics across the organisation. Key Responsibilities: Design, build, and maintain scalable ETL data pipelines to support AI, chatbot, and analytics use cases. Collaborate with data scientists, ML engineers, and product teams to deliver clean, reliable data for model training and real-time inference. Enable chatbot platforms by integrating structured … and unstructured data sources for conversational AI applications. Develop and maintain Tableau dashboards to support data storytelling and operational insights. Optimise data workflows across cloud and on-prem environments, ensuring performance and reliability. Skills & Experience: Strong experience in ETL pipeline development using tools like Apache Airflow, Informatica, or similar. Advanced SQL skills and experience More ❯

About the RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable, and test-driven code delivery.Key Responsibilities Develop and … ingestion, transformation, and validation pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data loads. Build and manage containerised environments using Docker for consistent development, testing, and deployment. Develop configurable, parameter … reusable data solutions. Integrate Azure services, including: Azure Functions for serverless transformation logic Azure Key Vault for secure credential management Azure Blob Storage for data lake operations What We're Looking For Proven experience in Python, PySpark, and Delta Lake. SC Cleared Strong knowledge of Behave for test-driven development. Experience with Docker and containerised More ❯

Data Analyst (Athena) - Active SC essential Westminster or Croydon - approx 2 days per month on site Initial contract until the end of the financial year - extension possible We are looking for an experienced AWS/Athena Data Analyst to support a high-profile government project. The role involves designing, developing, and optimising data queries … and analytics solutions using AWS services, with a strong focus on Athena and S3-based data lakes. Key responsibilities: Develop and maintain SQL queries in AWS Athena for large-scale datasets Optimise data retrieval and ensure efficient performance across AWS environments Collaborate with stakeholders to translate business requirements into actionable insights Work with AWS services such … as Glue, Lambda, and S3 for ETL and data processing Ensure compliance with government data security and governance standards Essential skills: Strong proficiency in SQL and AWS Athena Hands-on experience with AWS data services (Glue, S3, Lambda) Knowledge of data modelling and performance tuning Excellent analytical and problem-solving skills Ability More ❯

based data platforms, supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing, and environmental promotion workflows. Expert-level knowledge of … Terraform for provisioning Databricks resources, Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash, or PowerShell, with experience developing automation scripts … deployment utilities, and system health monitoring tools. Experience designing and implementing monitoring, logging, and observability solutions for data pipelines running in Azure Databricks, including cluster/job metrics, cost telemetry, and platform-level operational dashboards. Strong communication, documentation, and stakeholder management skills, collaborating effectively with technical and business teams. Understanding FinOps practices, including monitoring Azure cost drivers, analyzing More ❯

Database Administrator (PostgreSQL/Greenplum/Snowflake) - 6 months - Glasgow- Inside IR35 We're looking for skilled DBAs to manage and optimize our enterprise data platforms across PostgreSQL, Greenplum, and Snowflake. If you love performance tuning, automation, and working with cutting-edge data tech, this role is for you. Key Responsibilities: Administer Postgres, Greenplum, and Snowflake … databases. Optimize performance, manage backups, and ensure database security. Build data pipelines (Informatica/Talend) and handle varied data formats. Perform migrations using gpcopy; use Greenplum tools (gpload, pxf, GP Spark). Manage Postgres HA/DR with Patroni and streaming replication. Create automation with Shell, Python, or Ansible. Implement monitoring and troubleshoot complex issues (GPTEXT … platforms: AWS/Azure/GCP What You Will Ideally Bring: Strong DBA experience with Postgres, Greenplum, Snowflake. Solid SQL and complex query writing. Knowledge of Snowflake modelling, data lakes, and architecture. Expertise in performance tuning and stats-based optimization. Understanding of ETL processes and ingestion tools. Bonus: experience with Informatica/Talend and multi-cloud environments. Contract More ❯