1 to 25 of 70 Remote/Hybrid Data Lake Jobs in the UK

platform that directly supports board-level decision making. The technology stack is Microsoft-led, with an Azure environment, Azure Data Lake, Power BI, and Power Apps, alongside a bespoke operational system and an ERP that need to be integrated. Key Responsibilities Design and build … modern Azure-based data platform, including: Azure Data Lake Data ingestion pipelines Data modelling and transformation Automate ingestion of data from: Bespoke operational systems ERP systems High-volume transactional sources (1,000+ transactions per hour) Establish robust data ...

flows (statistics, APIs, surveillance intelligence, unstructured sources). Evaluate 2 to 3 infrastructure options, including Azure-based Analytical Platform (e.g., Data Lake, Data Factory, Databricks, or Fabric), Microsoft Fabric "small org" model, and a Hybrid model Produce the Data infrastructure blueprint. Design … Strong practical knowledge of Microsoft 365/Azure investments and services, specifically those for data and analytics (e.g., Azure Data Lake, Azure Data Factory, Databricks, Microsoft Fabric). Experience with Reproducible Analytical Pipelines (RAPs) , including the setup of appropriate Python/R environments ...

Title: Data Architect Location: London (Hybrid - minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data … Keywords Senior Data Engineer, Data Engineer, Microsoft Fabric, Azure Data Engineer, Data Warehouse, Data Lake, Lakehouse, ETL, Data Pipelines, SQL Server, SQL, Power BI, Python, M Language, R, Microsoft Partner, Consultancy, MSP, Scotland, Remote, Hybrid ...

Role: Data Architect Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Rate: £550 - £650 per day Security Clearance: Active SC Clearance required Project Description We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise-scale … roles High proficiency in SQL and database technologies (e.g. Oracle, SQL Server, PostgreSQL, MySQL) Strong knowledge of data warehouse, data lake, and lakehouse architectures Experience with ETL/ELT frameworks and orchestration tools (e.g. Informatica, Talend, Apache Airflow) Proven experience establishing and maintaining data ...

Head of Data Salary: Up to £120,000 + Bonus I am working with a forward-thinking organisation that is modernising its data capabilities to enable scalable analytics, reporting and data-driven decision-making across the Group. They are looking for a Head … , Data Director, or similar). Strong understanding of modern data platforms and architecture, including Azure Data Lake Storage, Azure SQL Data Warehouse, or Azure Databricks. Expertise in data governance, compliance, and security best practices. Knowledge of analytics ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Architect Harrogate- Hybrid workingUp to £80,000 (DOE) + Benefits Are you an experienced Data Architect looking to shape the data foundations of a modern, forward-thinking organisation? This is a rare opportunity to take ownership of enterprise-wide data architecture … play a central role in how data is structured, governed, protected, and leveraged across the business. In this role, you'll define the organisation's data vision and turn strategic goals into real, scalable data capabilities - ensuring data is trusted, secure ...

Data Engineer Location: Sheffield (Hybrid - 3 days per week onsite) Salary: £50,000-£60,000 depending on experience DCS Tech are searching for an experienced Data Engineer to join our clients growing team! You will play a crucial part in designing, building, and optimising the data … tools. Consolidate data from internal systems, APIs, and third-party sources into a unified data warehouse or data lake environment. Build and maintain robust data models to ensure accuracy, consistency, and accessibility across the organisation. Work closely with Data ...

Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark … Proven ability to engage senior stakeholders and clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working ...

Title: Senior Data Engineer Location: London (Hybrid - minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines that … translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience Experience with enterprise data ...

Data Engineer Fully Remote 6 Months Contract £550 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … data (JSON, XML) Experience with Microsoft Azure data services such as Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse, Azure Functions, Cosmos DB Familiarity with Git repositories and branching strategies Exposure to additional technologies such as PowerShell, Bicep, YAML ...

Role: Lead Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a lead data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Hands on skills across the GCP tech stack, SQL and Python. Ability to lead cultural change across organisations, and manage senior ...

Senior Data Engineer Fully Remote 6 Months Contract £600 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … data (JSON, XML) Experience with Microsoft Azure data services such as Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse, Azure Functions, Cosmos DB Familiarity with Git repositories and branching strategies Exposure to additional technologies such as PowerShell, Bicep, YAML ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … clients turn complexity into opportunity, and fostering a culture where technical specialists thrive and grow. An opportunity has arisen for a Principal GCP Data Engineer to join the London-based data and analytics practice. This Principal GCP Data Engineer role offers the chance ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … clients turn complexity into opportunity, and fostering a culture where technical specialists thrive and grow. An opportunity has arisen for a Principal GCP Data Engineer to join the London-based data and analytics practice. This Principal GCP Data Engineer role offers the chance ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … clients turn complexity into opportunity, and fostering a culture where technical specialists thrive and grow. An opportunity has arisen for a Principal GCP Data Engineer to join the London-based data and analytics practice. This Principal GCP Data Engineer role offers the chance ...

Principal GCP Data Engineer £Up to £95,000 GBP Hybrid WORKING Location: Bristol; Gloucester; Cardiff; Corsham; Cheltenham, Bristol, South West - United Kingdom Type: Permanent Principal GCP Data Engineer Join an award-winning innovation and transformation consultancy recognised for its cutting-edge work in data … clients turn complexity into opportunity, and fostering a culture where technical specialists thrive and grow. An opportunity has arisen for a Principal GCP Data Engineer to join the London-based data and analytics practice. This Principal GCP Data Engineer role offers the chance ...

Data Platform Consultant A fast-growing, forward-thinking technology Microsoft partnered consultancy is looking for a Data Platform Consultant to join their expanding Data & Analytics practice. This is an exciting opportunity to work on diverse, high-impact data transformation programmes across both … data modelling and data engineering Expertise with: Azure Data Services (Data Factory, Data Lake, Synapse, SQL, Analysis Services) Microsoft Fabric & Power BI On-prem equivalents (SSIS, SSAS, SSRS) welcome Highly proficient in T-SQL; experience with M, DAX, Python ...

Data Engineer/Architect This organisation builds and manages critical healthcare infrastructure used by communities across the UK. As data becomes central to decision-making and innovation, they’re investing heavily in modern platforms and AI-led solutions. This role sits at the heart of that … pipelines Advanced Python and SQL skills Solid hands-on experience with Azure data services (Data Factory, Synapse, Data Lake, Functions, Logic Apps) Power BI data modelling and dashboard development expertise Practical experience using OpenAI APIs or similar AI/ML services ...

Interim Principal Azure Data Architect Location: North London (hybrid) Contract: Interim Rate:£900 per day outside IR 35 A complex organisation based in North London is seeking an Interim Principal Azure Data Architect to reset, review, and re-implement its data architecture . This … architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets ...

Details Role/Job Title: Data Engineer Work Location: Manchester, UK Mode of Working: Hybrid Office Requirement (Hybrid): Tuesday/Wednesday/Thursday The Role Seeking a Data Engineer profile with deep technical expertise and thought leadership, provides advanced data solutions by using software … process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract ...