1 to 25 of 59 Remote/Hybrid Data Lake Jobs

strategy and standards Design and support data solutions using Azure-based services such as Data Factory and Data Lake Essential Skills & Experience Active SC (Security Check) clearance Strong experience in data modelling, including conceptual, logical, and physical data models … modelling tools Latest hands-on experience with Azure-based data services, including Data Factory and Data Lake Strong understanding of data classification, data security, and encryption principles Experience working in client-facing environments within complex programmes Experience ...

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading … This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data warehouse, creating a scalable, governed single source of truth for trading, risk and commercial data across ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

Architect/Data Architect Strong hands-on experience with Azure Databricks (ETL/ELT pipelines) Experience working across Azure Data Lake, Azure Data Factory and cloud platforms Understanding of Databricks Lakehouse architecture Experience designing enterprise-level data architectures Data … platforms Building and optimising Azure Databricks ETL/ELT pipelines Leading Lakehouse architecture implementations (greenfield Databricks projects) Working across Azure Data Lake, Data Factory and multiple data sources Implementing performance optimisation (partitioning, clustering) within Databricks Defining data models and Databricks ...

Architect/Data Architect Strong hands-on experience with Azure Databricks (ETL/ELT pipelines) Experience working across Azure Data Lake, Azure Data Factory and cloud platforms Understanding of Databricks Lakehouse architecture Experience designing enterprise-level data architectures Data … platforms Building and optimising Azure Databricks ETL/ELT pipelines Leading Lakehouse architecture implementations (greenfield Databricks projects) Working across Azure Data Lake, Data Factory and multiple data sources Implementing performance optimisation (partitioning, clustering) within Databricks Defining data models and Databricks ...

architecture, tooling, and people Support the move toward a more centralised data setup (e.g. data warehouse or data lake), where appropriate Ensure data solutions are scalable, governed, and not dependent on individual knowledge Act as a senior stakeholder for data … essential) Experience with Power Automate or similar tools Understanding of APIs and system integrations Knowledge of data warehousing or data lake concepts Experience with data governance, compliance, and data protection (e.g. GDPR) Personal Attributes Pragmatic, hands‐on, and resilient Comfortable working ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … platform ensuring reliable data across the organisation Extensive hands-on experience designing and delivering scalable, resilient cloud-based data lake platforms using modern lakehouse architectures Drive better data governance through the creation and embedding of principles and processes Build and maintain ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

Title: Senior Data Engineer Location: Warwick (Hybrid Working) Rate: £550 - £650 per day (Umbrella) Contract: Initial 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead the design, development, and maintenance of data integration solutions and data warehouse environments. This role will focus on building and optimising ETL/ELT pipelines, supporting data warehousing initiatives, and ensuring the quality, performance, and reliability of large-scale data systems. The successful candidate will collaborate closely with data architects, analysts, and developers ...

multiple sources (APIs, databases, SaaS platforms) Develop and maintain data platforms in Azure (e.g. Data Factory, Synapse, Data Lake) Structure and model data to support analytics and business use cases Work closely with clients to understand requirements and translate them into … skills and understanding of data modelling Experience with Azure data services (Data Factory, Synapse, Data Lake preferred) Experience integrating data via APIs and external systems Solid consulting skills - communication, problem-solving, stakeholder engagement Eligible for SC Security Check Benefits ...

Associate Director, Master Data Management Solution Architect, Engineering, AI & Data, Technology & Transformation Basic information Location London Business Line Job Type Permanent/FTC Date published 10-Dec-2025 Connect to your Industry Do you want to be at the heart of some of the biggest … reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex) and modern integration technologies (APIs, streaming, ETL/ELT). Solid understanding of data governance, data lineage ...

Responsibilities Design, build, and maintain scalable data pipelines (primarily in Python) Architect and evolve a modern data platform (ingestion, lake, warehouse, and consumption layers) Develop and optimise data warehousing solutions, including ClickHouse and cloud-based platforms Implement and manage data orchestration … practices Experience with semantic layers and business-facing data models Track record of building end-to-end data platforms (ingestion → lake → warehouse) Comfortable working in an agile, iterative delivery environment The Offer Salary: Up to £110,000 Bonus: Strong performance-based bonus Location: London (Hybrid ...

sources Design and manage Purview scans, collections, and data maps for structured platforms including Azure SQL, Synapse, and Azure Data Lake Configure classifications, sensitivity labels, business metadata, and lineage for structured datasets Support the definition and implementation of structured data governance operating models … data governance use cases Proven experience working with structured data platforms such as Azure SQL, Azure Synapse, Data Lake Gen2, or similar Solid understanding of structured data concepts including relational models, data warehouses, and analytics architectures Experience designing ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data … Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions using Delta Lake and medallion architecture (bronze, silver, gold) Optimise performance ...

pipelines Develop and manage ETL processes across Azure data platforms Work with Azure Data Factory, Azure Data Lake, and Azure SQL Collaborate with stakeholders to integrate data from multiple sources Support data warehouse development and optimisation Implement best … Contribute to CI/CD pipelines and deployment processes Required Skills & Experience Strong experience with Azure Data Factory, Azure Data Lake, and Azure SQL Solid background in ETL development and data pipeline engineering Proficiency in Python and SQL Experience with Spark and Databricks ...

Data Manager (Data Governance) Location: Manchester (Hybrid) Contract Duration: 6 Months Working Hours: 37.5 hours per week We are looking for a proactive Data Manager to join a global travel leader's Data Governance team. This role is pivotal in supporting … years of experience in Data Governance, MDM, or lifecycle management. Concepts: Strong understanding of Data Warehouse vs. Data Lake architectures and ETL workflows. Communication: Ability to translate technical data issues into actionable business insights for senior stakeholders. Randstad Technologies is acting ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Role We`re looking for a new Data Engineer to join our Technology team based in Loudwater, Buckinghamshire. In this role, you will have a passion for uncovering insights and making data-driven decisions. Your expertise lies in working with a range of tools (SQL, Python … fast-paced retail/multi-site/FMCG space. Strong experience using modern data platforms and services (Fabric, Data Lake, Azure Data Factory, SQL (On-prem/Cloud) to build conformed and derived data models for the purpose of integrations, reporting ...

Data Engineer - Azure or AWS with Databricks - London (Hybrid) - £75,000 + benefits We're partnering with a high-performing organisation that continues to invest heavily in its data capability. Over the last 24 months, the business has achieved 33% growth in its data … building end-to-end data pipelines using Databricks on Azure or AWS Developing modern lakehouse architectures using: Databricks (Spark, SQL, Delta Lake) Azure Data Lake Storage or Amazon S3 Writing high-quality PySpark, Python, and SQL for ingestion, transformation, and modelling Implementing Bronze/ ...

code agentic workflow platform — while simultaneously owning the data and model foundations that power them: the Sidetrade Data Lake, our ML model portfolio, and our LLM fine-tuning strategy. About Sidetrade: Sidetrade is an AI company, listed on Euronext Growth, on a mission to revolutionize … compose intelligent O2C workflows using agentic AI — without writing a line of code. Own the product strategy for the Sidetrade Data Lake — defining how data assets are structured, enriched, governed, and surfaced across all O2C domains, driving continuous improvement across Gold, Silver, and Bronze data ...

Data Engineer - SC Cleared/SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior … modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good communication and stakeholder engagement • Understanding of secure ...

Data Engineer – London – Databricks – Azure – 75k + bonus + benefits I’m currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they’ve established themselves … forefront of your field. What You’ll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines What you’ll do Design and implement ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling’s such as CI/CD pipelines and version control. The ability … will be responsible for the Design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisations architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping stakeholders ...

Data Developer Widnes, Cheshire- Hybrid Working £39,602 per annum Permanent, Full Time 37 hours per week The Data Developer plays a critical role at Halton Housing, a forward-thinking organisation managing over 7,000 homes with around 330 colleagues, where innovation and customers … engineeringsolutions with Microsoft Fabric,SQLand Python. Developing & maintaining ETL pipeline solutions in Azure Data Factory, utilising Azure Data Lake &AzureDev Ops. Providingsecondandthird linesupport for Data Team and ownallocatedsupport tickets. Monitoring the Data Warehouse load and performance. Performing routine ...

Data Developer Widnes, Cheshire - Hybrid Working £39,602 per annum Permanent, Full Time 37 hours per week The Data Developer plays a critical role at Halton Housing, a forward-thinking organisation managing over 7,000 homes with around 330 colleagues, where innovation and customers … engineering solutions with Microsoft Fabric, SQL and Python. Developing & maintaining ETL pipeline solutions in Azure Data Factory, utilising Azure Data Lake & Azure Dev Ops. Providing second and third line support for Data Team and own allocated support tickets. Monitoring the Data ...