1 to 25 of 47 Remote/Hybrid Permanent Data Lake Jobs

strategy and standards Design and support data solutions using Azure-based services such as Data Factory and Data Lake Essential Skills & Experience Active SC (Security Check) clearance Strong experience in data modelling, including conceptual, logical, and physical data models … modelling tools Latest hands-on experience with Azure-based data services, including Data Factory and Data Lake Strong understanding of data classification, data security, and encryption principles Experience working in client-facing environments within complex programmes Experience ...

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading … This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data warehouse, creating a scalable, governed single source of truth for trading, risk and commercial data across ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

Architect/Data Architect Strong hands-on experience with Azure Databricks (ETL/ELT pipelines) Experience working across Azure Data Lake, Azure Data Factory and cloud platforms Understanding of Databricks Lakehouse architecture Experience designing enterprise-level data architectures Data … platforms Building and optimising Azure Databricks ETL/ELT pipelines Leading Lakehouse architecture implementations (greenfield Databricks projects) Working across Azure Data Lake, Data Factory and multiple data sources Implementing performance optimisation (partitioning, clustering) within Databricks Defining data models and Databricks ...

Architect/Data Architect Strong hands-on experience with Azure Databricks (ETL/ELT pipelines) Experience working across Azure Data Lake, Azure Data Factory and cloud platforms Understanding of Databricks Lakehouse architecture Experience designing enterprise-level data architectures Data … platforms Building and optimising Azure Databricks ETL/ELT pipelines Leading Lakehouse architecture implementations (greenfield Databricks projects) Working across Azure Data Lake, Data Factory and multiple data sources Implementing performance optimisation (partitioning, clustering) within Databricks Defining data models and Databricks ...

architecture, tooling, and people Support the move toward a more centralised data setup (e.g. data warehouse or data lake), where appropriate Ensure data solutions are scalable, governed, and not dependent on individual knowledge Act as a senior stakeholder for data … essential) Experience with Power Automate or similar tools Understanding of APIs and system integrations Knowledge of data warehousing or data lake concepts Experience with data governance, compliance, and data protection (e.g. GDPR) Personal Attributes Pragmatic, hands‐on, and resilient Comfortable working ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … platform ensuring reliable data across the organisation Extensive hands-on experience designing and delivering scalable, resilient cloud-based data lake platforms using modern lakehouse architectures Drive better data governance through the creation and embedding of principles and processes Build and maintain ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

Associate Director, Master Data Management Solution Architect, Engineering, AI & Data, Technology & Transformation Basic information Location London Business Line Job Type Permanent/FTC Date published 10-Dec-2025 Connect to your Industry Do you want to be at the heart of some of the biggest … reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex) and modern integration technologies (APIs, streaming, ETL/ELT). Solid understanding of data governance, data lineage ...

Role We`re looking for a new Data Engineer to join our Technology team based in Loudwater, Buckinghamshire. In this role, you will have a passion for uncovering insights and making data-driven decisions. Your expertise lies in working with a range of tools (SQL, Python … fast-paced retail/multi-site/FMCG space. Strong experience using modern data platforms and services (Fabric, Data Lake, Azure Data Factory, SQL (On-prem/Cloud) to build conformed and derived data models for the purpose of integrations, reporting ...

Data Engineer - Azure or AWS with Databricks - London (Hybrid) - £75,000 + benefits We're partnering with a high-performing organisation that continues to invest heavily in its data capability. Over the last 24 months, the business has achieved 33% growth in its data … building end-to-end data pipelines using Databricks on Azure or AWS Developing modern lakehouse architectures using: Databricks (Spark, SQL, Delta Lake) Azure Data Lake Storage or Amazon S3 Writing high-quality PySpark, Python, and SQL for ingestion, transformation, and modelling Implementing Bronze/ ...

code agentic workflow platform — while simultaneously owning the data and model foundations that power them: the Sidetrade Data Lake, our ML model portfolio, and our LLM fine-tuning strategy. About Sidetrade: Sidetrade is an AI company, listed on Euronext Growth, on a mission to revolutionize … compose intelligent O2C workflows using agentic AI — without writing a line of code. Own the product strategy for the Sidetrade Data Lake — defining how data assets are structured, enriched, governed, and surfaced across all O2C domains, driving continuous improvement across Gold, Silver, and Bronze data ...

Data Engineer - SC Cleared/SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior … modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good communication and stakeholder engagement • Understanding of secure ...

Data Engineer – London – Databricks – Azure – 75k + bonus + benefits I’m currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they’ve established themselves … forefront of your field. What You’ll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines What you’ll do Design and implement ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling’s such as CI/CD pipelines and version control. The ability … will be responsible for the Design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisations architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping stakeholders ...

Data Developer Widnes, Cheshire- Hybrid Working £39,602 per annum Permanent, Full Time 37 hours per week The Data Developer plays a critical role at Halton Housing, a forward-thinking organisation managing over 7,000 homes with around 330 colleagues, where innovation and customers … engineeringsolutions with Microsoft Fabric,SQLand Python. Developing & maintaining ETL pipeline solutions in Azure Data Factory, utilising Azure Data Lake &AzureDev Ops. Providingsecondandthird linesupport for Data Team and ownallocatedsupport tickets. Monitoring the Data Warehouse load and performance. Performing routine ...

Data Developer Widnes, Cheshire - Hybrid Working £39,602 per annum Permanent, Full Time 37 hours per week The Data Developer plays a critical role at Halton Housing, a forward-thinking organisation managing over 7,000 homes with around 330 colleagues, where innovation and customers … engineering solutions with Microsoft Fabric, SQL and Python. Developing & maintaining ETL pipeline solutions in Azure Data Factory, utilising Azure Data Lake & Azure Dev Ops. Providing second and third line support for Data Team and own allocated support tickets. Monitoring the Data ...

Data Architect Up to £90,000 (Dependant on Experience) This is a hybrid position, combining the best of both worlds - working from home and spending 1-2 days a week in ourHalifaxoffice. We have an exciting opportunity to join us here atCovéa Insuranceas a Data Architect … Data Vault, Kimball, Inmon, and medallion design patterns Broad experience with cloud and on-prem Data Warehouse, Data Lake, and Lakehouse architectures Relevant cloud/data architecture certifications (Databricks, AWS, Azure) preferred Confident working with stakeholders at all levels, including partners ...

scalable Azure-based data pipelines Build and maintain ETL workflows supporting analytics and reporting Support Azure Synapse and Azure Data Lake production environments Contribute to the migration and adoption of Microsoft Fabric Develop and optimise data models supporting business intelligence Support Power … Requirements Strong experience in Azure data engineering Advanced SQL skills including performance tuning Experience with Azure Synapse and Azure Data Lake Strong ETL development experience Experience working with Power BI Knowledge of Microsoft Fabric Experience working within Agile environments Strong communication and collaboration skills Benefits ...

active SC clearance to be considered. Responsibilities Design, build and maintain Databricks data pipelines using Apache Spark (PySpark & Spark SQL) Implement Delta Lake/Lakehouse architectures (Bronze, Silver, Gold) Develop scalable ELT/ETL workflows for batch and streaming data Optimise performance, reliability and cost … experience as a Databricks Data Engineer Strong PySpark and SQL capability Hands-on delivery within AWS, Azure or GCP Experience with Delta Lake , data lakes and data warehouses Strong understanding of data modelling and scalable pipeline design Experience with ...

Define the long-term technical vision and roadmap for our modern Data Platform, Mobius (including Data Warehousing, Data Lake, Streaming, and Governance tooling). Design and govern the reference architecture for core data infrastructure, ensuring optimal scalability, reliability, and security. … engineering, with provable experience operating at a Principal, Staff, or equivalent level. Deep proficiency across the modern data stack (Snowflake, BigQuery, Delta Lake, Iceberg, Kafka, Flink). Proven track record designing scalable, self-service data platforms using cloud-native services (AWS/GCP) and infrastructure ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid youll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. Youll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. Youll take ownership of data reliability end-to-end, designing and implementing ...

Cleared Technical Architect – Data Platforms Truenorth are currently working with a leading technology consultancy on a Technical Architect (Data Platforms) opportunity, supporting the design and evolution of large-scale, cloud-based data platforms across a range of high-impact programmes. This role is ideal … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

working with a global healthcare and insurance organisation who are making a real difference to people's lives. We require an experienced Senior Data Platform Engineer to join the AI and Data Platform teams. £100,000 + Bonus + Excellent Benefits Fully remote with occasional travel … Azure-based data solutions. * Expert-level knowledge of Azure and/or Snowflake services, including Data Factory, Data Lake, Azure ML, and Power BI/Fabric. * Proven experience with infrastructure-as-code using Terraform and building CI/CD pipelines via Azure DevOps ...

Data Analyst Permanent £60,000 Hybrid working (3 days in office, 2 days remote) Wigan Sellick Partnership are supporting our industry leading client with the recruitment on a Data Analyst on a permanent basis as it looks to invest and transform the way it uses … focusing on reporting, analysis, and decision support for senior stakeholders. The technology stack is Microsoft-led, with an Azure environment, Azure Data Lake, Power BI, and Power Apps, alongside a bespoke operational system and an ERP that need to be integrated. The business is experiencing a real ...