101 to 125 of 437 Lakehouse Jobs in England

workflow orchestrator such as Airflow, Dagster or Prefect, and transformation tooling such as dbt or equivalent SQL-based workflows Cloud warehouse, lake or lakehouse experience , and integrating data from external APIs, databases and files Correctness under failure. Understanding of schema design, data contracts, idempotency, replay, backfills and late-arriving ...

establishing engineering standards that improve reliability, maintainability, scalability and reuse.Your experience is likely to include several of the following: Microsoft Fabric Snowflake Azure OneLake Lakehouse architecture Data Factory Spark Python SQL ETL/ELT dimensional modelling Data Vault orchestration Git Azure DevOps/GitHub CI/CD Infrastructure … dependency management, exception handling and delivery. Design and assure robust analytical data models translate complex analytical and business requirements into well-engineered, reusable dimensional, Lakehouse, Data Vault and semantic models that improve analytical consistency and performance. Drive automation and analytical productivity identify manual, repetitive and inefficient processes within Data ...

models Design secure, scalable, resilient, and supportable data platforms and solutions Define patterns for data integration, transformation, storage, and analytics Support the design of lakehouse, warehouse, and reporting solutions using Azure-based services Ensure data quality, lineage, governance, and security are incorporated into solution design Collaborate with engineers … skills Self-sufficient and collaborative, with the ability to work independently, alongside a structured, detail-oriented, and outcome-focused approach Experience with Microsoft Fabric, lakehouse architectures, and hands‐on development using Python, SQL, or Spark would be advantageous, along with familiarity with integration technologies Knowledge of DevOps practices, Infrastructure ...

AI. Modernisation is at the heart of the role: helping customers move away from legacy data warehouses, databases and fragmented data estates towards modern lakehouse, warehouse and federated designs on platforms such as Databricks, Snowflake, Microsoft Fabric and Starburst. In a pre-sales capacity, there is a demand … define migration approaches and phased roadmaps, and identify risks, dependencies and quick wins. Data Architecture & Modelling - Design end-to-end data platform architectures, including lakehouse, warehouse, federated and data-product approaches. Apply appropriate modelling patterns such as medallion, dimensional and domain-oriented designs. Data Integration & Engineering - Design ingestion ...

AI. Modernisation is at the heart of the role: helping customers move away from legacy data warehouses, databases and fragmented data estates towards modern lakehouse, warehouse and federated designs on platforms such as Databricks, Snowflake, Microsoft Fabric and Starburst. In a pre-sales capacity, there is a demand … define migration approaches and phased roadmaps, and identify risks, dependencies and quick wins. Data Architecture & Modelling - Design end-to-end data platform architectures, including lakehouse, warehouse, federated and data-product approaches. Apply appropriate modelling patterns such as medallion, dimensional and domain-oriented designs. Data Integration & Engineering - Design ingestion ...

driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms. \* Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads. \* Define data ingestion, transformation, governance, and consumption frameworks aligned to enterprise standards. \* Evaluate ...

maintain test strategies, test plans, test cases, and test data sets aligned to each platforms delivery cadence and risk profile. Test data warehouse, lakehouse, and reporting outputs built on Azure Synapse, Microsoft Fabric, Tableau, and Power BI verifying data accuracy, performance, and visualisation correctness. Test integrations and middleware flows ...

agents. Headquartered in San Francisco with 30+ offices around the globe, Databricks offers a unified platform that includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow Databricks on LinkedIn , X , YouTube , and Instagram . At Databricks, we strive to provide comprehensive benefits and perks ...

data architect or senior data engineer working on large‐scale data and analytics platforms. Deep understanding of modern data architectures (e.g. data lakehouse, event‐driven architectures, streaming, data mesh principles). Strong knowledge of one or more leading cloud data stacks (e.g. GCP BigQuery, AWS Redshift/Glue, Azure ...

pipelines in AWS and/or GCP. Comfortable with data quality tooling and the mindset that correctness is non‐negotiable. Familiarity with medallion/lakehouse architecture patterns. Verbal and written fluency in English is required — we're a distributed team and written communication is important. Preferred Qualifications Airflow ...

advising on migration architecture, transition states, historical data migration and legacy decommissioning. Lead the architecture, design and development of scalable cloud data warehouse, lakehouse, streaming and analytics solutions. Define ingestion, transformation and orchestration patterns, naming and structural conventions, and the publication boundary between Product Engineering and Data Engineering. Identify ...

Data Modelling & Storage: Strong data modelling skills and the ability to select appropriate data stores—including relational, NoSQL, graph, time‐series, distributed SQL and lakehouse technologies—based on business and technical requirements. End‐to‐End Data Flows: Architect operational and analytical data pipelines across APIs, streaming, CDC, batch ...

strong track record of mentoring engineers, leading projects, and a clear desire to step into people management. Deep experience with a modern lakehouse, ideally Databricks and Unity Catalog, and with dbt. Comfortable on AWS and with infrastructure as code (Terraform), and able to hold your own in a design ...

Proven experience building data platforms on Azure. You know Databricks inside out – not just how to write a notebook, but how to architect a Lakehouse, manage clusters, and optimise costs. Data Modelling Proficiency: You understand that data engineering is more than moving JSON blobs. You have strong opinions ...

closely related discipline, with enough hands‐on credibility to review a design and challenge an approach. Practical experience with a public cloud lakehouse or modern data platform; Databricks and Spark experience is an advantage. Solid grounding in relational databases at scale, ideally including Oracle and/or PostgreSQL. Real ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that ...

data skills: fluent SQL, solid data modelling, and a modern data stack. We are building on Databricks, so experience there or with an equivalent lakehouse or warehouse, plus a transformation framework such as dbt and strong Python, is what we are looking for. Demonstrated fluency with AI automation tooling ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities* Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities* Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

Experience delivering AI solutions in areas such as risk, compliance, fraud, customer operations, lending, or regulatory reporting. Data architecture, data modernisation, data platforms, or lakehouse expertise. Experience supporting large-scale cloud migration or transformation programmes. Knowledge of AI governance, model risk management, and regulatory requirements within financial services. Exposure ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

designing and delivering enterprise data platforms in a commercial setting. Modern cloud data platforms and ELT patterns, with sufficient depth in warehouse, lake and lakehouse architectures to review and challenge platform designs and critically evaluate supplier proposals, with a particular focus on the Microsoft Azure stack. Data contract design ...

with the Program Office for planning deliveries, providing timelines, cost estimates, and status updates. Partner with Data Engineering to ensure data pipelines and lakehouse structures support AI delivery needs. Team Development: Support the Head of Data Science & AI Delivery in leading and developing a growing team of Data Scientists ...

advising on migration architecture, transition states, historical data migration and legacy decommissioning. Lead the architecture, design and development of scalable cloud data warehouse, lakehouse, streaming and analytics solutions. Define ingestion, transformation and orchestration patterns, naming and structural conventions, and the publication boundary between Product Engineering and Data Engineering. Identify ...

support trusted data products and star schemas for actionable operational, tactical and strategic insights. These models will increasingly be implemented within a modern Azure lakehouse environment and consumed through Power BI and other governed analytics services. You will support these models with artefacts such as business glossary and data … entries. As L&Q evolves its data platform, the Data Modeller will contribute to the definition and adoption of modelling standards for a medallion lakehouse architecture, working with Data Engineering, Data Governance, Data Quality and Analytics colleagues. The role will help translate platform requirements into practical modelling patterns across ...