126 to 150 of 499 Lakehouse Jobs in the UK

pipelines in AWS and/or GCP. Comfortable with data quality tooling and the mindset that correctness is non‐negotiable. Familiarity with medallion/lakehouse architecture patterns. Verbal and written fluency in English is required — we're a distributed team and written communication is important. Preferred Qualifications Airflow ...

advising on migration architecture, transition states, historical data migration and legacy decommissioning. Lead the architecture, design and development of scalable cloud data warehouse, lakehouse, streaming and analytics solutions. Define ingestion, transformation and orchestration patterns, naming and structural conventions, and the publication boundary between Product Engineering and Data Engineering. Identify ...

Data Modelling & Storage: Strong data modelling skills and the ability to select appropriate data stores—including relational, NoSQL, graph, time‐series, distributed SQL and lakehouse technologies—based on business and technical requirements. End‐to‐End Data Flows: Architect operational and analytical data pipelines across APIs, streaming, CDC, batch ...

strong track record of mentoring engineers, leading projects, and a clear desire to step into people management. Deep experience with a modern lakehouse, ideally Databricks and Unity Catalog, and with dbt. Comfortable on AWS and with infrastructure as code (Terraform), and able to hold your own in a design ...

Proven experience building data platforms on Azure. You know Databricks inside out – not just how to write a notebook, but how to architect a Lakehouse, manage clusters, and optimise costs. Data Modelling Proficiency: You understand that data engineering is more than moving JSON blobs. You have strong opinions ...

closely related discipline, with enough hands‐on credibility to review a design and challenge an approach. Practical experience with a public cloud lakehouse or modern data platform; Databricks and Spark experience is an advantage. Solid grounding in relational databases at scale, ideally including Oracle and/or PostgreSQL. Real ...

responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. We are building a governed, interoperable data estate that ...

data skills: fluent SQL, solid data modelling, and a modern data stack. We are building on Databricks, so experience there or with an equivalent lakehouse or warehouse, plus a transformation framework such as dbt and strong Python, is what we are looking for. Demonstrated fluency with AI automation tooling ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities* Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities* Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

Experience delivering AI solutions in areas such as risk, compliance, fraud, customer operations, lending, or regulatory reporting. Data architecture, data modernisation, data platforms, or lakehouse expertise. Experience supporting large-scale cloud migration or transformation programmes. Knowledge of AI governance, model risk management, and regulatory requirements within financial services. Exposure ...

track record in leading the architecture vision, design & implementation of Enterprise scale data applications, with specific focus on Distributed Data Processing systems, Data LakeHouse, Data Products, Streaming data, ML & AI platform capabilities Working knowledge of ML and Generative AI, including the leverage of Agentic AI based systems within ...

designing and delivering enterprise data platforms in a commercial setting. Modern cloud data platforms and ELT patterns, with sufficient depth in warehouse, lake and lakehouse architectures to review and challenge platform designs and critically evaluate supplier proposals, with a particular focus on the Microsoft Azure stack. Data contract design ...

with the Program Office for planning deliveries, providing timelines, cost estimates, and status updates. Partner with Data Engineering to ensure data pipelines and lakehouse structures support AI delivery needs. Team Development: Support the Head of Data Science & AI Delivery in leading and developing a growing team of Data Scientists ...

advising on migration architecture, transition states, historical data migration and legacy decommissioning. Lead the architecture, design and development of scalable cloud data warehouse, lakehouse, streaming and analytics solutions. Define ingestion, transformation and orchestration patterns, naming and structural conventions, and the publication boundary between Product Engineering and Data Engineering. Identify ...

support trusted data products and star schemas for actionable operational, tactical and strategic insights. These models will increasingly be implemented within a modern Azure lakehouse environment and consumed through Power BI and other governed analytics services. You will support these models with artefacts such as business glossary and data … entries. As L&Q evolves its data platform, the Data Modeller will contribute to the definition and adoption of modelling standards for a medallion lakehouse architecture, working with Data Engineering, Data Governance, Data Quality and Analytics colleagues. The role will help translate platform requirements into practical modelling patterns across ...

alongside the Data Programme to build the foundational data capabilities required for those products: trusted, reusable data assets, reliable pipelines, data quality, lakehouse models and analytical products. These capabilities will support R&D products, AI applications, client intelligence and firm-wide decision support. This is a hands-on hybrid … Microsoft Fabric and Databricks to ingest, clean, standardise, enrich, version and publish structured, semi-structured and unstructured data as reusable data assets. Create scalable lakehouse data models, schemas, data contracts and reusable features for entities such as clients, organisations, people, matters, sectors, jurisdictions, opportunities and legal topics. Implement data ...

accessible data drives real business outcomes and supports growth across regulated industries.ResponsibilitiesImplement end-to-end Microsoft Fabric solutions based on approved architecture, including OneLake, Lakehouse, Warehouse, Data Factory pipelines, Dataflows Gen2, Notebooks (PySpark/Spark SQL) and Real-Time IntelligenceBuild medallion architectures (Bronze/Silver/Gold), including incremental … notebooksHands-on experience with Azure data services (Azure Data Factory, ADLS Gen2, Azure SQL, Synapse or Databricks)Solid understanding of data warehousing and lakehouse concepts, Delta/Parquet formats and dimensional modeling (Kimball)Experience with Real-Time Intelligence (Eventstreams, Eventhouse/KQL, Activator)Ability to turn architecture documents ...

Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/ELT frameworks, data pipelines, Lakehouse architectures and real-time data solutions, ensuring engineering excellence and reusability across the platform Establishing and governing enterprise data models, engineering standards, security controls … Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale data architectures, including data modelling, ETL/ELT frameworks, Lakehouse solutions, batch and real-time data processing, and cloud-native data platforms Strong understanding of data governance, security, architecture best practices and platform engineering ...

Gen2, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL and Event Hubs Designing and developing robust ETL/ELT frameworks, data pipelines, Lakehouse architectures and real-time data solutions, ensuring engineering excellence and reusability across the platform Establishing and governing enterprise data models, engineering standards, security controls … Analytics, Azure Databricks, Azure SQL and Event Hubs Extensive experience designing and implementing enterprise-scale data architectures, including data modelling, ETL/ELT frameworks, Lakehouse solutions, batch and real-time data processing, and cloud-native data platforms Strong understanding of data governance, security, architecture best practices and platform engineering ...

transformation pipelines, integrating data from internal systems and third-party platforms including Salesforce, Sopra Banking Services, CACI and Experian. Engineer Modern Data Architectures - Design Lakehouse, Warehouse and Delta Lake solutions using medallion architectures to support enterprise analytics and reporting. Deliver Analytics-Ready Data Assets - Build trusted, well-modelled datasets … create meaningful value for members and colleagues. About You Microsoft Fabric Expertise - You have strong hands‐on experience with Microsoft Fabric technologies including OneLake, Lakehouse, Warehouse, Data Factory, Spark and Power BI. Strong Engineering Skills - You're proficient in SQL, Python and PySpark, with experience developing scalable and maintainable ...

approaches. Provide technical leadership across modern data platforms, helping clients make appropriate architecture and technology decisions. Databricks & Modern Data Platforms Design enterprise Databricks and Lakehouse solutions incorporating technologies and patterns such as Delta Lake, medallion architecture, Unity Catalog and Databricks SQL. Apply strong knowledge of modern cloud data ecosystems … Include the Following? Significant experience designing and delivering enterprise cloud data architectures within complex client or business environments. Deep expertise in Databricks and modern Lakehouse architecture, including practical knowledge of Delta Lake and Unity Catalog. Strong experience with Microsoft Azure and/or AWS and modern enterprise data platforms ...

Business Intelligence Developer and Data Engineer Cheshire TBC, Permanent/Full Time Business Intelligence Developer and Data Engineer Location: Hybrid (Runcorn) with travel across the North West and Yorkshire Job type: Full-time, permanent Are ...

/SQL Data Warehousing ETL/ELT Processes Queries, stored procedures, scripts and database objects Data Reporting Microsoft Fabric Azure Data Factory Dataflows Data Lakehouse or Warehouse solutions Python Source Control (Git) Technical Leadership & Team Management You will be a Lead SQL Developer with good communication skills and have ...

Strong communication and stakeholder engagement skills. Required Skills Power BI DAX Semantic Modelling Power Query Databricks SQL Data Visualisation Desirable Experience Azure Databricks/Lakehouse environments Power BI Service Deployment pipelines/DevOps Large‐scale enterprise reporting programmes Microsoft Fabric #J-18808-Ljbffr ...