1 to 25 of 260 Lakehouse Jobs in the UK

implementing resilient data ingestion, orchestration, and provisioning capabilities for enterprise-scale workloads. Strong hands‐on experience with Databricks (AWS and/or Azure), including Lakehouse architecture, distributed processing, and production operations. Strong hands‐on experience with Apache Kafka and event-driven integration architectures. Proven expertise designing and implementing enterprise ...

delivering customer-facing consultancy or professional services engagements. Strong understanding of enterprise data architecture principles. Experience designing and implementing data lakes, data warehouses and lakehouse architectures. Good understanding of data governance, data quality and data management frameworks. Strong SQL skills and experience using Python or PySpark. Experience with Databricks ...

encourage you to apply. Transferable Skills and Experience Microsoft Fabric Expertise: evidence of designing, developing, and maintaining data solutions using key Microsoft Fabric components (Lakehouse, Data Factory, Notebooks, Dataflow Gen2, OneLake). Azure Ecosystem Knowledge: Strong experience with other Azure Data Services including Azure Databricks, Azure Data Factory, Azure ...

Skills: Advanced knowledge of cloud data platforms: Azure, AWS, and Google Cloud Platform (GCP). Strong experience with data warehousing, data lakes, and lakehouse architectures. Hands‐on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline ...

experience with: Azure Data Lake Databricks Snowflake Delta Lake Azure Synapse Analytics/Microsoft Fabric Spark/PySpark Strong understanding of: Data Lake and Lakehouse architecture Hybrid cloud environments Enterprise integration patterns Modern data formats including Parquet, Avro, and ORC DevOps & Platform Engineering Experience implementing CI/CD pipelines ...

Essential Experience Strong experience delivering enterprise-scale data architecture. Expertise in conceptual, logical, and physical data modelling. Experience with Oracle ERP, SQL databases, and Lakehouse platforms such as Databricks. Knowledge of cloud data platforms including Azure, AWS, or Google Cloud. Strong understanding of data governance, data quality, and master ...

Azure DevOps, CI/CD & Release Management Technical Documentation Technical Azure Databricks, PySpark, Python & SQL Azure Data Factory Azure Functions Azure Data Lake/Lakehouse REST APIs & Third-Party System Integration Azure SQL Logic Apps Azure DevOps, Git & CI/CD Docker/Containers Data Quality, Monitoring & Logging Data ...

platforms. Deep knowledge of the Microsoft data ecosystem, ideally including significant hands-on experience with Microsoft Fabric. Strong understanding of Fabric capabilities such as Lakehouse, Data Warehouse, OneLake, pipelines and notebooks, and how these can be used to build scalable enterprise data solutions. Strong experience with SQL, Python ...

Skills: Advanced knowledge of cloud data platforms: Azure, AWS, and Google Cloud Platform (GCP). Strong experience with data warehousing, data lakes, and lakehouse architectures. Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java. ETL/ELT design and data pipeline ...

solutions using Azure Data Factory and Microsoft Fabric. Develop high-performance data processing solutions using Python, PySpark, and SQL. Implement Delta Lake and Lakehouse architectures following industry best practices. Work with Azure Data Lake Storage (ADLS Gen2) to manage large-scale datasets. Optimise Spark workloads for performance, scalability ...

Develop ETL/ELT solutions using PySpark and SQL. Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric. Design scalable lakehouse and data warehouse solutions. Optimise data performance, reliability and quality across cloud platforms. Collaborate with data scientists, analysts and software engineers to deliver business ...

experience delivering data and analytics solutions within an IT environment . Strong Microsoft Azure experience, particularly: Azure Data Factory Databricks Azure Data Lake/Lakehouse Good understanding of data architecture and data flows . Practical SQL experience. Experience with Python and/or PySpark . Experience with CI/ ...

solutions and present insights to stakeholders Promote best practices in data engineering, documentation, and version control Requirements Strong hands-on experience with Microsoft Fabric (Lakehouse, Warehouse, pipelines). Azure Data Factory experience will also be considered if no working experience with fabric Advanced SQL and strong PySpark experience Proficiency ...

enterprise and solution architects to align data engineering solutions with wider technology strategy and architecture standards. Drive adoption of modern data architecture approaches, including lakehouse and warehouse patterns, data product thinking, and reusable engineering services. Mentor and support data engineers through technical coaching, knowledge sharing, and career development activities. ...

data platform, ensuring reliability, performance and scalability Design enterprise scale data architectures on Databricks and cloud platforms such as Azure, AWS or GCP Define lakehouse standards, data modelling approaches and governance frameworks Lead design of batch and streaming platforms using Delta Lake, Spark and related technologies Establish security, access ...

data platform, ensuring reliability, performance and scalability * Design enterprise scale data architectures on Databricks and cloud platforms such as Azure, AWS or GCP * Define lakehouse standards, data modelling approaches and governance frameworks * Lead design of batch and streaming platforms using Delta Lake, Spark and related technologies * Establish security, access ...

PySpark desirable). Proven experience designing and building cloud-based data platforms from inception. Hands-on experience with Databricks, Spark, modern data lake/lakehouse architectures, and data integration pipelines. Strong understanding of data security, governance, access controls, and handling sensitive data. Experience implementing CI/CD, Git-based ...

expertise across every area listed below. We're primarily looking for strong Data & AI architecture experience across the Microsoft ecosystem. Data & Analytics Microsoft Fabric Lakehouse architecture patterns Power BI and self-service analytics Semantic modelling and reporting solutions Data platform modernisation and analytics strategy AI & Automation Agentic AI patterns ...

/CD tooling such as Azure DevOps or GitHub Actions.* **Architectural Patterns:** Depth across architectural patterns such as microservices, event-driven, API-led, lakehouse/medallion and domain-driven design, with good judgement on when to apply each.* **Data Platforms:** A strong track record architecting data-intensive solutions handling ...

Functions, Storage, Service Bus, DevOps). Strong understanding of data architecture and ETL/ELT pipelines . Proven experience setting up Microsoft Fabric , Data Lakehouse , or Medallion architecture . Demonstrated ability to troubleshoot complex distributed systems and identify root causes. Exposure to SRE principles (monitoring, incident management, resilience). ...

ability to get commercial, finance, product, and engineering people into a room and come out with agreed definitions. Key Technologies Microsoft Fabric (OneLake, Lakehouse, Warehouse, Pipelines, Dataflows Gen2) Power BI and medallion architecture patterns CDC, streaming ingestion, and entity resolution SQL Server, Azure SQL Database, MySQL, Cosmos DB Azure ...

architectures for production systems, with evidence that your designs have shipped and run - not remained on paper. Deep expertise in data modelling, warehouse/lakehouse design, and data governance. Hands-on background in SQL and Python, and fluency with at least one major cloud provider (AWS or Azure ...

databases (Cassandra, MongoDB, Cosmos DB). - Familiarity with data modelling, query optimisation, and indexing strategies. Data Platforms: - Hands-on experience with data lakes and lakehouse architectures. - Familiarity with big data processing frameworks like Spark. Data Engineering Knowledge: - Proven experience building ETL/ELT pipelines and using orchestration tools (Airflow ...

critical enterprise distributed systems.**Deep Technical Breadth & Depth:*** Advanced data architecture experience using Databricks, Microsoft Fabric, and large-scale data processing (Data Mesh/Lakehouse patterns).* Strong background in data integration and relational platforms* Proven experience designing highly available Hybrid and Multi-Cloud architectures (Azure & AWS). ...

maintain scalable data pipelines using Databricks, Apache Spark and Delta Lake * Develop and optimise batch and streaming workflows for reliability and performance * Contribute to lakehouse architecture and medallion pattern implementation * Implement data quality checks, monitoring and observability across pipelines * Apply platform security, access control and governance standards * Support code ...