176 to 200 of 437 Lakehouse Jobs in England

Sonata Software is seeking a Data Architect for a permanent hybrid role in the UK. The candidate will lead data architecture with extensive Azure Databricks experience, including Delta Lake medallion patterns and Unity Catalog governance. ...

will develop high-throughput Spark pipelines, ETL/ELT workflows for diverse datasets, and Java or Scala components with advanced SQL, contributing to lakehouse architectures and secure data governance. #J-18808-Ljbffr ...

experience Experience working with Azure-based data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale cloud data platform, please ...

Description – Data Architect Data Architect (Azure | Databricks | Lakehouse) Contract | Remote | UK Public Sector Project We are seeking a Data Architect to work within a multi-disciplinary team to design and deliver a new data service within a large-scale organisational environment. This role involves shaping data architecture, supporting data ...

delivered * Lead and guide engineering teams through implementation * Shape longer-term data architecture and platform strategy **The environment** AWS, Azure, GCP · Databricks, Snowflake · Lake, Lakehouse and modern warehouse architectures · Distributed processing · DevOps, IaC and secure deployment · Governance, access control and analytics **What we're looking for** * Active DV clearance ...

accelerators, and background IP to support go‐to‐market activities. Lead development of intelligent data platform projects: integrate data from multiple systems, transform through lakehouse architectures, and make data available for reporting, AI, and conversational analytics. Maintain awareness of channels to market and the ability to work within ...

platform teams. Experience contributing to the development of shared architecture standards, principles and engineering patterns through practical delivery expertise. Experience implementing & managing data warehouse, lakehouse or medallion architecture patterns. Experience working effectively with senior stakeholders, Enterprise Architecture, governance functions and specialist technology teams. Technical Skills Expert knowledge of data ...

through served APIs. EXPERIENCE REQUIRED Strong Python and SQL, with production experience building and operating data pipelines — ideally in Microsoft Fabric, or a comparable lakehouse platform such as Databricks, Synapse or a dbt-based stack. Hands‐on experience with time‐series, sensor or telemetry data at scale, including ...

Power BI environment. Develop scalable batch and real-time data-processing solutions. Lead the design of a Customer Data Platform. Build and evolve a lakehouse architecture using AWS technologies. Create governed semantic models, consistent metrics and clear data definitions. Enable secure, self-service data analysis using modern AI tooling. … comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated testing. Lakehouse architecture and open table formats such as Iceberg. Medallion architecture and dimensional data modelling. Strong SQL and Python. SQL Server, SSIS/SSDT ...

Power BI environment. Develop scalable batch and real-time data-processing solutions. Lead the design of a Customer Data Platform. Build and evolve a lakehouse architecture using AWS technologies. Create governed semantic models, consistent metrics and clear data definitions. Enable secure, self-service data analysis using modern AI tooling. … comparable platforms. AWS data services, including S3, Lambda, Glue, Athena, Kinesis and RDS. Infrastructure as code using Terraform. CI/CD and automated testing. Lakehouse architecture and open table formats such as Iceberg. Medallion architecture and dimensional data modelling. Strong SQL and Python. SQL Server, SSIS/SSDT ...

Doing Take technical ownership of the Microsoft Fabric environment, helping shape its ongoing development, architecture and roadmap. Design, develop and optimise data pipelines, lakehouse and warehouse solutions to support reliable data delivery. Build and maintain scalable data models, semantic layers and reporting solutions. Work extensively with SQL, Python … Azure data technologies. Advanced SQL skills, including data transformation, modelling and query optimisation. Experience using Python for data engineering and automation. Good understanding of lakehouse and data warehouse architectures. Experience developing and maintaining data pipelines and orchestration processes. Knowledge of Power BI, including semantic models, DAX and reporting. Experience ...

Doing Take technical ownership of the Microsoft Fabric environment, helping shape its ongoing development, architecture and roadmap. Design, develop and optimise data pipelines, lakehouse and warehouse solutions to support reliable data delivery. Build and maintain scalable data models, semantic layers and reporting solutions. Work extensively with SQL, Python … Azure data technologies. Advanced SQL skills, including data transformation, modelling and query optimisation. Experience using Python for data engineering and automation. Good understanding of lakehouse and data warehouse architectures. Experience developing and maintaining data pipelines and orchestration processes. Knowledge of Power BI, including semantic models, DAX and reporting. Experience ...

infrastructure is now well established, and ready for someone to take to the next level. You’ll be the go‐to expert for our lakehouse/warehouse architecture, semantic models, and the pipelines that keep data flowing reliably across the business. This is a hands‐on senior individual contributor … Define and enforce best practices for data modelling, ingestion, transformation, orchestration, and semantic layer design. Drive platform reliability, performance, security, and cost optimisation across lakehouse/warehouse workloads. Act as technical lead for solution design, incident resolution, and complex delivery challenges. Partner with business stakeholders to translate requirements into ...

Microsoft Fabric is at the heart of where the data platform is going. Youll work across: Building data pipelines using Microsoft Fabric Fabric Lakehouse, Warehouse and OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third … isnt a requirement. Youll have the opportunity to develop that experience alongside your core Data Engineering work. Technology environment Data: Microsoft Fabric, Lakehouse, Warehouse, OneLake, Azure Data Lake, Azure Synapse Analytics: Power BI Engineering: SQL Server, SQL, ETL/ELT, API integrations Delivery: Azure DevOps, Git, CI/ ...

Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Your locationYour locationIndustriesChoose a partner with intimate knowledge of your industry and first-hand experience of defining its future.Birmingham ...

modelling and curation for large-scale datasets Preferred Qualifications Knowledge or interestin investment banking or financial instruments Experience with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka Goldman Sachs Highlights At Goldman Sachs ...

haves:*** Familiarity with evaluating AI system performance, including prompt evaluation, A/B testing, and quality assessment frameworks.* Understanding of modern data patterns: lakehouse architectures, vector databases, and relational/NoSQL stores* Familiarity with API gateways, event streaming and general integration patterns. **Eligibility:*** You need to have resided ...

where you can grow, belong and thrive. Your day at NTT DATA Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution Architects Data Engineers, Developers, ML Engineers … with Databricks Workflows and other orchestration tools. Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon). Familiarity with medallion architectures, data lakehouse principles and distributed data processing. Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data governance, security, and compliance ...

where you can grow, belong and thrive. Your day at NTT DATA Primary Responsibilities Client Engagement & Delivery Data Pipeline Development (Batch and Streaming) Databricks & Lakehouse Architectures Data Modelling & Optimisation (Delta Lake, Medallion architecture) Collaboration & Best Practices Quality, Governance & Security Business Relationships Solution Architects Data Engineers, Developers, ML Engineers … with Databricks Workflows and other orchestration tools. Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon). Familiarity with medallion architectures, data lakehouse principles and distributed data processing. Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data governance, security, and compliance ...

Ceox is seeking a Data Architect to design and deliver a new data service within a large-scale environment. You will shape data architecture, support data engineering, and ensure governance and scalable data structures across ...

Sagacity is seeking a QA-focused data specialist to own the testing of client data platform deployments. You will design and execute structured test programmes for Databricks pipelines, validate data quality across bronze–silver–gold ...

highly skilled Azure Data Engineer to design, build, and maintain our enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating … comprehensive logging, auditing, and fine-grained access controls to secure identifiable data. Location: on-site with a customer in Central London. Key Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data ...

efficient data solutions and products including data transformation, data modelling, and reporting on both on-premises and cloud environments Build modern data lake/lakehouse architectures that support scalable, flexible data processing Enhance platform integration by leveraging domain events to enable more efficient and real-time data processing Self … years of experience in data engineering, with demonstrated expertise in designing and implementing scalable, flexible modern data architectures Experience building modern data lake/lakehouse architectures (e.g., Apache Iceberg) in cloud environments Strong knowledge of AWS (S3, Redshift) or Azure data services Experience with ETL/ELT processes ...

Alto Software Group is hiring a Senior Data Platform Engineer in London. You will scale and operate a data lakehouse powering internal analytics and data products, migrating from legacy systems and building reusable data pipelines. You will design templates, lead ETL and data modelling efforts, and collaborate with product ...

NTT DATA, Inc. is seeking an experienced Data Engineer to design and deliver Databricks-based data pipelines for complex client projects. You will engage with clients, collaborate with architects and engineers, and drive best practices ...