1 to 25 of 266 Permanent Lakehouse Jobs in London

understanding of data engineering principles, including pipeline design, ETL/ELT, ingestion patterns, orchestration, and integration approaches. Experience designing or governing modern data architectures (lakehouse, warehouse, data mesh, data fabric). Hands-on experience with one or more cloud data ecosystems: Azure (Data Factory, Synapse, Fabric, ADLS, Databricks ...

Architect modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Design scalable data lake, lakehouse, data warehouse and data integration solutions. Establish data governance, security, quality, metadata and lineage using Microsoft Purview. Provide architecture leadership for Data & AI, analytics ...

Architect modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Design scalable data lake, lakehouse, data warehouse and data integration solutions. Establish data governance, security, quality, metadata and lineage using Microsoft Purview. Provide architecture leadership for Data & AI, analytics ...

data platforms and modern data services. Experience with platforms such as Snowflake, Microsoft Fabric, Databricks or equivalent. Strong understanding of data modelling, data warehousing, Lakehouse and modern data architecture. Experience with data governance, data quality and metadata management. Exposure to AI/ML integration within data solutions ...

Experience Experience in a data engineering role, ideally within a regulated environment Knowledge of the following is required: Modern Data platform concepts; Data Lake, Lakehouse, Data Warehouse, Data Vault ETL/ELT processes and designing, building and testing data pipelines Building data transformations using Python/PySpark Azure Cloud ...

Factory, Azure Synapse Analytics, Databricks, Snowflake, Microsoft Fabric (preferred)* Strong SQL and database expertise across relational and non-relational platforms.* Experience designing Data Lakes, Lakehouse architectures, and Enterprise Data Warehouses.* Knowledge of data governance tools and frameworks.* Familiarity with API integration, messaging platforms, and event streaming technologies.* Strong understanding ...

Highly Desirable Experience in the utilities, water, or regulated infrastructure sector — understanding of operational data, compliance requirements, and safety-critical system considerations Familiarity with Lakehouse Federation in Azure Databricks — federating queries across external data sources without full ingestion Experience with Azure Data Factory or equivalent ETL/ELT tooling ...

requirements Key Skills: Advanced knowledge of cloud data platforms: Azure, AWS, and Google Cloud Platform (GCP) Strong experience with data warehousing, data lakes, and lakehouse architectures Hands-on experience with SQL and at least one programming language such as Python, Scala, or Java ETL/ELT design and data ...

Spark, Python or SQL - Experience working with AWS and its data and AI/ML services such as SageMaker - Experience of big data and lakehouse platforms on AWS (EMR, Databricks or Snowflake) - Experience building data platforms such as Data Lakes, Lakehouses or Data Meshes that underpin analytics ...

technologies and applications relevant to the Bank’s enterprise applications (e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership ...

Microsoft Foundry platformsVersion control and CI/CD experience with GitHubUnderstanding of ETL/ELT optimization patterns beyond Azure stackKnowledge of data mesh or lakehouse architectural conceptsHands-on exposure to dbt (data build tool), MKDocs and similar developer productivity toolingWe offerEPAM Employee Stock Purchase Plan (ESPP)Protection benefits including ...

Fabric is becoming central to the data environment, supporting operational, reporting and analytics requirements across the business. You'll work across: Microsoft Fabric, including Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations ...

Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling. Solid understanding of data lakehouse, warehouse, and medallion architecture patterns. Experience applying DevOps and DataOps best practices including CI/CD, automated testing, monitoring, observability, and release management. Experience ...

Architect modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Design scalable data lake, lakehouse, data warehouse and data integration solutions. Establish data governance, security, quality, metadata and lineage using Microsoft Purview. Provide architecture leadership for Data & AI, analytics ...

Architect modern data platforms using Microsoft Fabric, Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake and Power BI. Design scalable data lake, lakehouse, data warehouse and data integration solutions. Establish data governance, security, quality, metadata and lineage using Microsoft Purview. Provide architecture leadership for Data & AI, analytics ...

optimize batch and streaming data pipelines using services such as Dataflow, Dataproc, Pub/Sub, and Cloud Composer. Architect data lake, data warehouse, and lakehouse solutions, including data modeling and performance tuning in BigQuery. Provision and manage data infrastructure using Terraform and CI/CD pipelines. Implement data governance ...

native data warehousing Fivetran – Automated data pipelines for seamless integration What You’ll Bring Data Architecture – Proven experience designing and building data warehouse/lakehouse solutions using technologies like BigQuery, Azure Synapse, Snowflake, Databricks Data Modeling – Strong expertise in data modeling and solution architecture, optimizing for performance and scalability ...

Unity Catalog. Strong knowledge of cloud ecosystems (AWS, Azure, GCP) and infrastructure-as-code (Terraform, CloudFormation). Hands-on expertise with data lake/lakehouse architectures and modern streaming solutions. Experience with SQL, NoSQL, ETL/ELT pipelines, and programming languages (Python, R, Java). Familiarity with BI, data ...

understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Experience working with lakehouse/medallion architectures in Databricks Experience with experimentation support tooling (such as Optimizely) A genuine curiosity about AI and a willingness to explore ...

Snowflake). Architect scalable, enterprise-grade cloud platforms across the full data lifecycle—from platform setup and ingestion to orchestration and consumption. Design modern lakehouse solutions, defining Medallion Architectures (Bronze/Silver/Gold), cross-domain data modeling, and governance standards. Define data architectures supporting Enterprise AI, Generative ...

initiatives, business intelligence and client-focused innovation.Key responsibilities include: Building reliable data pipelines and reusable data assets using Microsoft Fabric and Databricks. Designing scalable lakehouse data models and governed datasets. Conducting exploratory data analysis and developing machine learning models. Applying NLP, entity resolution and information extraction techniques to document ...

delivery of data platform programmes, including architecture governance and stakeholder management. Strong expertise in modern data architecture concepts: data lakes, data warehouses, lakehouse, data mesh, data governance, security, and quality. Hands-on experience with Azure and/or AWS native services for data storage, processing, orchestration, analytics ...

architectures for production systems, with evidence that your designs have shipped and run - not remained on paper. Deep expertise in data modelling, warehouse/lakehouse design, and data governance. Hands-on background in SQL and Python, and fluency with at least one major cloud provider (AWS or Azure ...

with accountability for successful delivery, senior stakeholder management and commercial outcomes. Strong hands‐on understanding of Microsoft Fabric, including platform architecture, data engineering, integration, lakehouse and warehouse patterns, governance and security. Deep Power BI expertise, including semantic models, data visualisation, governance, adoption and enterprise reporting approaches. Practical knowledge ...

technologies and architectural approaches including, butnotlimited to: Cloud platforms:AWS,Azureand GCP Modern data platforms:Databricks, Snowflake and cloud-native data services Data architecture:Lakehouse, medallion, datameshand domain-oriented patterns Data processing:Apache Spark,SQLand distributed processing technologies Data storage:Delta Lake, ApacheIcebergand open table formats Data pipelines:Enterprise ...