26 to 50 of 272 Lakehouse Jobs in London

technologies and architectural approaches including, butnotlimited to: Cloud platforms:AWS,Azureand GCP Modern data platforms:Databricks, Snowflake and cloud-native data services Data architecture:Lakehouse, medallion, datameshand domain-oriented patterns Data processing:Apache Spark,SQLand distributed processing technologies Data storage:Delta Lake, ApacheIcebergand open table formats Data pipelines:Enterprise ...

with the role. Knowledge, experience and skills Essential experience: Proven experience designing, reviewing and implementing enterprise-scale Microsoft Fabric solutions. Strong knowledge of OneLake, Lakehouse, Warehouse, notebooks, pipelines, dataflows, semantic models and Power BI. Experience defining enterprise data architectures, Medallion patterns, reusable data products and governance frameworks. Strong understanding ...

Databricks and Snowflake; exposure to Azure or GCP is beneficial A good understanding of modern data engineering patterns including ETL/ELT, data lakes, lakehouse, and warehousing architectures Expopsure to data governance frameworks, metadata management, and regulatory complianc It would be a bonus if you have: Familiarity with emerging ...

batch data processing architectures that support AI-driven analytics, recommendations, forecasting, and intelligent automation. Optimise cloud data platforms for AI scalability, including data lakehouse architectures, semantic layers, and high-performance data retrieval patterns. Stays current with Snowflake features, best practices, and industry trends in cloud data platforms. Performs additional ...

scalable, and real-time data assets across multiple brands and markets. You’ll primarily work on our Sportsbook Data Platform — a modern, event-driven lakehouse built on AWS and aligned to medallion architecture principles — delivering high-quality, well-governed data products that support analytics, trading insight, and machine learning ...

relational databases. Experience with data warehousing concepts and platforms. Excellent analytical and problem-solving skills. Strong communication and collaboration abilities. Knowledge of data Lakehouse architectures and modern data stack tools. Understanding of data privacy regulations (e.g., GDPR, HIPAA). Strong knowledge of data modeling tools (e.g., ER/Studio ...

simply delivering against predefined requirements. You’ll need experience with: Databricks, SQL, Python and PySpark Building and optimising ELT/data pipelines Data modelling, lakehouse architecture and modern data platforms Azure data services API and third-party system integration Data quality, governance, metadata and lineage Git, CI/ ...

Foster a culture of experimentation, continuous improvement, and technical curiosity within the data functio n. About you: Deep understanding of modern data architectures (data lakehouse, event-driven pipelines, and orchestration systems). Strong proficiency in Python, SQL, and IaC (Terraform). Experience using dbt, Snowflake, AWS, orchestration tool like ...

Substantial experience building and running production data pipelines that other teams and customers depend on. Strong Python and SQL. Deep experience with a modern lakehouse, ideally Databricks and Unity Catalog, and with dbt. Comfortable on AWS and with infrastructure as code (Terraform). Strong grounding in ingestion and integration ...

environments and implement resilient, self-healing pipeline architectures. Key Business Value & Strategic Impact Your leadership will directly advance life sciences technology. By pairing modern lakehouse architecture (Snowflake, Apache Iceberg, Kafka) with AI-augmented workflows, you will empower our platform to process critical safety signals in hours rather than weeks. ...

with CI/CD for data engineering using GitHub or Azure DevOpsExperience designing infrastructure-as-code solutions for Azure environmentsUnderstanding of data mesh or lakehouse principles for large-scale architecturesBackground in financial trading or capital markets data domainsWe offerEPAM Employee Stock Purchase Plan (ESPP)Protection benefits including life assurance ...

Experience building and designing products that use both real-time and batch data at scale, and an understanding of the underlying data architecture (e.g. lakehouse, star schema). Ability to write and validate SQL queries, and to trace data flows end-to-end to ensure data quality. Awareness ...

LoRA/QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code: Terraform and Ansible ...

performance tuning, advanced analytical queries, and reconciliation). Strong Azure Cloud Stack Experience: Azure Data Factory (ADF) Azure SQL DB Azure Data Lake/Lakehouse architectures Python for data manipulation & automation Proven experience across all migration phases: Strategy, Discovery, Cleansing, Mapping, Execution, and Post-migration Validation. Hands-on proficiency ...

deliver data solutions that support business-wide analytics and future AI initiatives.Key responsibilities include: Leading the design and implementation of a cloud-based Lakehouse platform using Microsoft Fabric Building scalable and reliable data pipelines using a Medallion architecture approach Designing robust data models and semantic layers across multiple business ...

standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such as Glue, EMR Serverless, Lambda, and S3. Contribute to the evolution of lakehouse architecture leveraging Apache Iceberg. Apply Software Engineering Best Practices Use version control, CI/CD pipelines, automated testing, and modular code principles. Participate ...

Strong commercial data engineering background, building and running production pipelines end to end Excellent Python and SQL Solid grasp of data modelling, warehousing and lakehouse concepts Hands-on with orchestration (e.g. Airflow, Dagster) and distributed processing (e.g. Spark) Experience with cloud data platforms (AWS, Azure or GCP) and containerised ...

take ownership of getting good quickly. People who wait to be trained will find this uncomfortable. Nice to have: Experience building Data Mesh or Lakehouse architectures. Familiarity with Kubernetes, Docker, and real-time streaming technologies (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. The Zego ...

reviews, pairing, and knowledge sharing. Problem‐Solving: Pragmatic approach to balancing technical excellence with delivery needs. Nice to Have Experience building Data Mesh or Lakehouse architectures. Familiarity with Kubernetes, Docker, and real‐time streaming technologies (e. g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. ...

reviews, pairing, and knowledge sharing. Problem-Solving: Pragmatic approach to balancing technical excellence with delivery needs. Nice to Have: Experience building Data Mesh or Lakehouse architectures. Familiarity with Kubernetes, Docker, and real-time streaming technologies (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. The Zego ...

containerization (Docker) and basic container orchestration concepts Knowledge in platform security practices including IAM, encryption, and network security basics Knowledge of data warehouse and lakehouse technologies (Snowflake, Databricks) Awareness of FinOps principles and cloud cost optimization Experience supporting multiple teams or use cases with shared platform capabilities Experience building ...

cloud services. Support API-based integrations, with Workday integration experience considered good to have. Contribute to data snapshotting, Parquet-based storage and Fabric/lakehouse development where required. Apply good engineering practices, including source control, testing, peer review, monitoring and controlled deployments. Identify, investigate and resolve data quality, pipeline ...

Catalog, Jobs/Workflows and PySpark. An understanding of infrastructure as code and reproducible deployment practices. Familiarity with dbt and modern data warehouse/lakehouse patterns. PureGym is proud to be an equal opportunities employer. Our company mantra is 'Everybody Welcome' and we are dedicated to promoting a diverse ...

consulting engagements within a consultancy, systems integrator or technology services business You have strong hands-on knowledge of Microsoft Fabric, including data engineering, Lakehouse and Warehouse architectures, integration, governance and security You have Power BI expertise, including semantic modelling, enterprise reporting, governance and adoption You have a broad knowledge ...

take ownership of getting good quickly. People who wait to be trained will find this uncomfortable. Nice to Have: Familiarity with Data Mesh or Lakehouse architectures. Familiarity with Kubernetes, Docker, and real-time streaming technologies (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. Pay Transparency ...