17 of 17 Permanent Delta Lake Jobs in the UK

data becomes a true competitive advantage. Why consider this role? Lead delivery of a strategic cloud data platform Own architecture across Azure, Databricks, Synapse & Delta Lake Influence enterprise-wide data governance and standards Hybrid working - 3 days per week in the office Competitive salary, bonus & strong benefits High … regulated finance environment What we're looking for Proven experience as a Lead/Principal Data Engineer Deep Azure data stack knowledge (Databricks, Synapse, Delta Lake, Unity Catalog) Strong SQL and data-modelling capability Experience with orchestration, monitoring and data quality tooling Background working in regulated financial services ...

data models, transformation logic, and quality frameworks across the data lifecycle. * Write clean, maintainable Python code for data engineering and automation tasks. * Work with Delta Lake and modern lakehouse patterns to optimise data storage and performance. * Contribute to CI/CD and DataOps practices to improve deployment reliability … years working in data engineering, data consulting, or a similar technical role. Nice to Have Skills * Exposure to Microsoft Fabric. * Experience with Delta Lake and lakehouse architectures. * Familiarity with CI/CD, DataOps, or modern deployment pipelines. Soft Skills * Confident in client facing interactions, including workshops, requirements gathering ...

quality, observability, and cost-efficient performance. Responsibilities • Design and implement complex ETL/ELT pipelines using Databricks (Python, SQL, DLT). • Build and optimise Delta Lake tables with effective partitioning and performance strategies. • Contribute to Lakehouse architecture design, ingestion patterns, and data product boundaries. • Ensure solutions align with … What You'll Need to Be Successful • Strong experience as a Senior Data Engineer in modern data environments. • Deep expertise in Databricks, Spark, Delta Lake, and Lakehouse architectures. • Proven ability to design scalable, modular, and maintainable data solutions. • Experience working in cloud platforms (Azure preferred). • Solid understanding ...

validate datasets and business logic Supporting data workflows using Azure SQL, Data Factory, Azure Functions, and Azure Synapse Working with Delta Lake architectures to ensure data reliability and version control Using Python, PySpark, and Jupyter Notebooks for data exploration, validation, and analysis Reviewing and improving CI/… focused role Strong SQL skills (SQL Server, Spark SQL, T-SQL) Experience working with Python and PySpark , ideally in Jupyter Notebook environments Exposure to Delta Lake and modern lakehouse architectures Experience within Azure environments , including Azure SQL, Data Factory, Functions, and ideally Synapse Understanding of CI/ ...

business. Contribute to architectural discussions and the ongoing data platform roadmap. Tech You'll Use Databricks: Lakeflow Declarative Pipelines, Lakeflow Workflows, Unity Catalog, Delta Lake Azure: ADLS Gen2, Data Factory, Event Hubs (optional), Key Vault, private endpoints Languages: PySpark, Spark SQL, Python, Git DevOps: Azure DevOps Repos & Pipelines … Azure + Databricks . Strong PySpark and Spark SQL skills within distributed compute environments. Experience working in a Lakehouse/Medallion architecture with Delta Lake. Understanding of dimensional modelling (Kimball), including SCD Type 1/2. Exposure to operational concepts such as monitoring, retries, idempotency and backfills. Mindset Good ...

line with the organisation’s norms and values Essential • Proven experience in managing data operations, integrations, and engineering teams. • Strong expertise in Databricks, including Delta Lake, Spark, and automated pipeline development. • Hands-on experience with ETL/ELT processes, data governance, and cloud-based data platforms. • Proficiency ...

improvement across the data engineering function. Responsibilities Build and maintain scalable ETL/ELT pipelines using Databricks (SQL, Python, Spark). Develop and optimise Delta Lake tables across medallion layers. Implement best practices for performance, modularity, and reusability. Support CI/CD processes for notebooks, jobs, and data ...

across the organisation. You'll design and develop scalable data pipelines within a modern Azure ecosystem, working with technologies such as Azure Synapse, Databricks, Delta Lake, Unity Catalog, and Databricks SQL. Responsibilities include overseeing pipeline orchestration, implementing data quality controls, monitoring and alerting, and managing data lineage, glossaries ...

wont just be delivering features; youll be setting direction. The tech youll work with Core:Azure, Databricks, Python, SQL, dbt, MQTT Storage & Serving:Delta Lake, Postgres, TimescaleDB Modelling & ML:MLflow Visualisation:Grafana What makes you a great fit Youre someone who can zoom out to architecture and zoom ...

consumption layers Technology Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture remains modern ...

consumption layers Technology Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture remains modern ...

streamlined data analysis, product builds and reduced time to market Competencies and Behaviours 1 -3 years analytics/data science experience Practical knowledge of; Delta Lake architecture and versioned datasets, Data pipelines, orchestration and scheduling concepts Proficiency in analytical programming language such as python and/ ...

Spark. Strong grasp of data modelling, normalization and API development for large scale analytical or trading systems. Experience with lakehouse architectures (Databricks ideally, or Delta Lake). Exposure to real time and historical market data within Fixed Income, ETFs or Equities would be excellent. Operational instincts - extreme agency ...

genuinely collaborative culture. The Role and Responsibility Design, build and maintain scalable data pipelines and products within a modern Databricks Lakehouse environment using Delta Lake, Spark, Python (PySpark) and SQL. Manage and optimise the cloud-based lakehouse, leveraging Unity Catalogue, Databricks Workflows and best practices for performance, quality ...

doing as the Machine Learning Engineer: Developing and maintaining API services using Azure and Databricks Managing caching layers with Azure Cache (Redis) Using Delta Live Tables for data processing and analytics Integrating with cloud-based data storage solutions like Snowflake Collaborating with cross-functional teams in an agile environment … from the Machine Learning Engineer: Solid experience in ML Ops, particularly with Azure and Databricks Familiarity with Postgres, Redis, and Snowflake Understanding of Delta Lake Architecture, Docker, and container services Experience building and orchestrating APIs Strong problem-solving and communication skills Bonus: exposure to Azure Functions, Containers ...

components to the position: Define the long-term technical vision and roadmap for our modern Data Platform, Mobius (including Data Warehousing, Data Lake, Streaming, and Governance tooling). Design and govern the reference architecture for core data infrastructure, ensuring optimal scalability, reliability, and security. Act as a hands … software and data engineering, with provable experience operating at a Principal, Staff, or equivalent level. Deep proficiency across the modern data stack (Snowflake, BigQuery, Delta Lake, Iceberg, Kafka, Flink). Proven track record designing scalable, self-service data platforms using cloud-native services (AWS/GCP) and infrastructure ...

role, focused on building, optimising, and operating Databricks-based Lakehouse solutions across cloud environments. Responsibilities: Design, build, and maintain data pipelines using Databricks (Spark, Delta Lake). Develop batch and streaming workloads using PySpark/Spark SQL. Implement data ingestion, transformation, and orchestration pipelines. Optimise Databricks workloads … GCP. Skills: Strong hands-on expertise with Databricks in production environments. Advanced PySpark and Spark SQL development experience. Experience building lakehouse architectures using Delta Lake. Strong cloud experience in Azure (preferred), AWS, or GCP. Experience with orchestration tools (ADF, Airflow, dbt, or similar). Certifications – Databricks Certified Data Engineer ...