18 of 18 Permanent Delta Lake Jobs in the UK

with engineering, analytics, and infrastructure teams to transform raw data into valuable enterprise assets. Key Responsibilities: Designing and implementing cloud-native data architectures using Databricks and technologies such as Delta Lake, Spark, and MLflow. Developing and maintaining robust data pipelines, including batch and streaming workloads, to support data ingestion, processing, and consumption. Collaborating with business stakeholders and analytics … science, Information Systems , Engineering , or a related field. Hands-on experience in data architecture , data engineering , or a similar role. Deep expertise in Databricks , including Spark (PySpark/Scala) , Delta Lake , and orchestration within Databricks workflows. Strong understanding of cloud infrastructure and data services on at least one major cloud platform (Azure preferred, but AWS or GCP also More ❯

cross-functionally with engineering, analytics, and infrastructure teams to transform raw data into valuable enterprise assets. Designing and implementing cloud-native data architectures using Databricks and technologies such as Delta Lake, Spark, and MLflow. Developing and maintaining robust data pipelines, including batch and streaming workloads, to support data ingestion, processing, and consumption. Collaborating with business stakeholders and analytics … is a strong advantage. Bachelor's or master's degree in computer science, Information Systems , Engineering , or a related field. Deep expertise in Databricks , including Spark (PySpark/Scala) , Delta Lake , and orchestration within Databricks workflows. Strong understanding of cloud infrastructure and data services on at least one major cloud platform (Azure preferred, but AWS or GCP also More ❯

in doing this properly - not endless meetings and PowerPoints. What you'll be doing: Designing, building, and optimising end-to-end data pipelines using Azure Databricks, PySpark, ADF, and Delta Lake Implementing a medallion architecture - from raw to enriched to curated Working with Delta Lake and Spark for both batch and streaming data Collaborating with analysts More ❯

on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on More ❯

on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on More ❯

machine learning models in production. What you'll be doing as Lead ML Ops Engineer: Leading the design and implementation of robust ML Ops pipelines using Azure, Databricks, and Delta Lake Architecting and overseeing API services and caching layers (e.g., Azure Cache for Redis) Driving integration with cloud-based data storage solutions such as Snowflake Collaborating with data … from the Machine Learning Operations Lead: Proven experience in ML Ops leadership, with deep expertise in Azure, Databricks, and cloud-native architectures Strong understanding of Postgres, Redis, Snowflake, and Delta Lake Architecture Hands-on experience with Docker, container orchestration, and scalable API design Excellent communication and stakeholder management skills Ability to drive strategic initiatives and influence technical direction More ❯

machine learning models in production. What you'll be doing as Lead ML Ops Engineer: Leading the design and implementation of robust ML Ops pipelines using Azure, Databricks, and Delta Lake Architecting and overseeing API services and caching layers (e.g., Azure Cache for Redis) Driving integration with cloud-based data storage solutions such as Snowflake Collaborating with data … from the Machine Learning Operations Lead: Proven experience in ML Ops leadership, with deep expertise in Azure, Databricks, and cloud-native architectures Strong understanding of Postgres, Redis, Snowflake, and Delta Lake Architecture Hands-on experience with Docker, container orchestration, and scalable API design Excellent communication and stakeholder management skills Ability to drive strategic initiatives and influence technical direction More ❯

. Deep knowledge of ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI, Plot.ly, matplotlib) Programming OOP DevOps Web technologies HTTP/S REST … APIs Experience with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Solid grasp of web technologies and APIs (REST, JSON, XML, authentication protocols). Experience with DevOps practices More ❯

modern data platform, mentor talented engineers, and make a real impact on strategic decision-making. A successful Lead Azure Data Engineer should have: Strong experience with Databricks, Azure Synapse, Delta Lake, and pipeline orchestration. Hands-on with ETL/ELT processes, data modeling (star schema), SQL, Python, and data governance tools (e.g., Purview, Unity Catalog). Experience implementing More ❯

design of scalable, secure data architectures on AWS. * Build and optimise ETL/ELT pipelines for batch and streaming data. * Deploy and manage Apache Spark jobs on Databricks and Delta Lake. * Write production-grade Python and SQL for large-scale data transformations. * Drive data quality, governance, and automation through CI/CD and IaC. * Collaborate with data scientists, analysts More ❯

Lambda, EMR) Strong communication skills and a collaborative mindset Comfortable working in Agile environments and engaging with stakeholders Bonus Skills Experience with Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi) Exposure to CI/CD tools like GitHub Actions, GitLab CI, or Jenkins Familiarity with data quality frameworks such as Great Expectations or Deequ Interest in More ❯

Lambda, EMR) Strong communication skills and a collaborative mindset Comfortable working in Agile environments and engaging with stakeholders Bonus Skills Experience with Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi) Exposure to CI/CD tools like GitHub Actions, GitLab CI, or Jenkins Familiarity with data quality frameworks such as Great Expectations or Deequ Interest in More ❯

across SQL Server, PostgreSQL, and cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge of data architectures supporting AI More ❯

the technical lead and design authority Ability to partner with and influence senior client stakeholders to drive the programme to the required outcomes Hands on experience of Databricks including Delta Lake and Unity Catalog Experience of cloud architectures. We favour Azure and AWS. You have guided data engineers and analysts through optimising their workloads and take FinOps at More ❯

environment. What you'll be doing as the Machine Learning Operations Engineer: Developing and maintaining API services using Azure and Databricks Managing caching layers with Azure Cache (Redis) Using Delta Live Tables for data processing and analytics Integrating with cloud-based data storage solutions like Snowflake Collaborating with cross-functional teams in an agile environment Supporting analytics, model deployment … What we're looking for from the Machine Learning Operations Engineer: Solid experience in ML Ops, particularly with Azure and Databricks Familiarity with Postgres, Redis, and Snowflake Understanding of Delta Lake Architecture, Docker, and container services Experience building and orchestrating APIs Strong problem-solving and communication skills Bonus: exposure to Azure Functions, Containers, or Insights Benefits for the More ❯

environment. What you'll be doing as the Machine Learning Operations Engineer: Developing and maintaining API services using Azure and Databricks Managing caching layers with Azure Cache (Redis) Using Delta Live Tables for data processing and analytics Integrating with cloud-based data storage solutions like Snowflake Collaborating with cross-functional teams in an agile environment Supporting analytics, model deployment … What we're looking for from the Machine Learning Operations Engineer: Solid experience in ML Ops, particularly with Azure and Databricks Familiarity with Postgres, Redis, and Snowflake Understanding of Delta Lake Architecture, Docker, and container services Experience building and orchestrating APIs Strong problem-solving and communication skills Bonus: exposure to Azure Functions, Containers, or Insights Benefits for the More ❯

methodologies Experience designing models across raw, business, and consumption layers Solid understanding of metadata, cataloguing, and data governance practices Working knowledge of modern data platforms such as Databricks, Azure, Delta Lake, etc. Excellent communication and stakeholder engagement skills Data Architect - Benefits: Competitive base salary with regular reviews Car allowance - circa £5k per annum Discretionary company bonus Enhanced pension More ❯

Youll oversee the modernisation of our Azure-based data environment, champion scalable and resilient data pipelines, and drive adoption of tools such as Fabric, Data Factory, Databricks, Synapse, and Delta Lake. Working across all areas of the IET, youll ensure our data is secure, accessible, and delivering maximum value for analytics, business intelligence, and operational excellence. Youll foster a … Lead and modernise The IETs data architecture, ensuring alignment with best practice and strategic goals. Drive adoption of Azure data technologies such as Fabric, Data Factory, Databricks, Synapse, and Delta Lake. Develop and maintain scalable, resilient data pipelines to support analytics and reporting. Stay hands-on in solving technical challenges, implementing solutions, and ensuring the reliability of our data More ❯