1 to 25 of 63 Permanent Delta Lake Jobs in England

Degree in Computer Science, Software Engineering, or similar (applied to Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and Information Security principles. Effective communication, ability … monitoring/security is necessary. Significant AWS or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … role. KEYWORDS Lead Data Engineer, Senior Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

on experience of HDFS/Hadoop and on-prem (coding, configuration, automation, delivery, monitoring, security). Extensive Big Data hands-on experience - Cloudera or similar. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Azure - hands-on experience including coding, configuration, automation and delivery. Advanced Database and SQL skills. Certifications: Cloudera, Azure or FME certifications … Company Sponsorship. KEYWORDS Senior Data Engineer, Coding Skills, Spark, Java, Python, PySpark, Scala, ETL Tools, Azure Data Fabric (ADF), Databricks, HDFS, Hadoop, Big Data, Cloudera, Data Lakes, Azure Data, Delta Lake, Data Lake, Databricks Lakehouse, Data Analytics, SQL, Geospatial Data, FME, QGIS, PostGIS. Please note that due to a high level of applications, we can only respond More ❯

BI tools, trading models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and lineage tracking to production … internal team can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. Experience in energy, grid operations More ❯

BI tools, trading models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and lineage tracking to production … internal team can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. Experience in energy, grid operations More ❯

BI tools, trading models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and lineage tracking to production … internal team can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. Experience in energy, grid operations More ❯

BI tools, trading models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and lineage tracking to production … internal team can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. Experience in energy, grid operations More ❯

BI tools, trading models, performance dashboards). Engineering & Implementation Build robust batch and streaming pipelines using Azure Data Factory, Databricks, and Spark Structured Streaming. Implement secure, scalable storage using Delta Lake formats, Azure Data Lake Gen2, and time-series solutions (e.g. Azure Data Explorer). Deliver data validation, schema evolution, metadata management, and lineage tracking to production … internal team can own and evolve the platform post-delivery. Required Skills & Experience Extensive experience delivering enterprise-scale data platforms in cloud environments(preferably Azure). Deep expertise in lake house architectures, real-time/batch processing, and telemetry/IoT pipelines. Proven ability to lead complex delivery across technical and non-technical teams. Strong hands-on experience with … Azure Event Hubs, IoT Hub, Data Factory, Data Lake Gen2, Synapse, Databricks Spark, Structured Streaming, Delta Lake, Parquet SQL, Python Time-series DBs (Azure Data Explorer, InfluxDB, TimescaleDB) Familiarity with Medallion architecture, schema evolution, cost optimisation, and system observability. Track record of mentoring internal teams and embedding best practices in technical delivery. Experience in energy, grid operations More ❯

with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering. Develop custom solutions using Databricks APIs and integrate with More ❯

with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering. Develop custom solutions using Databricks APIs and integrate with More ❯

with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake, and Apache Spark Implement advanced Delta Lake features including time travel, vacuum operations, and Z-ordering. Develop custom solutions using Databricks APIs and integrate with More ❯

Data Engineer/Data Engineering/Lakehouse/Delta Lake/Data Warehousing/ETL/Azure/Azure Databricks/Python/SQL/ML/Machine Learning/AI/Artificial Intelligence/Based in the West Midlands/Solihull/Birmingham area, Permanent role, £50,000 70,000 + car/allowance + bonus. One … Experience in a Data Engineer/Data Engineering role Large and complex datasets Azure, Azure Databricks ML/Machine Learning/AI/Artificial Intelligence Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL Database Design Python/PySpark Azure Blob Storage Azure Data Factory More ❯

on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on More ❯

on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

ensure the Databricks platform is reliable, scalable, and cost-effective. Key Responsibilities Lead, coach, and mentor data engineers, embedding modern AI-enabled practices. Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling). Redesign and optimise data pipelines for scalability, performance, and cost efficiency . Champion Python engineering best practices (testing, CI … product lifecycle management. What We’re Looking For 5+ years in data engineering/platform roles , with 2+ years running Databricks at scale . Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow . Strong Python engineering background with modern CI/CD pipelines. Proven experience optimising Databricks for performance and cost. Track record of leading teams More ❯

in teams, demonstrating strong interpersonal and collaboration skills. Familiarity with Microsoft Azure tools such as Azure Data Factory, Power BI, Data Pipelines, and Data Lake. Experience with Azure Data Lake and Delta Lake design pattern implementation, including file hierarchy and low-level permissions management (desirable). Experience in building CI/CD pipelines in Azure DevOps with More ❯