16 of 16 Remote Permanent Delta Lake Jobs

Degree in Computer Science, Software Engineering, or similar (applied to Data/Data Specialisation). Extensive experience in Data Engineering, in both Cloud & On-Prem, Big Data and Data Lake environments. Expert knowledge in data technologies, data transformation tools, data governance techniques. Strong analytical and problem-solving abilities. Good understanding of Quality and Information Security principles. Effective communication, ability … monitoring/security is necessary. Significant AWS or Azure hands-on experience. ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Certifications: AWS, Azure, or Cloudera certifications are a plus. To be considered for this role you MUST have in-depth experience … role. KEYWORDS Lead Data Engineer, Senior Data Engineer, Spark, Java, Python, PySpark, Scala, Big Data, AWS, Azure, Cloud, On-Prem, ETL, Azure Data Fabric, ADF, Hadoop , HDFS , Azure Data, Delta Lake, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this More ❯

on experience of HDFS/Hadoop and on-prem (coding, configuration, automation, delivery, monitoring, security). Extensive Big Data hands-on experience - Cloudera or similar. Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse. Azure - hands-on experience including coding, configuration, automation and delivery. Advanced Database and SQL skills. Certifications: Cloudera, Azure or FME certifications … Company Sponsorship. KEYWORDS Senior Data Engineer, Coding Skills, Spark, Java, Python, PySpark, Scala, ETL Tools, Azure Data Fabric (ADF), Databricks, HDFS, Hadoop, Big Data, Cloudera, Data Lakes, Azure Data, Delta Lake, Data Lake, Databricks Lakehouse, Data Analytics, SQL, Geospatial Data, FME, QGIS, PostGIS. Please note that due to a high level of applications, we can only respond More ❯

Data Engineer/Data Engineering/Lakehouse/Delta Lake/Data Warehousing/ETL/Azure/Azure Databricks/Python/SQL/ML/Machine Learning/AI/Artificial Intelligence/Based in the West Midlands/Solihull/Birmingham area, Permanent role, £50,000 70,000 + car/allowance + bonus. One … Experience in a Data Engineer/Data Engineering role Large and complex datasets Azure, Azure Databricks ML/Machine Learning/AI/Artificial Intelligence Microsoft SQL Server Lakehouse, Delta Lake Data Warehousing ETL Database Design Python/PySpark Azure Blob Storage Azure Data Factory More ❯

on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on More ❯

on coding experience with Python or PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on More ❯

Spark • Strong programming skills in Python, with experience in data manipulation libraries (e.g., PySpark, Spark SQL) • Experience with core components of the Databricks ecosystem: Databricks Workflows, Unity Catalog, and Delta Live Tables • Solid understanding of data warehousing principles, ETL/ELT processes, data modeling and techniques, and database systems • Proven experience with at least one major cloud platform (Azure … and scalable ETL processes to ingest, transform, and load data from various sources (databases, APIs, streaming platforms) into cloud-based data lakes and warehouses • Leveraging the Databricks ecosystem (SQL, Delta Lake, Workflows, Unity Catalog) to deliver reliable and performant data workflows • Integrating with cloud services such as Azure, AWS, or GCP to enable secure, cost-effective data solutions More ❯

Experience: 5 years of experience in a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala) Exposure to … Familiarity with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data governance and More ❯

ETL/ELT processes, and pipeline orchestration Familiarity with CI/CD and DevOps practices in a data engineering context Excellent communication and stakeholder engagement skills Desirable: Experience with Delta Lake, Power BI, and Azure DevOps Knowledge of data governance, security, and compliance frameworks Exposure to machine learning workflows and MLOps Relevant certifications (e.g. Microsoft Certified: Azure Data More ❯

data modeling and ETL best practices across projects. Troubleshoot and resolve issues in high-volume data processing environments. Experience with real-time data processing and streaming architectures Knowledge of Delta Lake or similar data lakehouse technologies Experience with CI/CD pipelines for data deployments Cloud platform expertise (AWS, Azure, or GCP) Contributions to open-source projects Progression More ❯

improve data infrastructure Explore AI-driven enhancements to boost data accuracy and productivity Requirements: Strong experience with: Azure Databricks, Data Factory, Blob Storage Python/PySpark SQL Server, Parquet, Delta Lake Deep understanding of: ETL/ELT, CDC, stream processing Lakehouse architecture and data warehousing Scalable pipeline design and database optimisation A proactive mindset, strong problem-solving skills More ❯

based database technologies like Snowflake, BigQuery, Redshift Experience in open source technologies like Spark, Kafka, Beam Good understanding of Cloud providers – AWS, Microsoft Azure, Google Cloud Familiarity with DBT, Delta Lake, Databricks Experience working in an agile environment Here’s a taste of the perks we roll out for our extraordinary team members: 25 Days of Holiday, plus More ❯

based database technologies like Snowflake, BigQuery, Redshift Experience in open source technologies like Spark, Kafka, Beam Good understanding of Cloud providers – AWS, Microsoft Azure, Google Cloud Familiarity with DBT, Delta Lake, Databricks Experience working in an agile environment Here’s a taste of the perks we roll out for our extraordinary team members: 25 Days of Holiday, plus More ❯

of data designs, logical and physical data models, data dictionaries, and metadata repositories. REQUIRED SKILLS: The Data Modeler/Architect can design, develop, and implement data models and data lake architecture to provide reliable and scalable applications and systems to meet the organization's objectives and requirements. The Data Modeler is familiar with a variety of database technologies, environments … facts, dimensions, and star schema concepts and terminology Strong proficiency with SQL Server, T-SQL, SSIS, stored procedures, ELT processes, scripts, and complex queries Working knowledge of Azure Databricks, Delta Lake, Synapse and Python Experience with evaluating implemented data systems for variances, discrepancies, and efficiency Experience with Azure DevOps and Agile/Scrum development methods Auditing databases to More ❯

prototype to production • Minimum of 3 years' experience building and deploying scalable, production-grade AI/ML pipelines in AWS and Databricks • Practical knowledge of tools such as MLflow, Delta Lake, and Apache Spark for pipeline development and model tracking • Experience architecting end-to-end ML solutions, including feature engineering, model training, deployment, and ongoing monitoring • Familiarity with More ❯

in a complex organisation Expertise in Kimball and Data Vault 2.0 methodologies Strong grasp of data modelling, metadata, and governance knowledge Hands-on experience with modern data platforms (Databricks, Delta Lake, Unity Catalog, Azure) Ability to define and drive architecture principles, patterns, and best practices Excellent communication and stakeholder management skills Retail industry experience is a bonus but More ❯

Youll oversee the modernisation of our Azure-based data environment, champion scalable and resilient data pipelines, and drive adoption of tools such as Fabric, Data Factory, Databricks, Synapse, and Delta Lake. Working across all areas of the IET, youll ensure our data is secure, accessible, and delivering maximum value for analytics, business intelligence, and operational excellence. Youll foster a … Lead and modernise The IETs data architecture, ensuring alignment with best practice and strategic goals. Drive adoption of Azure data technologies such as Fabric, Data Factory, Databricks, Synapse, and Delta Lake. Develop and maintain scalable, resilient data pipelines to support analytics and reporting. Stay hands-on in solving technical challenges, implementing solutions, and ensuring the reliability of our data More ❯