22 of 22 Remote Delta Lake Jobs

Engineer - Leading UK Enterprise - Milton Keynes (Hybrid -2/3 times/month!) (Tech stack: Data Engineer, Python, Spark, SQL, Data Modelling, Data Architecture, Delta Lake, Cloud (Azure/AWS/GCP), Medallion Architecture) Our client is a leading UK enterprise undergoing a major data transformation programme … applicants should have strong experience in Python , Spark , and SQL , alongside solid expertise in Data Modelling and modern Data Architecture principles. Experience working with Delta Lake and Medallion Architecture is highly desirable. Exposure to Cloud (Azure, AWS or GCP) platforms is essential for any Data Engineer looking ...

pipelines within a Databricks Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help … Experience building streaming and batch pipelines using Spark Structured Streaming Hands-on experience with Kafka (MSK) and real-time data ingestion Strong understanding of Delta Lake, Delta Live Tables, and Medallion Architecture Proficiency in Python and SQL for data engineering and analytics TO BE CONSIDERED... Please either ...

modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … within the team and communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous). Experience contributing ...

decisions, and working with people who care about building things properly, you’ll fit right in. You’ll Work With Azure Data Factory, Data Lake, Key Vault, Azure Functions Databricks, Delta Lake, Unity Catalog, PySpark, Spark SQL Medallion architecture, Lakehouse patterns, distributed compute CI/CD pipelines … home You’ll thrive in this role if you have: Strong hands‐on experience with Azure Data Services and Databricks Solid understanding of Delta Lake, Medallion architecture and Lakehouse patterns Proficiency in Python, PySpark and Spark SQL Experience building CI/CD pipelines using Azure DevOps Knowledge ...

govern data products within a Databricks Lakehouse architecture. Key Responsibilities Design, develop, and optimise scalable ETL/ELT pipelines using Databricks, Python, SQL, and Delta Live Tables (DLT). Build and maintain performant Delta Lake solutions, including partitioning and optimisation strategies. Contribute to Lakehouse architecture design … commercial experience as a Data Engineer or Senior Data Engineer. Deep hands-on expertise with Databricks on AWS (essential). Strong understanding of Spark, Delta Lake, and Lakehouse architectures. Proven experience designing scalable and maintainable modern data platforms. Strong knowledge of the end-to-end data engineering lifecycle. ...

Data Engineer will design, build, support and operate data pipelines and core data platform technologies within the organisation's Azure-based analytics and lake house environment. The role is hands-on and implementation-focused, working within established architectural patterns to deliver reliable, secure and well-governed data for analytics … Responsibilities Develop and maintain data pipelines using Azure Databricks (Python, PySpark and SQL) Implement ingestion and transformation across Bronze, Silver and Gold layers using Delta Lake Support and operate Azure Databricks and Azure Synapse platforms, including performance monitoring and configuration Build Gold-layer datasets optimised for Power ...

Doing Designing and building end-to-end data pipelines using Databricks on Azure or AWS Developing modern lakehouse architectures using: Databricks (Spark, SQL, Delta Lake) Azure Data Lake Storage or Amazon S3 Writing high-quality PySpark, Python, and SQL for ingestion, transformation, and modelling Implementing Bronze/ ...

data platforms. Required experience Strong Azure data engineering experience. Hands-on experience with tools such as Azure Data Factory, Azure Synapse, Databricks, SQL, Delta Lake, or Azure Data Lake . Experience building data pipelines and working with large datasets. Good understanding of ETL/ELT, data modelling ...

latest technology, ensuring you can be at the forefront of your field. What You’ll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines What you’ll do Design ...

including technical leadership responsibilities Strong SQL skills and extensive experience building ETL/ELT pipelines at scale Hands-on expertise with Databricks, including Autoloader, Delta Live Tables, Delta Lake, and Unity Catalog Strong experience designing and implementing lakehouse and medallion architecture patterns Strong data modelling experience, including ...

tooling Key skills Strong experience with Microsoft Fabric (Data Factory, Lakehouse, OneLake, Pipelines, SQL Warehouse) Solid data engineering background using SQL, Python, PySpark, Delta Lake E xperience building and optimising end-to-end data pipelines CI/CD experience for analytics and data platforms (Azure DevOps or GitHub ...

using Azure Data Factory and Fabric. Manage ingestion from APIs, databases, flat files, and event‐driven sources. Oversee Azure services including ADLS, Azure SQL, Delta Lake/OneLake, Key Vault, and Event Hubs. Drive platform reliability, observability, and operational excellence. Data Quality & Master Data Lead the implementation ...

target mapping, data quality rule setup for the target data model’s critical data elements (CDE). Database Optimization: Optimize Cloud databases such as Delta Lake or One Lake for efficiency, scalability, and faster access using techniques like indexing and partitioning. Data Governance: Work with Federated Governance ...

such as Azure (especially services such as ADLS, Azure SQL Server, Key Vault) or similar platform services such as AWS/GCP ·Familiarity with Delta Lake and transactional data patterns ·Experience with data orchestration tools (e.g. Databricks Workflows, MS Scheduler) ·Understanding of data modelling concepts for analytics ...

Requirements 7+ years experience in data engineering or data platform development Strong experience with Databricks, Spark and distributed data processing Experience with Unity Catalog, Delta Lake and streaming architectures Advanced Python and Microsoft SQL Server development Experience designing enterprise data architectures Proven experience leading engineering teams or workstreams ...

workflows for performance and reliability. Essential Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability to work independently … remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking for a flexible, remote opportunity with a Databricks Partner ...

Required Skills Strong background in data testing, ETL validation, and data migration. Hands-on expertise with cloud-based data platforms (Azure Data Factory, Databricks, Delta Lake). Advanced SQL skills for complex query validation. Experience with Agile/DevOps delivery models and JIRA test management. Familiarity with automation ...

cloud data strategy, define engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory, audit … Data Services and Databricks in enterprise environments. Proven delivery experience within the Lloyd's of London or London Market insurance sector Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling. Strong Python, PySpark and Spark SQL capability Solid understanding of data governance Proven track record ...

PySpark, Spark SQL and Python Implement and maintain CI/CD practices Enhance and optimise existing data pipelines About You Proven experience in Databricks, Delta Lake, PySpark and Spark SQL Excellent communication skills - ability to partner with the business and key stakeholders to champion best practice in data ...

multi-site business environment Strong proficiency in Python and SQL, with hands-on experience in Spark/PySpark and modern table formats (e.g. Delta Lake, Iceberg, Hudi) Expertise in AWS data services (e.g. S3, Glue, Redshift, Lambda, Step Functions, Kinesis) and infrastructure-as-code (Terraform or CDK) Experience ...

Modelling, Data Warehousing. Strong background in incident resolution, requests, changes and problem-solving within SLAs. Hands-on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. ...

Modelling, Data Warehousing. Strong background in incident resolution, requests, changes and problem-solving within SLAs. Hands-on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. ...