14 of 14 Remote/Hybrid Permanent Delta Lake Jobs

Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer, Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data Warehouse, Azure Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer … Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data Warehouse, Azure Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer, Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data ...

data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled … deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

collaboration skills. Familiarity with Microsoft Azure tools such as Azure Data Factory, Power BI, Data Pipelines, and Data Lake. Experience with Azure Data Lake and Delta Lake design pattern implementation, including file hierarchy and low-level permissions management (desirable). Experience in building CI/CD pipelines ...

experience with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft … Fabric. Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion and transformation. Proficiency in Python ...

Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables and the Medallion architecture . Hands-on experience with AWS services such as S3, Glue, Lambda, Batch ...

Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture, delta lake tables, security policies, and data governance within Fabric. o Build scalable, reusable data assets and engineering patterns that support analytics, reporting ...

Spark) o Data Warehouse (SQL endpoints, schemas, MPP performance tuning) o Real-Time Analytics (KQL databases, event ingestion) o Manage and enhance OneLake architecture, delta lake tables, security policies, and data governance within Fabric. o Build scalable, reusable data assets and engineering patterns that support analytics, reporting ...

post include; Develop, construct, test and maintain data architectures within large scale data processing systems. Develop and manage data pipelines using Azure Data Factory, Delta Lake and Spark. Utilise Azure Cloud architecture knowledge to design and implement scalable data solutions. Utilise Spark, SQL, Python, R, and other data ...

deliver the organisation’s data vision and roadmap with senior technology leaders. Act as the technical authority for data architecture across Azure, Microsoft Fabric, Delta Lake, and Power BI. Lead the design, build, and maintenance of scalable data products, pipelines, and Lakehouse solutions. Oversee data migration from legacy … building capability and technical standards. Essential Skills & Experience Strong experience building data products and pipelines using Azure data technologies such as Microsoft Fabric or Delta Lake. Skilled in Python, T-SQL, and modern development practices (including test-driven development). Extensive experience designing data architecture, data models, integrations ...

trading workflows. Exposure to cloud platforms (Azure, AWS, or GCP). Experience hiring, mentoring, or leading small engineering teams. Familiarity with Apache Spark, Kafka, Delta Lake, or similar data technologies. Apply Now to avoid disappointment! To find out more about Huxley, please visit ...

Factory pipelines, Lakehouse) or Azure Synapse Proven experience extracting and consolidating master data from multiple ERPs PySpark and/or T-SQL Understanding of Delta Lake, medallion architecture and lakehouse patterns Understanding of data quality, data governance, and best practices Ability to design clear, reliable, and scalable data ...

Contribute to the overall data strategy and roadmap, ensuring alignment with business objectives. Tech Stack & Skills Required: Strong hands-on experience with Databricks (Spark, Delta Lake, notebooks). Deep knowledge of Azure data services such as: Strong background in Python and/or Scala. Solid understanding ...

Familiarity with enterprise data platforms , metadata management, and governance Excellent leadership and stakeholder communication skills Knowledge of tools like MS Fabric , Synapse Notebooks , PySpark , Delta Lake Basic SQL/Python for troubleshooting Why This Role? Drive transformation in technology and data management Work on a critical, high-visibility ...