26 to 32 of 32 Remote Delta Lake Jobs

+ performance troubleshooting. Supporting + maintaining production data pipelines, including incident investigation, safe recovery, root cause analysis + permanent remediation. Experience of Spark SQL, Delta Lake, Parquet + Hive metastore tables, schemas, partitions and the relationship between table metadata and underlying files. Hands-on AWS experience, particularly ...

reusable frameworks and accelerators. What You'll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/CD, automated testing and Infrastructure ...

controls and records needed to support auditing, data traceability and compliance requirements. Performance and operational management Investigate and improve the performance of Spark workloads, Delta tables and SQL compute. Review resource consumption and identify ways to reduce unnecessary platform and cloud expenditure. Set up monitoring and alerting to identify … mentoring across the team. What we are looking for Practical experience managing Databricks in a production environment. A strong understanding of Apache Spark, Delta Lake and Unity Catalog. Experience working with one or more major cloud providers, including storage, networking and identity management. Confidence using Terraform ...

Data Warehousing . Strong background in incident resolution, requests, changes and problem-solving within SLAs. Hands-on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. ...

designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...

designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...

designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...