2 of 2 Contract Delta Lake Jobs in the North East

optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub. * Implement data quality validation, monitoring, metadata management, and governance processes. * Collaborate closely with … Required Skills and Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data Factory or other ...

Must-Have Skills: Azure & Cloud Computing Databricks experience Python for building scalable solutions SQL Data Orchestration - Azure Data Factory or equivalent Data Lakes & Governance - Delta Lake, Unity Catalog, Purview IaC - Terraform, Azure DevOps Bonus Skills: Power BI/Tableau Streaming Data - Event Hubs, IoT Hubs Distributed Compute Engines ...