Azure Data Engineer (Fabric & Cloud Data Platform)
- Location
- Greater London, England, United Kingdom
between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated data workflows using … Compliance: Direct experience implementing security controls for sensitive or identifiable data, utilizing Azure Key Vault, Azure Monitor, Log Analytics, and Microsoft Purview. Data Integration: Proven track record of migrating, refactoring, or connecting legacy SQL/stored procedure logic and existing pipelines ...