Data Engineer (Mid‐Level ), Global
- Hiring Organisation
- Vantage Data Centers
- Location
- London, United Kingdom
- Salary
- £ 60 K
operate batch and incremental data pipelines leveraging Azure Data Factory for orchestration and Azure Data Lake Storage Gen2 as the primary data store.Independently implement SQL- and Spark‐based transformations to produce curated datasets that support enterprise reporting, analytics, and downstream consumption.Take ownership of assigned data pipelines and datasets, including monitoring … data ingestion.Implement Spark‐based transformations that write curated datasets to Azure Data Lake Storage Gen2 using established folder structures and naming conventions.Create and maintain SQL views and tables in Azure Synapse to support analytics and reporting use cases.Respond to pipeline failures, data validation issues, and operational alerts.Perform basic performance tuning ...