Senior Data Engineer
- Hiring Organisation
- ASOS.com
- Location
- Belfast, Northern Ireland, United Kingdom
shopping experience. What You’ll Be Doing: Designing and developing large-scale, high-performance data pipelines for batch and real-time processing. Leveraging Azure services (Data Factory, Event Hubs, Service Bus) and Databricks to orchestrate complex workflows. Building robust ingestion and transformation frameworks using … Spark/PySpark and Python, ensuring data quality and reliability. Implementing CI/CD pipelines for automated deployment and testing with tools like Azure DevOps and GitHub Actions. Collaborating in an agile, cross-functional team, working closely with data scientists, engineers, and product stakeholders. Driving best practices ...