Lead Data Engineer - Perm - AWS Migration
- Location
- Manchester, Lancashire, United Kingdom
manager's technical number two. The immediate focus is the final stages of a large-scale migration from on-premises SQL Server to an AWS lakehouse, alongside designing the real-time streaming architecture that will take report latency from around 24 hours down to minutes. You'll have real … Previous experience as technical lead on a large-scale data platform or data warehouse migration (cutover, reconciliation, parallel running, decommissioning) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming ...