Senior Data Engineer (Azure, Spark SQL, Team Lead)
Sheffield, England, United Kingdom
Hybrid / WFH Options
Hybrid / WFH Options
HOK Consulting - Technical Recruitment Consultancy
I introduce talented IT Professionals to exciting contract opportunities within Banking & Financial Services Location: Hybrid (3 days/week from Sheffield) We are looking for a Senior Data Engineer with hands-on expertise in SQL/BigQuery migration , Azure Databricks , and Spark SQL , who also brings team leadership experience and thrives in Agile/SAFe/… to a small Agile team working on a cross-cloud data migration project. Migrate complex BigQuery SQL transformations to Spark SQL on Azure. Build & execute ETL workflows using Azure Databricks and Python. Drive automation of SQL workflows and artefact migration across cloud providers. Collaborate with developers, POs, and stakeholders on quality delivery and performance optimization. Key Requirements: Strong … SQL skills (BigQuery SQL & Spark SQL), Python, and ETL pipeline development. Experience with Azure and cloud data tools. Familiarity with CI/CD practices and automation. Proven team leadership and organisational capabilities. Comfortable with Agile/SAFe/PI Planning methodologies. Seniority level Seniority level Mid-Senior level Employment type Employment type Contract Job function Job function Information More ❯
Posted: