2 of 2 Spark SQL Jobs in Sheffield

infrastructure services or technical suppliers. Experience enabling governed self service access to data. Skills and Knowledge Essential Strong data engineering skills, including t-sql and spark spark sql; fabric or data factory pipelines; fabric notebook; data flows and data modelling. Understanding ...

processes and solutions. Lead the execution of Microsoft Fabric migration activities. Lead and guide migration engineers and QA resources. Develop Python, PySpark and Spark SQL code for data validation and curation within notebooks. Create data integration test cases and support testing activities. Implement and amend data … Azure Functions o Azure App Service o Logic Apps o Azure Kubernetes Service (AKS) o Web Apps Hands-on expertise in PySpark, SQL and Python. Good knowledge of real-time streaming applications, preferably including Kafka, Azure Functions or Azure Service Bus. Strong understanding of Spark processing ...