4 of 4 Permanent Spark SQL Jobs in the Thames Valley

data architecture aligned with modern best practices. Building and managing ingestion pipelines using Databricks and related tools. Developing PySpark/Spark SQL notebooks for complex transformations and cleansing. Applying governance, security, and CI/CD best practices across cloud environments. Leading technical discussions and producing professional … documentation. To be successful in this role, you will have: Hands-on experience with Databricks including Unity Catalog. Strong PySpark/Spark SQL skills for large-scale transformations. Experience integrating with diverse data sources such as APIs, cloud storage and databases. Experience with the Azure cloud ...

culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice Requirements You Will Demonstrate: Proficiency in SQL and Python: You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease. Understanding of Data … Lakehouse Architecture: You have a strong grasp of the principles and implementation of Data Lakehouse architecture. Hands-On Experience with Spark-Based Solutions: You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark ...

culture within the organisation, mentoring team members, and contributing to the continuous improvement of the Engineering Practice Requirements You Will Demonstrate: Proficiency in SQL and Python: You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease. Understanding of Data … Lakehouse Architecture: You have a strong grasp of the principles and implementation of Data Lakehouse architecture. Hands-On Experience with Spark-Based Solutions: You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark ...

plans and lead the development of data processing workflows. From a technical standpoint you must possess: Extensive Databricks experience including Unity Catolog and Spark SQL Strong programming skills, preferably in Python and SQL Strong knowledge and experience in Azure, including working with Azure Data ...