10+ years' experience in Data Engineering, with a minimum of 3 years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ELT patterns, and modern data More ❯
you will have: Proven leadership experience within data engineering or data consultancy. Hands-on experience with Microsoft Fabric, Azure Synapse, Data Factory and Databricks. Strong SQL and Python/PySpark skills. Experience designing data lakes, warehouses and scalable data models for BI tools like Power BI. Solid understanding of data architecture and optimisation techniques for large-scale solutions. Some More ❯
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Brightbox GRP Ltd
system. The successful candidate will play a critical role in supporting a broader initiative to migrate the ETL engine for the data set from Oracle PL/SQL to PySpark on Microsoft Fabric. Key Responsibilities: - Collaborate closely with the existing team to ensure a smooth transition of data during the migration process. - Optimise data pipelines for efficiency and performance. … migration initiatives. Qualifications: - Strong experience in data engineering roles, with a proven track record of data migration projects. - Familiarity with Oracle and Microsoft Fabric environments is essential. - Proficiency in PySpark is required. - Excellent analytical and problem-solving skills, with attention to detail. - Strong communication skills to effectively collaborate with team members and stakeholders. More ❯
