3 of 3 Contract SQL Jobs in Newcastle upon Tyne

candidate will play a critical role in supporting a broader initiative to migrate the ETL engine for the data set from Oracle PL/SQL to PySpark on Microsoft Fabric. Key Responsibilities: - Collaborate closely with the existing team to ensure a smooth transition of data during the migration process. - Optimise ...

data engineering challenges. Required Skills & Experience Proven experience as a Senior Data Engineer with strong Azure expertise.Strong hands-on experience with Databricks.Proficiency in Python, SQL, and data modelling.Strong understanding of ETL processes, data warehousing, and cloud architecture.Excellent problem-solving skills and ability to work independently Visa sponsorship is not available ...

data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities * Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL). * Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure … Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub. * Implement data quality validation, monitoring, metadata management, and governance processes. * Collaborate closely with data architects, analysts, and business stakeholders to understand data requirements. * Optimize Databricks clusters, jobs, and runtimes for performance and cost efficiency. * Develop ...