4 of 4 PySpark Jobs in the North East

e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

services, data modeling, ETL/ELT development, and collaborative engineering practices. Key Responsibilities* Design, develop, and maintain scalable data pipelines using Azure Databricks (Python, PySpark, SQL).* Build and optimize ETL/ELT workflows that ingest data from various on-prem and cloud-based sources.* Work with Azure services … standards and best practices. Required Skills and Experience* Proven experience as a Data Engineer working with Azure cloud services.* Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration.* Strong SQL and data modeling skills (e.g., dimensional modeling, data vault).* Experience with Azure Data ...

that powers analytics and AI-driven solutions. What You'll Do Build and maintain scalable data pipelines in a cloud environment. Develop transformations using PySpark, Python, and SQL. Model data for analytics and reporting. Ensure data quality and performance. Opportunity to engage with stakeholders and challenge external partners. What … Looking For Solid foundations in data engineering with experience in cloud-based platforms. Hands-on experience with Databricks or Fabric. Strong SQL and PySpark skills. Understanding of ETL and dimensional modelling. Excellent communication and problem-solving mindset. Why Join? Work on modernisation projects including Real Time reporting and AI. ...