14 of 14 PySpark Jobs in Manchester

e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability ...

ideally in enterprise-scale environments Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/SparkSQL) and distributed data processing Strong data modelling skills (Dimensional, ODS, Data Vault) and data warehousing concepts Proficiency in SQL, version control ...

Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta ...

more more) SQL, NoSQL, Data Lakes, Data Warehouses ELT/ETL tools: Databricks, Azure Data Factory, SSIS, Talend, Informatica, Palantir Python, PySpark managing and motivating teams, agile methodology Data governance and analytics expertise Strong communication skills to bridge business and technical requirements Salary & Benefits ...

scale data processing. Hands-on experience with Databricks and Azure . Strong stakeholder communication and problem-solving skills. Tech Stack Required: Databricks DBT Python PySpark SQL Azure Bonus: Experience in eCommerce environments. If you are interested please apply below ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

practices for data governance and security. Required Skills & Experience 5–10 years in data engineering roles, ideally within consultancy environments. Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice ...

services to deliver robust cloud solutions Coaching and supporting Data Engineers and Associate Engineers Experience Required Strong hands-on experience with Azure, Databricks and PySpark, Deep Azure data engineering expertise (ADF, Databricks, ADLS Gen2, Synapse, Azure SQL, Functions, Key Vault) Experience delivering end-to-end data solutions in cloud ...

services to deliver robust cloud solutions Coaching and supporting Data Engineers and Associate Engineers Experience Required Strong hands-on experience with Azure, Databricks and PySpark, Deep Azure data engineering expertise (ADF, Databricks, ADLS Gen2, Synapse, Azure SQL, Functions, Key Vault) Experience delivering end-to-end data solutions in cloud ...

data engineering and 1+ experience as Lead Data Engineer Proven expertise with Microsoft Azure Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark . Expertise in Databricks for large-scale data engineering and analytics workloads. Design and implement scalable data architectures using Databricks Unity Catalog, Delta Lake ...

processing (PDF, OCR) SQL and structured data familiarity Excellent communication skills Desirable: Intelligent search/retrieval systems Agent frameworks Azure cloud services MLflow, Flask, PySpark What’s on Offer Salary: £45,000–£55,000 Hybrid working (Hampshire or Manchester) 25 days annual leave + birthday off Pension scheme Freedom ...

. Maintain/implement data warehousing solutions and manage large-scale data storage systems (e.g. Microsoft Fabric) Build and optimise SQL queries, stored procedures, PySpark notebooks and database objects to ensure data performance and reliability. Migrate and modernise legacy databases to cloud-based architectures. Database Administration Administer, monitor … normalisation, indexing, query optimisation). Strong experience with ETL/ELT tools. E.g. Azure Data Factory, Databricks, Synapse Pipelines, SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations ...

12 Month Fixed Term Contract The Team: The Data Engineering team is positioned in the Delivery business unit of the IT function within the Data & Automation department sitting alongside the Report Engineering, Data Governance, Data ...