5 of 5 PySpark Jobs in Manchester

e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability ...

Days Cycle to work scheme And More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta ...

applied data science. Hands-on experience with cloud data platforms, including AWS, Azure, GCP, and/or Databricks. Proficiency in Python (and ideally PySpark); experience with R beneficial but not essential. Experience building end-to-end data pipelines, feature engineering, and production ML workflows. Exposure to Generative AI, LLMs ...

processing, and analytics • Designing scalable, secure, and high performance architectures using Databricks and distributed data systems • Building and overseeing robust data ingestion pipelines using PySpark, with a strong focus on reliability and accuracy • Ensuring end to end data quality from raw ingestion through to curated datasets used for reporting … wider regulatory requirements • Evaluating and introducing new technologies where they add clear value to the data ecosystem What you will bring • Deep expertise in PySpark and distributed data processing at scale • Strong hands on experience designing, building, and optimising Databricks based platforms • Advanced SQL skills including performance optimisation ...

Senior Data Engineer Cambridge | Hybrid (1 day on site) Up to £90k + benefits Do you you enjoy working closely with a tight-knit team? Do you want to work in a business where making ...