6 of 6 PySpark Jobs in the East of England

added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and transformation. Prior experience with Data warehousing and Data modelling (Star Schema or Snowflake Schema). Skilled in security frameworks ...

Hands-on experience building ETL/ELT pipelines in a cloud environment Strong SQL skills and experience with data modelling Experience working with Databricks ( PySpark/SQL) and Azure data services Familiarity with Git and CI/CD approaches for data engineering A collaborative approach and attention to detail ...

Hands-on experience building ETL/ELT pipelines in a cloud environment Strong SQL skills and experience with data modelling Experience working with Databricks (PySpark/SQL) and Azure data services Familiarity with Git and CI/CD approaches for data engineering A collaborative approach and attention to detail ...

data workflows using Data Lakes and Logic Apps Write and maintain complex T-SQL queries, stored procedures, and optimised database logic Use Python and PySpark for distributed data processing and large-scale transformation within Fabric and cloud BI pipelines Ensure data accuracy, quality, and adherence to BI governance standards ...

data platforms Deep expertise in Snowflake architecture Hands-on experience with Airflow/MWAA and dbt Strong knowledge of AWS data services (S3, EMR, PySpark) Experience designing Data Lakehouse architectures (Iceberg preferred) Expertise in performance tuning and optimisation Nice to Have CI/CD and DevOps practices Terraform/ ...

high-quality outcomes. Your Responsibilities: Lead the design and implementation of scalable, secure, and cost-efficient ETL/ELT pipelines using AWS Glue, Python (PySpark), and MWAA (Airflow). Define solution architectures, data models, orchestration patterns, and CI/CD for data workflows. Own the technical roadmap, decomposition …/data engineering, with 5+ years leading delivery of production solutions in an AWS data engineering environment. Advanced hands-on expertise with: Python (including PySpark & data engineering patterns) AWS Glue (Jobs, Crawlers, Glue Studio, Glue Catalog, PySpark, Job bookmarks) MWAA (Apache Airflow) (DAG design, scheduling, sensors, retries, XComs ...