2 of 2 Remote/Hybrid Jupyter Jobs in Tyne and Wear

solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache Airflow - configuring DAGs and managing task orchestration at scale Jupyter Notebooks - for exploratory data analysis and pipeline prototyping Understanding of dimensional data models and slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills ...

exposure to modern DevOps and data engineering practices. Must Have: AWS services; Terraform; Apache Spark; Python; Apache Airflow; Docker; GitLab; Security scanning agent; Jupyter; Notebooks; Key Responsibilities Design, develop, and maintain scalable Python applications and services Build and optimize cloud-native data processing pipelines Develop and manage workflows using orchestration …/CD pipelines Understanding of security scanning and vulnerability management tools such as Trivy, Trend Micro, Wiz, or similar Experience working with Jupyter Notebooks Familiarity with secure enterprise integrations and data transfer solutions Strong problem-solving and debugging skills Excellent communication and stakeholder collaboration skills Preferred Experience Experience working within ...