Data Engineer (SC Cleared)
- Hiring Organisation
- scrumconnect ltd
- Location
- Newcastle upon Tyne, UK
- Employment Type
- Full-time
solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache Airflow - configuring DAGs and managing task orchestration at scale Jupyter Notebooks - for exploratory data analysis and pipeline prototyping Understanding of dimensional data models and slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills ...