Data Engineer
- Location
- Newcastle upon Tyne, England, United Kingdom
solutions Data processing & orchestration Apache Spark - understanding of distributed data processing architecture and execution Apache Airflow - configuring DAGs and managing task orchestration at scale Jupyter Notebooks - for exploratory data analysis and pipeline prototyping Understanding of dimensional data models and slowly changing dimensions (SCD Types 1, 2, 3) Data analysis skills ...