2 of 2 Apache Jobs in Belfast

best practices, advising senior stakeholders and team members. Nice to haves: Python and/or exposure to Hive, Impala, and Spark ecosystem technologies (HDFS, Apache Spark, Spark-SQL, UDF, Sqoop) Please apply within for further details or call on 07393149627 Alex Reeder Harvey Nash Finance & Banking To From Record ...

Responsibilities Design, develop, and maintain robust data pipelines and ETL processes. Build and optimise data workflows using Python . Manage workflow orchestration with Apache Airflow (MWAA) . Perform data testing, validation, and produce data quality reports. Conduct data exploration and analysis to understand data structures prior to ETL development. … experience coding in Python . Solid understanding of ETL concepts and data pipeline architecture. Knowledge of data lakes and associated architectures. Experience with Apache Airflow (MWAA) . Familiarity with AWS Athena/PySpark (Glue) . If you would like immediate consideration, please send me an updated CV/contact ...