2 of 2 Permanent Apache Spark Jobs in Northern Ireland

will look like Understand Ubuntu, Linux, networking and services in real‐world environments Architect cloud infrastructure solutions such as Kubernetes, Kubeflow, OpenStack, Ceph and Spark on‐premises or in public clouds (AWS, Azure, Google Cloud) Architect and integrate popular open‐source software such as PostgreSQL, MongoDB, Kafka, Cassandra ...

hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration patterns and canonical models to support consistent, scalable data delivery Define and enforce data governance standards including metadata … scale Deep practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL, MySQL and DynamoDB Knowledge of data governance frameworks and tools including metadata management ...