1 of 1 Permanent Apache Spark Jobs in County Antrim

Data Architect JBLE1 NI

Hiring Organisation
Ocho
Location
Belfast, UK
hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration patterns and canonical models to support consistent, scalable data delivery Define and enforce data governance standards including metadata … scale Deep practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL, MySQL and DynamoDB Knowledge of data governance frameworks and tools including metadata management ...