3 of 3 Flink Jobs in Northern Ireland

practical knowledge of AWS data services including Redshift, Glue, EMR, Kinesis and S3 Experience with modern data engineering tools such as dbt, Spark or Flink Proven experience with SQL and NoSQL databases including PostgreSQL, MySQL and DynamoDB Knowledge of data governance frameworks and tools including metadata management and data ...

services such as Pub/Sub and BigQuery Experience with streaming technologies such as Kafka and real time processing engines such as Spark or Flink Strong understanding of performance optimisation, including indexing, partitioning, caching and query tuning Experience working across multi cloud and hybrid cloud environments, including cost optimisation ...

isolation, row‐and‐column‐level security, and PII handling. Define the streaming and batch ingestion architecture, building on our investments in NATS JetStream, Apache Flink, and Debezium CDC patterns, and direct the engineering team on execution. Specify the catalog, lineage, and data‐quality foundation and own the operational practice … data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data and table formats (Parquet, Avro, Apache Iceberg or Delta Lake) Experience designing ...