15 of 15 Kafka Jobs in Northern Ireland

observability platforms Desirable: OpenShift/Kubernetes Cloud technologies (Google Cloud Platform, Azure, AWS) Microservices and distributed architectures Event-driven architectures and messaging platforms (Kafka, MQ) Elastic Stack (ELK) Grafana Google Cloud Observability (GCO) Python, Shell, or PowerShell scripting CI/CD tooling and deployment automation Infrastructure as Code concepts ...

modern Java designing, building and operating production backend services at scale - Experience building event-driven or message-based systems AWS SNS/SQS, Kafka, Solace or similar middleware - Solid cloud infrastructure experience on AWS, with hands-on deployment and operational ownership - Strong understanding of CI/CD, containerisation (Docker ...

designing and implementing large‐scale, complex systems. Deep understanding of architectural principles and patterns for distributed systems (e.g., microservices, event‐driven architecture with Kafka). Expertise in resilience mechanisms and performance tuning to ensure system stability and efficiency at scale. Proficiency in managing cloud infrastructure and services (e.g. ...

system principles. * Experience with AWS and event-driven architectures. * Exposure to financial systems or trading environments preferred. * Familiarity with messaging or streaming systems (e.g., Kafka). * Strong problem-solving mindset with an interest in performance optimization. * Crypto knowledge or enthusiasm for the space is a distinct advantage. Why Join ...

infrastructure as code (Terraform or CloudFormation) Right to work in the UK or Republic of Ireland Nice to have Experience with streaming data (Kinesis, Kafka or similar) Apache Airflow or similar orchestration tooling Exposure to dbt for transformation layer management WHY APPLY? Salary up to £75,000 depending ...

Applications Development Demonstrated knowledge of client core business functions Demonstrated leadership, project management, and development skills Relationship and consensus building skills Preferred Kafka/Event-Driven Architecture Apache Iceberg/Delta Lake Python AI/ML & LLM integration Financial Services/Capital Markets Education Bachelor’s degree/University ...

Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory ...

batch). Hands‐on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data ...

driven development (TDD) principles (e.g., NUnit, Jest). Distributed Systems Knowledge: Deeper understanding of distributed systems, including building scalable and resilient services (e.g., Redis, Kafka, AWS infrastructure). Problem‐Solving & Collaboration: Show strong problem‐solving skills and collaborate effectively with team members, product managers, and stakeholders to deliver solutions ...

Architecture: Event-driven systems and microservice development - we use Azure Service Bus, and welcome experience with similar messaging technologies such as Kafka or RabbitMQ Infrastructure: Kubernetes, Docker Observability: Prometheus, Grafana Engineering culture: DevOps, infrastructure as code, automated testing across all environments including production, continuous delivery Our Engineering Approach Full … providers Solid understanding of event-driven architecture and microservice development - we use Azure Service Bus, and welcome experience with similar messaging technologies such as Kafka or RabbitMQ Experience leading or mentoring engineers in a collaborative team environment Ability to set technical direction and provide architectural guidance Comfortable working with ...

services such as Kinesis, S3 and Redshift, and GCP services such as Pub/Sub and BigQuery Experience with streaming technologies such as Kafka and real time processing engines such as Spark or Flink Strong understanding of performance optimisation, including indexing, partitioning, caching and query tuning Experience working across ...

system ownership at genuine scale LLM/RAG, NLP, and streaming ML pipelines processing millions of items daily AWS-native (Lambda, ECS, SageMaker, MSK, Kafka), strong Python required £65,000-£75,000 High-impact role across AI Insights, Automated Answers, and mission-critical Machine Moderation systems About the Company … Flyte or Airflow Manage ML pipelines on AWS with containerised services and CI/CD via GitHub Actions Implement streaming data processing with Kafka for real-time content moderation Monitor model performance and drift using observability tools such as Arize AI Collaborate with Scala-based service teams and maintain ...

hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration patterns and canonical models to support consistent, scalable data delivery Define and enforce data governance standards including metadata … Information Systems or a related field Desirable: Experience with GCP data services including BigQuery and Pub/Sub Experience with streaming technologies such as Kafka or Confluent Familiarity with encryption standards and key management solutions including AES-256, TLS and KMS Relevant cloud certifications such as AWS Certified Data ...

Java Technical Specialist (Low Latency) At a Glance Senior individual contributor role in a high-growth prediction markets trading firm Core stack: Java, Kafka, Aeron, FIX Protocol exchange and clearing infrastructure Salary: £80,000 - £95,000 + highly attractive bonus package. 5+ years experience required - strong fintech or financial … messaging architecture using Aeron and related frameworks Implement customer-facing API interfaces using FIX, REST and WebSocket protocols Build fault-tolerant distributed systems using Kafka, PostgreSQL and in-memory data structures for hot-path processing Profile, benchmark and tune system performance at the JVM level Participate in on-call ...

Manage and support large-scale KDB environments handling petabyte-scale data and 500+ users. Integrate KDB+ with Real Time messaging platforms such as Solace, Kafka, and ION. Implement DevOps, automation, monitoring, and platform reliability practices. Troubleshoot performance issues and ensure platform stability and scalability. Required Skills KDB+ & q Strong … storage, and query optimization - Inter-process communication - Tickerplant, RDB, HDB, Gateway, and chained process architectures Real Time Data Platforms Experience integrating KDB+ with Solace, Kafka, or ION Strong understanding of Real Time market data processing and distribution. Capital Markets Strong domain knowledge of: -Fixed Income - FX - Equities Experience with ...