19 of 19 Kafka Jobs in Northern Ireland

observability platforms Desirable: OpenShift/Kubernetes Cloud technologies (Google Cloud Platform, Azure, AWS) Microservices and distributed architectures Event-driven architectures and messaging platforms (Kafka, MQ) Elastic Stack (ELK) Grafana Google Cloud Observability (GCO) Python, Shell, or PowerShell scripting CI/CD tooling and deployment automation Infrastructure as Code concepts ...

modern Java designing, building and operating production backend services at scale - Experience building event-driven or message-based systems AWS SNS/SQS, Kafka, Solace or similar middleware - Solid cloud infrastructure experience on AWS, with hands-on deployment and operational ownership - Strong understanding of CI/CD, containerisation (Docker ...

Remote) Full-time Staff-level ownership of large-scale, distributed data pipelines, not just execution Modern open-source stack: Airflow/Dagster, Spark, dbt, Kafka, AWS Flexible Hybrid working out of Belfast Join a platform already moving billions of consumer interactions a year, still scaling About the Company This … Azure) and Terraform Strong grasp of CI/CD, git, agile delivery and containerisation Desirable: Knowledge of event-driven and streaming technologies (Kafka, Kafka Streams, Flink) Prior technical leadership or mentoring experience Why Apply? Hybrid working model based in Belfast Staff-level scope with genuine architectural influence Work ...

Bitbucket Pipelines, GitHub Actions). Working knowledge of cloud platforms (AWS, GCP, Azure) and their core services. Desirable Skills: Experience with message queueing solutions (Kafka, SQS), Serverless technologies (Lambda), and monitoring and logging tools (Dynatrace, ELK stack, Splunk). Experience using logging to derive application insights. Consideration ...

designing and implementing large‐scale, complex systems. Deep understanding of architectural principles and patterns for distributed systems (e.g., microservices, event‐driven architecture with Kafka). Expertise in resilience mechanisms and performance tuning to ensure system stability and efficiency at scale. Proficiency in managing cloud infrastructure and services (e.g. ...

system principles. Experience with AWS and event-driven architectures. Exposure to financial systems or trading environments preferred. Familiarity with messaging or streaming systems (e.g., Kafka). Strong problem-solving mindset with an interest in performance optimization. Crypto knowledge or enthusiasm for the space is a distinct advantage. Why Join ...

operate with minimal supervision Nice to Have: CI and CD pipeline setup and configuration Document based or NoSQL databases The ELK stack Apache Kafka Spring Security and OAuth2 flows React or React Native Keycloak, Camunda or OpenAPI and Swagger Nginx setup and configuration Why Apply? Salary ...

infrastructure as code (Terraform or CloudFormation) Right to work in the UK or Republic of Ireland Nice to have Experience with streaming data (Kinesis, Kafka or similar) Apache Airflow or similar orchestration tooling Exposure to dbt for transformation layer management WHY APPLY? Salary up to £75,000 depending ...

during interview stage* Experience in REST API and authentication mechanisms (OAuth/Basic Authentication)* Messaging Systems experience in any of the following middleware technologies (Kafka preferrable, Nats, Solace, TiBCo, RabbitMQ etc.)* Experience working with SQL and databases such as Oracle, SQL Server, Hadoop etc.* Experience with Java Multithreading/ ...

Applications Development* Demonstrated knowledge of client core business functions* Demonstrated leadership, project management, and development skills* Relationship and consensus building skills**Preferred*** Kafka/Event-Driven Architecture* Apache Iceberg/Delta Lake* Python* AI/ML & LLM integration* Financial Services/Capital Markets**Education:*** Bachelor’s degree/University ...

Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory ...

Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus.Domain Knowledge:Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations.In-depth knowledge of regulatory reporting ...

At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years, our innovative drive has kept us a step ahead ...

services such as Kinesis, S3 and Redshift, and GCP services such as Pub/Sub and BigQuery Experience with streaming technologies such as Kafka and real time processing engines such as Spark or Flink Strong understanding of performance optimisation, including indexing, partitioning, caching and query tuning Experience working across ...

driven development (TDD) principles (e.g., NUnit, Jest). Distributed Systems Knowledge: Deeper understanding of distributed systems, including building scalable and resilient services (e.g., Redis, Kafka, AWS infrastructure). Problem‐Solving & Collaboration: Show strong problem‐solving skills and collaborate effectively with team members, product managers, and stakeholders to deliver solutions ...

Architecture: Event-driven systems and microservice development - we use Azure Service Bus, and welcome experience with similar messaging technologies such as Kafka or RabbitMQ Infrastructure: Kubernetes, Docker Observability: Prometheus, Grafana Engineering culture: DevOps, infrastructure as code, automated testing across all environments including production, continuous delivery Our Engineering Approach Full … providers Solid understanding of event-driven architecture and microservice development - we use Azure Service Bus, and welcome experience with similar messaging technologies such as Kafka or RabbitMQ Experience leading or mentoring engineers in a collaborative team environment Ability to set technical direction and provide architectural guidance Comfortable working with ...

system ownership at genuine scale LLM/RAG, NLP, and streaming ML pipelines processing millions of items daily AWS-native (Lambda, ECS, SageMaker, MSK, Kafka), strong Python required £65,000-£75,000 High-impact role across AI Insights, Automated Answers, and mission-critical Machine Moderation systems About the Company … Flyte or Airflow Manage ML pipelines on AWS with containerised services and CI/CD via GitHub Actions Implement streaming data processing with Kafka for real-time content moderation Monitor model performance and drift using observability tools such as Arize AI Collaborate with Scala-based service teams and maintain ...

hybrid cloud environments, including Redshift, Glue, EMR and S3 Implement real-time and batch processing pipelines using modern data engineering frameworks including Spark, Kafka and dbt Create data flow diagrams, integration patterns and canonical models to support consistent, scalable data delivery Define and enforce data governance standards including metadata … Information Systems or a related field Desirable: Experience with GCP data services including BigQuery and Pub/Sub Experience with streaming technologies such as Kafka or Confluent Familiarity with encryption standards and key management solutions including AES-256, TLS and KMS Relevant cloud certifications such as AWS Certified Data ...

Java Technical Specialist (Low Latency) At a Glance Senior individual contributor role in a high-growth prediction markets trading firm Core stack: Java, Kafka, Aeron, FIX Protocol exchange and clearing infrastructure Salary: £80,000 - £95,000 highly attractive bonus package. 5 years experience required - strong fintech or financial markets … messaging architecture using Aeron and related frameworks Implement customer-facing API interfaces using FIX, REST and WebSocket protocols Build fault-tolerant distributed systems using Kafka, PostgreSQL and in-memory data structures for hot-path processing Profile, benchmark and tune system performance at the JVM level Participate in on-call ...