1 to 25 of 31 Kafka Jobs in Northern Ireland

Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience designing and implementing event-driven systems using Apache Kafka , including topic configuration, producer/consumer APIs, and stream processing. Database Concepts: Exceptional understanding of database concepts. Strong proficiency in SQL, database design, indexing ...

with monitoring tools (e.g., Prometheus, Grafana, ELK, Splunk) Strong debugging, troubleshooting, and analytical skills Desirable/Nice to Have Experience with event-driven architectures (Kafka, RabbitMQ) Knowledge of database technologies (SQL and NoSQL) Certification in ITIL Experience in high-availability, enterprise-scale systems Certifications in cloud or Agile methodologies ...

17+ preferred. Rest/GraphQL APIs using Spring Boot or any similar. Strong SQL experience with any RDBMS. Working experience with messaging technologies like Kafka or similar. Strong problem‐solving and analytical abilities, with keen attention to detail. Agile experience, with a focus on backlog execution, dependencies, continuous improvement ...

observability platforms Desirable: OpenShift/Kubernetes Cloud technologies (Google Cloud Platform, Azure, AWS) Microservices and distributed architectures Event-driven architectures and messaging platforms (Kafka, MQ) Elastic Stack (ELK) Grafana Google Cloud Observability (GCO) Python, Shell, or PowerShell scripting CI/CD tooling and deployment automation Infrastructure as Code concepts ...

HaveExperience with NVIDIA Omniverse, OpenUSD, or Unreal Engine.Cloud platform expertise across AWS, Azure, or GCP.Geospatial technologies including PostGIS, GeoJSON, Cesium, or GIS platforms.Experience with Kafka, Kinesis, or Pub/Sub.Exposure to edge computing technologies such as NVIDIA Jetson.Knowledge of robotics, ROS, industrial protocols, OPC-UA, or Modbus.Experience building dashboards ...

cloud transformation. What You Will Do/Key Responsibilities Middleware & Application Architecture: Architect, operate, and support the migration of application platforms—including Messaging (Kafka, RedPanda, MQ, Pub/Sub), Service Discovery (Consul, Vault), and Data Distribution (SFTP/JScape)—to Google Cloud Platform. Manage cluster lifecycles, data replication, RBAC ...

driven architectures. Experience with some of EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, Snowflake, Terraform and Transfer Family. Knowledge of streaming technologies (Kafka, Kinesis) and API integrations, and hands-on experience with monitoring tools (e.g. Grafana) and observability practices. Proficient with Terraform or CDK (infrastructure-as-code ...

reduction strategies at enterprise scale. Knowledge of Kusto Query Language (KQL) and large‐scale analytics platforms. Experience with Cribl, ADX, Datadog Pipelines, Splunk, Sentinel, Kafka, Event Hubs, Open Telemetry, Elastic, Grafana, or similar observability ecosystems. Ability to leverage AI assisted development tools (e.g., Copilot, Cursor) responsibly to improve developer ...

e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event‐driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public cloud environments: e.g. AWS, GCP, Azure, Terraform. Strong knowledge of software engineering practices: e.g. testing ...

REQUIREMENTS : Experience of performance tuning Experience of data visualisation and complex data transformations Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products Expertise in continuous improvement and sharing input on data best practice Practical experience with AI technologies, tools, processes ...

post graduation. Good experience in the .Net and C# ecosystem. Working knowledge of architectural patterns for distributed systems (e.g., microservices, event‐driven architecture using Kafka), and the judgement to weigh design trade‐offs at a component level. Experience working with cloud infrastructure and services (e.g., AWS, Kubernetes/ ...

during interview stage Experience in REST API and authentication mechanisms (OAuth/Basic Authentication) Messaging Systems experience in any of the following middleware technologies (Kafka preferrable, Nats, Solace, TiBCo, RabbitMQ etc.) Experience working with SQL and databases such as Oracle, SQL Server, Hadoop etc. Experience with Java Multithreading/ ...

written communication skills are vital Experience in any number of additional technologies (listed below) is advantageous: Cloud Technologies (Kubernetes, Open Shift) Messaging Technologies (Kafka) Database/Data Store/Data Query Technologies (SQL Server, Mongo, S3) This job description provides a high‐level review of the types of work ...

integration layers connecting applications to services like Amazon Bedrock, SageMaker, and OpenAI APIs for intelligent features Event-Driven Architecture: Building event-driven architectures using Kafka/MSK, AWS EventBridge, SQS, and SNS for real-time, scalable system communication Test-Driven Development: Responsible for comprehensive testing including unit tests, integration … DynamoDB, EventBridge, Step Functions AI/ML platforms: Amazon Bedrock, SageMaker, OpenAI APIs, or similar services Event-driven architecture: Messaging systems and asynchronous processing (Kafka/SQS) Infrastructure as Code: CloudFormation, CDK, or Terraform Container technologies: Docker, Kubernetes, AWS ECS/Fargate DevOps & observability: CloudWatch, X-Ray, Dynatrace, monitoring ...

Applications Development* Demonstrated knowledge of client core business functions* Demonstrated leadership, project management, and development skills* Relationship and consensus building skills**Preferred*** Kafka/Event-Driven Architecture* Apache Iceberg/Delta Lake* Python* AI/ML & LLM integration* Financial Services/Capital Markets**Education:*** Bachelor’s degree/University ...

threading and parallel task programming.Proven experience in ensuring robust testing quality practice and maintaining clean CI/CD pipelines.Experience working in Java/Kotlin, Kafka, ELK.Experience leveraging safely AI coding agents such as Devin, Copilot, Claude Code.Preferred Qualifications:Understanding of trade booking and life cycle processesKnowledge/experience ...

parallel task programming. Proven experience in ensuring robust testing quality practice and maintaining clean CI/CD pipelines. Experience working in Java/Kotlin, Kafka, ELK. Experience leveraging safely AI coding agents such as Devin, Copilot, Claude Code. Preferred Qualifications: Understanding of trade booking and life cycle processes Knowledge ...

lakehouse architectures.* Drive integration of AI/GenAI capabilities, including LLMs, RAG frameworks, AI Agents, and intelligent automation solutions.* Architect event-driven systems using Kafka, Solace, and distributed caching technologies.* Establish engineering standards, SDLC best practices, observability, resiliency, and security controls.* Collaborate with Architecture, Product, Data Engineering, Infrastructure, Security … technology initiatives and distributed engineering teams.### Technical Expertise* Java 17+, Spring Boot, Microservices* Angular and/or React* REST APIs and Event-Driven Architecture* Kafka, Solace, Redis, Hazelcast* Oracle, MongoDB, Snowflake* Databricks, Spark, Data Engineering concepts* Azure and/or AWS Cloud Platforms* Docker, Kubernetes, OpenShift* Git, Jenkins, Azure ...

/CD practices, and you will connect applications to AI services such as Bedrock, SageMaker and OpenAI while building event-driven data flows with Kafka, SQS and SNS. #J-18808-Ljbffr ...

understanding of test-driven development (TDD) principles (e.g., NUnit, Jest). Deeper understanding of distributed systems, including building scalable and resilient services (e.g., Redis, Kafka, AWS infrastructure). Strong problem-solving skills and collaborates effectively with team members, product managers, and stakeholders to deliver solutions that align with business ...

batch). Hands-on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data ...

regulations, and implement AI-driven automation while ensuring scalable, reliable data processing across big data stacks. The role emphasizes real-time streaming with Kafka, Spark-based batch processing, and close collaboration with Compliance to translate complex rules into robust software solutions. #J-18808-Ljbffr ...

Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus. Domain Knowledge: Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory reporting ...

Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus.Domain Knowledge:Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations.In-depth knowledge of regulatory reporting ...

efficiently across our platform, and drive automation to support future scale. The role focuses on building robust Go microservices with AWS, Docker, Postgres, and Kafka in a distributed cloud environment. You will mentor engineers and collaborate with cross‐functional partners to deliver high‐quality solutions. #J-18808-Ljbffr ...