24 of 24 Kafka Jobs in Northern Ireland

Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience designing and implementing event-driven systems using Apache Kafka , including topic configuration, producer/consumer APIs, and stream processing. Database Concepts: Exceptional understanding of database concepts. Strong proficiency in SQL, database design, indexing ...

with monitoring tools (e.g., Prometheus, Grafana, ELK, Splunk) Strong debugging, troubleshooting, and analytical skills Desirable/Nice to Have Experience with event-driven architectures (Kafka, RabbitMQ) Knowledge of database technologies (SQL and NoSQL) Certification in ITIL Experience in high-availability, enterprise-scale systems Certifications in cloud or Agile methodologies ...

observability platforms Desirable: OpenShift/Kubernetes Cloud technologies (Google Cloud Platform, Azure, AWS) Microservices and distributed architectures Event-driven architectures and messaging platforms (Kafka, MQ) Elastic Stack (ELK) Grafana Google Cloud Observability (GCO) Python, Shell, or PowerShell scripting CI/CD tooling and deployment automation Infrastructure as Code concepts ...

driving our cloud transformation. What You Will Do/Key ResponsibilitiesMiddleware & Application Architecture: Architect, operate, and support the migration of application platforms—including Messaging (Kafka, RedPanda, MQ, Pub/Sub), Service Discovery (Consul, Vault), and Data Distribution (SFTP/JScape)—to Google Cloud Platform. Manage cluster lifecycles, data replication ...

cloud transformation. What You Will Do/Key Responsibilities Middleware & Application Architecture: Architect, operate, and support the migration of application platforms—including Messaging (Kafka, RedPanda, MQ, Pub/Sub), Service Discovery (Consul, Vault), and Data Distribution (SFTP/JScape)—to Google Cloud Platform. Manage cluster lifecycles, data replication, RBAC ...

driven architectures. Experience with some of EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, Snowflake, Terraform and Transfer Family. Knowledge of streaming technologies (Kafka, Kinesis) and API integrations, and hands-on experience with monitoring tools (e.g. Grafana) and observability practices. Proficient with Terraform or CDK (infrastructure-as-code ...

designing and implementing large‐scale, complex systems. Deep understanding of architectural principles and patterns for distributed systems (e.g., microservices, event‐driven architecture with Kafka). Expertise in resilience mechanisms and performance tuning to ensure system stability and efficiency at scale. Proficiency in managing cloud infrastructure and services (e.g. ...

skills. Experience building and optimizing ETL/ELT pipelines. Desirable Skills Strong proficiency in Java and experience building distributed applications and services. Experience with Kafka or similar event-streaming platforms. Understanding of Data Governance, Data Quality, Security, and Privacy controls. Ability to mentor junior engineers and provide technical leadership ...

Experience building or contributing to an internal developer platform or shared enterprise capability Experience with event driven architecture and messaging platforms (e.g. Kafka, AWS MSK) Familiarity with Python or TypeScript for services, scripting and automation Familiarity with security best practices and compliance standards in a regulated industry Experience working ...

reduction strategies at enterprise scale. Knowledge of Kusto Query Language (KQL) and large‐scale analytics platforms. Experience with Cribl, ADX, Datadog Pipelines, Splunk, Sentinel, Kafka, Event Hubs, Open Telemetry, Elastic, Grafana, or similar observability ecosystems. Ability to leverage AI assisted development tools (e.g., Copilot, Cursor) responsibly to improve developer ...

REQUIREMENTS : Experience of performance tuning Experience of data visualisation and complex data transformations Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products Expertise in continuous improvement and sharing input on data best practice Practical experience with AI technologies, tools, processes ...

during interview stage Experience in REST API and authentication mechanisms (OAuth/Basic Authentication) Messaging Systems experience in any of the following middleware technologies (Kafka preferrable, Nats, Solace, TiBCo, RabbitMQ etc.) Experience working with SQL and databases such as Oracle, SQL Server, Hadoop etc. Experience with Java Multithreading/ ...

written communication skills are vital Experience in any number of additional technologies (listed below) is advantageous: Cloud Technologies (Kubernetes, Open Shift) Messaging Technologies (Kafka) Database/Data Store/Data Query Technologies (SQL Server, Mongo, S3) This job description provides a high‐level review of the types of work ...

Applications Development Demonstrated knowledge of client core business functions Demonstrated leadership, project management, and development skills Relationship and consensus building skills Preferred Kafka/Event-Driven Architecture Apache Iceberg/Delta Lake Python AI/ML & LLM integration Financial Services/Capital Markets Education Bachelor’s degree/University ...

parallel task programming. Proven experience in ensuring robust testing quality practice and maintaining clean CI/CD pipelines. Experience working in Java/Kotlin, Kafka, ELK. Experience leveraging safely AI coding agents such as Devin, Copilot, Claude Code. Preferred Qualifications: Understanding of trade booking and life cycle processes Knowledge ...

Have Experience with ClickHouse or Snowflake (highly preferred) Experience with columnar data stores and analytical query optimization Familiarity with event‐driven or streaming architectures (Kafka, SQS, SNS, Kinesis, or Pub/Sub) Experience parsing binary formats, log data, or forensic artefacts Background in mobile security, threat detection, or digital ...

regulations, and implement AI-driven automation while ensuring scalable, reliable data processing across big data stacks. The role emphasizes real-time streaming with Kafka, Spark-based batch processing, and close collaboration with Compliance to translate complex rules into robust software solutions. #J-18808-Ljbffr ...

Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory ...

Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus. Domain Knowledge: Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory reporting ...

workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Experience managing delivery in large transformation programmes Experience delivering projects in regulated environments #J-18808-Ljbffr ...

workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Hands on experience with databricks a distinct advantage Experience leading data platform migrations Experience managing delivery in large transformation programmes Experience ...

development team supporting a high-volume message processing environment. The team is heavily Java-focused, operating within a client ecosystem that relies extensively on Kafka, Kubernetes/OpenShift, caching solutions, REST APIs, and high-throughput distributed systems. You will bring solid, practical experience in backend Java development … architecture running on Docker/OpenShift/Kubernetes. Solid application development skills in Java, SQL (SQL Server, Oracle, etc.) and messaging platforms such as Kafka and MQ.Experience with the Spring framework and Spring Boot technologies. Experience in Java REST API development and application security best practices (OAuth, JWT, etc. ...

across our organization.**The Platform:** You'll be supporting a modern Big Data platform built on industry-standard technologies including Hadoop, Hive, Impala, Spark, Kafka, and other open-source tools. This platform handles massive volumes of data daily, supporting analytics, reporting, and business-critical operations.**The Team … Spark, or similar distributed data platforms (or strong willingness to learn)• Familiarity with **monitoring tools** like Splunk, Grafana, or enterprise monitoring platforms• Knowledge of **Kafka** or other real-time data streaming technologies• Strong **Unix/Linux scripting** skills for automation• Experience with **incident management** processes and ticketing systems (ServiceNow ...

Citi is hiring a Big Data Applications Support Analyst to monitor and troubleshoot a large-scale data platform built on Hadoop, Hive, Spark, and Kafka. You will work with global teams to ensure 24/ ...