1 to 25 of 34 Kafka Jobs in Northern Ireland

Hive . Proven ability to write and optimize complex Spark jobs. Real-Time Streaming: Practical experience designing and implementing event-driven systems using Apache Kafka , including topic configuration, producer/consumer APIs, and stream processing. Database Concepts: Exceptional understanding of database concepts. Strong proficiency in SQL, database design, indexing ...

with monitoring tools (e.g., Prometheus, Grafana, ELK, Splunk) Strong debugging, troubleshooting, and analytical skills Desirable/Nice to Have Experience with event-driven architectures (Kafka, RabbitMQ) Knowledge of database technologies (SQL and NoSQL) Certification in ITIL Experience in high-availability, enterprise-scale systems Certifications in cloud or Agile methodologies ...

DevOps)Familiarity with monitoring tools (e.g., Prometheus, Grafana, ELK, Splunk)Strong debugging, troubleshooting, and analytical skillsDesirable/Nice to HaveExperience with event-driven architectures (Kafka, RabbitMQ)Knowledge of database technologies (SQL and NoSQL)Certification in ITIL Experience in high-availability, enterprise-scale systemsCertifications in cloud or Agile methodologiesSoft SkillsStrong ...

solutions. AI experience is highly desirable but not mandatoryTools you'll use (depending on role)Server: Kotlin, Java, Spring Boot, ktor, PostgreSQL, MongoDB, Apache Kafka, Docker, Kubernetes, Helm, Tekton, HarnessInfra: OpenShift, Tekton, Harness,Mac or PC - It's up to you. Access to time-saving AI tools such ...

observability platforms Desirable: OpenShift/Kubernetes Cloud technologies (Google Cloud Platform, Azure, AWS) Microservices and distributed architectures Event-driven architectures and messaging platforms (Kafka, MQ) Elastic Stack (ELK) Grafana Google Cloud Observability (GCO) Python, Shell, or PowerShell scripting CI/CD tooling and deployment automation Infrastructure as Code concepts ...

NVIDIA Omniverse, OpenUSD, or Unreal Engine. Cloud platform expertise across AWS, Azure, or GCP.Geospatial technologies including PostGIS, GeoJSON, Cesium, or GIS platforms. Experience with Kafka, Kinesis, or Pub/Sub. Exposure to edge computing technologies such as NVIDIA Jetson. Knowledge of robotics, ROS, industrial protocols, OPC-UA, or Modbus. ...

cloud transformation. What You Will Do/Key Responsibilities Middleware & Application Architecture: Architect, operate, and support the migration of application platforms—including Messaging (Kafka, RedPanda, MQ, Pub/Sub), Service Discovery (Consul, Vault), and Data Distribution (SFTP/JScape)—to Google Cloud Platform. Manage cluster lifecycles, data replication, RBAC ...

driven architectures. Experience with some of EKS, Lambda, EventBridge, Step Functions, S3, DynamoDB, AWS Glue, Snowflake, Terraform and Transfer Family. Knowledge of streaming technologies (Kafka, Kinesis) and API integrations, and hands-on experience with monitoring tools (e.g. Grafana) and observability practices. Proficient with Terraform or CDK (infrastructure-as-code ...

reduction strategies at enterprise scale. Knowledge of Kusto Query Language (KQL) and large‐scale analytics platforms. Experience with Cribl, ADX, Datadog Pipelines, Splunk, Sentinel, Kafka, Event Hubs, Open Telemetry, Elastic, Grafana, or similar observability ecosystems. Ability to leverage AI assisted development tools (e.g., Copilot, Cursor) responsibly to improve developer ...

reduction strategies at enterprise scale. Knowledge of Kusto Query Language (KQL) and large-scale analytics platforms. Experience with Cribl, ADX, Datadog Pipelines, Splunk, Sentinel, Kafka, Event Hubs, Open Telemetry, Elastic, Grafana, or similar observability ecosystems. Ability to leverage AI assisted development tools (e.g., Copilot, Cursor) responsibly to improve developer ...

e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event‐driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. Experience with public cloud environments: e.g. AWS, GCP, Azure, Terraform. Strong knowledge of software engineering practices: e.g. testing ...

REQUIREMENTS : Experience of performance tuning Experience of data visualisation and complex data transformations Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products Expertise in continuous improvement and sharing input on data best practice Practical experience with AI technologies, tools, processes ...

during interview stage Experience in REST API and authentication mechanisms (OAuth/Basic Authentication) Messaging Systems experience in any of the following middleware technologies (Kafka preferrable, Nats, Solace, TiBCo, RabbitMQ etc.) Experience working with SQL and databases such as Oracle, SQL Server, Hadoop etc. Experience with Java Multithreading/ ...

TechnologiesDESIRABLE REQUIREMENTS:Experience of performance tuningExperience of data visualisation and complex data transformationsExperience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) productsExpertise in continuous improvement and sharing input on data best practicePractical experience with AI technologies, tools, processes and deliveryEmbracing ...

written communication skills are vital Experience in any number of additional technologies (listed below) is advantageous: Cloud Technologies (Kubernetes, Open Shift) Messaging Technologies (Kafka) Database/Data Store/Data Query Technologies (SQL Server, Mongo, S3) This job description provides a high‐level review of the types of work ...

integration layers connecting applications to services like Amazon Bedrock, SageMaker, and OpenAI APIs for intelligent features Event-Driven Architecture: Building event-driven architectures using Kafka/MSK, AWS EventBridge, SQS, and SNS for real-time, scalable system communication Test-Driven Development: Responsible for comprehensive testing including unit tests, integration … DynamoDB, EventBridge, Step Functions AI/ML platforms: Amazon Bedrock, SageMaker, OpenAI APIs, or similar services Event-driven architecture: Messaging systems and asynchronous processing (Kafka/SQS) Infrastructure as Code: CloudFormation, CDK, or Terraform Container technologies: Docker, Kubernetes, AWS ECS/Fargate DevOps & observability: CloudWatch, X-Ray, Dynatrace, monitoring ...

Applications Development Demonstrated knowledge of client core business functions Demonstrated leadership, project management, and development skills Relationship and consensus building skills Preferred Kafka/Event-Driven Architecture Apache Iceberg/Delta Lake Python AI/ML & LLM integration Financial Services/Capital Markets Education: Bachelor's degree/University ...

parallel task programming. Proven experience in ensuring robust testing quality practice and maintaining clean CI/CD pipelines. Experience working in Java/Kotlin, Kafka, ELK. Experience leveraging safely AI coding agents such as Devin, Copilot, Claude Code. Preferred Qualifications: Understanding of trade booking and life cycle processes Knowledge ...

Have Experience with ClickHouse or Snowflake (highly preferred) Experience with columnar data stores and analytical query optimization Familiarity with event‐driven or streaming architectures (Kafka, SQS, SNS, Kinesis, or Pub/Sub) Experience parsing binary formats, log data, or forensic artefacts Background in mobile security, threat detection, or digital ...

/CD practices, and you will connect applications to AI services such as Bedrock, SageMaker and OpenAI while building event-driven data flows with Kafka, SQS and SNS. #J-18808-Ljbffr ...

understanding of test-driven development (TDD) principles (e.g., NUnit, Jest). Deeper understanding of distributed systems, including building scalable and resilient services (e.g., Redis, Kafka, AWS infrastructure). Strong problem-solving skills and collaborates effectively with team members, product managers, and stakeholders to deliver solutions that align with business ...

batch). Hands‐on experience with: Dremio, Snowflake, or Databricks AWS data services (S3, Glue, Athena, Lake Formation, or equivalent) NATS/Apache Kafka or similar, and CDC patterns (Debezium or equivalent) Stream processing (Apache Flink, Spark Structured Streaming, or equivalent) SQL and query optimisation at scale Data ...

regulations, and implement AI-driven automation while ensuring scalable, reliable data processing across big data stacks. The role emphasizes real-time streaming with Kafka, Spark-based batch processing, and close collaboration with Compliance to translate complex rules into robust software solutions. #J-18808-Ljbffr ...

Databricks). Experience with data integration (ETL/ELT, APIs). Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) is a plus. Domain Knowledge Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory ...

Oracle, Snowflake, Databricks).Experience with data integration (ETL/ELT, APIs).Familiarity with cloud data platforms (AWS, Azure, GCP) and big data (Hadoop, Spark, Kafka) a plus. Domain Knowledge: Exceptional understanding of the Funds business lifecycle, financial instruments, market data, and investment operations. In-depth knowledge of regulatory reporting ...