1 to 25 of 166 Kafka Jobs

Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible" Skillsets required: 1. Core Kafka Expertise (Must-Have … Kafka architecture: brokers, topics, partitions, replication Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft Topic & partition management, consumer groups Performance tuning, retention, throughput optimisation Cluster setup, upgrades, scaling and failover Troubleshooting (eg lag, ISR, leader issues) Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps ...

scope technologies/products: "Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible" Skillsets required: 1. Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs ...

architectures. Strong knowledge of RESTful API design and integration. Experience with Hibernate, JPA, and ORM frameworks. Hands-on experience with messaging technologies such as Kafka or RabbitMQ. Experience with cloud platforms including AWS, Azure, or GCP. Strong experience with Docker and Kubernetes. Proficiency with relational and NoSQL databases such ...

working within Agile delivery environments. Excellent problem-solving and communication skills. Desirable Skills Experience with Docker and Kubernetes. Knowledge of messaging technologies such as Kafka or RabbitMQ. Exposure to DevOps practices and CI/CD tools including Jenkins or GitHub Actions. Understanding of API security frameworks including OAuth2 ...

Technical Consultant role.* Background in data engineering — ETL/ELT pipelines, data modelling, or analytics platforms.* Familiarity with event-driven architectures, message queues (Kafka, SQS, RabbitMQ), and microservices patterns.* Experience with advanced AI/ML engineering, including fine-tuning open-source models, building evaluation frameworks for LLM outputs ...

distributed systems Experience designing and developing REST APIs Strong knowledge of Hibernate/JPA and relational database design Experience with messaging systems such as Kafka or RabbitMQ Hands-on experience with cloud platforms (AWS, Azure, or GCP) Experience with Docker and Kubernetes Strong database experience with PostgreSQL, MySQL, MongoDB ...

Azure DevOps. Knowledge of monitoring tools such as Prometheus, Grafana, or ELK Stack. Preferred Skills Experience with event-driven architectures. Experience with Kafka, RabbitMQ, or other messaging platforms. Exposure to distributed systems and high-volume transactional environments. Knowledge of gRPC and Protocol Buffers. Experience working in Agile/Scrum ...

microservices, distributed systems, and system design Experience designing and building RESTful APIs at scale Hands-on experience with: Hibernate/JPA Messaging systems (Kafka, RabbitMQ) Experience with cloud platforms ( AWS/Azure/GCP ) Strong knowledge of Docker, Kubernetes , and container orchestration Expertise in database design ( SQL & NoSQL ) Strong ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

environment). Comfortable working in Agile delivery teams with iterative releases and continuous improvement. Nice to Have Experience with event-driven architectures (e.g., Kafka or similar). Knowledge of observability practices (metrics, logging, tracing) and production monitoring. Experience improving performance and scalability in high-throughput systems. Understanding of secure ...

DevOps & Cloud: Hands-on experience with Kubernetes , Docker, Terraform, and CI/CD tools like Jenkins or GitHub Actions. Data & Messaging: Expert knowledge of Kafka , Apache Flink, PostgreSQL, Oracle, and Elasticsearch. Security: Deep understanding of OAuth 2.0, secure web services, and API gateway management. Candidate Profile Enterprise Experience: Proven ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

expertise in designing large-scale machine learning systems and architectures Advanced programming skills (Python preferred) with experience in frameworks and tools such as JavaScript, Kafka, and reactive systems Extensive experience with cloud-based development, particularly on Azure, including AI/ML services and data platforms Proven experience with Kubernetes ...

using OAuth2/OIDC, session management, and fine-grained permissions. Design and maintain event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. ...

RESTful API design principles and best practices. Experience with TDD and testing frameworks such as Boost.Test, Google Test, etc... NicetoHaves: ExperiencewithAzureservicesformanagingGPTpipelinesandmulti-cloudinfrastructure. FamiliaritywithbigdatatechnologiessuchasApacheSpark,Kafka,andMSKforlarge-scaledataprocessing. Experience with boost libraries (asio, beast). Advancedexperienceincostoptimizationstrategiesforcloudinfrastructureanddatabaseperformancetuning. Technicalacumen: AdvancedknowledgeofallAWSsystemsandservices. Detailoriented: Responsibleformission-criticalhealthcareproductsandservices. CommunicationsandTrust: Phenomenalcommunicationskillswiththeabilitytomaintainthehighestlevelsofconfidentialityonaconsistentbasis. OrganisationandGettingStuffDone: Jugglingmultipleprojectsandtimelines.Prioritising.Keeneyefordetailinalltasksandprojects.Exceptionalatmakinglistsandmaintainingorganisation. GrowthMindset: Yourabilitytolearnfrommistakes,reflectonmistakes,andnotmakemistakesagain.Beingcuriousandaskingquestionsandfacingresilienceinthefaceofsetbacks. Benefits Join ...

Functions, SQS/SNS, etc.) FastAPI and NextJS experience (if we re still using the latter) Websockets, Server-Side Events, Pub/Sub (RabbitMQ, Kafka, etc.) Who You'll Work With Squad members of a specific squad, led by a Product Owner. Tribe Leaders, Product Owners, and other Chapter ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

Solid experience with SQL and data modelling concepts Strong analytical and problem-solving skills Nice to Have Skills Experience with data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active ...

Nice to Have Experience building cybersecurity or threat detection platforms Exposure to AI/ML security challenges and AI-driven security tooling Experience with Kafka, Pulsar, Splunk, or real-time streaming systems Golang expertise Experience contributing to open-source projects or internal developer platforms Knowledge of Microsoft Copilot ecosystem ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

Practice, and the GOV.UK Design System Desirable Experience leading Legacy modernisation, including strangler-pattern migrations away from Mainframe systems Experience with event-driven architectures (Kafka, EventBridge, SNS/SQS) Familiarity with accessibility standards (WCAG 2.2) and inclusive design Experience supporting services through GDS Alpha, Beta, and Live assessments Active ...

/version control systems - Active DV Clearance essential - Sole British National essential DESIRABLE EXPERIENCE - AWS, Azure or GCP within secure environments - Docker and Kubernetes - Kafka, Spark or additional data engineering technologies WHY APPLY? This is an opportunity to work on highly secure, technically advanced programmes within a complex ...