18 of 18 Permanent Kafka Jobs in the City of London

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

workflows, including the behaviour, lifecycle, and risk controls of execution algos used across the EMEA markets Experience designing and supporting message-based architectures (Solace, Kafka, or similar) Practical understanding of global Listed Derivatives markets and system workflows Proven experience managing cloud-based infrastructure and services (AWS, Azure ...

trading workflows, including the behaviour, lifecycle, and risk controls of execution algos used across the EMEA marketsExperience designing and supporting message-based architectures (Solace, Kafka, or similar)Practical understanding of global Listed Derivatives markets and system workflowsProven experience managing cloud-based infrastructure and services (AWS, Azure, or GCP), including ...

building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure), GCP is a plus Why join High impact and ownership ...

Observability Platforms (example products IBM Netcool, (Watson CloudPak AiOps), Tivoli, SCOM, SMARTS, Dynatrace, Splunk, Elastic, Prometheus, Grafana or Messaging systems for telemetry transport like Kafka, OTEL) Formal training or certification on software engineering concepts and expert applied experience. In addition, advanced experience leading technologists to manage, anticipate and solve ...

timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux, Git and CI/CD experience. Highly Desirable Familiarity with ...

Experience with Linux‐based, concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Knowledge of delegated authority operations and the Lloyd's ecosystem. Hands-on experience with technologies such as Azure Integration Services, MuleSoft, Boomi, IBM MQ, Kafka, REST/SOAP APIs, XML, JSON, and managed file transfer solutions. Experience designing cloud-native and hybrid integration architectures. Knowledge of TOGAF ...

Responsible AI Principles. Advanced degree in Computer Science, Artificial Intelligence, Data Science, or a related field. Experience designing event-driven, cloud-native architectures using Kafka (or equivalent streaming platforms), including topic design, schema governance, and consumer patterns. Why Join Us? Join our team and contribute to a culture ...

messaging, or bordereaux processes. Exposure to delegated authority and Lloyd's ecosystem platforms. Hands-on knowledge of Azure Integration Services, MuleSoft, Boomi, IBM MQ, Kafka, REST/SOAP, XML, JSON, and managed file transfer technologies. Understanding of cloud and hybrid integration architecture. TOGAF or similar architecture framework knowledge desirable. ...

working autonomously in a fast-paced engineering environment You embrace modern AI development tools while maintaining a strong focus on engineering quality Experience with Kafka, RabbitMQ, NATS, streaming systems, developer platforms or cloud infrastructure is highly advantageous What's in it for you: As a Backend Developer/Software ...

interactive user interfaces using Core Java, Kotlin, Spring Boot, and ReactJS. Real-Time Data Processing: Build and maintain scalable event-driven architectures utilizing Apache Kafka and Apache Flink for real-time risk data streaming. API & Integration Engineering: Design, implement, and maintain high-performance RESTful APIs and gRPC services … Services, Kubernetes. Additional Technical & Functional Competencies Frontend Architecture: TypeScript, JavaScript (ES6+), Redux/Context API, HTML5, CSS3, REST/gRPC integration. Streaming & Messaging: Apache Kafka, Apache Flink. APIs & Protocols: RESTful web services, gRPC, JSON, Protocol Buffers. Core Computer Science: Strong mastery of data structures, algorithms, object-oriented design ...

following Application Development areas: Expertise in application architecture using modern technologies such as cloud native development, 12 factor Apps, microservices, serverless, API management, Kafka, etc. Deep knowledge of Microservices, Containers, REST APIs development, API Management tools (e.g. MuleSoft, Apigee), Kafka Solution architect with broad expertise in wide range ...

Group is seeking a Principal Data Engineer to own the technical architecture of its GCP data platform, including BigQuery and Kafka-based ingestion, across London. You will lead delivery of complex, high-risk work in the GCP consolidation programme and define platform contracts and self-service patterns to empower ...

Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time streaming (Kafka, Flink) RPA tooling (UiPath, Power Automate) dbt for data transformation Claude Code, Claude Cowork, or Claude Skills Experience with vector databases, real-time streaming (Kafka ...

within complex payment environments. Design and implement scalable, cloud-based solutions within AWS . Build and integrate asynchronous, event-driven services using Apache Kafka . Work with ISO 20022 payment standards, schemes and payment types. Contribute to technical design, development, testing and deployment across the full software development lifecycle. … with Java 11 . Strong Spring Boot and microservices experience. Hands-on experience with ICON IPF . Strong AWS experience. Solid experience with Apache Kafka and asynchronous messaging. Strong understanding of ISO 20022 , including payment types and schemes. Experience delivering technology solutions for major banking organisations . Strong software ...

Design and deliver end-to-end applications using Java (Spring Boot) and React . Build scalable backend microservices, REST APIs, and gRPC services. Utilize Kafka for real-time event streaming and data processing. Deploy and maintain applications in AWS using Kubernetes . Collaborate across teams to align software architecture … years of full-stack software development experience. Core proficiency in Java, Spring Boot, and ReactJS . Hands-on experience with AWS, Kubernetes, and Kafka . Strong grasp of multithreading, microservices architecture, and API design. Financial services, Investment Banking, or Risk domain experience is highly advantageous. Ability to work from ...

What you’ll do Own the technical architecture of IG’s GCP data platform end-to-end — Core Lake (BigQuery), batch and real-time (Kafka) ingestion, transformation in the Medallion architecture, and Data-Engineering-owned integration services — setting the reference designs and patterns squads build against. Lead delivery … role Hands-on experience designing and operating large-scale data pipelines on GCP (BigQuery, Cloud Composer/Airflow, GCS), with proven knowledge of Apache Kafka and real-time streaming architectures Demonstrated experience leading or technically mentoring a team of data engineers, with the ability to set standards, conduct code ...