1 to 25 of 35 Kafka Jobs in the City of London

their output, and maintain quality over AI‐generated work product. Experience building event‐driven and distributed systems , including familiarity with messaging platforms (e.g., Apache Kafka), delivery guarantees, and resilience strategies. Strong SDLC practices : version control, CI/CD pipelines, automated build/test/deploy workflows, and code quality ...

microservices architecture event-driven systems distributed systems Strong backend engineering experience using Java/Spring Boot or equivalent Experience working with: REST APIs Kafka/RabbitMQ/messaging systems Docker Kubernetes cloud-native deployments Strong understanding of security, scalability, resilience, and reliability principles Strong communication and stakeholder management skills ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

heterogeneous technology landscape, notably encompassing: Compute & Services: Java, .NET, Python, Cloud-native microservices; Data & Analytics: Databricks, Microsoft Fabric, AWS Glue, Athena, Event Streaming (e.g., Kafka); AI & ML: Azure OpenAI, LLM Integration patterns, Vector Databases; Integration & Storage: Azure Data Factory (ADF), SQL Server, Enterprise relational platforms; Infrastructure: Azure ...

trading workflows, including the behaviour, lifecycle, and risk controls of execution algos used across the EMEA marketsExperience designing and supporting message-based architectures (Solace, Kafka, or similar)Practical understanding of global Listed Derivatives markets and system workflowsProven experience managing cloud-based infrastructure and services (AWS, Azure, or GCP), including ...

workflows, including the behaviour, lifecycle, and risk controls of execution algos used across the EMEA markets Experience designing and supporting message-based architectures (Solace, Kafka, or similar) Practical understanding of global Listed Derivatives markets and system workflows Proven experience managing cloud-based infrastructure and services (AWS, Azure ...

Redshift or BigQuery. Experience with orchestration tools such as Airflow or Databricks Workflows. Previous experience working within Agile delivery environments. Desirable Experience Databricks certifications. Kafka or Structured Streaming. CI/CD and DevOps practices. Docker and Kubernetes. Exposure to Machine Learning pipelines. Experience within Financial Services or other highly ...

popular ORM tools Used NoSQL databases such as cosmos DB, Mongo or Cassandra Enterprise Expertise: Experience with messaging such as Service Bus, MQ or Kafka Data Analytics: Experience with Data Analytics and Business Intelligence What we can offer- Scale, some of our clients are well known global brands ...

Data Engineering and Analytics: Work closely with data teams to define robust data pipelines and scalable cloud-based data platforms using tools like Apache Kafka, Snowflake, or Databricks. Monitoring and Performance Tuning: Implement advanced monitoring and observability solutions using tools like Prometheus, Grafana, or Datadog to proactively identify ...

secure API architecture (IAM, authentication/authorisation) CI/CD experience and production support exposure Background in enterprise or regulated environments (ideal) Desirable skills: Kafka/event-driven architecture Apigee or MuleSoft PostgreSQL/document stores AWS certifications Observability tools (CloudWatch, ELK, Grafana) Security Clearance Due to the nature ...

Excellent communication skills, both written and spoken An interest (or experience) in any of Functional Programming, Distributed Systems or Event-Driven Architectures (using Apache Kafka) Knowledge of decision engines wanted but not essential Able to architect custom AI solutions and smart automated systems that are safe, maintainable, and aligned ...

understanding of CI/CD, automation and DevOps practices Experience mentoring engineers and providing technical leadership Key Technologies AWS Terraform Linux Cassandra Couchbase ScyllaDB Kafka CI/CD Pipelines Observability & Monitoring Platforms Distributed Database Technologies Nice to Have Experience with additional distributed persistence technologies Background in large-scale cloud ...

grasp of REST APIs, auth/authorisation and data modelling (MongoDB or similar) Experience with event-driven/message-based systems (SNS/SQS, Kafka or RabbitMQ) Solid testing practices (unit, integration, end-to-end) Comfortable owning loosely defined features from concept to production Strong communication skills; thrives ...

relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment ...

building from scratch in a fast-moving, product-led environment Experience with vector databases and vector search in modern AI systems Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures Cloud experience (AWS, GCP or Azure) is a plus Why join High impact and ownership as an early ...

only Desirable SC clearance alongside NPPV3 Functional/typed Scala — Cats, Cats Effect, FS2, http4s, Circe — a strong plus Streaming/big-data frameworks (Kafka, Spark, Flink) for integrating with partner pipelines Government, policing or law-enforcement data experience Data lineage, provenance, audit or integrity/verification tooling Secure ...

with big data concepts, such as Lakehouse, ETL data pipelines (e.g. Spark, AWS Glue) Experience with near real time and event-based systems like Kafka ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital and ideas to help our clients, shareholders and the communities we serve ...

timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, Snowflake, Databricks, kdb+ or similar. Docker, Linux, Git and CI/CD experience. Highly Desirable Familiarity with ...

Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka or other event‐driven technologies. Experience supporting data governance or enterprise data architecture initiatives. #J-18808-Ljbffr ...

Airflow, Prefect or Dagster. Experience with market data providers such as Bloomberg, Refinitiv or ICE. Exposure to enterprise data management platforms. Knowledge of Kafka or other event-driven technologies. Experience supporting data governance or enterprise data architecture initiatives. Disclaimer: This vacancy is being advertised by either Advanced Resource Managers ...

Experience with Linux‐based, concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Curious, proactive, and a strong problem solver Able to work both independently and as part of a team Tech Stack Python, C++, Docker, Kubernetes, Kafka, LXC/LXD, Grafana, Prometheus Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy. ...

platforms, and performance engineering systemes that traders rely on daily. Lead incident response like a battlefied commander Dive deep into Java Kotlin, Python, Microservices, Kafka, Grafana, Splunk, Dynatrace and full modern SRE arsenal Work shoulder to shoulder with elite traders across Equities, Fixed Income, FX & Beyond Turn chaos into ...

Chainalysis, we are at the forefront of this development. Technologies in Use Technologies we use include: AWS serverless architectures Kubernetes PostgreSQL Spark Typescript Terraform Kafka Github (including Github Actions) Java Data Platform Development We are building the data platform for blockchain, cryptocurrency, and web3. The Protocol Acquisition (PA) team ...

fast-paced startup or scale-up environments Passion for solving customer problems and influencing product direction Technical Environment: Go, TypeScript, React, Next.js, PostgreSQL, Kafka, Redis, AWS, GCP, AI/LLMs If you're a Senior Full Stack Engineer looking to join a high-growth product business where ...