1 to 25 of 65 Kafka Jobs in London

optimise CI/CD pipelines, ensuring automated testing and deployment. Architecture Contribution: Contribute to event-driven and distributed system designs using technologies like Kafka or Event Hub. Mentorship: Guide junior developers and foster a collaborative atmosphere within a cross-functional agile team. Soft Skills A strong engineering mindset with ...

environment). Comfortable working in Agile delivery teams with iterative releases and continuous improvement. Nice to Have Experience with event-driven architectures (e.g., Kafka or similar). Knowledge of observability practices (metrics, logging, tracing) and production monitoring. Experience improving performance and scalability in high-throughput systems. Understanding of secure ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

Azure) Strong knowledge of REST APIs , messaging, and integration patterns Experience working in agile, consultancy, or client-facing environments Desirable Skills Event-driven architectures (Kafka, RabbitMQ, etc.) Containerisation and orchestration (Docker, Kubernetes) CI/CD pipelines and DevOps practices Experience influencing architectural decisions at scale What's On Offer ...

test-driven development, delivery automation and good software engineering practices. · Experience with message-driven architectures and event-driven systems would be beneficial. · Experience with Kafka, Kafka Streams or Kafka Connect would also be beneficial. · Experience working with applications deployed in Kubernetes environments would also be beneficial. ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

Solid experience with SQL and data modelling concepts Strong analytical and problem-solving skills Nice to Have Skills Experience with data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active ...

property graphs Hypergraph structures Entity resolution Graph schema design Data Engineering & Integration Pipeline Development Data Integration Languages & Tools ETL/ELT pipeline design Apache Kafka Apache Spark AWS Glue dbt Apache Airflow Entity matching and resolution Data lineage tracking Schema mapping Semantic data integration Metadata management Data quality frameworks ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...

Excellent communication and stakeholder management skills. Preferred Qualifications: Experience with machine learning data pipelines and MLOps practices. Knowledge of data streaming technologies such as Kafka or Kinesis. Familiarity with Terraform or similar infrastructure automation tools. Previous experience working in consulting or client-facing roles. What We Offer: Competitive compensation ...

cause analysis Mentoring others and contributing to engineering best practices Exploring and introducing new tools and technologies Tech Stack Java | Vert.x | RxJava | Groovy Couchbase | Kafka Azure | Kubernetes | Terraform GitHub Actions | CI/CD pipelines What We're Looking For Strong experience with Java (8+) Hands-on expertise with cloud ...

e.g., Airflow, Databricks Workflows) Strong understanding of data modelling and lakehouse architecture Databricks certifications (e.g., Databricks Certified Data Engineer) Experience with streaming data pipelines (Kafka, Structured Streaming) Experience with CI/CD and DevOps practices Knowledge of Delta Lake features (time travel, CDC, optimisation) Experience with containerisation (Docker, Kubernetes ...

Microsoft 365 and exposure to AI productivity tooling is advantageous Desirable Experience: Vector databases and embedding-based pipelines Real-time data streaming technologies (e.g. Kafka, Flink) RPA tools such as UiPath or Power Automate Data transformation tools such as dbt Exposure to modern AI tooling and frameworks (e.g. Claude ...

faster and more efficient delivery. Your Profile Essential skills/knowledge/experience: Strong experience with Google Cloud Platform (GCP) services Knowledge of Kafka Google Kubernetes Engine (GKE) VPC design, subnets, firewall rules, load balancers Cloud Storage, Cloud SQL Cloud Monitoring, Cloud Logging, Error Reporting Strong experience in DevOps ...

communication, time management and collaboration in diverse, multi‐disciplinary teams. Nice to have Document & graph stores (e.g., Neo4j) and streaming patterns (Event Hub/Kafka). Azure/AWS Solutions Architect exposure; optional governance/model‐risk/responsible‐AI credentials. Technical Certifications (preferred) Microsoft Azure AI Engineer Associate ...

Kubernetes networking, security and service mesh technologies Experience with the following would be highly beneficial: Cilium Istio/Service Mesh ArgoCD or Flux OpenTelemetry Kafka or Redpanda Python automation tooling Policy as Code/Kubernetes security tooling To progress matters please send your CV Laura at Services advertised ...

secure API architecture (IAM, authentication/authorisation) CI/CD experience and production support exposure Background in enterprise or regulated environments (ideal) Desirable skills: Kafka/event-driven architecture Apigee or MuleSoft PostgreSQL/document stores AWS certifications Observability tools (CloudWatch, ELK, Grafana) Security Clearance Due to the nature ...

Kubernetes networking, security and service mesh technologies Experience with the following would be highly beneficial: Cilium Istio/Service Mesh ArgoCD or Flux OpenTelemetry Kafka or Redpanda Python automation tooling Policy as Code/Kubernetes security tooling What's on Offer Opportunity to help shape a greenfield cloud-native ...

continuous improvement Manage capacity planning, skills development, and vendor contributions The individual: Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark. Experience with data modeling, metadata and lineage tooling; performance & cost optimization. Proven leadership in engineering teams; Agile/DevOps ...

ecosystems, particularly AWS SageMaker (required). Proven experience developing monitoring frameworks, observability pipelines, and dashboards. Deep understanding of event-driven architectures and messaging systems (Kafka, Vert.x, or similar). Knowledge of security engineering, IAM principles, encryption, and cloud security controls. Experience with CI/CD, infrastructure-as-code ...

Nice to have: pandas experience Exposure to Azure or AWS Basic Docker or DevOps knowledge Interest in AI/ML Experience with streaming tools (Kafka, RabbitMQ) Hybrid working – 3 days per week in a central London office (Tues - Thurs) If you’re excited by the idea of building ...

with this vacancy only. KEY SKILLS Solace, PubSub+, Messaging Administrator, Linux, Prometheus, Grafana, WAN, Low Latency Systems, Distributed Systems, Python, Bash, Infrastructure, Production Support, Kafka, RabbitMQ, Docker, Kubernetes, AWS, Azure, Messaging Systems ...

Strong commercial development experience with C# and Microsoft .NET. Experience designing and implementing microservices and distributed systems. Familiarity with messaging technologies such as RabbitMQ, Kafka, Azure Service Bus, or similar platforms. Strong experience developing and consuming RESTful Web APIs. Understanding of API gateway and API Management technologies. SQL Server ...

scalable solutions. Knowledge of financial industry regulations and standards, particularly around data security and privacy. Familiarity with event-driven architectures or message queues (eg, Kafka, RabbitMQ) for Real Time data processing. Experience with automated testing frameworks and continuous delivery tools like Jenkins, GitLab CI, or CircleCI. Understanding of performance … Bank Banking Finance Financial Services Crypto Blockchain Web3 Trading Exchange Digital Assets Hybrid Flexible Developer Software Engineer Backend Developer Golang Engineer Kafka Apache Kafka RabbitMQ AWS Lambda Cloud Platform NATS Exchange Clear Clearing ...

banking environment (this is a must-have!). Cloud & Messaging: Strong experience deploying to AWS and managing high-throughput, asynchronous data with Apache Kafka . Domain Expertise: Deep understanding of ISO 20022 standards, diverse payment types, and global clearing schemes. What You'll Do Architect & Build: Develop high-performance ...