526 to 550 of 594 Kafka Jobs in the UK

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Desirable skills: Java Docker Kubernetes Grafana/… ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

enable real‐time and batch data processing at scale. Responsibilities Drive platform capability improvements – continuously enhance distributed data platforms using knowledge of Spark, Databricks, Kafka, Pulsar, Cassandra, and object stores to maintain best‐in‐class capabilities. Enable application data consumption – understand how applications produce and consume data, designing solutions … access patterns, real‐time streaming, and batch processing for application needs. Architect data streaming solutions – design and implement real‐time data streaming architectures using Kafka and Pulsar, ensuring low‐latency data delivery to downstream applications and services. Design distributed data structures – work with engineering teams to design effective data ...

Event Streaming Systems team within the broader Storage organisation. The team builds and operates highly reliable, scalable and efficient event streaming infrastructure, including Kafka, Event Streaming abstractions (internally called EventBus) and future streaming platform technologies. These systems support Tier-0 workflows and are foundational to how engineering teams build … scale. Design, build and operate large-scale event streaming infrastructure that supports critical production workloads. Improve the reliability, scalability, observability and automation of Kafka, EventBus and related streaming platforms. Debug complex distributed systems issues, including performance bottlenecks, capacity constraints and production reliability challenges. Build infrastructure automation and self-healing ...

series and beyond. ● Deploy and operate large, high-performance ElasticSearch clusters holding 2000+TB of data. ● Deploy and grow high-throughput data pipelines built on Kafka, handling hundreds of thousands of events per second. ● Design and build an alerting system that allows engineering teams to construct alerts from multiple data … willing to be part of a production on-call rotation. ● Have direct experience with the following technologies (or similar): Elasticsearch Logstash Kibana (ELK) stack, Kafka, Prometheus/Thanos/Cortex, Graphite, Ansible, Terraform, Consul. ● Have strong experience in building out solitons based on Software engineering best practices. Keywords: Observability ...

Design and deliver end-to-end applications using Java (Spring Boot) and React . Build scalable backend microservices, REST APIs, and gRPC services. Utilize Kafka for real-time event streaming and data processing. Deploy and maintain applications in AWS using Kubernetes . Collaborate across teams to align software architecture … years of full-stack software development experience. Core proficiency in Java, Spring Boot, and ReactJS . Hands-on experience with AWS, Kubernetes, and Kafka . Strong grasp of multithreading, microservices architecture, and API design. Financial services, Investment Banking, or Risk domain experience is highly advantageous. Ability to work from ...

Develop scalable microservices and APIs using Java/Kotlin, enabling reliable and efficient order processing across multiple channels. Contribute to event-driven architectures using Kafka to support high-volume transactional workflows across Payments, Pricing, and Fulfilment domains. Design and evolve GraphQL and REST APIs, ensuring consistency, performance, scalability … Engineering API Design Distributed Systems Asynchronous Messaging Scalable Services Soft Skills Collaboration Problem Solving Industry Keywords Order Lifecycle Transactional Systems Commerce Challenges Tools & Technologies Kafka REST APIs Distributed Databases Caching Technologies #J-18808-Ljbffr ...

shaping the architecture of our Prime Brokerage and Capital Markets platforms. You will design and build scalable, event‐driven trading systems using Java and Kafka, define cloud and container strategies with Docker and Kubernetes, and collaborate closely with managers and stakeholders. This role suits a senior technologist who combines … focus on secure, high-performance solutions. To be successful, you should have: Strong knowledge of Java and MSSQL Experience in data streaming (Kafka), and distributed event driven system design Design and build of trading/lifecycle systems in Java using containers Some other highly valued skills may include: Knowledge ...

software engineer\* Solid knowledge of relational databases and designing data models for correctness and performance.\* Experience building distributed and concurrent systems (e.g., Kafka or equivalent).\* Strong engineering fundamentals: testable code, unit + integration testing, and pragmatic testing strategies.\* Clear communication: able to explain technical decisions to non-technical … 5+ years of experience in Java or Kotlin (or other JVM based language)\* Strong experience with Spring framework, relational databases, distributed and concurrent systems (Kafka)\* Experience in scraping technologies at scale and maintaining data accuracy\* Close collaboration with product managers, data scientists, data analysts, engineers and other product teams ...

data from global partners at up to PB/day scale. Design and build parallelised, distributed data transfer pipelines using Flyte for workflow orchestration, Kafka/event‐driven patterns for lifecycle tracing, and Azure for storage and transfer infrastructure. Build and operate a globally distributed hub‐and‐spoke data … startup within a scale‐up. High degree of autonomy and ownership: you take responsibility for outcomes, not just tasks. Nice to Have Experience with Kafka for event‐driven transfer observability. Multi‐cloud experience across Azure, AWS and/or GCP. Experience working directly with external data partners . Background ...

**About the Role** We are seeking a highly skilled and hands-on Lead Java Engineer with AI proficiency to help build the next generation FTSE Russell Index Platform. This platform underpins the calculation and distribution ...

Role: Solution ArchitectLocation: Guildford Business Park Guildford Surrey GU2 8XGJob Type: FTE(4 days Remote,1 day onsite)ResponsibilitiesProduce proposals and justify the value of technology strategies to senior business audiences.Drive alignment of the client ...

Manage Elasticsearch deployments and optimisation \n Implement workflow automation using Azure Data Factory \n Develop and support Real Time event streaming solutions using Kafka and NATS \n Support security, authentication and access management using technologies such as Keycloak \n Collaborate with technical teams to deliver resilient, secure and scalable … Strong commercial Python development experience \n Experience developing ETL/ELT solutions within enterprise environments \n Azure Data Factory expertise \n Experience with Kafka and/or NATS event streaming technologies \n PostgreSQL administration and development experience \n Elasticsearch experience \n Strong understanding of data security, access controls ...

Job Title: Senior Apache Cassandra EngineerJob Location: London, UK (Hybrid)Job Type: ContractAbout the RoleWe are seeking an experienced Senior Apache Cassandra Database Engineer to join our Business Platform team supporting critical Financial Crime and ...

build distributed services from the ground up, working with core Java rather than solely relying on heavy framework usage. Develop event-driven systems using Kafka and event-streaming frameworks at scale Orchestrate deployments on Kubernetes, defining services, deployments and stateful sets Tackle hard problems around data consistency and availability … Java developer, building complex distributed systems A deep understanding of core Java, data structures and concurrency, not just framework knowledge Hands-on experience with Kafka and event-streaming frameworks such as Flink, Kafka Streams or Spark Practical Kubernetes experience, including troubleshooting production issues Experience tuning JVM performance - garbage ...

with a strong interest in continuous learning. Flexibility to travel up to 20% of the time. Preferred Technical and Professional Experience Experience with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra ...

Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

Responsibilities Scale Prometheus metrics infrastructure to handle 100+ million active series . Operate large Elasticsearch clusters holding 2000+TB of data . Grow high-throughput Kafka data pipelines processing hundreds of thousands of events per second. Build custom alerting workflows and self-service APIs for internal engineering teams. Provision cloud … bare-metal machines. 2+ years developing in Go, Python, Ruby, Scala, or Bash. Hands-on experience with Prometheus/Thanos/Cortex, Kafka, the ELK stack, Ansible, or Consul . Comfortable diving into unfamiliar codebases and participating in an on-call rotation. Keywords: Observability, Monitoring, SRE, Site Reliability Engineering ...

Skills: Golang, Microservices, Agile, Kafka, Docker, REST Web Services, CI/CD Work Mode: Full Time Job Status: Open Follow Us On: We are looking for Golang Developer to join our team, who will work closely with development team to develop new system capabilities as defined within the technical … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server. Working knowledge of AWS data services, especially S3. Understanding … data pipelines from legacy mainframe DB2 and on‐prem SQL Server systems into an AWS‐based data lake. Implement real‐time ingestion using Confluent Kafka and land data in Amazon S3. Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold). Design ...

Billing within an event-driven architecture.Key ResponsibilitiesOwn end-to-end solution architecture and HLD across all workstreamsDefine and govern event-driven architecture patterns (Kafka/event streaming, async processing)Manage cross-domain dependencies and ensure integration consistencyProvide architecture governance, design approvals, and CAB stakeholder engagementPartner with Integration Architect, Data … multiple domains: Payments, KYC, Billing, Treasury, OperationsExperience working in onshore leadership roles with offshore delivery teamsTechnical & Domain SkillsStrong experience in event-driven architecture (Kafka, event bus, streaming platforms)Expertise in microservices, APIs, cloud-native architecture (Azure/AWS)Understanding of payment ecosystems (SEPA, SWIFT, Faster Payments, ISO 20022)Familiarity ...

activation webhooks), custom webhook delivery engine, and the event routing that connects domain events to external system notifications. Architecture decisions: Service boundaries, event contracts (Kafka), data model evolution (Prisma/PostgreSQL), API design for both public and private endpoints, and the migration strategy from the legacy Next.js monolith … monorepo with 7 microservices (CRM, Billing, Payments, Ledger, Communications, Provisioning, Integrations) TypeScript end‐to‐end PostgreSQL with Prisma ORM (shared database, service‐scoped access) Kafka message bus (migrating from RabbitMQ) for inter‐service communication (send/emit patterns) Redis for caching, queues, rate limiting, and idempotency REST API gateway ...

Are you looking for a new challenge? Fancy helping us shape the future of motor insurance? the company could be the place for you. Since 2015, we’ve been using our love of data and ...

This is an exciting opportunity for you to join a talented team of engineers and make a global impact. As a Lead Software Engineer, you’ll help shape market-leading technology products that advance our ...

Job Description We are seeking a Senior Software Engineer II to collaborate with our Regional Europe & UK team, driving data‐driven and innovative growth decisions and leading the team in delivering value to our customers ...