151 to 175 of 202 Kafka Jobs

Collaborate with SRE and Platform teams to ensure resilient and observable systems Streaming, Messaging & Distributed Systems * Build and support real-time pipelines using Apache Kafka (producers, consumers, schema evolution, partitioning, offsets) * Ensure reliability, ordering guarantees, and performance optimisation across distributed services Distributed SQL & Data Platforms * Work with Starburst/… developer environments * Experience building scalable production applications (not scripting/automation-only backgrounds) * Hands-on OpenShift production deployment and support * Practical experience with Apache Kafka * Professional Git workflows and code review processes * Starburst/Trino for distributed query processing * Advanced SQL (joins, CTEs, window functions, performance tuning) * Experience integrating ...

continuous deployment (CI/CD) processes. Work with Kubernetes and OpenShift for container orchestration and management. Develop and maintain event streaming solutions using Kafka and Azure Event Hub. Ideal Candidate Profile Java Development : Previous experience as a Java developer, with expertise in Java Quarkus or Java Spring Boot (Java … version 21). Cloud Native : Experience developing in a cloud environment (MS Azure or AWS). Event Streaming : Experience with event streaming infrastructure (e.g., Kafka, Azure Event Hub). DevOps : Experience with DevOps infrastructure and components, including Jenkins, ArgoCD, and Helm charts. Containerization : Proficiency in containerization and orchestration tools ...

continuous deployment (CI/CD) processes. Work with Kubernetes and OpenShift for container orchestration and management. Develop and maintain event streaming solutions using Kafka and Azure Event Hub. Ideal Candidate Profile Java Development : Previous experience as a Java developer, with expertise in Java Quarkus or Java Spring Boot (Java … version 21). Cloud Native : Experience developing in a cloud environment (MS Azure or AWS). Event Streaming : Experience with event streaming infrastructure (e.g., Kafka, Azure Event Hub). DevOps : Experience with DevOps infrastructure and components, including Jenkins, ArgoCD, and Helm charts. Containerization : Proficiency in containerization and orchestration tools ...

cloud platforms (Azure/AWS/GCP) and data services Understanding of DevOps tools: Git, Jenkins, Docker, Kubernetes (optional) Familiar with messaging and streaming: Kafka, Event Hub, Kinesis Experience with monitoring tools (e.g., Grafana, Prometheus, CloudWatch) Soft Skills Strong analytical and problem solving abilities Excellent communication and stakeholder management … cloud platforms (Azure/AWS/GCP) and data services Understanding of DevOps tools: Git, Jenkins, Docker, Kubernetes (optional) Familiar with messaging and streaming: Kafka, Event Hub, Kinesis Experience with monitoring tools (e.g., Grafana, Prometheus, CloudWatch) Soft Skills Strong analytical and problem solving abilities Excellent communication and stakeholder management ...

andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

platform. Key Responsibilities Design and maintain data pipelines to process large geospatial and sensor datasets. Develop distributed systems using tools such as Apache Spark, Kafka, and Hadoop. Integrate diverse data sources including satellite, remote sensing, IoT, and GIS feeds. Build analytical models and workflows to detect patterns, predict outcomes … experience in data engineering, software development, or platform design. Strong programming ability in Python, Java, or Scala. Knowledge of frameworks such as Spark, Kafka, or Flink. Experience working with geospatial data and tools including PostGIS, GDAL, or GeoServer. Strong SQL and NoSQL experience, including data warehousing and ETL development. ...

integration, contract, performance). Develop cloud-native solutions on Azure or AWS using CI/CD and DevOps tooling. Build event-driven systems using Kafka, including schema evolution and resilient consumer patterns. Mentor engineers and support best practice across coding, testing, and delivery. Contribute to roadmap planning, technical direction … coding, observability, and engineering excellence. Essential Skills & Experience Java 17+, Spring Boot, and modern Back End engineering. Strong automation testing experience. Solid experience with Kafka and event-driven architectures. Cloud engineering with Azure or AWS, CI/CD pipelines, containers, IaC exposure. Strong understanding of architecture patterns: SOLID, Clean ...

Design and implement Real Time and batch data pipelines to support fraud detection and operational decision-making. Develop event-driven solutions using Kafka, Flink, and data transformation frameworks such as PySpark or Pandas. Write maintainable, high-quality Python or Java code with strong SQL capabilities. Build and manage cloud … with AWS, SQL, Python, and PySpark, including building cloud infrastructure using IaC (CloudFormation/Terraform). Hands-on experience with streaming frameworks such as Kafka and Flink. Familiarity with data quality frameworks (eg, Great Expectations) and graph databases is a plus. Agile development experience (Scrum preferred), with strong code ...

delivery with full technical and project accountability Work with modern Java technology stacks (Spring Boot, Java 17/21) and cloud infrastructure (AWS, Docker, Kafka) Join a collaborative software consultancy with 20+ years' industry experience and genuine startup culture Develop your expertise in financial systems whilst building lasting client … modern Java technology stacks, particularly Spring Boot Experience with cloud technologies and containerisation (AWS, Docker) Solid understanding of databases (Cassandra, Oracle) and messaging systems (Kafka, MQ) Demonstrated project leadership experience with independent task management and timeline ownership Ability to lead high-quality code reviews Ability to estimate work accurately ...

month, deliver the best user experiences and personalisation for talent and talent seekers. We built in-house large scale tracking platform, powered by Tealium, Kafka and Adobe Analytics, and successfully rolled it out to 10 of our brands. Along with the tracking we are owners of our AB testing … hypermedia APIs Proficient in Web Technologies like HTML, CSS, JavaScript, React.js, Next.js and Node.js, and in event-driven and eventual consistency systems using Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift ...

Hedge Fund - Python Developer (Equities) - Trade life cycle - PnL - Kafka - Contract Our Hedge Fund client is looking for a Python Developer/Engineer Contract role This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role … trade events. Build and operate Python-based services that perform large-scale data transformations and calculations. Publish and distribute transaction and PnL data using Kafka, including AVRO-based schemas and streaming patterns. Required Skills Minimum of 6+ years of professional Python development experience, ideally in capital markets ...

Catalog and Delta Sharing via AWS PrivateLink. Experience with Databricks or equivalent analytics platforms is important for assessing and scaling the right approach • Apache Kafka — event streaming experience is essential. The platform is evaluating Kafka as the strategic backbone for ordered event logs, consumer group replay, and guaranteed … operate across systems. This role provides the data foundation that makes agentic capabilities possible • Event streaming architecture — opportunity to design and implement a Kafka‐based event backbone, shaping the platform’s real‐time data architecture • Manufacturing AI — opportunity to work at the intersection of industrial operations and generative ...

trading teams to translate models into production-ready systems Contribute to the design and implementation of distributed, event-driven architectures using technologies such as Kafka and containerised environments Optimise system performance across both research and live trading environments, focusing on latency, throughput, and scalability Take ownership of production systems … production/trading environments Proficiency in Python and Java, with additional experience in C++ beneficial Solid understanding of distributed systems, messaging frameworks (e.g. Kafka), and scalable system design Experience with containerisation and cloud technologies (e.g. Kubernetes) Strong focus on performance optimisation (system-level, not just quantitative models) Comfortable working ...

solutions. We are looking for a Golang Software Engineer to work within a microservices architecture, building REST APIs and asynchronous messaging services such as Kafka or RabbitMQ. This Golang Software Engineer will operate within a Scrum framework, contributing to business-critical functions delivered through a fully automated CI/… This Golang Software Engineer role is ideal for someone experienced in regulated or fintech environments. Required Skills Golang Microservices architecture REST and asynchronous messaging (Kafka, RabbitMQ) Scrum/Agile delivery CI/CD pipelines and automation Desired Skills Degree in Computer Science, Engineering, or equivalent experience Test-Driven Development ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

teams across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

work independently and as part of a team Highly Desirable Experience with Temporal or similar workflow orchestration systems Knowledge of event streaming platforms like Kafka Experience with LLMs and AI integration (particularly for Investigations team) Background in SaaS platforms or B2B products Experience in fintech, compliance, or regulated industries … with observability tools (Grafana, Prometheus, etc.) Understanding of authorisation patterns and security best practices Our Tech Stack Languages: Go Databases: MongoDB Messaging & Orchestration: Temporal, Kafka APIs: REST, gRPC, protobuf Infrastructure: Kubernetes, GCP Observability: Grafana stack AI: LLMs (OpenAI, Gemini), RAG systems What Success Looks Like In your first ...

identified by our QA, development team, and users. We work with three applications. A Spring Batch Java application that processes and sends data using Kafka and MQ. It uses a SQL Server database to store data used by batch jobs and intraday processes. A Spring Boot Java application that … expected. Candidate Requirements: Experienced in Java development (Spring Boot or Spring Batch experience preferred). Experienced in SQL. Comfortable messaging systems (MQ or Kafka preferred). Knowledgeable in containerisation and cloud deployment fundamentals. Comfortable with Unix command-line (Experience using Bash also helpful) Experienced using version control such ...

Snowflake warehouse. Manage and mentor a team of Data Engineers in a player/coach capacity. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Evolve a configuration-driven platform enabling non-engineers to define regulatory logic. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient … tools. Ability to translate complex regulatory requirements into technical specifications. High ownership mindset and accountability for delivery and reliability. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

Java Architect (with Capital Markets exp.) Project description We are building an end-to-end client lifecycle management solution, where technology drives procedural automation and standardization. Our solution includes industry-leading modules and tools widely ...

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

results for products assigned to them. Key Skills needed: 4 years + Java Development Java 17/21 Spring boot Nexus, Artifactory, Sonar, Jacoco Kafka Kubernetes, Helm Databases - Hbase etc Nice to have: Kafka Streams, Data sinks OCP RabbitMQ Gatling, JMeter Datadog AWS These roles are based Hybrid ...

team, focusing on real-time data pipelines, streaming architectures, and AWS-based solutions. What You'll Do Build and scale real-time data pipelines (Kafka/Flink) Develop ELT workflows using Python/Java & SQL Work on AWS with IaC (Terraform/CloudFormation) Contribute to high-quality, production-grade … engineering What We're Looking For Strong Data Engineering experience Python or Java + SQL + AWS Experience with Kafka/streaming frameworks Exposure to PySpark/data transformation tools Why Apply? Work on high-impact fraud prevention systems Modern tech stack (AWS, streaming, real-time data) Strong engineering ...

Code across dev & prod Building robust observability and monitoring frameworks Supporting uptime/SLAs Designing and maintaining Kubernetes clusters (advanced configuration) Designing and maintaining Kafka clusters (including DR & scaling strategy) Building and optimising CI/CD pipelines Identifying infrastructure vulnerabilities and improving resilience What We're Looking For 3+ … years DevOps experience in a SaaS environment Strong AWS expertise Advanced Kubernetes administration Advanced Kafka administration (DR, topic scaling, performance tuning) Infrastructure as Code (Terraform essential) Config management (Ansible, Chef or Puppet) CI/CD tooling (Git, Jenkins or GitHub Actions) Distributed systems knowledge Strong networking knowledge (TCP/ ...

Design event-driven, data-centric architectures (pub-sub, API-led connectivity) Evaluate middleware, integration patterns, and architectural approaches Drive scalable, loosely coupled systems using Kafka and API ecosystems Align solutions with enterprise goals across business and technology stakeholders Provide governance and guidance to delivery teams Integration Architect - Key Requirements … Proven experience in enterprise Integration Architecture Expertise in event-driven architecture, pub-sub, and API-led design Hands-on experience with Kafka and integration frameworks Strong communication and architectural decision-making skills Experience across complex, multi-system environments Exposure to Endur is advantageous Database Architect - Key Responsibilities Define ...