126 to 150 of 155 Permanent Kafka Jobs

platform. Key Responsibilities Design and maintain data pipelines to process large geospatial and sensor datasets. Develop distributed systems using tools such as Apache Spark, Kafka, and Hadoop. Integrate diverse data sources including satellite, remote sensing, IoT, and GIS feeds. Build analytical models and workflows to detect patterns, predict outcomes … experience in data engineering, software development, or platform design. Strong programming ability in Python, Java, or Scala. Knowledge of frameworks such as Spark, Kafka, or Flink. Experience working with geospatial data and tools including PostGIS, GDAL, or GeoServer. Strong SQL and NoSQL experience, including data warehousing and ETL development. ...

integration, contract, performance). Develop cloud-native solutions on Azure or AWS using CI/CD and DevOps tooling. Build event-driven systems using Kafka, including schema evolution and resilient consumer patterns. Mentor engineers and support best practice across coding, testing, and delivery. Contribute to roadmap planning, technical direction … coding, observability, and engineering excellence. Essential Skills & Experience Java 17+, Spring Boot, and modern Back End engineering. Strong automation testing experience. Solid experience with Kafka and event-driven architectures. Cloud engineering with Azure or AWS, CI/CD pipelines, containers, IaC exposure. Strong understanding of architecture patterns: SOLID, Clean ...

Design and implement Real Time and batch data pipelines to support fraud detection and operational decision-making. Develop event-driven solutions using Kafka, Flink, and data transformation frameworks such as PySpark or Pandas. Write maintainable, high-quality Python or Java code with strong SQL capabilities. Build and manage cloud … with AWS, SQL, Python, and PySpark, including building cloud infrastructure using IaC (CloudFormation/Terraform). Hands-on experience with streaming frameworks such as Kafka and Flink. Familiarity with data quality frameworks (eg, Great Expectations) and graph databases is a plus. Agile development experience (Scrum preferred), with strong code ...

delivery with full technical and project accountability Work with modern Java technology stacks (Spring Boot, Java 17/21) and cloud infrastructure (AWS, Docker, Kafka) Join a collaborative software consultancy with 20+ years' industry experience and genuine startup culture Develop your expertise in financial systems whilst building lasting client … modern Java technology stacks, particularly Spring Boot Experience with cloud technologies and containerisation (AWS, Docker) Solid understanding of databases (Cassandra, Oracle) and messaging systems (Kafka, MQ) Demonstrated project leadership experience with independent task management and timeline ownership Ability to lead high-quality code reviews Ability to estimate work accurately ...

month, deliver the best user experiences and personalisation for talent and talent seekers. We built in-house large scale tracking platform, powered by Tealium, Kafka and Adobe Analytics, and successfully rolled it out to 10 of our brands. Along with the tracking we are owners of our AB testing … hypermedia APIs Proficient in Web Technologies like HTML, CSS, JavaScript, React.js, Next.js and Node.js, and in event-driven and eventual consistency systems using Kafka, .Net, Java, REST APIs, AWS, Terraform and DevOps Nice to have:experience in data pipping and modelling using SQL, DBT, ETL, Data Warehousing, Redshift ...

Catalog and Delta Sharing via AWS PrivateLink. Experience with Databricks or equivalent analytics platforms is important for assessing and scaling the right approach • Apache Kafka — event streaming experience is essential. The platform is evaluating Kafka as the strategic backbone for ordered event logs, consumer group replay, and guaranteed … operate across systems. This role provides the data foundation that makes agentic capabilities possible • Event streaming architecture — opportunity to design and implement a Kafka‐based event backbone, shaping the platform’s real‐time data architecture • Manufacturing AI — opportunity to work at the intersection of industrial operations and generative ...

trading teams to translate models into production-ready systems Contribute to the design and implementation of distributed, event-driven architectures using technologies such as Kafka and containerised environments Optimise system performance across both research and live trading environments, focusing on latency, throughput, and scalability Take ownership of production systems … production/trading environments Proficiency in Python and Java, with additional experience in C++ beneficial Solid understanding of distributed systems, messaging frameworks (e.g. Kafka), and scalable system design Experience with containerisation and cloud technologies (e.g. Kubernetes) Strong focus on performance optimisation (system-level, not just quantitative models) Comfortable working ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

teams across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

work independently and as part of a team Highly Desirable Experience with Temporal or similar workflow orchestration systems Knowledge of event streaming platforms like Kafka Experience with LLMs and AI integration (particularly for Investigations team) Background in SaaS platforms or B2B products Experience in fintech, compliance, or regulated industries … with observability tools (Grafana, Prometheus, etc.) Understanding of authorisation patterns and security best practices Our Tech Stack Languages: Go Databases: MongoDB Messaging & Orchestration: Temporal, Kafka APIs: REST, gRPC, protobuf Infrastructure: Kubernetes, GCP Observability: Grafana stack AI: LLMs (OpenAI, Gemini), RAG systems What Success Looks Like In your first ...

Snowflake warehouse. Manage and mentor a team of Data Engineers in a player/coach capacity. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Evolve a configuration-driven platform enabling non-engineers to define regulatory logic. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient … tools. Ability to translate complex regulatory requirements into technical specifications. High ownership mindset and accountability for delivery and reliability. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

Java Architect (with Capital Markets exp.) Project description We are building an end-to-end client lifecycle management solution, where technology drives procedural automation and standardization. Our solution includes industry-leading modules and tools widely ...

Senior Software Engineer Salary: £75k-£110k (plus attractive bonus on top) Location: London or Leeds (relaxed about hybrid or remote working, if preferred) My client is a specialist provider of sports pricing and trading technology ...

team, focusing on real-time data pipelines, streaming architectures, and AWS-based solutions. What You'll Do Build and scale real-time data pipelines (Kafka/Flink) Develop ELT workflows using Python/Java & SQL Work on AWS with IaC (Terraform/CloudFormation) Contribute to high-quality, production-grade … engineering What We're Looking For Strong Data Engineering experience Python or Java + SQL + AWS Experience with Kafka/streaming frameworks Exposure to PySpark/data transformation tools Why Apply? Work on high-impact fraud prevention systems Modern tech stack (AWS, streaming, real-time data) Strong engineering ...

Code across dev & prod Building robust observability and monitoring frameworks Supporting uptime/SLAs Designing and maintaining Kubernetes clusters (advanced configuration) Designing and maintaining Kafka clusters (including DR & scaling strategy) Building and optimising CI/CD pipelines Identifying infrastructure vulnerabilities and improving resilience What We're Looking For 3+ … years DevOps experience in a SaaS environment Strong AWS expertise Advanced Kubernetes administration Advanced Kafka administration (DR, topic scaling, performance tuning) Infrastructure as Code (Terraform essential) Config management (Ansible, Chef or Puppet) CI/CD tooling (Git, Jenkins or GitHub Actions) Distributed systems knowledge Strong networking knowledge (TCP/ ...

Design event-driven, data-centric architectures (pub-sub, API-led connectivity) Evaluate middleware, integration patterns, and architectural approaches Drive scalable, loosely coupled systems using Kafka and API ecosystems Align solutions with enterprise goals across business and technology stakeholders Provide governance and guidance to delivery teams Integration Architect - Key Requirements … Proven experience in enterprise Integration Architecture Expertise in event-driven architecture, pub-sub, and API-led design Hands-on experience with Kafka and integration frameworks Strong communication and architectural decision-making skills Experience across complex, multi-system environments Exposure to Endur is advantageous Database Architect - Key Responsibilities Define ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data … Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed ...

Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Lead GCP Data Engineer New Malden (Hybrid, approx. 4 days per month onsite) £85,000 to £90,000 plus up to 30 percent bonus This is an opportunity to take ownership of a brand-new ...

experience with asynchronous Rust and networked services Solid understanding of distributed systems and event-driven architecture Experience with messaging or streaming platforms such as Kafka Comfortable diagnosing issues across the full technical stack Technical Environment Rust with async frameworks (Tokio, Axum, Actix or similar) Distributed microservices architectures Event-driven … systems and Kafka gRPC and high-throughput APIs Large-scale backend systems supporting significant user or transaction volume Ideal Background Candidates often come from high-scale technology environments such as fintech, trading platforms, payments, or large consumer applications. Engineers with experience building complex distributed systems (in Rust) in other ...

professional experience with Golang Experience with gRPC, goroutines, and channels Hands-on knowledge of PostgreSQL performance tuning Familiarity with GORM, Prometheus, Grafana, and Kafka Exposure to Ruby on Rails, JavaScript, and TypeScript Practical experience applying design patterns such as Singleton and Factory DevOps experience in deployment and environment managemen … reliability through robust testing and performance monitoring using Prometheus and Grafana Participate in system architecture discussions, especially in migrating monoliths to microservices Work with Kafka and asynchronous communication systems Manage deployment pipelines and production environments Collaborate with cross-functional teams and contribute to code reviews and best practices ...

What you’ll work on Designing and improving high-volume data pipelines Optimising performance across ClickHouse and Postgres Working with streaming/event systems (Kafka-style architectures) Improving reliability and observability of data workflows Debugging real production data and performance issues Supporting data platform evolution and migration initiatives Contributing … fundamentals Experience operating data systems at scale Experience with at least two of: Columnar databases (ClickHouse, BigQuery, etc.) Relational databases (Postgres, MySQL) Streaming systems (Kafka, Kinesis, etc.) Strong performance debugging skills Experience in one or more of: TypeScript/Node, Go, Python Ability to reason about behaviour under load ...

scraper consolidation, and platform resilience improvements. Rationalise, deduplicate, and govern curves across systems. Architect and oversee a Medallion-style platform using Python, React, ClickHouse, Kafka/event streaming, Azure/AWS, and C#/.NET. Remain hands-on with design, prototyping, code reviews, and architecture decisions. Lead engineers, data … high-data environments. Hands-on Python experience and familiarity with modern frameworks; React for UI delivery. Experience with streaming/event-driven architectures (Kafka) and large-scale data processing; ClickHouse or similar highly desirable. C#/.NET experience beneficial for legacy systems. Knowledge of energy trading, commodities, or financial ...

container-related issues in production environments Implement and maintain monitoring, alerting, and logging solutions Support operational aspects of platforms such as: MongoDB, PostgreSQL, Apache Kafka, OpenSearch Required Skills & Experience Experience working in a DevOps or Platform Engineering role Strong knowledge of Linux and working knowledge of Windows Hands … PowerShell Familiarity with monitoring, alerting, and incident management practices Desirable Skills: Experience with GitOps tooling (Argo CD) Experience with Bamboo and Bitbucket Knowledge of Kafka, MongoDB, or PostgreSQL operations Experience operating OpenSearch or similar logging platforms Understanding of cloud security and access control (RBAC, secrets ...

Python Previously worked at a start up/smaller sized company 5 years+ experience Ability to build software which scales Building messaging queues e.g., Kafka (nice to have) This is entirely a Python back-end development role (Python 3), where the core framework used is FastAPI and Kafka ...