151 to 175 of 181 Kafka Jobs in England

cloud platforms (Azure/AWS/GCP) and data services Understanding of DevOps tools: Git, Jenkins, Docker, Kubernetes (optional) Familiar with messaging and streaming: Kafka, Event Hub, Kinesis Experience with monitoring tools (e.g., Grafana, Prometheus, CloudWatch) Soft Skills Strong analytical and problem solving abilities Excellent communication and stakeholder management … cloud platforms (Azure/AWS/GCP) and data services Understanding of DevOps tools: Git, Jenkins, Docker, Kubernetes (optional) Familiar with messaging and streaming: Kafka, Event Hub, Kinesis Experience with monitoring tools (e.g., Grafana, Prometheus, CloudWatch) Soft Skills Strong analytical and problem solving abilities Excellent communication and stakeholder management ...

Senior Java Software Engineer – Java 11+, Spring, Spring Boot, Microservices, Kafka, Akka, Docker/Kubernetes, Real-time, TDD/BDD, Reactive Programming, MongoDB Payments A Senior Java Engineer with a background in finance/payments and experience working on distributed real-time systems is sought after by a global … usage of Spring/Spring Boot Experience developing distributed, real-time applications with deep knowledge of Reactive Programming Principles and tools like Akka, Kafka, WebFlux, RXJava Hands-on experience of both MongoDB and AWS cloud Industry experience within Financial Services, preferably within the Payments arena or at the very ...

This job is with Wise, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Wise is a global technology company ...

strategic objectives for innovation, operational excellence, and long-term sustainability with a strong focus on domain-driven design and event-driven architecture leveraging Kafka and related technologies. Key Responsibilities: Architecture & Design Design: Lead the design and implementation of solutions aligned with our domain-driven, event-driven architecture. Ensure designs … complementary technologies. Actively promote the adoption of modern patterns, frameworks, and tooling. Event-Driven Patterns: Design, evolve, and document asynchronous communication patterns using Kafka, Mass Transit, and patterns such as CQRS, Event Sourcing, and Outbox. Ensure effective message contracts and event schemas across domains. Integration: Oversee the integration between ...

driving engineering direction across a large-scale distributed system. What you’ll do Design and build Java (Spring Boot) microservices Architect event-driven systems (Kafka/messaging) Apply AI/ML to real-world business problems Work with modern development tooling, including AI-assisted environments Influence technical direction … Principal/Staff/Architect level Strong Java and distributed systems background Hands-on AI/ML experience (Python or similar) Experience with Kafka or MQ, SQL/Oracle, cloud and containerisation Nice to have Financial services experience (post-trade, custody, corporate actions, trading ...

data, distributed systems, and modern cloud architectures . What youll be doing Design and build scalable data pipelines (batch & streaming) Work with technologies like Kafka, Flink, Spark, AWS services Develop real-time, event-driven data solutions Contribute to data architecture and modelling best practices Implement CI/CD pipelines … analytics and AI teams to deliver clean datasets What were looking for Strong programming skills in Java (preferred) or Python Experience with streaming technologies (Kafka/Flink/Spark) Knowledge of distributed systems and large-scale data processing Experience with cloud platforms (AWS preferred) Familiarity with DevOps tools ...

articulate complex technical concepts Highly Desirable Experience with Temporal or similar workflow orchestration systems at scale Deep knowledge of event streaming platforms like Kafka Experience with LLMs and AI integration (particularly for Investigations team) Experience driving AI tooling adoption and practices across an engineering team — establishing shared conventions, measuring … Deep understanding of authorization patterns, security, and multi-tenancy Experience with protobuf and gRPC Our Tech Stack Languages: Go Databases: MongoDB Messaging & Orchestration: Temporal, Kafka APIs: REST, gRPC, protobuf Infrastructure: Kubernetes, GCP Observability: Grafana stack AI/ML: LLMs (OpenAI, Gemini), RAG systems Development Tools: Claude Code, AI-assisted ...

Devops, application security, DLTs, SaaS, data (real time , data lakes) ,SRE Infra, event sourcing, Caching strategies, REST/GRPC/JSON/Solace/KAFKA/Oracle/PostgreSQL • Process skills - Ability to drive process and operational standardization • Strategy - Ability to straddle both big picture and the low level … Devops, application security, DLTs, SaaS, data (real time, data lakes) ,SRE Infra, event sourcing, Caching strategies, REST/GRPC/JSON/Solace/KAFKA/Oracle/PostgreSQL • Expertise/background in implementing/designing ultra low latency trading platforms and/or scalable Transaction processing systems • Expertise ...

Hedge Fund - Python Developer (Equities) - Trade life cycle - PnL - Kafka - Contract Our Hedge Fund client is looking for a Python Developer/Engineer Contract role This team is responsible for the firms equity transaction data platform, including trade life cycle event processing, enrichment, and PnL calculations. The role … trade events. Build and operate Python-based services that perform large-scale data transformations and calculations. Publish and distribute transaction and PnL data using Kafka, including AVRO-based schemas and streaming patterns. Required Skills Minimum of 6+ years of professional Python development experience, ideally in capital markets ...

time series* Proficiency in SQL and NoSQL databases* Significant experience with Azure Functions, Web Apps, distributed/event-driven architecture (event hub, event bus, Kafka), ELK* Intermediate to advanced exposure to Azure Active Directory, Azure Data Factory, Azure Data Lake, Azure Storage, Azure Kubernetes Service, CosmosDB, Azure SQL* Integration … experience with Confluent/Kafka, API Management, Logic Apps* Practical agile experience in both start-up and enterprise environments* Lead the engineering community to follow Shell Engineer Management standards, ensuring consistency and reuse* Understand and deliver core engineering GPA objectives* Create a collaborative environment for technical roles to drive ...

platform, designed to be able to handle all aspects of the Loyalty and Benefits customer experience, globally. Built using modern tools such as Golang, Kafka and Docker, there is ample opportunity to drive innovation and grow knowledge and skills as an Engineer. As a Software Engineer on an Scrum … other experience can be considered) Comfortable/experienced with back-end micro-service architecture and communication, specifically REST and asynchronous messaging services (e.g., Kafka, RabbitMQ etc.) Comfortable/experience within a Scrum framework working with as part of a team to deliver business functions and customer journeys that ...

supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems stable at scale Collaborating within an existing team … + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience (Python preferred) Experience building and supporting ...

Designing and delivering scalable APIs and microservices Building backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Handling event-driven architectures (Kafka, SNS/SQS, etc.) Driving system design decisions across distributed systems Improving observability, reliability, and performance in production Debugging complex issues and leading resolution across … teams Staying hands-on while setting technical direction and standards Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) CI/CD (Concourse, Git workflows) Databases (Postgres, DynamoDB, Couchbase) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience ...

teams across Europe Operate in Agile environments (Scrum/Kanban) with a strong engineering culture Tech Stack (current & evolving): Java 17+, Spring WebFlux, Akka, Kafka, reactive streams, distributed messaging, cloud-native tooling What You Bring We’re looking for engineers who enjoy thinking in events, streams, and asynchronous workflows … ideally Java 17) in production environments Deep understanding of asynchronous and reactive programming models Proven experience with event-driven architectures and real-time messaging (Kafka, JMS, Akka, etc.) Solid grasp of distributed systems concepts: concurrency, idempotency, fault tolerance, and resilience Experience building and testing production-grade systems using ...

Snowflake warehouse. Manage and mentor a team of Data Engineers in a player/coach capacity. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Evolve a configuration-driven platform enabling non-engineers to define regulatory logic. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient … tools. Ability to translate complex regulatory requirements into technical specifications. High ownership mindset and accountability for delivery and reliability. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

ingestion, processing, and access layers Design scalable, resilient data platforms (hub-and-spoke, lake/lakehouse) Lead implementation of batch and real-time pipelines (Kafka, APIs, SFTP) Architect solutions using: AWS (S3, EMR, Glue) PySpark/Python Support cloud migrations and platform modernisation Ensure best practices in CI/… Required Experience Active SC Clearance (essential) Strong experience with AWS data platforms (S3, EMR, Glue) Expertise in data lake/lakehouse architectures Experience with Kafka/event-driven architectures Strong Python & PySpark skills Experience with Terraform and CI/CD pipelines Proven track record designing large-scale data solutions ...

ingestion, processing, and access layers Design scalable, resilient data platforms (hub-and-spoke, lake/lakehouse) Lead implementation of batch and real-time pipelines (Kafka, APIs, SFTP) Architect solutions using: AWS (S3, EMR, Glue) PySpark/Python Support cloud migrations and platform modernisation Ensure best practices in CI/… Required Experience Active SC Clearance (essential) Strong experience with AWS data platforms (S3, EMR, Glue) Expertise in data lake/lakehouse architectures Experience with Kafka/event-driven architectures Strong Python & PySpark skills Experience with Terraform and CI/CD pipelines Proven track record designing large-scale data solutions ...

problems a plus Automated test experience, Unit testing and Integration testing An understanding of message-driven programming and messaging systems Experience with FIX and Kafka a huge plus To excel in this role, you will need a minimum of 7 years' experience in JVM, with proficiency in both Kotlin … including unit testing and integration testing, is also required. An understanding of message-driven programming and messaging systems, along with experience in FIX and Kafka, would be highly advantageous. If you are ready to take the next step in your career and make a significant impact in the world ...

real-time). Ensure alignment with organisational architectural standards and governance frameworks. Contribute to target architecture roadmaps. Provide architectural guidance across: Data ingestion (Kafka, APIs, SFTP) Data processing (PySpark, EMR, Glue) Storage (S3 and data lake patterns) Collaborate with DevOps, Data Engineers, and Testers to ensure cohesive delivery. Promote … capability uplift. Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure as Code (Terraform ...

real-time). Ensure alignment with organisational architectural standards and governance frameworks. Contribute to target architecture roadmaps. Provide architectural guidance across: Data ingestion (Kafka, APIs, SFTP) Data processing (PySpark, EMR, Glue) Storage (S3 and data lake patterns) Collaborate with DevOps, Data Engineers, and Testers to ensure cohesive delivery. Promote … capability uplift. Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure as Code (Terraform ...

software engineer Solid knowledge of relational databases and designing data models for correctness and performance. Experience building distributed and concurrent systems (e.g., Kafka or equivalent). Strong engineering fundamentals: testable code, unit + integration testing, and pragmatic testing strategies. Clear communication: able to explain technical decisions to non-technical … 5+ years of experience in Java or Kotlin (or other JVM based language) Strong experience with Spring framework, relational databases, distributed and concurrent systems (Kafka) Experience in scraping technologies at scale and maintaining data accuracy Close collaboration with product managers, data scientists, data analysts, engineers and other product teams ...

design and implement enterprise‐scale data platform components, working closely with Data Architecture, Enterprise Architecture and Solution Architecture teams. Hands‐on experience with Confluent (Kafka), Azure Data Lake, Snowflake, and FiveTran, including data ingestion, storage, processing and consumption patterns. Strong understanding of data governance, security and compliance frameworks, enabling … resilient, scalable and cost‐efficient platforms. Technical Skills Strong expertise in data platform architecture and cloud-based data solutions. Hands-on experience with Confluent (Kafka), Azure Data Lake, Snowflake, and FiveTran. Good expertise in Data Visualisation tools such as Power BI. Proficiency in data integration, ETL/ELT pipelines ...

delivery speed, while maintaining rigorous standards for documentation and compliance. Key responsibilities: •Develop & Optimise: Modernise data collection, processing, and storage systems using tools like Kafka, Kubernetes, and Zookeeper. •Automate & Enhance: Streamline and automate release processes with Ansible and Azure DevOps for greater reliability and quality. •Configure & Maintain: Support, configure … with ArcSight SIEM configuration, support, and troubleshooting •Strong knowledge of RHEL and Windows environments •Experience automating releases via Ansible and Azure DevOps •Familiarity with Kafka, Kubernetes, and distributed systems •Strong written and verbal communication skills •Understanding of data engineering (SQL or Big Data) •Scripting ability (PowerShell, Bash) advantageous •Active ...

This job is with Capgemini, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. About the Job you are considering ...

Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...