676 to 700 of 738 Kafka Jobs in London

artifacts, dramatically reducing integration timelines across different life science datasets. High-throughput Streaming & Backend Services: Build scale, fault-tolerant real-time ingestion pipelines using Kafka, AWS, and Snowflake. Write robust enterprise services in Java or Scala, leveraging AI coding assistants for rapid code generation, refactoring, and performance tuning. Technical … Engineering & Streaming: Demonstrated expertise building production backend services in Java or Scala on AWS, alongside deep familiarity with real-time streaming architectures (e.g., Apache Kafka) and modern data engineering design patterns. AI-Augmented Engineering Proficiency: Active, practical experience integrating AI developer tools (e.g., GitHub Copilot, Cursor) into daily workflows ...

team will provide mentorship and exposure to modern technologies as we build from the ground up. Technology stack: Java/Python, AWS, Linux, Postgres, Kafka, Git. Requirements Solid working knowledge of Java and/or Python. Practical experience with relational databases and SQL (e.g. Postgres). Working command … Familiarity with developing, testing and deploying with cloud providers (e.g. AWS, GCP, Azure). Experience with integrating with external/vendor APIs. Familiarity with Kafka messaging. Firm Mirae Asset Securities Co., Ltd. is the largest investment banking and stock brokerage company by market capitalisation in South Korea. It provides ...

engineering experience Strong proficiency in Python or Go (we use both) Experience with distributed systems and microservices architecture Familiarity with real-time data processing (Kafka, Redis, etc.) Experience with PostgreSQL and data modelling for complex domains Understanding of security best practices for handling sensitive data Excellent communication skills … other healthcare interoperability standards Experience with voice/audio processing systems Background in ML infrastructure or model serving Our Stack Python, Go, PostgreSQL, Redis, Kafka, Kubernetes, GCP, Terraform. We're pragmatic about technology choices-we use what works best for the problem at hand. Equity: Meaningful equity stake ...

owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands-on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe) and SQL Server. Working knowledge of AWS data services, especially S3. Understanding … data pipelines from legacy mainframe DB2 and on prem SQL Server systems into an AWS-based data lake. Implement real-time ingestion using Confluent Kafka and land data in Amazon S3. Develop data transformations and analytics pipelines in Databricks using the medallion architecture (Bronze, Silver, Gold). Design ...

audiences. Integration Leadership: Architect and document end-to-end solutions, focusing on data integration, transformation, and orchestration using modern tools (e.g., NiFi, API gateways, Kafka, Kubernetes), integration patterns for asynchronous, event driven systems. Technical Pre‐sales (Discovery & De‐risking): Partner with Sales during technical discovery to validate feasibility, surface … discovery and product/service improvements. Data & Architecture: Specify and map data flows, formats (JSON, XML, CSV, graph), and transports (HTTP, S/FTP, Kafka, MQ). Address challenges of async/sync and streaming communications, including idempotency, retries, rate limiting, error handling, and timeouts Security & Compliance: Confidently explain ...

trade infrastructure Supporting automated trade and settlement workflows, including T+1 processing Working with APIs, messaging technologies and data feeds Developing event-driven components using Kafka Working with traders, operations and other engineers to deliver new functionality Testing, troubleshooting and improving production applications Contributing to the ongoing design … fundamentals Strong problem-solving skills Good written and verbal communication Experience with any of the following would be beneficial: APIs and external-system integrations Kafka or other messaging technologies AWS or another major cloud environment SWIFT or settlement connectivity Trade processing or post-trade technology Repo Capital markets Financial ...

architectures Build reliable, performant, and scalable systems for storage, authentication, and asset serving Automate deployment, management, and operations of distributed systems including Cassandra, Elasticsearch, Kafka, and more Develop foundational capabilities for Palantir Foundry and Gotham used by public- and private-sector institutions worldwide Requirements Engineering background in Computer Science … Qualifications Active US Security Clearance Industry Keywords Software Development Lifecycle Granular Permissioning Compute Workloads Public Sector Solutions Private Sector Solutions Tools & Technologies Cassandra Elasticsearch Kafka Palantir Foundry Gotham #J-18808-Ljbffr ...

Tech Stack: Selenium, Core Java, JDBC, Kafka, HDFS, Docker, SQL, Multithreading Challenge: Testing a Greenfield Big Data Analysis Platform Development in FS Firm: Well-known Financial Data fintech50 business, City of London, 10 man flat Dev Team Pay: 70k, Options, training budget, Pension, Life/Health, Some Work from … technology and the possibility of making serious money doing something you are passionate about. My client is based in LondonSelenium, Core Java, JDBC, Kafka, HDFS, Docker, SQL, Multithreading ...

whole of Business Spend. On the technical side, you can expect to work with the following stack: AWS, Github actions, Kotlin on the JVM, Kafka, Spring Boot, Gradle, Kubernetes, and Grafana for metrics, logs, and traces. Our frontend is TypeScript and React. What you bring You’ll thrive … that work without you in the room. A background in payments, fintech, accounts payable, ERP or B2B SaaS. Experience with event‐driven systems and Kafka, and a habit of building observability into what you ship. Why is this role a good fit for you This role is a good ...

Company DescriptionWise is a global technology company, building the best way to move and manage the world's money. Min fees. Max ease. Full speed. Whether people and businesses are sending money to another country ...

Blockchain is connecting the world to the future of finance. As the most trusted and fastest-growing global crypto company, it helps millions of people worldwide safely access cryptocurrency. Since its inception in 2011, Blockchain ...

The energy transition is the biggest infrastructure buildout in human history. Modo Energy is the data platform at the centre of it. We build the benchmarking, forecasting, and valuation tools that the world's most ...

London The energy transition is the biggest infrastructure buildout in human history. Modo Energy is the data platform at the centre of it. We build the benchmarking, forecasting, and valuation tools that the world's ...

Integration Architect - Kafka Rate - £550 - £600 Inside IR35 (Total to umbrella) Duration - 6 months initial Location - Central London on site 4 times a week Role Details: We're supporting a major transformation programme and are looking for an experienced Integration Architect with strong Kafka expertise to lead … deliver enterprise integration solutions across complex technology estates. Define event driven architecture patterns and best practice. Lead the implementation and optimisation of Apache Kafka platforms. Produce high quality architecture artefacts and technical designs. Work closely with engineering teams to support delivery and resolve complex technical challenges. Engage with senior ...

technology and require mid and senior level Java Developers to form the backbone of this via a major rebuild of their tech stack. Utilising Kafka and Kafka Streams to build a resilient, scalable backbone that powers the growth of the company, this is a unique opportunity … must. A desire to constantly learn, an inquisitive nature and an active member of the wider Java community Bonus Points For: Experience with Kafka and/or a streams-based platform (Samza, Storm) Experience of BDD (behaviour driven development). Experience of Eloqua #J-18808-Ljbffr ...

returning the results to various business systems. We build on a vast variety of technological stacks, from building products on top of Apache Kafka, Apache Spark, and Apache Beam to integrating Neo4j into Google Dataflow Templates and Microsoft Fabric. We also build backend components for our Data Importer product … have professional experience developing software systems, either in cloud or on-premises, involving either of the following; Distributed event streaming platforms, such as Apache Kafka or similar products, Data processing and analytics platforms, such as Apache Spark, Apache Beam, or their derivatives, Data warehouses in the cloud, such ...

Compliance, Risk, and Finance teams, driving features from initial concept through production deployment and iteration. Stack Languages: Rust, Go, TypeScript/Node, Python Messaging: Kafka/Redpanda, NATS API/IPC: gRPC/REST Infra: AWS (EKS, RDS, KMS), Terraform Requirements You are a backend and onramp specialist with … TypeScript/Node/Python. Database Mastery: Expert‐level knowledge of Postgres (transactions, indexing, locking), with familiarity in Redis and event/OLAP stores (Kafka/Redpanda, ClickHouse). API Craftsmanship: Mastery of gRPC/REST best practices, including versioning, pagination, authN/Z, idempotency keys, and building rock ...

practices across the business Supporting our journey towards more real-time and incremental data processing, including working with technologies such as MongoDB change streams, Kafka, and AWS MSK Helping teams become more self-sufficient with data by making datasets understandable, well documented, and easy to consume … products Have experience working with cloud data platforms and services, ideally within AWS Ideally have experience with event-driven or streaming data architectures, particularly Kafka/AWS MSK, MongoDB change streams, CDC, or similar technologies Have hands on experience working with an orchestration tool such as Airflow Thrive ...

important company while its foundations are still being formed. What You’ll Work On Ingestion from financial platforms, CRMs, providers and internal services , across Kafka-based streams, event-driven movement and batch pipelines for large or scheduled imports Core data models covering clients, households, firms, assets, products, advice … copy of it Strong command of Python , or comparable depth in another language used for data processing Batch and event-driven processing. Experience with Kafka or an equivalent streaming system, a workflow orchestrator such as Airflow, Dagster or Prefect, and transformation tooling such as dbt or equivalent SQL-based ...

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You'd drive out the cloud transformation, taking a lead on all things data ...

/Test Engineer READ THIS BEFORE YOU APPLY You will be testing Kafka-based streaming data pipelines at genuinely enormous scale, and you will be writing the test strategy for the whole programme from a blank page. There is nothing in place today. If that sounds like … Streaming, continuous, and at a scale where millions to potentially billions of rows a day is the normal operating picture, not the stress test. Kafka, high-volume ETL and ELT pipelines, and a blank page where the test strategy should be. That is the job. WHAT YOU WILL ACTUALLY ...

experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand how to design scalable end-to-end architectures … pipelines on large volumes of data (think Kafka/Flink for streaming + AWS Lambda + Kinesis)Solid data engineering fundamentals: pipeline design, SQL, Python, schema modeling, data qualityExperience building or integrating with CDP, marketing automation, or behavioral data-management platformsProven ability to go from ambiguous problem to working ...

ramp); safety-critical or regulated systems; Playwright, Selenium, Robot Framework, Cypress, Karate or Appium; Postman or SOAP UI; Jenkins and GitHub; JSON, SQL, Kafka or Grafana; performance, resilience or security testing; Python or Java; ISTQB; testing AI-powered or agentic capabilities Ready to Apply? If you want your automation … SDET, Senior QA Analyst, API Test Engineer, Playwright, Selenium, Cypress, Robot Framework, Karate, Appium, Postman, Jenkins, GitHub Actions, CI/CD, Python, Java, SQL, Kafka, ISTQB, Agile testing, regression testing, airline operations, load control, weight and balance, aviation software, safety-critical systems. Deerfoot Recruitment Solutions Ltd is a leading ...

Employ tools such as Azure Data Factory to automate data flows and manage complex workflows within hybrid environments. Utilise event‐driven technologies such as Kafka and NATS to handle real‐time data streams effectively. Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity … hybrid (on‐premises and Azure) environments. Practical experience with Azure Data Factory in environments. Proven ability in managing and deploying event streaming platforms like Kafka and NATS. Experience with implementing security practices and tools, including Keycloak, across multiple platforms. Strong background in managing Elasticsearch and PostgreSQL in environments that ...

Tech: Core Java, JDBC, Kafka, HDFS, Docker, SQL, MultithreadingChallenge: Greenfield Big Data Analysis Platform Development in FSFirm: Well-known Financial Data fintech50 business, City of London, 10 man flat Dev TeamPay: 85k, Options, training budget, Pension, Life/Health, Some Work from HomeNO FINANCE EXPERIENCE NEEDEDCore Java Developer … technology and the possibility of making serious money doing something you are passionate about. My client is based in LondonCore Java, JDBC, Kafka, HDFS, Docker, SQL, Multithreading ...