51 to 75 of 218 Kafka Jobs in London

few of the open-source libraries we use extensively. We implement the systems that require the highest data throughput in Java and C++. We use Airflow for workflow management, Kafka for data pipelines, Bitbucket for source control, Jenkins for continuous integration, Grafana + Prometheus for metrics collection, ELK for log shipping and monitoring, Docker and Kubernetes for containerisation, OpenStack … the challenges of dealing with large data sets, both structured and unstructured Used a range of open source frameworks and development tools, e.g. NumPy/SciPy/Pandas, Spark, Kafka, Flink Working knowledge of one or more relevant database technologies, e.g. Oracle, Postgres, MongoDB, ArcticDB. Proficient on Linux Advantageous: An excellent understanding of financial markets and instruments An understanding More ❯

company are profit making, have team members globally with over 500 employees, very established and very reputable. Other key skills: Rust, TDD, BDD, Microservices, AWS, Distributed Systems, PY03, SQL, Kafka, Docker, Kubernetes, Tokio, Async Apply for immediate consideration for this excellent Rust Engineer opportunity! Understanding Recruitment is acting as an employment agency for this Rust Engineer vacancy. More ❯

through the system every second. You'll play a key role in developing a fully scalable platform, that can accommodate ever-changing customer demand, using technology such as GCP, Kafka, Kubernetes, and Gitlab. You'll have ownership of a core product domain, while also having a say in establishing best practices and key strategies. You will be responsible for More ❯

instincts and attention to detail Strong communicator who works well across technical teams Bonus Points If You Have: Familiarity with Docker/Kubernetes Experience with other messaging platforms like Kafka, RabbitMQ, or MQ Exposure to DevOps pipelines and CI/CD tools Experience deploying in AWS, Azure, or GCP More ❯

and know what it takes to deliver secure, scalable solutions in a high-growth environment. Skills & Experience Strong hands-on technical background, with experience in: Python, ReactJS, REST APIs, Kafka, SQL databases SaaS architecture on AWS Proven leadership of software development teams in agile environments Deep understanding of DevOps, CI/CD, and SDLC best practices Experience managing cloud More ❯

solving skills Comfort working within a globally-distributed team A background in some of the following a bonus: Java experience Python experience Ruby experience Big data technologies: Spark, Trino, Kafka Financial Markets experience SQL: Postgres, Oracle Cloud-native deployments: AWS, Docker, Kubernetes Observability: Splunk, Prometheus, Grafana For more information about DRW's processing activities and our use of job More ❯

Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development & DevOps: Strong programming and scripting skills in Python. Knowledge of Event-Driven Architectures (Kafka). Collaborate with DevOps teams to implement CI/CD pipelines and infrastructure as code using tools like Terraform, CloudFormation, and Ansible. Implement and manage monitoring and observability tools More ❯

and various platforms, including Azure, SQL Server. NoSQL databases is good to have. Hands-on experience with data pipeline development, ETL processes, and big data technologies (e.g., Hadoop, Spark, Kafka). Experience with DataOps practices and tools, including CI/CD for data pipelines. Experience in medallion data architecture and other similar data modelling approaches. Experience with data visualization More ❯

team of engineers whilst operating collaboratively across cross-functional teams Strong software development skills (problem decomposition, design, implementation, testing) Expertise in Java with experience in Spring, Unix, SQL, AMPS, Kafka, AWS, EKS, Kubernetes, FIX Excellent written and oral communication skills. Equal Employment Opportunity and Affirmative Action Statement PIMCO recruits and hires qualified candidates without regard to race, national origin More ❯

Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of Data virtualization Production management (L3 support) experience Any Beneficial/Nice to have skills and More ❯

/Kubernetes). Experience working in environments with AI/ML components or interest in learning data workflows for ML applications . Bonus if you have e xposure to Kafka, Spark, or Flink . Experience with data compliance regulations (GDPR). What you can expect from us: Opportunity for annual bonuses Medical Insurance Cycle to work scheme Work from More ❯

contracts, gRPC etc) to co-design solutions with our other engineers Working knowledge of microservices architecture Working knowledge of distributed event stream platforms for high-performance data pipelines (e.g. Kafka etc) What's in it for you 401k matching + Competitive equity package Excellent Medical, Dental and Vision health benefits Fertility & Family Forming Benefits Flexible time off Lunch, snacks More ❯

experience with Terraform for infrastructure as code, enabling scalable and reliable systems. Experience with monitoring and observability tools, such as Datadog or Prometheus. Familiarity with event-driven systems, particularly Kafka and/or RabbitMQ. Deep understanding of messaging and queuing systems, including design patterns for reliability, retries, and scaling. Strong understanding of PostgreSQL for relational database systems. Experience working More ❯

experience with Terraform for infrastructure as code, enabling scalable and reliable systems. Experience with monitoring and observability tools, such as Datadog or Prometheus. Familiarity with event-driven systems, particularly Kafka and/or RabbitMQ. Deep understanding of messaging and queuing systems, including design patterns for reliability, retries, and scaling. Strong understanding of PostgreSQL for relational database systems. Experience working More ❯

Lead Backend Software Engineer/Developer (Java Kafka SpringBoot) London/WFH to £120k Are you a skilled Backend Software Engineer with strong Java and real-time messaging experience combined with SC Clearance? You could be progressing your career in a senior, hands-on Lead Backend Software Engineer position at a scale-up technology company with a successful workforce … colleagues in the London office once a week. About you: You have significant experience as a backend focussed Java software engineering with leadership responsibilities You have strong Spring Boot, Kafka and event driven microservices experience with high throughput You have leadership, mentoring and coaching skills You have a strong understanding of system-level concerns: observability, availability, resilience You have … day a week in London office Pension, Healthcare Impactful role with excellent career progression Apply now to find out more about this Lead Backend Software Engineer/Developer (Java Kafka SpringBoot) opportunity. At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We're an equal opportunities employer whose More ❯

Lead Java Developer/Software Engineer (Java Kafka Spring Boot) London/WFH to £120k Are you a skilled Java Developer with strong Java and real-time messaging experience combined with SC Clearance? You could be progressing your career in a senior, hands-on Lead Java Developer position at a scale-up technology company with a successful workforce management … colleagues in the London office once a week. About you: You have significant experience as a backend focussed Java software engineering with leadership responsibilities You have strong Spring Boot, Kafka and event driven microservices experience with high throughput You have leadership, mentoring and coaching skills You have a strong understanding of system-level concerns: observability, availability, resilience You have … day a week in London office Pension, Healthcare Impactful role with excellent career progression Apply now to find out more about this Lead Java Developer/Software Engineer (Java Kafka Spring Boot) opportunity. At Client Server we believe in a diverse workplace that allows people to play to their strengths and continually learn. We're an equal opportunities employer More ❯

of functional programming so you can expect to join a team that is applying principles from FP, Reactive Programming and Distributed Computing to build these services, using Scala, Akka, Kafka, Play and Cats, as well a wide range of cloud-native technologies including AWS (Kinesis, DynamoDB, Lambda), Docker and Serverless. We have a mature DevOps culture in place, where … the team is responsible for the infrastructure and deployment of those applications - "You build it, you run it." What you will do: You will be using Scala , Akka , Kafka , Kinesis , and Dynamo to build and innovate our software that is distributed, reactive, and scalable. You will: Lead a product engineering team, ultimately responsible for the delivery of that product More ❯

working in Agile teams and communicating clearly across engineering, product, and security stakeholders Passionate about improving developer experience and contributing to team knowledge-sharing Nice to Have: Experience with Kafka, gRPC, GraphQL, or policy-as-code tools like Sentinel or OPA Contributions to internal or open-source platforms Familiarity with building cost-optimized and compliant infrastructure in regulated environments More ❯

working in Agile teams and communicating clearly across engineering, product, and security stakeholders Passionate about improving developer experience and contributing to team knowledge-sharing Nice to Have: Experience with Kafka, gRPC, GraphQL, or policy-as-code tools like Sentinel or OPA Contributions to internal or open-source platforms Familiarity with building cost-optimized and compliant infrastructure in regulated environments More ❯

modern front-end workflows Solid knowledge of Docker (Kubernetes experience a plus) Experience shipping SaaS platforms end-to-end Strong communication and debugging skills Bonus if youve worked with: Kafka, GraphQL, GitHub Actions, Jenkins, or Golang. ?? Why Valent? Mission-led : Build tools that protect global information integrity. High impact : Direct involvement in a vital AI system used by governments More ❯

software engineering background with advanced Python and PySpark coding skills You have experience in batch, distributed data processing and near real-time streaming data pipelines with technologies such as Kafka You have experience of Big Data Analytics platform integration with AWS You have a strong understanding of RDBMS, Data Warehousing, Data Modelling, SQL (Redshift, PostgreSQL) and NoSQL databases You More ❯

you will need to be able to: Work on large-scale, multiple industries, eCommerce and enterprise-level software development projects using languages and technologies such as Java, SpringBoot, Azure, Kafka, AWS and SQL. Experience with low latency systems Experience with high throughput scalable applications Knowledge of Hazelcast Knowledge of audio streaming/encoding and byte analysis techniques Champion software More ❯

data sets Strong knowledge of algorithms, design patterns, OOP, threading, multiprocessing, etc. Experience with SQL, NoSQL, or tick databases Experience working in a Unix environment and git Familiarity with Kafka, Docker, AirFlow, Luigi Strong communication skills in verbal and written English. Domain knowledge in futures & swaps is a plus Highly competitive compensation and bonus structure Meritocratic environment with ample More ❯

paced environment, handling multiple stakeholders effectively. Excellent communication skills with the ability to translate technical findings into business insights Nice-to-Have Qualifications: Experience with streaming technologies such as Kafka or similar. Familiarity with containerization and orchestration (Docker and ECS) for data workflows. Exposure to BI tools such as Tableau or Power BI for data visualization. Understanding of machine More ❯

Job Description Tadaweb is a pioneering technology company with roots in Luxembourg and a growing global presence, with offices in the United Kingdom, France, and the United States. For over 13 years, we’ve been on a mission to make More ❯