24 of 24 Permanent Kafka Jobs in the City of London

partner technologies for modernization Design architectures incorporating: Mainframe ‘In-place modernization and optimization’ , and Mainframe ‘Exit-to-Cloud’ Event-driven architectures (AWS EventBridge, Apache Kafka, IBM MQ) for real-time integration and decoupling. Strangler Fig patterns for incremental modernization without disrupting business operations. Domain-driven design , microservices ...

Experienced with any of the following: Cloud technologies AWS modules: CloudWatch (logging), Athena, EC2, Lambda, storage (S3, EBS), databases (RDS, DynamoDB) stream-processing platform: Kafka, webhook, protos Docker and Kubernetes (nice to have ...

version control systems (e.g., Git). Experience with Agile development methodologies. Excellent communication, interpersonal, and problem-solving skills. Experience with streaming data technologies (e.g., Kafka, Azure Event Hubs). Experience with data visualisation tools (e.g., Tableau, Power BI). Experience with DevOps tools and practices (e.g., Azure DevOps, Jenkins ...

Skills: Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. ...

financial services, or banking systems. Strong communication skills and a bias toward action and opinionated design decisions. Nice to Have : Familiarity with messaging systems (Kafka, RabbitMQ, etc.) Exposure to container security and performance tuning on OpenShift. Knowledge of payment gateways, ISO 20022, or SWIFT formats. • Collaborative, fast-paced ...

based workflows, code reviews, and CI/CD practices. Preferred Qualifications: Experience with Azure cloud services. Exposure to streaming or event-driven architectures (e.g., Kafka, Kinesis). Experience with infrastructure as code (e.g., Terraform) and containerisation (e.g., Docker, Kubernetes). Understanding of data governance, lineage, cataloguing, and security best ...

workflows, code reviews, and CI/CD practices. Preferred Qualifications: Have used Azure cloud services previously Experience with streaming/event-driven systems e.g., Kafka/Kinesis Experience with infrastructure as code e.g., Terraform and containerization e.g., Docker/Kubernetes Familiarity with data governance, cataloging, lineage, and privacy/ ...

beyond the Databricks ecosystem * dbt or equivalent SQL transformation layer; experience building and maintaining dbt projects in a production data warehouse * Event streaming with Kafka or Confluent Platform - topic design, consumer group management, exactly-once delivery guarantees * OLAP-optimised stores - ClickHouse, DuckDB, or equivalent; understanding of columnar storage ...

related technologies CI/CD: Experience building and maintaining pipelines using tools such as GitHub Actions Microservices: Familiarity with microservices and event-driven architectures (Kafka knowledge is beneficial) Communication: Strong interpersonal skills with the ability to collaborate across teams Benefits 25 days annual leave plus bank holidays Hybrid working ...

data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda is a plus. Direct experience in building and applying large-scale (100M+ users) machine learning solutions for personalizing recommendations. Hands-on experience building training frameworks and/ ...

Microsoft Azure Data Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience with streaming solutions (Kafka, Event Hubs, Spark Streaming) (desirable). Knowledge of machine learning and AI on Databricks (desirable). Benefits of working at Canada Life We believe ...

DevOps experience, within tools such as Terraform, ArgoCD, Helm, or other IaC Degree within Computer Science, ideally at Masters or PhD level Experience with Kafka, Spark, Trino would be beneficial If interested, please apply below with your CV. ...

Strong Background and experience in Data Ingestions, Transformation, Modeling and Performance tuning. Should have experience in designing and developing dashboards Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Should have experience in creating roadmap to improve platform Observability Experience in leading mid-scale teams with strong communication skills Experience ...

proactive, and a strong problem solver Able to work both independently and as part of a team Tech Stack Ubuntu, Python, Ansible, Docker, Kubernetes, Kafka, LXC/LXD, Grafana, Prometheus Spectrum IT Recruitment (South) Limited is acting as an Employment Agency in relation to this vacancy. ...

such as Oracle and/or Couchbase Cloud experience Understanding of responsive design and frontend performance Systems & Tooling Messaging/event-driven systems (e.g. Kafka , ActiveMQ, AmazonMQ) Observability tools (e.g. Prometheus, Grafana, CloudWatch) CI/CD pipelines and build tools (e.g. Concourse, Git-based workflows) Experience debugging and supporting ...

excellent C# or Java Engineer (Codebase contains both languages), but also someone with AI, distributed systems and database exposure. Stack: C# or Java, Kubernetes, Kafka, React, LLMs The firm can offer market leading salaries, coupled with a hybrid working model. If you're interested in building high-impact trading ...

Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help ...

Mindset: A strong philosophy on what makes a "good" SLO and a passion for eliminating toil through automation. Technical Breadth: Experience with message brokers (Kafka, ActiveMQ), containerization (Nomad/Docker), and troubleshooting distributed systems. Systems Thinking: A passion for both software development and reliability engineering, applying discipline to solve ...

team, aiding their growth and acting as a force multiplier through your technical leadership. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient in regulated environments. Implement robust data quality controls including testing, validation, monitoring, and alerting. … technical specifications. Ability to work autonomously with a high degree of accountability for the systems you build and maintain. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

Java Architect (with Capital Markets exp.) Project description We are building an end-to-end client lifecycle management solution, where technology drives procedural automation and standardization. Our solution includes industry-leading modules and tools widely ...

supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems stable at scale Collaborating within an existing team … + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience (Python preferred) Experience building and supporting ...

Designing and delivering scalable APIs and microservices Building backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Handling event-driven architectures (Kafka, SNS/SQS, etc.) Driving system design decisions across distributed systems Improving observability, reliability, and performance in production Debugging complex issues and leading resolution across … teams Staying hands-on while setting technical direction and standards Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) CI/CD (Concourse, Git workflows) Databases (Postgres, DynamoDB, Couchbase) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience ...

during this busy period and be able to add value to their Python team. The Python Developer will need to have worked with Python, Kafka, Open APIs. They need a solid engineer who will hit the ground running and be able to get on with the tasks in hand. … Experience Needed Highly experienced Python Engineer/Developer Can hit the ground running and make an impact from early Technology needed: Python, Kafka, Flask, OpenAPI + FastAPI Excellent communication and collaborative skills needed Python Developer Day Rate: £400 Outside IR35 Duration: 6-months Start Date: ASAP (No long notice ...

Lead Data Engineer Tech Stack: Python | Spark | Kafka | Airflow | Vector DBs Location: London - office based Salary: Up to £140k + equity We’re partnering with a well-funded AI startup building a category-defining platform within a major UK industry undergoing rapid transformation. This is a first data hire … looking for: • 7+ years in Data/Backend Engineering • Strong Python and distributed systems experience • Hands-on with modern data tooling (Spark, Airflow, Kafka, etc.) • Experience with relational + NoSQL databases (vector DBs a big plus) • Comfortable in a fast-paced, early-stage environment 💡 High ownership, strong engineering culture ...