26 to 36 of 36 Kafka Jobs in Central London

will help unlock smarter, faster decision-making. Key Actions Work with Data Engineering team to implement robust and trustworthy data to support high-performance Kafka streams and predictive models Deploy and maintain machine learning models as APIs for use in our live environments Employ a variety of languages ...

Interest in financial data (experience helpful but not required) Nice to have: DuckDB experience Time-series experience (market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation ...

analytics, automation, and data processing. Build trader- and portfolio manager-facing tools, dashboards, and interfaces. Implement event-driven patterns and streaming services using Kafka . Develop cloud-ready components and services within AWS (preferred) or similar environments. Contribute to DevOps processes using Azure DevOps , Git, and Docker … C#/.NET for backend engineering. Strong experience with SQL and database architecture. Practical experience using Python for tools, automation, or analysis. Understanding of Kafka or comparable streaming/messaging technologies. Experience building and deploying within AWS cloud environments. Familiarity with Azure DevOps , Git workflows, and Docker containers. Background ...

optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services Palantir Foundry Stakeholder Engagement Why Apply? Work on mission-critical ...

Snowflake warehouse. Manage and mentor a team of Data Engineers in a player/coach capacity. Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark. Evolve a configuration-driven platform enabling non-engineers to define regulatory logic. Ensure pipelines are auditable, lineage-aware, idempotent, and resilient … tools. Ability to translate complex regulatory requirements into technical specifications. High ownership mindset and accountability for delivery and reliability. Nice-to-Haves Experience with Kafka or other event streaming platforms. Hands-on experience with AWS cloud infrastructure. Experience building new data platforms or modernizing legacy systems. FinTech, RegTech ...

Java Architect (with Capital Markets exp.) Project description We are building an end-to-end client lifecycle management solution, where technology drives procedural automation and standardization. Our solution includes industry-leading modules and tools widely ...

supporting APIs and microservices in production Developing backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Working with event-driven systems (Kafka, SNS/SQS, etc.) Supporting and improving existing production systems Debugging real-world issues and keeping systems stable at scale Collaborating within an existing team … + codebase (pragmatic engineering) Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) Databases (Postgres, DynamoDB, Couchbase) CI/CD (Concourse, Git workflows) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience (Python preferred) Experience building and supporting ...

Designing and delivering scalable APIs and microservices Building backend systems using Python + AWS (Lambda, API Gateway, S3, DynamoDB) Handling event-driven architectures (Kafka, SNS/SQS, etc.) Driving system design decisions across distributed systems Improving observability, reliability, and performance in production Debugging complex issues and leading resolution across … teams Staying hands-on while setting technical direction and standards Tech Stack Python AWS (Lambda, API Gateway, S3, DynamoDB, IAM) Event-driven systems (Kafka, SNS/SQS) CI/CD (Concourse, Git workflows) Databases (Postgres, DynamoDB, Couchbase) Observability (Prometheus, Grafana, CloudWatch) What You’ll Bring Strong backend engineering experience ...

About the Job you are considering: This role involves designing, building, and supporting large‐scale Big Data solutions using Hadoop and Spark technologies. You will primarily develop and debug Spark jobs in Scala, with opportunities ...

enrichment workflows, graph modelling, and stakeholder reporting on metrics. Ideally you will possess data quality analyst capabilities and/or focus on pipeline architecture, Kafka integration patterns, and export service development. These roles will entail writing production code, both will engage with data quality, and both will contribute … months. About the role/Experience with: Experience with Python for data pipelines, export services, ETL, reconciliation, profiling scripts Data quality assessment Apache Kafka PostgreSQL for data modelling, query design, migrations etc Data modelling and schema design REST API design Ideally you will have: Experience of C# ...

Lead Data Engineer Tech Stack: Python | Spark | Kafka | Airflow | Vector DBs Location: London - office based Salary: Up to £140k + equity We’re partnering with a well-funded AI startup building a category-defining platform within a major UK industry undergoing rapid transformation. This is a first data hire … looking for: • 7+ years in Data/Backend Engineering • Strong Python and distributed systems experience • Hands-on with modern data tooling (Spark, Airflow, Kafka, etc.) • Experience with relational + NoSQL databases (vector DBs a big plus) • Comfortable in a fast-paced, early-stage environment 💡 High ownership, strong engineering culture ...