201 to 225 of 713 Kafka Jobs in London

building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills ...

implement database schemas, write and optimise SQL queries against PostgreSQL databases handling high-volume transactional data Build and maintain event-driven architectures using Apache Kafka for asynchronous processing of financial events across distributed services Develop and maintain a payment orchestration system that dynamically routes payments across Payment Service Providers ...

implement database schemas, write and optimise SQL queries against PostgreSQL databases handling high-volume transactional dataBuild and maintain event-driven architectures using Apache Kafka for asynchronous processing of financial events across distributed servicesDevelop and maintain a payment orchestration system that dynamically routes payments across Payment Service Providers to optimize ...

Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such as PythonReporting ...

concepts (immutability, referential transparency, algebraic design) .Web services architecture knowledge (REST, , stack, JSON codecs)Familiarity with message brokers/event-driven boundaries (e.g., Apache Kafka) .Good understanding of local development tooling and environments. Experience working with payment platforms such as Stripe, Google Pay or Apple Pay. Experience with authentication ...

commercial development experience, with strong skills in Python. Hands‐on experience with building and deploying data pipelines Familiarity with modern infrastructure (CI/CD, Kafka, Airflow) Excellent communication and collaboration skills Detail orientated, with a commitment to best engineering practices The ability to prioritise, plan and deliver to projects ...

integrity, self-motivation, and a commitment to continuous learning Experience in any of the following would be advantageous: Middleware and messaging technologies such as Kafka, IBM MQ, or ACE Software architecture technologies including XBRL and HTML Banking, financial services, or regulated industry experience #J-18808-Ljbffr ...

commercial development experience, with strong skills in Python. Hands-on experience with building and deploying data pipelines Familiarity with modern infrastructure (CI/CD, Kafka, Airflow) Excellent communication and collaboration skills Detail orientated, with a commitment to best engineering practices The ability to prioritise, plan and deliver to projects ...

compute management at scale, including technologies such as SLURM Strong understanding of event-driven architecture and experience with messaging and caching technologies such as Kafka, Solace, Pulsar, Memcache, and Redis Experience building AI RAG and MCP agents Experience with monitoring and observability tools such as Datadog ...

build within a latency budget Hands-on experience with SQL and/or NoSQL databases and exposure to event-driven architectures such as Kafka Willingness to operate what you build, including sharing on-call duties, with a pragmatic approach to reliability Use AI tooling in day-to-day development ...

strong track record delivering large-scale distributed systems in cloud environmentsDeep knowledge of API design - REST and GraphQL, and substantial hands-on experience with Kafka in a production environmentSolid cloud platform experience, particularly AWS, and comfort with containerised infrastructureProficiency in TypeScript across a modern backend stackExperience leading and influencing ...

essential:* **Languages:** Python, SQL, Terragrunt, JavaScript* **Cloud:** AWS (primary), some GCP* **Warehouse & Storage:** Snowflake, S3/Parquet* **Data & ETL:** dbt, Fivetran* **Platform & Infra:** Kubernetes, Kafka, RabbitMQ, Argo, GitHub Actions, HashiCorp Vault* **Observability:** Datadog, Grafana* **Dashboarding:** Preset* **Other**: Claude### **What we’re looking for**Strong fundamentals and the ability ...

real-time applications using WebSockets or streaming technologies. Ability to contribute to architectural discussions and operate independently in complex production environments. Nice to have Kafka, Solace, or TIBCO EMS. SQL Server, MongoDB, and S3/Object Storage. Kubernetes and OpenShift. OpenTelemetry, ELK Stack, Grafana. HashiCorp Vault and CyberArk. Prime ...

understanding of CI/CD, automation and DevOps practices Experience mentoring engineers and providing technical leadership Key Technologies AWS Terraform Linux Cassandra Couchbase ScyllaDB Kafka CI/CD Pipelines Observability & Monitoring Platforms Distributed Database Technologies Nice to Have Experience with additional distributed persistence technologies Background in large-scale cloud ...

application development Familiarity with relational databases (e.g., Postgres) and AWS services such as S3, EKS, SageMaker, and Bedrock Practical experience with Kubernetes, EKS, Docker, Kafka, MLOps and Large Language Model Operations (LLMOps) Experience working on AIML systems and/or prior experience collaborating with data scientists #J-18808-Ljbffr ...

sOur Tech StackWe use GitHub Copilot for agentic developmentOur services are written in modern C# and RustWe use a fair bit of SQL databases, Kafka, and RabbitMQWe run some services on dedicated hardware and on AWSWe use Azure DevOps for build/deploy pipelines and story managementOur observability stack ...

architectures Experience developing, debugging, and maintaining code with modern programming languages and database querying languages Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development ...

plus Experience with finance/derivative products. Knowledge of Convertible Bonds is a plus Experience of publish/subscribe messaging protocols such as Kafka , AMQP, AMPS Experience with C#/WPF desktop application programming Exposure to Relational Database Management Systems (Sybase) Experience of Cloud technologies Exceptional client relationship skills ...

utilizing FastAPI to serve machine learning insights. Deploy and manage cloud-native services using strong AWS knowledge and Infrastructure as Code (IaC) principles. Leverage Kafka to deliver near real time data to our machine learning models, other teams, or directly to customers. Use AI throughout the software development lifecycle ...

OTelDesirable Skills: Experience with cloud-native and distributed SQL database, such as Aurora, YugabyteDB or TiDBKnowledge of data streaming and integration tools, including Kafka, Debezium and CDC pipelinesExperience with security and compliance in database environments, for example covering encryption, auditing and RBACFamiliarity with DataOps practices and collaboration with Data ...

architectures Experience developing, debugging, and maintaining code with modern programming languages and database querying languages Experience in large‐scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal) Demonstrated experience leading effective use of enterprise‐authorized AI‐assist­ed software development ...

experience with cloud‐native and distributed SQL databases such as Aurora, YugabyteDB or TiDB Desirable: knowledge of data streaming and integration tools such as Kafka, Debezium and CDC pipelines Desirable: experience with security and compliance in database environments, covering encryption, auditing and RBAC Desirable: familiarity with DataOps practices ...

data lake architecturesExperience developing, debugging, and maintaining code with modern programming languages and database querying languagesExperience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, Observability tools (Dynatrace, Splunk, Grafana), and Orchestration tools (Airflow, Temporal)Proficiency in automation, continuous delivery methods, and all aspects of the Software ...

highly performant codeDeep experience building and operating microservices, with a solid understanding of event-driven architecture, distributed system and concurrency patternsHands-on experience with Kafka or similar messaging systems, including designing and owning robust, scalable event pipelinesProficiency with relational and non-relational databases, including query optimization, schema design ...

data pipelines using Delta Lake, Spark Structured Streaming, Unity Catalog, and Azure-native services. Build real-time, event-driven solutions using technologies such as Kafka and Azure Event Hubs, applying AI-enabled engineering approaches where appropriate to improve delivery efficiency. Develop and maintain CI/CD pipelines using Azure ...