251 to 275 of 713 Kafka Jobs in London

relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes-based deployment ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI ...

Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such as PythonReporting ...

about performance, cost, and access patterns in real‐world environments. Streaming & event‐driven data: You understand how data flows through streaming systems such as Kafka or similar platforms, including producer and consumer behavior, lag, delivery semantics, and how streaming issues propagate into downstream datasets and analytics. Data quality, lineage ...

optimization. GitLab: Strong knowledge of version control systems and CI/CD pipelines. REST API Services: Proficient in designing and consuming RESTful web services. Kafka: Skilled in implementing real‐time data pipelines and messaging systems. Splunk: Expertise in monitoring, logging, and troubleshooting application performance. Team Leadership: Proven experience ...

related field is preferred. Preferred Skills Familiarity with cloud services like AWS, Google Cloud, or Azure. Experience with big data tools: Hadoop, Spark, Kafka, etc. Knowledge of data integration tools like Informatica, Talend, etc. Understanding of machine learning algorithms and statistics. Experience with data visualization tools like Tableau, PowerBI ...

primary focus, but you'll also work across the core trading platform as it develops. Technology stack: Java/Python, AWS, Linux, Postgres, Kafka, Git. Requirements Solid working knowledge of Python and/or Java. Practical experience with relational databases and SQL (e.g. Postgres). Working command of Linux. ...

both high-level and low-level languages (Python & C++ or similar). Familiarity with modern distributed computing platforms (specifically: docker, kubernetes, ceph, mongodb & kafka). Theoretical proficiency in numerical computing, online algorithms, data structures, networking, databases, and operating systems. Familiarity with typical quantitative research toolchains including Numpy, Polars, Scikitlearn ...

plus. Nice to have experience: AWS Aurora Databricks PostgreSQL Exposure to or interest in the cryptocurrency technology ecosystem Technologies we use: PostgreSQL Java Kafka Terraform, K8, CDK Cloud Technologies including AWS We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. ...

Python Hands-on experience with building and deploying data pipelines, gained through internship, academic, or personal projects Familiarity with modern infrastructure (CI/CD, Kafka, Airflow) Excellent communication and collaboration skills Detail orientated, with a commitment to best engineering practices The ability to prioritise, plan and deliver to projects ...

Familiarity with developing, testing and deploying with cloud providers (e.g. AWS, GCP, Azure). Experience with integrating with external/vendor APIs. Familiarity with Kafka messaging. Firm Mirae Asset Securities Co., Ltd. is the largest investment banking and stock brokerage company by market capitalisation in South Korea. It provides ...

sandbox environments, with cloud experience; GCP is advantageous Knowledge of microservices, gRPC, API design, asynchronous messaging and platforms such as Pub/Sub or Kafka Strong testing, communication and collaboration skills, alongside a genuine interest in understanding how systems are compromised Desirable Experience: Experience in offensive security, penetration testing ...

Python Hands-on experience with building and deploying data pipelines, gained through internship, academic, or personal projects Familiarity with modern infrastructure (CI/CD, Kafka, Airflow) Excellent communication and collaboration skills Detail orientated, with a commitment to best engineering practices The ability to prioritise, plan and deliver to projects ...

ClickHouse.- Strong Python and SQL skills.- Production experience with Java or Kotlin. We will also consider strong experience in another systems language.- Experience with Kafka or another streaming or near-real-time data platform.- Experience with Kubernetes, CI/CD, monitoring, logging, and alerting.- The ability to diagnose technical ...

Preferred Qualifications, Capabilities, and Skills: Experience with Java 21 Familiarity with Spring framework and Spring Boot Knowledge of RDBMS and NoSQL databases Experience with Kafka Expertise in microservices architecture Ability to leverage AI tools like MCP servers and Claude to enhance productivity #J-18808-Ljbffr ...

high‐performance, high‐concurrency, and highly available systems. Familiar with distributed systems and core backend technologies such as microservices architecture, message queues (such as Kafka/RabbitMQ), and service discovery (such as Etcd/ZooKeeper). Experienced with both SQL (such as MySQL/PostgreSQL) and NoSQL (such ...

skills in both high-level and low-level languages (Python & C++ or similar).Familiarity with modern distributed computing platforms (specifically: docker, kubernetes, ceph, mongodb & kafka).Theoretical proficiency in numerical computing, online algorithms, data structures, networking, databases, and operating systems. Familiarity with typical quantitative research toolchains including Numpy, Polars, Scikitlearn ...

security data strategy aligned with business and regulatory requirements Qualifications Strong experience with Elastic Stack and data engineering technologies such as Logstash, Beats, Kafka or similar Expertise in Elastic data modelling, indexing and performance optimisation Experience designing scalable log collection and processing architectures Knowledge of data governance, retention ...

automated testing, Kubernetes, and continuous integration and delivery workflow. Preferred QualificationsDeep knowledge and interest in real-time data processing with technologies such as Kafka Streams, ClickHouse, Flink, and similar. Familiarity with relational, document-based, or vector datastores. Familiarity with AI-assisted development tools such as Kosmos, Codex, or Claude. ...

ideal candidate will have the following skills and experience: Strong experience with Elastic Stack and data engineering technologies such as Logstash, Beats, Kafka or similarExpertise in Elastic data modelling, indexing and performance optimisationExperience designing scalable log collection and processing architecturesKnowledge of data governance, retention and security telemetry across cloud ...

practices (CI/CD). Knowledge of big data technologies (Hadoop, Spark, Flink). Knowledge of NoSQL databases (MongoDB, Cassandra, DynamoDB), message queueing systems (Kafka, RabbitMQ), and version control systems (Git). Preferred Skills: Hugging Face Transformers. Familiarity with time‐series databases and analysis tools. Knowledge of AI model ...

features and close collaboration across teams. Proficiency in Java (preferred) or solid experience with similar backend programming languages. Familiarity with messaging systems such as Kafka or RabbitMQ, and strong knowledge of relational databases (SQL).Excellent communication and collaboration skills, combined with a growth mindset and focus on delivering user ...

features and close collaboration across teams. Proficiency in Java (preferred) or solid experience with similar backend programming languages. Familiarity with messaging systems such as Kafka or RabbitMQ, and strong knowledge of relational databases (SQL).Excellent communication and collaboration skills, combined with a growth mindset and focus on delivering user ...

engineering environments Desirable Experience with cloud-based risk platforms and pricing engines Azure Kubernetes Service (AKS) Azure Data Lake Microservices and event-driven architectures Kafka, Redis, Spark, HBase, and HDFS Market Risk platforms covering VaR, Stress Testing, and FRTB Risk exposure reconciliation and reporting platforms Enterprise scheduling tools such ...