23 of 23 Kafka Jobs in the Thames Valley

MLOps tooling such as Kubernetes, Docker, MLflow, Airflow, Terraform, and CI/CD. Preferred Skills Data Streaming and Orchestration: Familiarity with tools such as Kafka, Flink, Spark, dbt, and Airflow. Multi-Modal LLM Systems: Experience with multi-modal LLM systems (text + image embeddings). AI Observability and Evaluation ...

Docker) Big Data Technologies (Apache.... Spark, Flink, HDFS, Airflow, Trino, Iceberg, Hive) Dependency injection frameworks (Spring) Observability (Loki/Grafana) Large scale data processing (Kafka) CI/CD Build tools ( Maven, Git, Jenkins ) NoSQL DBs (Cockroach DB, Cassandra, Zookeeper, ArangoDB) Your responsibilities: Design, implement and provide architectural guidance ...

Docker) Big Data Technologies (Apache.... Spark, Flink, HDFS, Airflow, Trino, Iceberg, Hive) Dependency injection frameworks (Spring) Observability (Loki/Grafana) Large scale data processing (Kafka) CI/CD Build tools ( Maven, Git, Jenkins ) NoSQL DBs (Cockroach DB, Cassandra, Zookeeper, ArangoDB) Your responsibilities: Design, implement and provide architectural guidance ...

Integrate with enterprise procurement ecosystems—major systems such as SAP, Oracle, Coupa, and GEP ERP, GraphQL/REST APIs, SFTP feeds, and event buses (Kafka, Pulsar) Wrangle large, heterogeneous procurement datasets—model, transform, and index multi-modal, multi-terabyte enterprise contract and vendor data for advanced negotiation workloads ...

building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills ...

Core Tech Stack Languages: Python (FastAPI, Flask, or Django) Cloud: AWS (Lambda, ECS/Fargate, S3, DynamoDB, CloudWatch, API Gateway) Data & Messaging: PostgreSQL, Redis, Kafka or SQS CI/CD & Infrastructure: Docker, Terraform, GitHub Actions, CloudFormation Monitoring & Observability: Prometheus, Grafana, OpenTelemetry Testing: Pytest, integration and load testing frameworks ...

similar tools Web services technology such as REST, JSON or Thrift Testing web applications with Selenium WebDriver Big data technology such as Hadoop, MongoDB, Kafka or SQL Network principles and protocols such as TLS and TCP Continuous integration systems such as Jenkins or Bamboo Continuous delivery concepts What ...

Purview, Unity Catalog, or Apache Atlas to ensure data integrity and compliance. Exposure to Streaming/Event-Based Technologies: Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming for real-time data processing and event-driven architectures. Understanding of SOLID Principles: Familiarity with the SOLID principles ...

Purview, Unity Catalog, or Apache Atlas to ensure data integrity and compliance. Exposure to Streaming/Event-Based Technologies: Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming for real-time data processing and event-driven architectures. Understanding of SOLID Principles: Familiarity with the SOLID principles ...

optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). DevOps Principles: Experience with version control (git) and CI/CD for data pipelines. BI/Visualisation: Familiarity with ...

optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). DevOps Principles: Experience with version control (git) and CI/CD for data pipelines. BI/Visualisation: Familiarity with ...

optimisation. Programming Proficiency: Proficiency in Python and Bash (for data processing, scripting, and automation). Data Streaming: Familiarity with streaming data technologies (e.g., Kinesis, Kafka, or similar). DevOps Principles: Experience with version control (git) and CI/CD for data pipelines. BI/Visualisation: Familiarity with ...

maintain data pipelines, leveraging PySpark and/or Typescript within Foundry, to transform raw data into reliable, usable datasets. Familiarity with Palantir Foundry, PySpark, Kafka, TypeScript, PowerBI preferable. Assist in preparing and optimizing data pipelines to support machine learning and AI model development, ensuring datasets are clean, well-structured ...

TensorFlow, PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless) Running discovery experiments and validating concepts ...

platforms that operate at large scale, processing millions or billions of events daily. Experience of Agile delivery practices and iterative product development. Experience with Kafka or other event streaming technologies. Familiarity with data governance and compliance requirements in complex organisations. Comfortable with approaches that prioritise learning quickly and shaping ...

platforms that operate at large scale, processing millions or billions of events daily. Experience of Agile delivery practices and iterative product development. Experience with Kafka or other event streaming technologies. Familiarity with data governance and compliance requirements in complex organisations. Comfortable with approaches that prioritise learning quickly and shaping ...

delta one, store of value, or FICC options trading. Experience with Linux-based, concurrent, low-latency systems. Familiarity with Airflow/Dagster (pipeline orchestration), Kafka (streaming), Delta Lake/Apache Iceberg (data lakes), and relational databases. Exceptional communication skills, comfortable working directly with both engineers and business stakeholders. Degree ...

value being on-site 3 days a week has in building culture, fostering innovation, and supporting effective communication. Nice to have Experience with Kafka or other streaming platforms Experience with data quality frameworks like Great Expectations Experience with Delta Lake or modern data lake architectures ...

Skills: Experience in Database technologies - MS SQL Server, DB2 , Oracle, Postgres, AWS RDS/Redshift Experience in Data Integration - Messaging (IBM MQ) , AWS DMS, Kafka Experience in Data Visualisation - MicroStrategy, Microsoft Power BI Knowledge of authentication methodologies like OAUTH/Okta . Knowledge of Operating systems (Windows and Linux ...

testable systems. Our infrastructure runs on Kubernetes in Google Cloud Platform (GCP), and we rely on Google and open‐source components such as Kafka, Bigtable, BigQuery, Dataflow, Spanner, Airflow, and Postgres. What you'll need? A willingness to learn functional programming and a solid understanding of general software engineering … enhance productivity. We'd be particularly excited if you have one or more of the below Some experience or familiarity with messaging systems (e.g. Kafka or Kinesis). Familiarity with distributed data stores (e.g. Bigtable, DynamoDB). Familiarity with building and deploying microservices on Kubernetes, perhaps using tools like ...

ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects, ensuring system health … designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. Proficiency in CI/CD tools such as Jenkins, GitLab CI/CD, or Cloud Build, along with ...

ensure successful project delivery, adhering to client timelines and quality standards. Implement and manage real-time and batch data processing frameworks (e.g., Apache Kafka, Apache Spark, Google Cloud Dataproc) in line with project needs. Build and maintain robust monitoring, logging, and alerting systems for client projects, ensuring system health … designing and optimising data pipelines using frameworks like Apache Airflow or equivalent. Demonstrated experience with real-time and batch data processing frameworks, including Apache Kafka, Apache Spark, or Google Cloud Dataflow. Proficiency in CI/CD tools such as Jenkins, GitLab CI/CD, or Cloud Build, along with ...

Director - Head of eFX - C++, Java, Python, FX, eFX, Low-latency, Trading, Front Office, Linux, Unix, Multithreading, Agile, DevOps, Cloud, Databases, Databricks, Kafka I am working with a leading Investment Banks which is looking for a Head of eFX (Director level) to join their Information Systems Department who provide … C# FX Financial Markets Low-Latency Market Data Multi-Threading No-SQL/SQL Unit Testing/TDD/Automated Testing Strong Database Knowledge Kafka This is a full-time position, offering a highly competitive salary, a strong benefits package, and a performance-related bonus. You will be required ...