76 to 100 of 191 Permanent Kafka Jobs

distributed systems and cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg ...

with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies Knowledge of data visualisation tools, particularly Power ...

skills Experience building data pipelines and integrating data from multiple sources Exposure to technologies such as Power BI, Snowflake, SQL Server, PostgreSQL, Spark, Kafka, Airflow, Docker, and Kubernetes Experience within engineering, manufacturing, industrial, or other complex regulated environments would be advantageous Excellent stakeholder management and problem-solving abilities What ...

load balancer configs (F5, Nginx, ALB/NLB), service mesh performance Storage: Latency, IOPS constraints, distributed file system behavior Caching & Middleware: Redis, Hazelcast, NATS, Kafka, RabbitMQ configuration and throughput tuning Databases: Connection pool tuning, slow queries, indexing, replication lag Cloud Layer: AWS compute/storage/network performance, regional ...

candidate will have: * Experience in data engineering, ideally aerospace/defence or industrial sectors. * ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). * Strong Python and SQL; C++, C#, or MATLAB a plus. * Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. * Data Platform Capabilities: Low-Code ...

Experience with Natural Language Processing (NLP), Large Language Models (LLMs) or Image Processing. Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). While we think the above experience ...

Experience with Natural Language Processing (NLP), Large Language Models (LLMs) or Image Processing. Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). While we think the above experience ...

quality, reliability, and observability. Improve the resilience and scalability of systems that support external partners and financial operations. Work with event-driven architectures, including Kafka, alongside MongoDB and MariaDB to build auditable, extensible, and performant systems. Use AI tooling in the development lifecycle to support delivery and code quality. ...

collaborationComfort with Agile operating modelsEnergetic, self-directed, and self-motivatedPreferred QualificationsHands on experience with Java and experience with any of the Rx* variantsExperience with Kafka or similar messaging technologiesExperience with microservice architecture Experience with the Spring framework familyStrong proficiency in: Distributed systems, Low-latency services, NoSQL and relational databasesExperience ...

willingness to grow.Experience with version control & CI/CD tools such as Git & GitLab/GitHubUnderstanding of one or more messaging technology such Kafka, RabbitMQ, Solace etc.Clear understanding various design patterns and leveraging the same to solve complex technical problems.Conduct performance testing and profiling to ensure application robustness ...

InfoSum is WPP's privacy-first data collaboration technology, trusted by global businesses to unlock the full potential of their first-party data without risk. Its patented, cross-cloud, decentralized collaboration technology leverages advanced Privacy ...

related occupation; Other Requirements: Experience must include two (2) years use of all the following: Azure Kubernetes Service (AKS), Docker, Kubernetes, Jenkins, Apache Kafka, Azure Event Hub, GraphQL, Dynatrace, Mezmo, Azure DevOps, Git, and GitHub Copilot. Will also accept any suitable combination of education, training, and/or experience. ...

implement database schemas, write and optimise SQL queries against PostgreSQL databases handling high-volume transactional dataBuild and maintain event-driven architectures using Apache Kafka for asynchronous processing of financial events across distributed servicesDevelop and maintain a payment orchestration system that dynamically routes payments across Payment Service Providers to optimize ...

GitHub Actions. Experience with Lambda, ECS and Fargate. Good knowledge of AWS security, IAM, KMS and incident response. Experience with data pipelines using Kinesis, Kafka or similar. Proficiency in TypeScript and some Python. Strong communication skills and ability to take technical ownership. Experience with AWS Bedrock or other ...

GitHub Actions. Experience with Lambda, ECS and Fargate. Good knowledge of AWS security, IAM, KMS and incident response. Experience with data pipelines using Kinesis, Kafka or similar. Proficiency in TypeScript and some Python. Strong communication skills and ability to take technical ownership. Experience with AWS Bedrock or other ...

development. Support the delivery of reliable, secure data solutions. Essential Skills & Experience Strong experience in Java and/or Python. Hands-on expertise with Kafka, Kubernetes and AWS. Experience with Terraform and CI/CD pipelines (ideally Drone). Proven experience leading data engineering teams. Previous Central Government experience. ...

skills and experience working with large datasets. Experience with Elasticsearch, Kubernetes and Docker. Understanding of precision, recall and false-positive optimisation. Exposure to Kafka, AWS, PostgreSQL, Bash, Jenkins or Ansible would be beneficial. Previous experience in government, defence, security or identity matching environments is advantageous. Security Clearance: Candidates must ...

Golang, Git, REST Web Services, Jenkins, NoSQL, PostgreSQL Experience in application design, Agile development, and CI/CD tools. Experience of messaging service (ideally Kafka) Understanding of BDD/TDD Strong problem-solving, analytical skills, and a desire to learn new technologies. Preferred: Experience with Docker, Kubernetes. Experience with ...

skills and experience working with large datasets. Experience with Elasticsearch, Kubernetes and Docker. Understanding of precision, recall and false-positive optimisation. Exposure to Kafka, AWS, PostgreSQL, Bash, Jenkins or Ansible would be beneficial. Previous experience in government, defence, security or identity matching environments is advantageous. Security Clearance: Candidates must ...

making practical technical decisions in an early-stage environment. Desirable experience Working with banking, payments, financial or regulatory datasets. Streaming technologies such as Kafka and real-time data processing. Building datasets and processes for regulatory reporting. Supporting analytics or machine learning use cases. Experience working within a regulated industry. ...

TypeScript — experience with control systems or telemetry is a strong advantage Solid knowledge of distributed systems and real-time streaming technologies such as Kafka or WebSockets, plus familiarity with a range of data persistence approaches including relational, document, and time-series stores Confidence with modern DevOps practices including ...

engage effectively across business, operations, and engineering teams. Hands-on experience with Windows and Linux, CI/CD pipelines, and messaging platforms such as Kafka and MQ, along with programming/scripting languages including Java and Python. At BNY, our culture allows us to run our company better ...

. Experience with Natural Language Processing (NLP) and Large Language Models (LLMs). Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). These lists are not exhaustive ...

. Experience with Natural Language Processing (NLP) and Large Language Models (LLMs). Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). These lists are not exhaustive ...

experience in software engineering, MLOps, and deploying machine learning models at scale. Proficiency in SQL, Python, and familiarity with big data technologies (e.g., Kafka, Spark) and/or cloud platforms (e.g., GCP, AWS, or Azure). Industry knowledge: Experience in gaming or digital entertainment is a strong plus. This ...