201 to 225 of 971 Kafka Jobs

services and components . Build and maintain platform capabilities supporting batch and real-time data workloads . Develop and operate distributed data services using Kafka, Kinesis, Spark, Flink or equivalent technologies . Build and maintain cloud-native data platform capabilities using AWS and/or Azure . Support data … platforms . Strong programming experience using Java and/or Python . Hands-on experience with real-time streaming and event-driven architectures , including Kafka, Kinesis or equivalent. Experience with distributed data processing technologies such as Spark, Flink, Kafka Streams or equivalent. Strong experience with AWS and/ ...

practical experience with distributed data processing frameworks (e.g., Apache Spark, Flink, Hadoop). Strong expertise in message brokers and event streaming platforms (e.g., Apache Kafka, Kinesis). End-to-end exposure to data pipeline lifecycle development, including extensive experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). Hands ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/ ...

ideally in a consumer or marketplace environment. Deep understanding of distributed systems and modern data ecosystems — including extensive experience with Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time ...

maintainable solutions.## **Preferred Qualifications*** Experience with Argo CD, Helm, or other GitOps tooling.* Familiarity with Airflow, Snowflake, or Apache Iceberg.* Experience with Apache Kafka or Amazon MSK.* Experience with hybrid cloud, enterprise networking, or multi-account AWS environments.* Experience with Ansible or similar configuration management tools.* Experience in financial ...

Azure Purview, UnityCatalog, or Apache Atlas to ensure data integrity and compliance. Exposure to Streaming/Event-Based Technologies: Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming for real-time data processing and event-driven architectures. Understanding of SOLID Principles: Familiarity with the SOLID principles ...

will find this uncomfortable. Nice to have: Experience building Data Mesh or Lakehouse architectures. Familiarity with Kubernetes, Docker, and real-time streaming technologies (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. The Zego ways of working Teams work better with time to collaborate and space ...

tools like Azure Purview, UnityCatalog, or Apache Atlas to ensure data integrity and compliance. ExposuretoStreaming/Event-Based Technologies:Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming for real-time data processing and event-driven architectures. Understanding of SOLID Principles:Familiarity with the SOLID principles ...

tools like Azure Purview, UnityCatalog, or Apache Atlas to ensure data integrity and compliance. ExposuretoStreaming/Event-Based Technologies:Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming for real-time data processing and event-driven architectures. Understanding of SOLID Principles:Familiarity with the SOLID principles ...

frameworks. Experience with Terraform or Databricks Asset Bundles. Exposure to MLflow, MLOps or AI and Generative AI workloads. Experience with streaming technologies such as Kafka or Structured Streaming. Databricks certification. Previous consulting or client-facing delivery experience. Why Join Unifeye? We're building a consultancy where talented people ...

have the tools and opportunities to advance your career while creating software that changes the world. Your Role and Responsibilities WarpStream is an Apache Kafka compatible data streaming platform built directly on top of object storage with zero local disks. It’s delivered to customers as a BYOC-style ...

engineering fundamentals, including programming, distributed systems and SQL. Hands‐on experience with event‐driven architectures, event streaming platforms and schema governance technologies such as Kafka, Kinesis, Schema Registry and Avro. Experience implementing data mesh, data product or domain‐oriented data ownership models. Strong knowledge of data contracts, metadata management ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Cloud: Compute Engine, Kubernetes Engine, IAM, VPC Networks, BigQuery, Dataproc, CloudStorage, Cloud Functions, CloudSQL, Memorystore PubSub, Iceberg Infrastructure & Technologies: Apache Airflow, Druid/Imply, Kafka, Spark, Postgres, Jenkins, Scylla, Redis, Docker, Prometheus, Github, Linux. Languages: Python, Scala, C++, JavaScript, Java. What Blis can offer Comprehensive private healthcare Matched pension ...

Large Language Models (LLMs), retrieval‐augmented generation (RAG), and agentic workflows. Extensive experience building and optimizing data pipelines and data architectures (preferred using Talend, Kafka, and/or Informatica). Expertise in performance optimization, scalability, troubleshooting, analytical problem‐solving, and software design. Bachelor’s degree in Computer Science, Engineering ...

develop homogenous data repositories to deliver data led decision making. Ingest data from various sources, including on premise SQL databases, REST API’s, Apache Kafka streams, etc. Define and apply cleansing rules to the data to ensure meets quality expectations. Define and model data for its appropriate use including ...

Enterprise Architecture OAuth, SAML, JWT, Security Best Practices CI/CD, DevOps Cloud Platforms (AWS, Azure, GCP) Preferred Skills SAP, Salesforce, Oracle, Workday integrations Kafka/Event Streaming Apigee, MuleSoft, Azure API Management Microservices, Docker, Kubernetes Required Skills & Experience Senior experience in Integration/Middleware technologies. Hands-on Dell ...

code reviews Experience writing unit and integration tests (Jest, Mocha or similar) Good-to-have skills TypeScript Microservices and message queues (Kafka, RabbitMQ) Cloud platforms: AWS, Azure, or GCP Docker, Kubernetes, and CI/CD pipelines Caching tools such as Redis GraphQL ...

platforms (AWS, Fastly). Solid knowledge of RESTful APIs and microservices architecture. Experience with databases (PostgreSQL, MySQL, NoSQL databases). Proficiency with message queues (Kafka, RabbitMQ). Strong DevOps experience, including: CI/CD pipelines (GitHub Actions). Containerization technologies (Docker, Kubernetes). Monitoring & logging tools (Prometheus, Grafana ...

modernising complex technology platforms. Java & Microservices: Strong engineering foundations, ideally including Java, Spring Boot, REST APIs and distributed systems. Event-Driven Architecture: Experience with Kafka, IBM MQ, Solace or similar messaging technologies. Data & Cloud: Oracle, PL/SQL, data integration, AWS and Snowflake. Architecture Governance: Design reviews, architecture standards ...

systems Practical cloud native experience Preferred Qualifications, Capabilities, and Skills: Experience with Java and Oracle Familiarity with messaging platforms such as RMQ and Kafka Expertise in Kubernetes Proficiency in ReactJS and JavaScript Functional knowledge of FX or Dervis Settlements domain If you’re looking for a place where your ...

essential:* **Languages:** Python, SQL, Terragrunt, JavaScript* **Cloud:** AWS (primary), some GCP* **Warehouse & Storage:** Snowflake, S3/Parquet* **Data & ETL:** dbt, Fivetran* **Platform & Infra:** Kubernetes, Kafka, RabbitMQ, Argo, GitHub Actions, HashiCorp Vault* **Observability:** Datadog, Grafana* **Dashboarding:** Preset* **Other**: Claude### **What we’re looking for**Strong fundamentals and the ability ...

experience delivering system design, application development, testing, and operational stability Advanced in one or more programming language(s) including Java, React, Microservices, API, Springboot, Kafka, MongoDB etc. Demonstrated experience leading effective use of approved AI-assisted software development tools (e.g., for coding, code review, test acceleration, troubleshooting) with ...

application development Familiarity with relational databases (e.g., Postgres) and AWS services such as S3, EKS, SageMaker, and Bedrock Practical experience with Kubernetes, EKS, Docker, Kafka, MLOps and Large Language Model Operations (LLMOps) Experience working on AIML systems and/or prior experience collaborating with data scientists #J-18808-Ljbffr ...

Lambda API Gateway SQS S3 KMS CloudWatch X-Ray ECS/Fargate ECR EKS Infrastructure & DevOps Terraform Docker Databases MongoDB Amazon DocumentDB Messaging & Monitoring Kafka Confluent Schema Registry Dynatrace Other Serverless architectures What We're Looking For We're interested in developers who: Enjoy solving complex technical problems Write ...