351 to 375 of 1,042 Kafka Jobs

with AKS or containerized workloads interacting with databases. Knowledge of data governance, retention, and archival strategies. Exposure to streaming and integration patterns (Event Hubs, Kafka) and ETL/ELT workflows. Experience supporting highly regulated environments with robust controls and documentation. Education and Certifications: Bachelor's degree in Computer Science ...

JavaScript/TypeScript, or Golang. Experience with specific frameworks like Spring (AI, Boot), N8N, or Flask. Familiarity with messaging and integration platforms such as Kafka or JMS/MQ. Experience with UI development using modern frameworks like React JS or StreamLit for interactive AI applications. Practical experience in model ...

logical replication).Experience with durable execution frameworks (Temporal).Experience with data formats and protocols (Avro, Parquet, Protobuf).Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink).Experience with maintaining/contributing to open-source software.Why Join UsWork on challenging problems at the intersection of database technologies, distributed systems ...

skills and attention to detail. Exposure to Docker, Kubernetes, and cloud services in an enterprise environment is beneficial. Experience with message brokers such as Kafka a plus. A friendly, positive, and can do attitude. A Bachelor's degree in Computer Science, Engineering, or a related field. Our benefits ...

decisions, review code meaningfully, and set the standard for your squad. Familiarity with our core stack – Node/TypeScript, React, Java, AWS, Kubernetes, and Kafka – or a comparable modern stack; deep expertise in some areas, with the breadth to engage credibly across the rest. A strong grasp of software ...

service delivery in production environments. Previous hands‐on experience running large cloud-based website environments with GKE, service mesh, load balancers, CDN/WAF, Kafka, Elasticsearch. Strong understanding of cloud services including networking, compute, storage, containerisation, security and IAM. Experience with IAC, python, Go, CI/CD, Terraform, Kubernetes ...

Certifications in relevant technologies, such as Azure Data Engineer or Databricks Certified Developer Experience with real-time data processing and streaming technologies like Apache Kafka or Azure Event Hubs Knowledge of data visualization tools, such as Power BI or Tableau Contributions to open-source projects or active participation ...

technical reports. MOD or Defence security standards and accreditation processes. Working with secure or safety-critical systems. Exposure to technologies such as Apache Kafka, Apache NiFi, Node.js, TypeScript, MongoDB, AI or Machine Learning would also be beneficial. Security Clearance Due to the nature of the work, candidates must already ...

applications. Strong Python development skills. Data & Infrastructure: Experience with some of the following technologies is highly desirable: Frameworks & Infrastructure: Apache Spark Apache Airflow Kafka Elasticsearch/OpenSearch Databases: PostgreSQL MongoDB Vector databases such as Qdrant, Milvus, or pgvector Python Ecosystem: Pandas Polars Engineering Skills: Experience building highly scalable backend ...

relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment ...

relevant experience and the ability to work across comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment ...

PyArrow)Distributed data processing (Apache Spark)Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)Cloud services (AWS, Azure or GCP)Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake)Containerisation and orchestration (Docker/ ...

PyArrow)Distributed data processing (Apache Spark)Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)Cloud services (AWS, Azure or GCP)Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake)Containerisation and orchestration (Docker/ ...

PyArrow)Distributed data processing (Apache Spark)Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi)Cloud services (AWS, Azure or GCP)Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services)SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake)Containerisation and orchestration (Docker/ ...

traditional data warehouses An understanding of machine learning model development lifecycle, feature engineering, training and testing Good understanding or hands‐on experience of Kafka Experience as a DBA or developer on RDBMS such as PostgreSQL, MySQL, Oracle or SQL Server Experience designing data applications to meet non‐functional requirements ...

problem-solving skills; Ability to refine problem statements and propose solutions considering effort, impact, and scalability trade-offs; Nice to have: Apache Spark, Iceberg, Kafka, dbt, Scikit-Learn, XGBoost, PyTorch, MLFlow, GraphFrames, Ray, AWS S3, EMR, SageMaker, Lakeformation, Terraform, Docker, GitHub CI/CD, Knowledge Graphs, RAG, graph ...

security assurance bodies. Understanding of defence, national security, or safety‐critical environments. Familiarity with technologies such as: Azure and AWS Docker and Kubernetes Apache Kafka and NiFi Node.js and TypeScript MongoDB AI and Machine Learning technologies Security Requirements Due to the nature of the work, candidates must either hold ...

background in Java/Scala and a scripting language like Python.Experience building large scale data pipelinesStrong familiarity with the Apache Hadoop ecosystem including : Spark, Kafka, Flink, Iceberg/Delta Lake/Hive, Apache Presto/Trino, etc.Experience with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra, DynamoDBFamiliarity ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost-control systems (such as Karpenter, Infracost, OpenCost ...

Engineering, Information Technology or equivalent work experience. • Strong knowledge and hands on experience of big data technologies such as data lakes, Apache Spark, Flink, Kafka etc. • Good knowledge of data warehousing concepts and ETL processes, DevOps, CI/CD and software testing. • Expertise with one of programming languages such ...

Tornado or Django, DockerExperience working with ETL pipelines is desirable e.g. Luigi, Airflow or ArgoExperience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.Data acquisition and development of data sets and improving data qualityPreparing data for predictive and prescriptive modellingHands on coding experience, such as PythonReporting tools ...

targeting methodologies in ad tech—understanding how data flows through the ecosystem and where privacy constraints applyPreferred: experience with real-time streaming technologies (Kafka, Flink) and familiarity with Aerospike or similar low-latency key-value stores used in high-throughput targeting systemsOur LaurelsAdAge Best Places to Work ThinkLA Partner ...