526 to 550 of 583 Permanent Kafka Jobs

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong expertise in … the design, implementation, and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to … will be key in enabling organizations to unlock the value of real-time data, improve operational efficiency, and accelerate digital transformation. Responsibilities Act as the primary technical owner for Kafka and Confluent Cloud implementations. Design, configure, and maintain Kafka clusters, topics, and streaming pipelines. Ensure secure, reliable, and scalable data onboarding from various sources to both on-prem More ❯

optimal operation. The Data Engineer Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply by clicking online or emailing me … SKILLS: DATA ENGINEER/DATA ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE More ❯

across government The Lead Data Engineer Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Gloucester when required. Required experience in the following: Apache Kafka Apache NiFI SQL and NoSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java Understand and interpret technical and business stakeholder needs Manage expectations through clear … SKILLS: DATA ENGINEER/DATA ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE More ❯

automated trading systems for UK energy markets Develop real-time bidding, dispatch, and optimization tools Build monitoring dashboards for LAES operations and grid stability systems Develop data pipelines using Kafka and TimescaleDB Create microservices to connect trading platforms and grid operators What We’re Looking For Strong Software Fundamentals: Excellent Python skills (Rust is a bonus) and experience designing … distributed systems, REST APIs, and microservices Data & Infrastructure: Experience with Kafka or similar streaming technologies, PostgreSQL, and time-series data management DevOps & Observability: Familiar with Docker, monitoring, and observability tools Bonus Points For: Prior experience with energy markets, trading systems, industrial control systems, or IoT environments If you’re passionate about applying your software skills to the clean energy More ❯

automated trading systems for UK energy markets Develop real-time bidding, dispatch, and optimization tools Build monitoring dashboards for LAES operations and grid stability systems Develop data pipelines using Kafka and TimescaleDB Create microservices to connect trading platforms and grid operators What We’re Looking For Strong Software Fundamentals: Excellent Python skills (Rust is a bonus) and experience designing … distributed systems, REST APIs, and microservices Data & Infrastructure: Experience with Kafka or similar streaming technologies, PostgreSQL, and time-series data management DevOps & Observability: Familiar with Docker, monitoring, and observability tools Bonus Points For: Prior experience with energy markets, trading systems, industrial control systems, or IoT environments If you’re passionate about applying your software skills to the clean energy More ❯

not just code syntax. What you’ll be doing Designing automated trading systems for green energy markets Building real-time bidding, dispatch, and optimisation tools Developing data pipelines using Kafka & TimescaleDB Creating microservices that connect trading platforms and grid operators Building monitoring dashboards for grid stability and energy storage operations What they’re looking for Strong software fundamentals — ideally … Python , Rust is a bonus Experience with distributed systems, REST APIs, and microservices Knowledge of Kafka (or similar), PostgreSQL , and time-series data Familiar with Docker, monitoring, and observability tools ✅ Experience in a startup or scale-up , collaborating closely with engineers in a fast-moving environment Bonus points if you’ve worked in energy markets, trading systems, industrial control More ❯

not just code syntax. What you’ll be doing Designing automated trading systems for green energy markets Building real-time bidding, dispatch, and optimisation tools Developing data pipelines using Kafka & TimescaleDB Creating microservices that connect trading platforms and grid operators Building monitoring dashboards for grid stability and energy storage operations What they’re looking for Strong software fundamentals — ideally … Python , Rust is a bonus Experience with distributed systems, REST APIs, and microservices Knowledge of Kafka (or similar), PostgreSQL , and time-series data Familiar with Docker, monitoring, and observability tools ✅ Experience in a startup or scale-up , collaborating closely with engineers in a fast-moving environment Bonus points if you’ve worked in energy markets, trading systems, industrial control More ❯

looking for a Lead Site Reliability Engineer to support and scale their Video on Demand (VOD) infrastructure. You’ll work across modern tech stacks including AWS, GCP, Cassandra, and Kafka, helping deliver reliable, high-performance systems used by millions. What you’ll do Lead project delivery while supporting day-to-day operations and incident management Build and manage infrastructure … functional environment What you’ll bring Strong Linux administration skills (Ubuntu preferred) Hands-on experience with AWS and GCP Proficiency in Terraform, Ansible, Jenkins, or GitLab CI Knowledge of Kafka, Cassandra, and relational or NoSQL databases Scripting skills in Python, Bash, Go, or Java Familiarity with monitoring tools like Prometheus, Nagios, or Icinga Understanding of networking fundamentals and virtualisation More ❯

looking for a Lead Site Reliability Engineer to support and scale their Video on Demand (VOD) infrastructure. You’ll work across modern tech stacks including AWS, GCP, Cassandra, and Kafka, helping deliver reliable, high-performance systems used by millions. What you’ll do Lead project delivery while supporting day-to-day operations and incident management Build and manage infrastructure … functional environment What you’ll bring Strong Linux administration skills (Ubuntu preferred) Hands-on experience with AWS and GCP Proficiency in Terraform, Ansible, Jenkins, or GitLab CI Knowledge of Kafka, Cassandra, and relational or NoSQL databases Scripting skills in Python, Bash, Go, or Java Familiarity with monitoring tools like Prometheus, Nagios, or Icinga Understanding of networking fundamentals and virtualisation More ❯

experience with orchestration tools (Airflow, Prefect, Dagster).* Expertise in Docker and Kubernetes.* Solid understanding of CI/CD principles and tooling.* Familiarity with open-source data technologies (Spark, Kafka, PostgreSQL).* Knowledge of Infrastructure as Code (Terraform, Ansible).* Understanding of data architecture principles.* Experience with monitoring tools like Grafana and Prometheus.* Strong leadership skills to guide teams … the client's supplier list for this position.KeywordsLead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security Clearance, Leadership, DevOps, Observability, Monitoring. More ❯

experience with orchestration tools (Airflow, Prefect, Dagster). * Expertise in Docker and Kubernetes. * Solid understanding of CI/CD principles and tooling. * Familiarity with open-source data technologies (Spark, Kafka, PostgreSQL). * Knowledge of Infrastructure as Code (Terraform, Ansible). * Understanding of data architecture principles. * Experience with monitoring tools like Grafana and Prometheus. * Strong leadership skills to guide teams … s supplier list for this position. Keywords Lead DataOps Engineer, DataOps, Data Pipeline Automation, Airflow, Prefect, Dagster, Docker, Kubernetes, EKS, AKS, CI/CD, Terraform, Ansible, Grafana, Prometheus, Spark, Kafka, PostgreSQL, Infrastructure as Code, Cloud Data Engineering, Hybrid Working, Security Clearance, Leadership, DevOps, Observability, Monitoring. More ❯

it's a piece of code, a flaky test, or a README. Reporting into an Engineering Manager, the Backend Engineer will leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, while also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. You won't just be working through tickets - you'll be part of a genuinely … architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Backend Engineer who enjoys working autonomously More ❯

expansions). • Analyze and address root causes of recurring environment/configuration issues. Reporting & Dashboarding • Produce daily, weekly, and monthly reports on change activity, pipeline health, and metrics (e.g., Kafka). • Automate dashboards in Power BI/Tableau for leadership visibility. • Use scripts/chat-ops bots for scheduled reporting and acknowledgements. • Correlate incidents, RFCs, and intake forms for … and security changes. • Strong ITIL Change Management expertise; proven experience running CABs. • Hands-on prior working experience with CI/CD (Jenkins, GitLab CI), Kubernetes (EKS/AKS), Docker, Kafka, Splunk • Knowledge on AWS networking (VPCs, subnets, load balancers, security groups). • Familiarity with SaaS/PaaS, billing platforms, and JIRA Cloud workflows. • Strong knowledge of observability tools (Splunk More ❯

Build and optimize ML models for predictive analytics, anomaly detection, and recommendations using Azure ML, Databricks, and Python. Integrate agents with enterprise platforms such as SAP HANA, Salesforce, Snowflake, Kafka, and UiPath. Ensure observability and reliability through Azure Monitor, logging, and alerting frameworks. Define and enforce architecture patterns, reusable components, and governance standards. Lead code reviews, technical design sessions … Support adoption and training with change management and enablement teams. Develop solutions using Python, Power Apps, Power Automate, Databricks, and Snowflake. Integrate with enterprise systems such as SAP HANA, Kafka, and UiPath. Build and deploy agents on Microsoft AI Foundry (preferred) and Copilot Studio (optional). Implement workflows with Azure Machine Learning, Azure DevOps, and GitHub. Ensure observability using More ❯

Bitvavo Amsterdam, North Holland, Netherlands Senior Software Engineer - Low Latency Bitvavo launched its digital assets trading platform in 2018, bridging the gap between traditional currencies and digital assets. By offering transparent fees, a wide range of assets, and an easy More ❯

structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data science … cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part of a company with a clear mission and strong data culture, joining a team More ❯

structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data science … cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part of a company with a clear mission and strong data culture, joining a team More ❯

Role: Platform Engineer - Kafka Location: NYC, NY - Need to go onsite from Day 1 - Hybrid 3 Days/Week Contract Interview Process - L1 Virtual Interview, Client interview will be F2F in NYC, NY Looking for: Platform Engineers who manage configure, Authentication, Authorizations, Admin tasks, Product Expansions dynamically based on Volumes. who can handle the products Setup, Volume and other … Admin/Identity Managements(Authorization/Authentications) etc. Job Descriptions: Kafka JD: Key Responsibilities: Deploy, configure and maintain Confluent Kafka clusters in a highly available environment. Perform Kafka upgrades and patching ensuring minimal downtime and seamless transitions. Administer security protocols and access controls to protect the platform. Monitor cluster health and performance using our established monitoring stack … manual intervention. Assist with planning and managing cluster resources to support future growth. Qualifications: Bachelor's degree in computer science, Information technology or equivalent professional experience. 5+ years of Kafka administration experience, ideally with confluent platform. Demonstrated expertise in Kafka upgrades and production troubleshooting. Strong background in Linux system administration. Proficiency in Python and/or Bash scripting More ❯

not just code syntax. What you’ll be doing Designing automated trading systems for green energy markets Building real-time bidding, dispatch, and optimisation tools Developing data pipelines using Kafka & TimescaleDB Creating microservices that connect trading platforms and grid operators Building monitoring dashboards for grid stability and energy storage operations What they’re looking for Strong software fundamentals — ideally … Python , Rust is a bonus Experience with distributed systems, REST APIs, and microservices Knowledge of Kafka (or similar), PostgreSQL , and time-series data Familiar with Docker, monitoring, and observability tools ✅ Experience in a startup or scale-up , collaborating closely with engineers in a fast-moving environment Bonus points if you’ve worked in energy markets, trading systems, industrial control More ❯

not just code syntax. What you’ll be doing Designing automated trading systems for green energy markets Building real-time bidding, dispatch, and optimisation tools Developing data pipelines using Kafka & TimescaleDB Creating microservices that connect trading platforms and grid operators Building monitoring dashboards for grid stability and energy storage operations What they’re looking for Strong software fundamentals — ideally … Python , Rust is a bonus Experience with distributed systems, REST APIs, and microservices Knowledge of Kafka (or similar), PostgreSQL , and time-series data Familiar with Docker, monitoring, and observability tools ✅ Experience in a startup or scale-up , collaborating closely with engineers in a fast-moving environment Bonus points if you’ve worked in energy markets, trading systems, industrial control More ❯

York/Massachusetts ( 70% travel ) Hiring Mode: FTE - Full Time Employee, ( US Citizens & Green Card Holder ) Required Skill/Responsibility/Role Hands on Design and development experience in Kafka, Spark Streaming, Scala, Hive, SQL. Shell Scripting, Java Programming Involve in planning, designing and strategizing the roadmap around On-premise and cloud solutions. Experience in designing and developing real … time data processing pipelines Expertise in working with Hadoop data platforms and technologies like Kafka, Spark, Impala, Hive and HDFS in multi-tenant environments Expert in Java programming ,SQL and shell script, DevOps Good understanding of current industry landscape and trends on tools to ingestion, processing, consumption and security management Expert in designing and implementation solutions for multi-tenancy More ❯

global scale. We’re looking for a Data Engineer to join the platform team. You’ll help design, build, and run pipelines and services on a modern data stack (Kafka, AWS, Iceberg, Kubernetes), collaborating with engineers, data scientists, and product teams across multiple regions. What you’ll do Build & maintain streaming and batch pipelines Develop our Lakehouse (AWS S3 … is trustworthy, accessible, and reusable Implement schemas, contracts, and observability Support compliance with global data regulations What you’ll bring Good working experience in data engineering Hands-on with Kafka/Pulsar/Kinesis Strong SQL & relational DBs (Postgres/MySQL) Coding experience in Java/Scala Cloud (AWS preferred) + Infrastructure-as-Code familiarity Solid understanding of ETL More ❯

will consider EU candidates. The Opportunity You'll play a key role in shaping and delivering the technical strategy behind a modern, cloud-native, real-time data platform. From Kafka pipelines to Databricks orchestration, this is a chance to work on high-scale systems powering real-time insights across the business. What We’re Looking For The ideal contractor … strategic thinking and hands-on engineering. Specifically, you’ll have: Proven experience as a Senior Data Engineer, focused on real-time, distributed systems Deep expertise with modern streaming tools: Kafka, Flink, Spark, Databricks Strong cloud-native data architecture experience (AWS, GCP, or Azure) Solid understanding of streaming vs. batch processing paradigms Experience defining technical strategy and creating actionable roadmaps More ❯

with architects and analysts to design scalable data models and enforce data governance standards. Monitor and optimize pipeline performance, reliability, and cost. Integrate Snowflake with tools like dbt and Kafka for orchestration and streaming. Required Skills 5+ years in data engineering; 3+ years hands-on with Snowflake Data Cloud. Strong SQL and Python/Snowpark skills. Experience with data … modeling, DevOps/CI-CD, and data governance (Collibra, Alation, or Purview). Proven ability to troubleshoot, optimize, and deliver scalable solutions. Preferred Experience with dbt, Kafka, or data quality tools (Great Expectations, Monte Carlo). Snowflake certification (SnowPro Core or Advanced). Background in regulated industries such as healthcare or insurance. Soft Skills Strong analytical and communication abilities. More ❯

Date Posted: Not sure what skills you will need for this opportunity Simply read the full description below to get a complete picture of candidate requirements. 2025-10-28 Country: United States of America Location: CO106: 16470 East Hughes Drive More ❯