26 to 50 of 154 Permanent Kafka Jobs

track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Strong proficiency in relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra). Deep knowledge of data ...

transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug ...

Gitlab, bitbucket, etc.) and automation services (e.g., Jenkins, Gitlab CI/CD, etc.). Experience with database technologies (SQL/NoSQL), messaging systems (e.g., Kafka, ActiveMQ), and/or data streaming technologies (e.g., CCSDS). Bachelor of Science degree from an accredited course of study in engineering, engineering technology ...

Domain experience in BFSI (risk, pricing, regulatory reporting, underwriting, fraud, payments, or actuarial data). Experience with event-driven and near-real-time pipelines (Kafka/Kinesis, streaming ETL). Knowledge of data quality frameworks (Great Expectations, Deequ) and data lineage/catalog (Atlas, Alation, Collibra). Exposure ...

Senior Java Software Engineer - Java 11+, Spring, Spring Boot, Microservices, Kafka, Akka, Docker/Kubernetes, Real-time, TDD/BDD, Reactive Programming, MongoDB Payments A Senior Java Engineer with a background in finance/payments and experience working on distributed real-time systems is sought after by a global ...

Strong knowledge of DevOps - experience with CI/CD (Gitlab) • Experience dealing with highly scalable systems with high throughput • Experience with Postgres, Terraform, Kafka and Containers with be beneficial • Testing experience (TDD) • Excellent verbal and written communication skills Does this sound like an opportunity that might be of interest ...

modern DevOps culture with CI/CD, automated testing, and infrastructure as code Tech stack: React, Node.js (Nest.js), Python/FastAPI, AWS (ECS), PostgreSQL, Kafka, Terraform, GitHub CI/CD Testing: Jest, Cypress, Pact, Pytest What they’re looking for: • Strong experience building distributed systems/microservices architectures • Deep ...

into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across Cloud (Azure, AWS, GCP) and Big Data (Spark, Kafka) stacks. Collaboration: Work closely with business teams to define data flows and ensure security protocols (encryption/authentication) are met. Technical Toolkit Languages: Proficiency ...

cloud services (e.g., ECS, S3, RDS, Lambda) and a solid understanding of cloud architecture. Familiarity with event-driven systems and messaging frameworks (e.g., Kafka, RabbitMQ) is a plus. Excellent problem-solving skills, with the ability to work in a dynamic and evolving environment. Strong communication and collaboration abilities, with ...

Microsoft Azure Data Engineer or Solutions Architect certification (desirable). Databricks Certified Data Engineer or Machine Learning Associate (desirable). Experience with streaming solutions (Kafka, Event Hubs, Spark Streaming) (desirable). Knowledge of machine learning and AI on Databricks (desirable). ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/ ...

Experience Experience working with cloud platforms, ideally AWS. A strong Linux background. Experience with data integration and messaging technologies such as Apache NiFi, Apache Kafka, RabbitMQ, or similar tools. Experience using Infrastructure as Code tools such as Terraform or CloudFormation. Previous experience working in a consultancy or public sector ...

track record with data governance, quality, lineage, and security practices. Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). Experience in, or knowledge of, DevSecOps Tooling and Processes. Self-starter with the ability to appropriately prioritise ...

Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI, Tableau, MicroStrategy). Experience in financial ...

integrating with third-party APIs End-to-end ownership of systems (design/build/operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

Work With: Tech Stack Frontend: React Backend: NestJS, Python (FastAPI), LangChain Test Automation: Pact, Jest, Cypress, Pytest (including AI testing) Infrastructure: AWS ECS, PostgreSQL, Kafka Infrastructure as Code: Terraform (native AWS services where possible) CI/CD: GitHub-based tooling What’s in it for you: Significant ownership over ...

advocate for their use where appropriate Technology: Angular, .Net Core 6, C#, Angular 8+, AWS Cloud, REST API, SQL Server, PostgreSQL, Tableau, ELK, Confluent Kafka Qualifications: Bachelors degree in Computer Science or equivalent experience required; Masters degree preferred 7+ years of software development experience with at least an years ...

power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed ...

platforms Experience owning systems end-to-end (design, delivery, operation, and iteration) Technical Expertise Event-driven architectures and messaging systems (e.g. EventBridge, SQS, SNS, Kafka) Designing for failure retries, idempotency, backoff strategies, DLQs Observability, monitoring, and debugging in distributed systems Data modelling, transformation, and schema evolution across systems Leadership ...

containers (OpenShift/Kubernetes) and Redis Familiarity with CI/CD concepts and tools Experience with API design Technical skills including: Python, Snowflake, RabbitMQ, Kafka, MongoDB, Postgres, Tomcat Experience with AWS services such as Auto scaling, ECS, EFS, Lambda, Elasticache, RDS, DynamoDB, Direct Connect Experience with Azure services such ...

NoSQL databases. Secure development practices. Git-based source control. Knowledge of CI automation systems such as Jenkins Bonus points for: Event streaming (e.g. Kafka, Kinesis) and change data capture (CDC). Messaging (e.g. RabbitMQ, SQS). Docker and Kubernetes. Solution and architecture design. Test-driven development (TDD). ...

scalable solutions. Knowledge of financial industry regulations and standards, particularly around data security and privacy. Familiarity with event-driven architectures or message queues (eg, Kafka, RabbitMQ) for Real Time data processing. Experience with automated testing frameworks and continuous delivery tools like Jenkins, GitLab CI, or CircleCI. Understanding of performance … Bank Banking Finance Financial Services Crypto Blockchain Web3 Trading Exchange Digital Assets Hybrid Flexible Developer Software Engineer Backend Developer Golang Engineer Kafka Apache Kafka RabbitMQ AWS Lambda Cloud Platform ...

DevOps experience, within tools such as Terraform, ArgoCD, Helm, or other IaC Degree within Computer Science, ideally at Masters or PhD level Experience with Kafka, Spark, Trino would be beneficial If interested, please apply below with your CV. ...

with Python (2+ Years) Experience working with REST Microservices Strong SQL Experience working with very large data sets. Knowledge of big data tools (Spark, Kafka etc) Experience working in finance (Preferred) Strong formal education - ideally in Computer Science If this sounds of interest, then please do not hesitate ...

Computer Science (or related field) 4+ years of relevant work experience using Python and related tech stack in a professional environment Django, FastAPI, PostgreSQL, Kafka, AWS, Kubernetes experience and knowledge Experience in a Fintech or Financial services organisation is a nice to have Clear communication skills, both written ...