626 to 650 of 672 Kafka Jobs

InsurTech with cutting-edge machine learning and AI? At Simply Business, we're not just using data; we're continuously evolving our platform with technologies like AWS, Snowflake, and Kafka to drive real value and inform company strategy. As a leading player in the market, our mission is to remain at the forefront of data engineering, ML, and AI … continuously evolving our class-leading data and ML platform infrastructure, balancing maintenance with exciting greenfield projects. develop and maintain our real-time model serving infrastructure, utilising technologies such as Kafka, Python, Docker, Apache Flink, Airflow, and Databricks. Actively assist in model development and debugging using tools like PyTorch, Scikit-learn, MLFlow, and Pandas, working with models from gradient boosting More ❯

skills in Python or another major language; writing clean, testable, production-grade ETL code at scale. Modern Data Pipelines: Experience with batch and streaming frameworks (e.g., Apache Spark, Flink, Kafka Streams, Beam), including orchestration via Airflow, Prefect or Dagster. Data Modeling & Schema Management: Demonstrated expertise in designing, evolving, and documenting schemas (OLAP/OLTP, dimensional, star/snowflake, CDC … data contracts, and data cataloguing. API & Integration Fluency: Building data ingestion from REST/gRPC APIs, file drops, message queues (SQS, Kafka), and 3rd party SaaS integrations, with idempotency and error handling. Storage & Query Engines: Strong with RDBMS (PostgreSQL, MySQL), NoSQL (DynamoDB, Cassandra), data lakes (Parquet, ORC), and warehouse paradigms. Observability & Quality: Deep familiarity with metrics, logging, tracing, and More ❯

Database Management System (RDBMS) Web app server Familiar (Experience preferred) with open source web application server such as Apache HTTP, Tomcat Middle tier - messaging systems Experience using the following: Kafka - or any Java-based message broker Active MQ - product we are using that is java based message broker or similiar Experience in development and usage with RESTful web services … in Relational Database Management. 10 Years' Experience with Angular 3+ front-end web application platform and PrimeNG UI components or similar web framework. Experience with middle tier messaging systems, Kafka, Active MQ or similiar and development and usage with RESTful web services Active Top Secret or TS/SCI security clearance. Need to have Current Poly or consent to More ❯

Build scalable services with Kotlin, and deal with problems like synchronization, asynchronous operations, database optimisations, scalability and reliability of systems Gain exposure to an array of technologies such as Kafka, PostgreSQL, Redis, Docker etc Optimise existing systems for scalability, extensibility and performance whilst building out reusable, modular code for use across Blockchain's products Ensure security is at the … strong technical documentation and effective monitoring You inspire other engineers to do better Understanding of data structures, databases and large-scale distributed systems Preferably exposure to technologies such as Kafka, PostgreSQL, Redis, RabbitMQ You are customer focused and continuously suggest how the backend can provide the best Customer Experience A passion for crypto and the transformations it enables We … use Kotlin, PostgreSQL, Kafka, Redis, Datadog, Amplitude, Grafana, BigQuery, ApacheSpark and more COMPENSATION & PERKS Unlimited vacation policy; work hard and take time when you need it Unlimited learning policy; order the technical resources you need or simply pick something up from our company library Apple equipment Full-time salary based on experience and meaningful equity in an industry-leading More ❯

weekly travel Inside IR35Support the standing up multiple environments on AWSSupport the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EESkills required:REQUIRED/NON-NEGOTIABLE: - Full AWS stack (inc. Lambda, SQS, SNS)- IAM management for pipelines … and users- Terraform or Cloud Formation- CloudWatch- Kubernetes NICE TO HAVE: - Kafka- Kong EE- Micro-UI patterns (jwt tokenisation and passthrough More ❯

Inside IR35 Support the standing up multiple environments on AWS Support the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE Skills required: REQUIRED/NON-NEGOTIABLE: - Full AWS stack (inc. Lambda, SQS, SNS) - IAM management for … pipelines and users - Terraform or Cloud Formation - CloudWatch - Kubernetes NICE TO HAVE: - Kafka - Kong EE - Micro-UI patterns (jwt tokenisation and passthrough More ❯

Inside IR35 Support the standing up multiple environments on AWS Support the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE Skills required: REQUIRED/NON-NEGOTIABLE: - Full AWS stack (inc. Lambda, SQS, SNS) - IAM management for … pipelines and users - Terraform or Cloud Formation - CloudWatch - Kubernetes NICE TO HAVE: - Kafka - Kong EE - Micro-UI patterns (jwt tokenisation and passthrough More ❯

database systems to the next level. We're looking for a highly-technical, hands-on engineer, who loves to work with data plane services like Cassandra, ElasticSearch/Opensearch, Kafka, Redis, Valkey, MySQL, PostgreSQL and is comfortable building automation around large-scale cloud-based critical systems. We'll be looking at candidate CVs with an eye on achievement what … can do for us in the future. Focus area: OpenSearch and ElasticSearch What You'll Do: Maintain a deep understanding of the data components - including Cassandra, ElasticSearch/OpenSearch, Kafka, Zookeeper, MySQL and PostgreSQL, Redis, Valkey, Memcache, Pulsar, SQS and use that understanding to operate and automate properly configured clusters. Understanding of operating databases in kubernetes and managing container … data safe, secure, and available. What You'll Need: Configuration management (Chef) Scripting in Python and bash Experience with large scale datastores using technologies like Cassandra, ElasticSearch/Opensearch, Kafka, Zookeeper,MySQL, PostgreSQL, Redis, Valkey, Memcache, Pulsar, SQS Experience with large-scale, business-critical Linux environments Experience operating within the cloud, preferably Amazon Web Services, GCP and OCI Proven More ❯

Currently, our micro-services communicate via REST API calls, fostering seamless integration between different services. You will actively participate in our ongoing transition towards an event-driven architecture, utilising Kafka as a core component. We are proud to say that our engineers at ClearScore are world class and at the heart of making this mission a reality for our … millions of users. The Typelevel Stack (Cats, Cats Effect, http4s, Circe), Kafka, SBT and occasionally Akka HTTP A world-class SRE team who champion our "you build it you run it" principle, empowering our developers to work with AWS, Kubernetes and Spinnaker A Quality Assistance programme to build, test, release and monitor your own work TDD and peer-reviewing More ❯

of the full software engineering lifecycle, including design, development, and implementation. Reporting into an Engineering Manager, the GoLang Developer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the GoLang Developer will also be responsible for optimising system performance, reliability, and … design and architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Experience with Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate GoLang Developer seeking a challenging and More ❯

the full software engineering lifecycle, including design, development, and implementation. Reporting into an Engineering Manager, the Senior Backend Engineer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the Senior Backend Engineer will also be responsible for optimising system performance, reliability … architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Senior Backend Engineer seeking a challenging More ❯

strong commitment to user-centred design and agile delivery, and more to deliver innovative digital services that matter Preferred Tech Stack Expertise Cloud Infrastructure : AWS (EKS, RDS, Aurora, ElastiCache, Kafka, IAM) Secure Hosting : Experience working with air-gapped or government-secure environments Secrets & Identity Management : HashiCorp Vault, Keycloak Automation : IaC, pipeline build automation, event relay tooling Scripting : Bash, Python … on-call support . Ensure all services are compliant with security standards and support the change and release governance model . Build and maintain infrastructure components like event streaming (Kafka), databases (Aurora, RDS, Redis), identity management (Keycloak), and caching layers. Enhance and maintain CI/CD tooling and self-service developer pipelines for tenant teams. Proactively manage and resolve More ❯

full software engineering life cycle, including design, development, and implementation. Reporting into an Engineering Manager, the Senior Backend Engineer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the Senior Backend Engineer will also be responsible for optimising system performance, reliability … architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Senior Backend Engineer seeking a challenging More ❯

State/Region/Province London Country United Kingdom Domain Delivery Interest Group Company ITL UK Requisition ID 137810BR Role - Senior Technology Architect Technology - Azure Data Factory, ADLS, Snowflake, Kafka, Power BI, Confluent Cloud, MS Fabric, Python/Pyspark, MSBI(SSIS) Location - London Business Unit - DNA Compensation - Competitive (including bonus) Job Description We are looking for a Lead Data … client satisfaction. Conduct product demos, proof-of-concept workshops, and prepare effort estimates aligned with client budgets. Job description Role - Senior Technology Architect Technology - Azure Data Factory, ADLS, Snowflake, Kafka, Power BI, Confluent Cloud, MS Fabric, Python/Pyspark, MSBI(SSIS) Location - London Business Unit - DNA Compensation - Competitive (including bonus) Job Description We are looking for a Lead Data … expertise in Azure Data Factory, ADLS, Snowflake Mandatory: Strong hands-on experience in at least one of these technologies. Preferred: Experience in more than one is a strong advantage. Kafka, Power BI, Confluent Cloud, Microsoft Fabric Mandatory: Strong hands-on experience in at least one of these technologies. Preferred: Experience in multiple is a plus. Python/PySpark, MSBI More ❯

it's a piece of code, a flaky test, or a README. Reporting into an Engineering Manager, the Backend Engineer will leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, while also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. You won't just be working through tickets - you'll be part of a genuinely … architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Backend Engineer who enjoys working autonomously More ❯

written in Dart with Flutter and available on both Android and iOS Our NALA for Business product is web only and written in React and Typescript. We use Postgres, Kafka, Redis and Vault We use and leverage AWS as much as possible and we manage it with Terraform We write unit and integration tests, do code reviews and deploy … least 5+ years of experience building highly reliable and scalable backend services in Go Experience with RDBMSs such as Postgres, MySQL etc. Experience with message-brokers technologies such as Kafka, RabbitMQ etc, working within event-driven architectures. You have excellent knowledge of the best practices in designing, developing and deploying those services in a cloud environment You have experience More ❯

functions Work with sophisticated analytics tools that are custom built by our team of developers Use the latest technology stacks such as AWS, Java 17, Python 3, HDF5, Kubernetes, Kafka and Argo Is globally distributed across Europe and North America supporting global systems. Our team cares deeply about preserving a respectful and diverse team culture. We believe in choosing … software (git or svn) Experience with cloud computing, AWS preferred SQL experience including queries/updates/table creation/basic database maintenance Exposure to data technologies such as Kafka, Spark or Delta Lake is useful but not mandatory. For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice More ❯

/Elixir code Polyglot - All our services are built-in Ruby, Elixir, GraphQL federation or Typescript, depending on which language best suits the solution Messaging - For communication, we use Kafka for events and gRPC or JSON for synchronous calls. Kubernetes - All our services run in Kubernetes. Migration - We are in the process of switching away from our Ruby monolith … or TypeScript Distributed Systems - You understand how to build, deploy and maintain a globally distributed system. Event-driven architecture - Knowledge of event-driven systems and tools/protocols like Kafka, and gRPC will be a plus. Experience - Have experience ( 3+ years) working on internal product engineering teams, developer tools, developer productivity or infrastructure products at scale. Adaptable - Are a More ❯

Superb 12 month contract opportunities on offer for multiple Senior Java Developers within a Central Government Department. We're looking for talented and enthusiastic Java Developers (with experience of Java 21) who want to work within an Agile, multidisciplinary team More ❯

Senior C++ Contract Engineer - SQL, Unix/Linux, Oracle, Kafka, Finance, C#, GUI Our financial services client is looking for an experienced Senior C++ Software Engineer to help grow and enhance their platform. As a Senior C++ Software Engineer, you will be involved in: Analysis of user requirements and translation into solution design Estimating and breaking down tasks into More ❯

data processing and reporting. In this role, you will own the reliability, performance, and operational excellence of our real-time and batch data pipelines built on AWS, Apache Flink, Kafka, and Python. You'll act as the first line of defense for data-related incidents , rapidly diagnose root causes, and implement resilient solutions that keep critical reporting systems up … call escalation for data pipeline incidents, including real-time stream failures and batch job errors. Rapidly analyze logs, metrics, and trace data to pinpoint failure points across AWS, Flink, Kafka, and Python layers. Lead post-incident reviews: identify root causes, document findings, and drive corrective actions to closure. Reliability & Monitoring Design, implement, and maintain robust observability for data pipelines … Architecture & Automation Collaborate with data engineering and product teams to architect scalable, fault-tolerant pipelines using AWS services (e.g., Step Functions , EMR , Lambda , Redshift ) integrated with Apache Flink and Kafka . Troubleshoot & Maintain Python -based applications. Harden CI/CD for data jobs: implement automated testing of data schemas, versioned Flink jobs, and migration scripts. Performance Optimization Profile and More ❯

person insight into their missions, workflows, and perspectives, then utilize that knowledge to inform the platform's design. Core technical tasks include: REST API development in Java, working within Kafka streams to process and transform data, and general Java development to build and maintain the product. Responsibilities: Contribute to the development of enterprise-grade software solutions. Build and maintain … proficient with the project's graph database and develop complex database queries. Required Skills: Experience using Java to build enterprise products and applications. Knowledge of streaming analytic platforms like Kafka, RabbitMQ, Spark, etc. Familiarity with Extract, Transform, Load (ETL) software patterns to ingest large and complex datasets. Familiarity with Git and GitLab CI/CD. Understanding of common Enterprise … Integration Patterns (EIP) and how to apply them Desired Skills: Experience with graph databases such as Neo4j. Experience building real-time data processing applications using streaming libraries like Kafka Streams. Experience modeling data and relationships in graph databases. Experience with networking concepts, protocols, and analysis (routers, switches, etc.). Knowledge of SIGINT collection and analysis systems. Experience with production More ❯

The skillset · Support the standing up multiple environments on AWS· Support the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE· MFA/IAM role management for team of developers· Correctly tagging cloud resources per DWP central … inc. Lambda, SQS, SNS), IAM management for pipelines and users, blue/green deployment experience, Terraform or Cloud Formation, Prometheus, CloudWatchNICE TO HAVE: SonarQube, Wiz, FinOps tagging experience (apptio), Kafka, Kong EE, Dynatrace, micro-UI patterns (jwt tokenisation and passthrough More ❯

The skillset · Support the standing up multiple environments on AWS · Support the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE · MFA/IAM role management for team of developers · Correctly tagging cloud resources per DWP central … Lambda, SQS, SNS), IAM management for pipelines and users, blue/green deployment experience, Terraform or Cloud Formation, Prometheus, CloudWatch NICE TO HAVE: SonarQube, Wiz, FinOps tagging experience (apptio), Kafka, Kong EE, Dynatrace, micro-UI patterns (jwt tokenisation and passthrough More ❯

skill set Support the standing up multiple environments on AWS Support the management of the AWS stack/Git pipelines across mix of React Front End, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE MFA/IAM role management for team of developers Correctly tagging cloud resources per DWP central … Lambda, SQS, SNS), IAM management for pipelines and users, blue/green deployment experience, Terraform or Cloud Formation, Prometheus, CloudWatch NICE TO HAVE: SonarQube, Wiz, FinOps tagging experience (apptio), Kafka, Kong EE, Dynatrace, micro-UI patterns (jwt tokenisation and passthrough More ❯