601 to 625 of 654 Kafka Jobs

skills in Python or another major language; writing clean, testable, production-grade ETL code at scale. Modern Data Pipelines: Experience with batch and streaming frameworks (e.g., Apache Spark, Flink, Kafka Streams, Beam), including orchestration via Airflow, Prefect or Dagster. Data Modeling & Schema Management: Demonstrated expertise in designing, evolving, and documenting schemas (OLAP/OLTP, dimensional, star/snowflake, CDC … data contracts, and data cataloguing. API & Integration Fluency: Building data ingestion from REST/gRPC APIs, file drops, message queues (SQS, Kafka), and 3rd party SaaS integrations, with idempotency and error handling. Storage & Query Engines: Strong with RDBMS (PostgreSQL, MySQL), NoSQL (DynamoDB, Cassandra), data lakes (Parquet, ORC), and warehouse paradigms. Observability & Quality: Deep familiarity with metrics, logging, tracing, and More ❯

.NET Developer (FinTech) - London - £500-550 per day (.NET, C#, Azure, SQL, Kafka, Microservices) We're working with an industry leading currency exchange platform that are looking for a .NET Developer to come and join them for an initial 6-month contract. This person will be tasked with working alongside an existing engineering team as they move away from … role. Previous FinTech/Payments/Exchange experience would be highly advantageous but not a prerequisite for this role. Technical requirements - .NET C# SQL Azure (Functions, LoigcApps, ServiceBus etc) Kafka Docker Microservices CI/CD Pipelines If you're available in the next 2 weeks then please apply here as this role requires the right person to start ASAP. … .NET, C#, Azure, SQL, Kafka, Microservices) .NET Developer (FinTech) - London - £500-550 per day More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will … design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. … financial services environments You have expertise with AWS including Lake formation and transformation layers You have strong Python coding skills You have experience with real-time data streaming using Kafka You're collaborative and pragmatic with excellent communication and stakeholder management skills You're comfortable taking ownership of projects and working end-to-end You have a good knowledge More ❯

Senior Data Engineer (AWS Kafka Python) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will … design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure scalability, security and resilience. You'll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. … financial services environments You have expertise with AWS including Lake formation and transformation layers You have strong Python coding skills You have experience with real-time data streaming using Kafka You're collaborative and pragmatic with excellent communication and stakeholder management skills You're comfortable taking ownership of projects and working end-to-end You have a good knowledge More ❯

excited by the opportunity to build new things. You will have many examples of successfully delivering complex enterprise software projects. We use technologies such as C++, Java, Kotlin, Kubernetes, Kafka, ElasticSearch and AWS. You'll be comfortable using some of these to research and prototype new approaches. Natural collaborator . It takes a village to do anything worthwhile, and … systems Familiar with Docker, Kubernetes and cloud technologies such as AWS Experience with processing large data sets on Elasticsearch or similar data stores Experience with event-driven architectures (CQRS, Kafka Streams etc) Understanding of networking fundamentals Cisco values the perspectives and skills that emerge from employees with diverse backgrounds. That's why Cisco is expanding the boundaries of discovering More ❯

DevSecOps Engineer Consortia has partnered with an innovative Fintech company at the forefront of transforming the financial services industry. This dynamic environment offers you a unique opportunity to be part of a forward-thinking organisation that values innovation, collaboration, and More ❯

Rust Developer - Crypto exchange Up to £135,000 + Bonus Join the best-performing cryptocurrency exchange and help design and develop cutting-edge, trader-neutral Rust platforms used by over 9 million users daily. As a Rust Developer, you can More ❯

the ground-up with a deep understanding of core Java, data structures and concurrency, rather than relying on frameworks such as Spring. You have built event-driven applications using Kafka and solutions with event-streaming frameworks at scale (Flink/Kafka Streams/Spark) that go beyond basic ETL pipelines. You know how to orchestrate the deployment of More ❯

InsurTech with cutting-edge machine learning and AI? At Simply Business, we're not just using data; we're continuously evolving our platform with technologies like AWS, Snowflake, and Kafka to drive real value and inform company strategy. As a leading player in the market, our mission is to remain at the forefront of data engineering, ML, and AI … continuously evolving our class-leading data and ML platform infrastructure, balancing maintenance with exciting greenfield projects. develop and maintain our real-time model serving infrastructure, utilising technologies such as Kafka, Python, Docker, Apache Flink, Airflow, and Databricks. Actively assist in model development and debugging using tools like PyTorch, Scikit-learn, MLFlow, and Pandas, working with models from gradient boosting More ❯

Database Management System (RDBMS) Web app server Familiar (Experience preferred) with open source web application server such as Apache HTTP, Tomcat Middle tier - messaging systems Experience using the following: Kafka - or any Java-based message broker Active MQ - product we are using that is java based message broker or similiar Experience in development and usage with RESTful web services … in Relational Database Management. 10 Years' Experience with Angular 3+ front-end web application platform and PrimeNG UI components or similar web framework. Experience with middle tier messaging systems, Kafka, Active MQ or similiar and development and usage with RESTful web services Active Top Secret or TS/SCI security clearance. Need to have Current Poly or consent to More ❯

Build scalable services with Kotlin, and deal with problems like synchronization, asynchronous operations, database optimisations, scalability and reliability of systems Gain exposure to an array of technologies such as Kafka, PostgreSQL, Redis, Docker etc Optimise existing systems for scalability, extensibility and performance whilst building out reusable, modular code for use across Blockchain's products Ensure security is at the … strong technical documentation and effective monitoring You inspire other engineers to do better Understanding of data structures, databases and large-scale distributed systems Preferably exposure to technologies such as Kafka, PostgreSQL, Redis, RabbitMQ You are customer focused and continuously suggest how the backend can provide the best Customer Experience A passion for crypto and the transformations it enables We … use Kotlin, PostgreSQL, Kafka, Redis, Datadog, Amplitude, Grafana, BigQuery, ApacheSpark and more COMPENSATION & PERKS Unlimited vacation policy; work hard and take time when you need it Unlimited learning policy; order the technical resources you need or simply pick something up from our company library Apple equipment Full-time salary based on experience and meaningful equity in an industry-leading More ❯

weekly travel Inside IR35Support the standing up multiple environments on AWSSupport the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EESkills required:REQUIRED/NON-NEGOTIABLE: - Full AWS stack (inc. Lambda, SQS, SNS)- IAM management for pipelines … and users- Terraform or Cloud Formation- CloudWatch- Kubernetes NICE TO HAVE: - Kafka- Kong EE- Micro-UI patterns (jwt tokenisation and passthrough More ❯

Inside IR35 Support the standing up multiple environments on AWS Support the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE Skills required: REQUIRED/NON-NEGOTIABLE: - Full AWS stack (inc. Lambda, SQS, SNS) - IAM management for … pipelines and users - Terraform or Cloud Formation - CloudWatch - Kubernetes NICE TO HAVE: - Kafka - Kong EE - Micro-UI patterns (jwt tokenisation and passthrough More ❯

Inside IR35 Support the standing up multiple environments on AWS Support the management of the AWS stack/Git pipelines across mix of React front-end, microservices, lambda functions, Kafka integration, possible mix of Transit Gateway/Private Link, use of Kong EE Skills required: REQUIRED/NON-NEGOTIABLE: - Full AWS stack (inc. Lambda, SQS, SNS) - IAM management for … pipelines and users - Terraform or Cloud Formation - CloudWatch - Kubernetes NICE TO HAVE: - Kafka - Kong EE - Micro-UI patterns (jwt tokenisation and passthrough More ❯

database systems to the next level. We're looking for a highly-technical, hands-on engineer, who loves to work with data plane services like Cassandra, ElasticSearch/Opensearch, Kafka, Redis, Valkey, MySQL, PostgreSQL and is comfortable building automation around large-scale cloud-based critical systems. We'll be looking at candidate CVs with an eye on achievement what … can do for us in the future. Focus area: OpenSearch and ElasticSearch What You'll Do: Maintain a deep understanding of the data components - including Cassandra, ElasticSearch/OpenSearch, Kafka, Zookeeper, MySQL and PostgreSQL, Redis, Valkey, Memcache, Pulsar, SQS and use that understanding to operate and automate properly configured clusters. Understanding of operating databases in kubernetes and managing container … data safe, secure, and available. What You'll Need: Configuration management (Chef) Scripting in Python and bash Experience with large scale datastores using technologies like Cassandra, ElasticSearch/Opensearch, Kafka, Zookeeper,MySQL, PostgreSQL, Redis, Valkey, Memcache, Pulsar, SQS Experience with large-scale, business-critical Linux environments Experience operating within the cloud, preferably Amazon Web Services, GCP and OCI Proven More ❯

Currently, our micro-services communicate via REST API calls, fostering seamless integration between different services. You will actively participate in our ongoing transition towards an event-driven architecture, utilising Kafka as a core component. We are proud to say that our engineers at ClearScore are world class and at the heart of making this mission a reality for our … millions of users. The Typelevel Stack (Cats, Cats Effect, http4s, Circe), Kafka, SBT and occasionally Akka HTTP A world-class SRE team who champion our "you build it you run it" principle, empowering our developers to work with AWS, Kubernetes and Spinnaker A Quality Assistance programme to build, test, release and monitor your own work TDD and peer-reviewing More ❯

of the full software engineering lifecycle, including design, development, and implementation. Reporting into an Engineering Manager, the GoLang Developer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the GoLang Developer will also be responsible for optimising system performance, reliability, and … design and architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Experience with Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate GoLang Developer seeking a challenging and More ❯

the full software engineering lifecycle, including design, development, and implementation. Reporting into an Engineering Manager, the Senior Backend Engineer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the Senior Backend Engineer will also be responsible for optimising system performance, reliability … architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Senior Backend Engineer seeking a challenging More ❯

strong commitment to user-centred design and agile delivery, and more to deliver innovative digital services that matter Preferred Tech Stack Expertise Cloud Infrastructure : AWS (EKS, RDS, Aurora, ElastiCache, Kafka, IAM) Secure Hosting : Experience working with air-gapped or government-secure environments Secrets & Identity Management : HashiCorp Vault, Keycloak Automation : IaC, pipeline build automation, event relay tooling Scripting : Bash, Python … on-call support . Ensure all services are compliant with security standards and support the change and release governance model . Build and maintain infrastructure components like event streaming (Kafka), databases (Aurora, RDS, Redis), identity management (Keycloak), and caching layers. Enhance and maintain CI/CD tooling and self-service developer pipelines for tenant teams. Proactively manage and resolve More ❯

full software engineering life cycle, including design, development, and implementation. Reporting into an Engineering Manager, the Senior Backend Engineer will also leverage modern technologies like AWS, Kubernetes, Docker, and Kafka, whilst also architecting and implementing microservices-based solutions in collaboration with cross-functional teams. In addition, the Senior Backend Engineer will also be responsible for optimising system performance, reliability … architecture Hands-on experience working on complex, data-intensive applications A product-focused mindset and familiarity with working in technology-driven organisations or start-ups Hands-on skills in Kafka, Cassandra, gRPC, and microservices architecture will also be beneficial, as well as experience contributing to open-source projects If you're a passionate Senior Backend Engineer seeking a challenging More ❯

written in Dart with Flutter and available on both Android and iOS Our NALA for Business product is web only and written in React and Typescript. We use Postgres, Kafka, Redis and Vault We use and leverage AWS as much as possible and we manage it with Terraform We write unit and integration tests, do code reviews and deploy … least 5+ years of experience building highly reliable and scalable backend services in Go Experience with RDBMSs such as Postgres, MySQL etc. Experience with message-brokers technologies such as Kafka, RabbitMQ etc, working within event-driven architectures. You have excellent knowledge of the best practices in designing, developing and deploying those services in a cloud environment You have experience More ❯

/Elixir code Polyglot - All our services are built-in Ruby, Elixir, GraphQL federation or Typescript, depending on which language best suits the solution Messaging - For communication, we use Kafka for events and gRPC or JSON for synchronous calls. Kubernetes - All our services run in Kubernetes. Migration - We are in the process of switching away from our Ruby monolith … or TypeScript Distributed Systems - You understand how to build, deploy and maintain a globally distributed system. Event-driven architecture - Knowledge of event-driven systems and tools/protocols like Kafka, and gRPC will be a plus. Experience - Have experience ( 3+ years) working on internal product engineering teams, developer tools, developer productivity or infrastructure products at scale. Adaptable - Are a More ❯

We have excellent 12 month contract opportunities for multiple Senior Java Developers within a Central Government Department. We're looking for talented and enthusiastic Java Developers who want to work within an Agile, multidisciplinary team of Developers, Designers, and Analysts More ❯

Role: Data Scientist Clearance: TS/SCI Clearance Location: (Washington DC/Northern Virginia) Salary: $160k-$200k + Shares and bonus My client is an innovative company delivering cutting-edge AI and data analytics solutions through an advanced AI platform. More ❯

data processing and reporting. In this role, you will own the reliability, performance, and operational excellence of our real-time and batch data pipelines built on AWS, Apache Flink, Kafka, and Python. You'll act as the first line of defense for data-related incidents , rapidly diagnose root causes, and implement resilient solutions that keep critical reporting systems up … call escalation for data pipeline incidents, including real-time stream failures and batch job errors. Rapidly analyze logs, metrics, and trace data to pinpoint failure points across AWS, Flink, Kafka, and Python layers. Lead post-incident reviews: identify root causes, document findings, and drive corrective actions to closure. Reliability & Monitoring Design, implement, and maintain robust observability for data pipelines … Architecture & Automation Collaborate with data engineering and product teams to architect scalable, fault-tolerant pipelines using AWS services (e.g., Step Functions , EMR , Lambda , Redshift ) integrated with Apache Flink and Kafka . Troubleshoot & Maintain Python -based applications. Harden CI/CD for data jobs: implement automated testing of data schemas, versioned Flink jobs, and migration scripts. Performance Optimization Profile and More ❯