to the customer. You’ll also oversee the movement of data from the cloud into long-term storage for both internal and customer use, with customer preference for ApacheKafka formats. Key Responsibilities Maintain and extend PostgreSQL databases hosted on DigitalOcean, updating schemas for new products and ensuring reliable cloud data storage. Redesign data transfer architecture to use OpenVPN … Desirable Skills Programming experience in Rust (for Linux processor development). Experience with JavaScript (for HMI or front-end interfaces). Familiarity with AWS cloud infrastructure. Knowledge of ApacheKafka and data streaming architecture. Background in energy storage, embedded systems, or industrial IoT. If you feel you could be a good fit, please get in touch! CMC provide expert More ❯
regulated environment with sensitive data. You’ll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn, PyTorch, TensorFlow/Keras, LangChain, Pydantic, Spark, Kafka, Databricks, MLflow, Azure, Docker, Kubernetes. Salary: Up to £100k Working Environment: Fully Remote in UK What you’ll do Research, prototype, and deploy LLM use cases (Q&A, summarisation … document processing) Build and tune models using scikit-learn, PyTorch, TensorFlow/Keras, and XGBoost Create data pipelines for batch and streaming with Spark and Kafka Use Databricks and MLflow for experiments, deployment, and monitoring What you’ll bring Hands-on Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/KafkaMore ❯
join their ever-expanding platform/DevOps team remotely from the UK. They are looking for you to have excellent cloud knowledge, ideally AWS as well as Terraform and Kafka experience. As well as this you will also be expected to have knowledge of GitLab as well as having Python experience is a must. As the AWS Engineer, you … fully remote position but they have an office based in Southwark should you wish to go in. Skills required for the AWS Engineer: • Knowledge of AWS • Working experience of Kafka • Python experience •Excellent communicator This is a really exciting opportunity to rapidly grow your skill set and work closely with some of the most talented Developers and Analyst's More ❯
join their ever-expanding platform/DevOps team remotely from the UK. They are looking for you to have excellent cloud knowledge, ideally AWS as well as Terraform and Kafka experience. As well as this you will also be expected to have knowledge of GitLab as well as having Python experience is a must. As the AWS Engineer, you … fully remote position but they have an office based in Southwark should you wish to go in. Skills required for the AWS Engineer: Knowledge of AWS Working experience of Kafka Python experience Excellent communicator This is a really exciting opportunity to rapidly grow your skill set and work closely with some of the most talented Developers and Analyst's More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Understanding Recruitment
join their ever-expanding platform/DevOps team remotely from the UK. They are looking for you to have excellent cloud knowledge, ideally AWS as well as Terraform and Kafka experience. As well as this you will also be expected to have knowledge of GitLab as well as having Python experience is a must. As the AWS Engineer, you … fully remote position but they have an office based in Southwark should you wish to go in. Skills required for the AWS Engineer: * Knowledge of AWS* Working experience of Kafka* Python experience*Excellent communicator This is a really exciting opportunity to rapidly grow your skill set and work closely with some of the most talented Developers and Analyst's More ❯
the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯
the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯
the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯
london (city of london), south east england, united kingdom
Selby Jennings
the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯
the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯
based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between 120,000 to 140,000 + 40% bonus/40% LTIP + 7.5k car allowance … requirements: Management & Leadership experience of Data Engineering function comprised of SQL and Azure engineers (circa 40) is a must have. Recent experience of implementation of Event driven architecture on Kafka is a must have. Demonstrable industry experience of a regulated environment (finance or banking preferred) is a must have. Extensive experience in large complex data engineering projects, designing and More ❯
based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between £120,000 to £140,000 + 40% bonus/40% LTIP + 7.5k car allowance … requirements: Management & Leadership experience of Data Engineering function comprised of SQL and Azure engineers (circa 40) is a must have. Recent experience of implementation of Event driven architecture on Kafka is a must have. Demonstrable industry experience of a regulated environment (finance or banking preferred) is a must have. Extensive experience in large complex data engineering projects, designing and More ❯
based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between £120,000 to £140,000 + 40% bonus/40% LTIP + 7.5k car allowance … requirements: Management & Leadership experience of Data Engineering function comprised of SQL and Azure engineers (circa 40) is a must have. Recent experience of implementation of Event driven architecture on Kafka is a must have. Demonstrable industry experience of a regulated environment (finance or banking preferred) is a must have. Extensive experience in large complex data engineering projects, designing and More ❯
based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between £120,000 to £140,000 + 40% bonus/40% LTIP + 7.5k car allowance … requirements: Management & Leadership experience of Data Engineering function comprised of SQL and Azure engineers (circa 40) is a must have. Recent experience of implementation of Event driven architecture on Kafka is a must have. Demonstrable industry experience of a regulated environment (finance or banking preferred) is a must have. Extensive experience in large complex data engineering projects, designing and More ❯
based data platforms (Databricks, streaming device data, Smart Data, ERP systems) coupled with hands on capabilites implementing robust data ingestions pipelines (ETL/ELT) and introduced even-driven architecture (Kafka) to enable scalable, real-time solutions. Our client is offering a basic salary between £120,000 to £140,000 + 40% bonus/40% LTIP + 7.5k car allowance … requirements: Management & Leadership experience of Data Engineering function comprised of SQL and Azure engineers (circa 40) is a must have. Recent experience of implementation of Event driven architecture on Kafka is a must have. Demonstrable industry experience of a regulated environment (finance or banking preferred) is a must have. Extensive experience in large complex data engineering projects, designing and More ❯
Reigate, England, United Kingdom Hybrid / WFH Options
esure Group
security and governance through robust access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks. Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform. Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives. What we’d … reporting requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policies Exposure to enabling GenAI and ML workloads by preparing model-ready and More ❯
guildford, south east england, united kingdom Hybrid / WFH Options
esure Group
security and governance through robust access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks. Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform. Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives. What we’d … reporting requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policies Exposure to enabling GenAI and ML workloads by preparing model-ready and More ❯
or instances daily. Key Requirements: Python Previously worked at a start up/smaller sized company 5 years+ experience Ability to build software which scales Building messaging queues e.g., Kafka (nice to have) This is entirely a Python back-end development role (Python 3), where the core framework used is FastAPI and Kafka for the messaging queues. The More ❯
data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or Confluent. Build and maintain scalable backend systems in Python or Scala, following clean code and testing principles. Develop tools and frameworks for data governance, privacy, and quality … advanced data use cases. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong experience in streaming technologies such as Kafka, Flink, or Confluent. Advanced proficiency in Python or Scala, with a solid grasp of software engineering fundamentals. Proven ability to design, deploy, and scale production-grade data platforms and More ❯
data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or Confluent. Build and maintain scalable backend systems in Python or Scala, following clean code and testing principles. Develop tools and frameworks for data governance, privacy, and quality … advanced data use cases. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong experience in streaming technologies such as Kafka, Flink, or Confluent. Advanced proficiency in Python or Scala, with a solid grasp of software engineering fundamentals. Proven ability to design, deploy, and scale production-grade data platforms and More ❯
data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or Confluent. Build and maintain scalable backend systems in Python or Scala, following clean code and testing principles. Develop tools and frameworks for data governance, privacy, and quality … advanced data use cases. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong experience in streaming technologies such as Kafka, Flink, or Confluent. Advanced proficiency in Python or Scala, with a solid grasp of software engineering fundamentals. Proven ability to design, deploy, and scale production-grade data platforms and More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Uniting Ambition
Solution Architect – Shape the Future of a High-Scale Platform Kafka, SQL, C#, .NET, Golang, TypeScript Are you ready to define and drive the architecture of a platform built to handle millions of transactions per second, powering international growth and long-term scalability? We’re embarking on a full systems transformation of a mission-critical, large-scale platform — with … world-class delivery. What You’ll Do Define solution architecture and technical strategy for a complex, high-scale platform Own end-to-end design across distributed, event-driven systems (Kafka, SQL, cloud-native) Partner with product, engineering, and business stakeholders to translate vision into architecture Lead technical planning, standards, and best practices across multiple teams Provide architectural oversight and … DNA of the platform What We’re Looking For Proven track record designing or architecting distributed, high-volume systems Experience with event-driven architectures and high-throughput data pipelines (Kafka) Strong knowledge of at least one of: C#, .NET, Golang, or TypeScript , plus SQL/databases Ability to balance hands-on technical leadership with high-level solution design Excellent More ❯
Software Technical Lead – Shape the Future of a High-Scale Platform Kafka, SQL, c# , .Net, Golang , Typescript, £70–75k + Excellent Benefits | Are you ready to take the lead on a major platform transformation that will support millions of transactions per second and fuel international expansion? We’re building a high-impact engineering team to drive a full systems … undergoing complete modernization What We’re Looking For: Proven experience in designing and architecting complex systems at scale Commercial experience within web clients or server-side development Knowledge of Kafka, SQL, c# , .Net, Golang or Typescript, though expertise in similar or alternative technologies is welcome. Strong leadership and communication skills Deep understanding of performance, scalability, and system design principles More ❯
Manchester, Lancashire, England, United Kingdom Hybrid / WFH Options
Uniting Ambition
Software Technical Lead – Shape the Future of a High-Scale Platform Kafka, SQL, c# , .Net, Golang , Typescript, £70–75k + Excellent Benefits | Are you ready to take the lead on a major platform transformation that will support millions of transactions per second and fuel international expansion? We’re building a high-impact engineering team to drive a full systems … undergoing complete modernization What We’re Looking For: Proven experience in designing and architecting complex systems at scale Commercial experience within web clients or server-side development Knowledge of Kafka, SQL, c# , .Net, Golang or Typescript, though expertise in similar or alternative technologies is welcome. Strong leadership and communication skills Deep understanding of performance, scalability, and system design principles More ❯
Role Title: Kafka SME Duration: 8 Months Location: Leeds/Remote Rate: £600 Per Day - Umbrella only Would you like to join a global leader in consulting, technology services and digital transformation? Our client is at the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms. Role purpose/… summary Kafka Modernisation. We are looking at a potential project starting in December and likely running for 8 months to migrate Cloudera CDP Kafka clusters to Acceldata ODP Kafka. Data pipelines are streaming and the target architecture is stretched. If anyone exists who is a Kafka expert and has experience of doing this before in a global More ❯