successes to team members and Product Owners. Has experience of people management or desire to manage individuals on the team Nice to Have Experience with some of these- Kafka, Kinesis, Kinesis Analytics, Glue, Lambda, Kubernetes, ETL pipelines, BigQuery, Dataflow, BigTable, and SQL Enthusiastic about learning and applying new technologies (growth mindset). Ability to build new solutions and More ❯
experience in operations of sizing, monitoring, and management, for Kafka, Logstash, Beats, Kibana, and Elastic Agent You have worked with queuing systems and data streams in production (SQS, ActiveMQ, Kinesis, Kafka or similar) and you are familiar with programming languages such as: PHP and/or Python and/or Java; 4+ years of experience in administering/developing More ❯
scalable, and high-availability architectures. Solid understanding of networking, security, authentication, and authorization (OAuth, JWT, OpenID Connect, IAM roles, etc.). Familiarity with big data technologies, streaming platforms like Kinesis, and data lake architectures. Proficiency in C#, Python, or Node.js for backend development and scripting. Strong problem-solving, analytical, and communication skills. AWS certification (e.g., AWS Certified Solutions Architect More ❯
range of disciplines and skill levels. • Experience working with Identity and Access Management systems. • Knowledge of AWS cloud infrastructure and services. Including experience with AWS; CDK, CloudFormation, Lambda, EC2, Kinesis, WAF, ALB. • Experience working on zero down time systems and providing live support in the event of service disruption. If you can bring some of these skills and experience More ❯
balancing technical excellence with business priorities and constraints Nice to have Experience building Data Mesh or Data Lake architectures. Familiarity with Kubernetes, Docker, and real-time streaming (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. What's it like to work at Zego? Joining Zego is a career-defining move. People go further here, reaching More ❯
AWS Data Engineer London, UK Permanent Strong experience in Python, PySpark, AWS S3, AWS Glue, Databricks, Amazon Redshift, DynamoDB, CI/CD and Terraform. Total 7 + years of experience in Data engineering is required. Design, develop, and optimize ETL pipelines using AWS Glue, Amazon EMR and Kinesis for real-time and batch data processing. Implement data … transformation, streaming, and storage solutions on AWS, ensuring scalability and performance. Collaborate with cross-functional teams to integrate and manage data workflows. Skill-set Amazon Redshift, S3, AWS Glue, Amazon EMR, Kinesis Analytics Ensure data security, compliance, and best practices in cloud data engineering Experience with programming languages such as Python, Java, or Scala. More ❯
automated tests to ensure the quality and reliability of our cloud-based applications. Requirements : Java, Java Springboot , JEST ( good to have ) , typescript ( good to have) , AWS services knowledge ( Lambda, kinesis stream, SQS, Eventbridge) , BDD framework cucumber ( good to have ), CI/CD pipelines and DevOps practices. Key Responsibilities: Design, develop, and execute automated tests using the Java Springboot framework. More ❯
automated tests to ensure the quality and reliability of our cloud-based applications. Requirements : Java, Java Springboot , JEST ( good to have ) , typescript ( good to have) , AWS services knowledge ( Lambda, kinesis stream, SQS, Eventbridge) , BDD framework cucumber ( good to have ), CI/CD pipelines and DevOps practices. Key Responsibilities: Design, develop, and execute automated tests using the Java Springboot framework. More ❯
Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Strong understanding of data modelling and system architecture Excellent problem-solving and analytical skills Whilst having More ❯
implementing API service architecture Experience in working with a relational database Experience provisioning infrastructure with Terraform and Cloud Formation Understanding of messaging systems like MQ, Rabbit MQ, Kafka, or Kinesis Effective communication and collaboration skills to be able to partner with business stakeholders and other technical teams AWS and Java Certifications External applicants will be required to perform a More ❯
implementing API service architecture Experience in working with a relational database Experience provisioning infrastructure with Terraform and Cloud Formation Understanding of messaging systems like MQ, Rabbit MQ, Kafka, or Kinesis Effective communication and collaboration skills to be able to partner with business stakeholders and other technical teams AWS and Java Certifications External applicants will be required to perform a More ❯
may be a fit if you have: Expertise in Cloud-Native Data Engineering: 3+ years building and running data pipelines in AWS or Azure, including managed data services (e.g., Kinesis, EMR/Databricks, Redshift, Glue, Azure Data Lake). Programming Mastery: Advanced skills in Python or another major language; writing clean, testable, production-grade ETL code at scale. Modern More ❯
languages Proven experience building and operating scalable distributed systems and services within AWS cloud infrastructure or similar technologies. Designed and implemented distributed, event-driven systems using Kafka Streams, AWS Kinesis, or similar. Optimize for low-latency and high-throughput processing (1M+ TPS) microservices. Implemented auto-scaling , blue-green deployments , and canary releases andBuild and maintain SLAs, SLOs, and SLIs More ❯
Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: Data warehousing and lake architectures ETL/ELT pipeline development SQL and NoSQL databases Distributed computing frameworks (Spark, Kinesis etc) Software development best practices including CI/CD, TDD and version control. Strong understanding of data modelling and system architecture Excellent problem-solving and analytical skills Whilst having More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
advocate for scalable, efficient data processes and platform enhancements Tech Environment: Python, SQL, Spark, Airflow, dbt, Snowflake, Postgres AWS (S3), Docker, Terraform Exposure to Apache Iceberg, streaming tools (Kafka, Kinesis), and ML pipelines is a bonus What We're Looking For: 5+ years in Data Engineering, including 2+ years in a leadership or management role Experience designing and operating More ❯
languages Proven experience building and operating scalable distributed systems and services within AWS cloud infrastructure or similar technologies. Designed and implemented distributed, event-driven systems using Kafka Streams, AWS Kinesis, or similar. Optimize for low-latency and high-throughput processing (1M+ TPS) microservices. Implemented auto-scaling , blue-green deployments , and canary releases andBuild and maintain SLAs, SLOs, and SLIs More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Harnham - Data & Analytics Recruitment
talent and fostering a culture of learning and ownership Nice to Have Experience with Data Mesh or Data Lake architectures Familiarity with Kubernetes , Docker, and real-time streaming (Kafka, Kinesis) Exposure to ML engineering pipelines or MLOps Interested? If you're ready to lead a team at the forefront of data innovation in a mission-driven scale-up, apply More ❯
the Data Platform by designing and building the next generation of the stack. Develop, run and support our batch and real-time data pipelines using tools like Airflow, PlanetScale, Kinesis, Snowflake, Tableau, all in AWS. Collaborate with product managers, data engineers, analysts and data scientists to develop tooling and infrastructure to support their needs. Develop automation and tooling to More ❯
Proficient in data technologies like MySQL , Hadoop , or Cassandra . Experience with batch processing , data pipelines , and data integrity practices. Familiarity with AWS services (e.g., RDS, Step Functions, EC2, Kinesis) is a plus. Solid understanding of unit , integration , and E2E testing paradigms. Prior experience in FinTech, Financial sector, Banking or Payment system. Awareness of security best practices (authentication, authorization More ❯
Proficient in data technologies like MySQL , Hadoop , or Cassandra . Experience with batch processing , data pipelines , and data integrity practices. Familiarity with AWS services (e.g., RDS, Step Functions, EC2, Kinesis) is a plus. Solid understanding of unit , integration , and E2E testing paradigms. Prior experience in FinTech, Financial sector, Banking or Payment system. Awareness of security best practices (authentication, authorization More ❯
as a Database Designer & Senior Data Engineer, with hands-on experience in cloud based data services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage , Azure Data Factory. Knowledge of data modelling , ETL processes, and data warehousing principles. Preferred Skills Strong More ❯
Hemel Hempstead, Hertfordshire, United Kingdom Hybrid / WFH Options
Eckoh
with front-end applications (e.g., React, Nuxt, Vue) Collaborate closely with product teams to translate functional requirements into technical solutions Cloud-Native Development: Design and deploy containerized services with Amazon EKS (Elastic Kubernetes Service), focusing on scalability, resilience, and service orchestration Build cloud-native applications using AWS services such as Lambda, API Gateway, DynamoDB, SQS, and EventBridge Develop robust … applications Strong coding skills in Node.js and Python Solid experience with AWS application services (Lambda, API Gateway, Step Functions, DynamoDB, etc.) Production experience deploying and managing containerized services on Amazon EKS Proven ability to design and build modern, API-driven systems in a scalable resilient cloud-based platform Experience developing or integrating data processing systems (batch or streaming) and … business value early and often. Desirables: Experience with modern front-end frameworks and API integration (React, Vue, Angular) Familiarity with message-based architectures and tools like RabbitMQ, Kafka, or Kinesis Demonstrable experience building LLM backed systems and applications Understanding of regulatory and compliance frameworks (e.g., PCI, ISO 27001, SOC 2, GDPR) and how to apply them in software and More ❯
Hemel Hempstead, Hertfordshire, South East, United Kingdom Hybrid / WFH Options
Eckoh PLC
with front-end applications (e.g., React, Nuxt, Vue) Collaborate closely with product teams to translate functional requirements into technical solutions Cloud-Native Development: Design and deploy containerized services with Amazon EKS (Elastic Kubernetes Service), focusing on scalability, resilience, and service orchestration Build cloud-native applications using AWS services such as Lambda, API Gateway, DynamoDB, SQS, and EventBridge Develop robust … applications Strong coding skills in Node.js and Python Solid experience with AWS application services (Lambda, API Gateway, Step Functions, DynamoDB, etc.) Production experience deploying and managing containerized services on Amazon EKS Proven ability to design and build modern, API-driven systems in a scalable resilient cloud-based platform Experience developing or integrating data processing systems (batch or streaming) and … business value early and often. Desirables: Experience with modern front-end frameworks and API integration (React, Vue, Angular) Familiarity with message-based architectures and tools like RabbitMQ, Kafka, or Kinesis Demonstrable experience building LLM backed systems and applications Understanding of regulatory and compliance frameworks (e.g., PCI, ISO 27001, SOC 2, GDPR) and how to apply them in software and More ❯
from FP, Reactive Programming and Distributed Computing to build these services, using Scala, Akka, Kafka, Play and Cats, as well a wide range of cloud-native technologies including AWS (Kinesis, DynamoDB, Lambda), Docker and Serverless. We have a mature DevOps culture in place, where the team is responsible for the infrastructure and deployment of those applications - "You build it … you run it." What you will do: You will be using Scala, Akka, Kafka, Kinesis, and Dynamo to build and innovate our software that is distributed, reactive, and scalable. You will: Contribute to or lead a significant part of the implementation and deployment of services within your team. Work on challenging and varied business domains including video encoding, digital More ❯
Manchester, Lancashire, United Kingdom Hybrid / WFH Options
WorksHub
processes that help us achieve our objectives. So each team leverages the technology that fits their needs best. You'll see us working with data processing/streaming like Kinesis, Spark and Flink; application technologies like PostgreSQL, Redis & DynamoDB; and breaking things using in-house chaos principles and tools such as Gatling to drive load all deployed and hosted … experience: including REST and GraphQL . Monitoring and optimising applications written for the JVM . Relational and NoSQL databases, particularly PostgreSQL, Aurora, & DynamoDB with experience modelling & optimising query performance. Kinesis or any other streaming data. Understanding of statistical analysis of data. Experience with or an interest in " DevOps " tooling & infrastructure as code. A strong understanding of continuous integration and More ❯