Development (TDD) Experience working with AWS-based DevOps or CI/CD pipelines is advantageous - particularly if you've used tools such as OpenSearch (or Elasticsearch), AmazonMSK/Kafka, or AWS Lambda as part of infrastructure, monitoring, or event-driven architectures. Familiarity with Apache Camel or ApacheKafka is advantageous, especially for designing event-driven architectures More ❯
driven development Experience working with AWS-based DevOps or CI/CD pipelines is advantageous - particularly if you've used tools such as OpenSearch (or Elasticsearch), AmazonMSK/Kafka, or AWS Lambda as part of infrastructure, monitoring, or event-driven architectures. You'll have end-to-end ownership of features. We welcome input on how to More ❯
London, South East, England, United Kingdom Hybrid / WFH Options
Computer Futures
designed for scale, resilience, and agility. Frontend: React.js (Hooks, Context API) TypeScript Redux Cypress, Jest Backend: Java 11+ Spring Boot RESTful APIs Microservices PostgreSQL Kafka Cloud & DevOps: AWS (EKS, MSK, Opensearch) CI/CD with Jenkins Monitoring with CloudWatch, Kibana Why You'll Love Working Here This isn't just a role-it's a career accelerator. You'll More ❯
You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with ApacheKafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or More ❯
You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with ApacheKafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or More ❯
Greater Manchester, England, United Kingdom Hybrid / WFH Options
Searchability®
More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables and the Medallion architecture . Hands-on experience with AWS services such as S3 More ❯
GCP, Azure) and Kubernetes • Familiarity with CI/CD pipelines and infrastructure automation (Ansible, CFK) Required: • Experience with other Kafka platforms such as Open-source Kafka, Cloudera Kafka, AWS MSK, etc. • Solid understanding of Kafka architecture and operational management in enterprise environments. • Experience in professional services or implementation consulting for SaaS products, especially involving data integration, streaming, or enterprise More ❯
GCP, Azure) and Kubernetes • Familiarity with CI/CD pipelines and infrastructure automation (Ansible, CFK) Required: • Experience with other Kafka platforms such as Open-source Kafka, Cloudera Kafka, AWS MSK, etc. • Solid understanding of Kafka architecture and operational management in enterprise environments. • Experience in professional services or implementation consulting for SaaS products, especially involving data integration, streaming, or enterprise More ❯
Glasgow, Scotland, United Kingdom Hybrid / WFH Options
Caspian One
Demonstrable experience applying Generative AI concepts to front-office/capital markets environments Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation) Passion for being hands-on while enabling and growing a small engineering team Nice to Have Experience with on-prem Hadoop and Kubernetes Familiarity with AWS cost management More ❯
experience applying Generative AI concepts (ideally in a front-office/capital market environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Experience working in a fast-paced front-office environment in either engineering or analytical roles. Passion for being hands-on and contributing to a collaborative engineering culture. More ❯
experience applying Generative AI concepts (ideally in a front-office/capital market environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Experience working in a fast-paced front-office environment in either engineering or analytical roles. Passion for being hands-on and contributing to a collaborative engineering culture. More ❯
Glasgow, Scotland, United Kingdom Hybrid / WFH Options
Caspian One
experience applying Generative AI concepts (ideally in a front-office/capital markets environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation) Experience working in a fast-paced front-office environment in either engineering or analytical roles Passion for being hands-on and contributing to a collaborative engineering culture Nice More ❯
glasgow, central scotland, united kingdom Hybrid / WFH Options
Caspian One
experience applying Generative AI concepts (ideally in a front-office/capital markets environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation) Experience working in a fast-paced front-office environment in either engineering or analytical roles Passion for being hands-on and contributing to a collaborative engineering culture Nice More ❯
testing. Demonstrable experience applying GenAI concepts to front-office/capital market environments. Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small engineering team. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost More ❯
testing. Demonstrable experience applying GenAI concepts to front-office/capital market environments. Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small engineering team. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost More ❯
Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For leadership-focused More ❯
AWS Kafka platform engineer Bachelor's degree in computer science or related fields Minimum 2 Implementations are mandated Proficiency in Kafka Streams Kafka Connect and ksqlDB. Experience with AWS MSK Confluent Cloud and monitoring tools like Prometheus and Grafana Familiarity with Kubernetes CICD pipelines and GitOps workflows Proficiency in a wide range of public cloud technologies ex Cloud watchAWS … EC2 EKS EBS RDS S3 etc. Experience with Amazon AWS cloud services such as EC2 S3 SQS Kafka and RDS is preferred Design and manage AWS Kafka based streaming data pipelines. Configure and monitor Kafka clusters for performance and scalability. Integrate Kafka with AWS services like EC2 RDS Lambda and S3. Implement security protocols disaster recovery and high More ❯
