Development (TDD) Experience working with AWS-based DevOps or CI/CD pipelines is advantageous - particularly if you've used tools such as OpenSearch (or Elasticsearch), AmazonMSK/Kafka, or AWS Lambda as part of infrastructure, monitoring, or event-driven architectures. Familiarity with Apache Camel or ApacheKafka is advantageous, especially for designing event-driven architectures More ❯
driven development Experience working with AWS-based DevOps or CI/CD pipelines is advantageous - particularly if you've used tools such as OpenSearch (or Elasticsearch), AmazonMSK/Kafka, or AWS Lambda as part of infrastructure, monitoring, or event-driven architectures. You'll have end-to-end ownership of features. We welcome input on how to More ❯
You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with ApacheKafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or More ❯
You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with ApacheKafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or More ❯
Greater Manchester, England, United Kingdom Hybrid/Remote Options
Searchability®
More.. DATA ENGINEER – ESSTENTIAL SKILLS Proven experience building data pipelines using Databricks . Strong understanding of Apache Spark (PySpark or Scala) and Structured Streaming . Experience working with Kafka (MSK) and handling real-time data . Good knowledge of Delta Lake/Delta Live Tables and the Medallion architecture . Hands-on experience with AWS services such as S3 More ❯
GCP, Azure) and Kubernetes • Familiarity with CI/CD pipelines and infrastructure automation (Ansible, CFK) Required: • Experience with other Kafka platforms such as Open-source Kafka, Cloudera Kafka, AWS MSK, etc. • Solid understanding of Kafka architecture and operational management in enterprise environments. • Experience in professional services or implementation consulting for SaaS products, especially involving data integration, streaming, or enterprise More ❯
GCP, Azure) and Kubernetes • Familiarity with CI/CD pipelines and infrastructure automation (Ansible, CFK) Required: • Experience with other Kafka platforms such as Open-source Kafka, Cloudera Kafka, AWS MSK, etc. • Solid understanding of Kafka architecture and operational management in enterprise environments. • Experience in professional services or implementation consulting for SaaS products, especially involving data integration, streaming, or enterprise More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Caspian One
Demonstrable experience applying Generative AI concepts to front-office/capital markets environments Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation) Passion for being hands-on while enabling and growing a small engineering team Nice to Have Experience with on-prem Hadoop and Kubernetes Familiarity with AWS cost management More ❯
experience applying Generative AI concepts (ideally in a front-office/capital market environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Experience working in a fast-paced front-office environment in either engineering or analytical roles. Passion for being hands-on and contributing to a collaborative engineering culture. More ❯
experience applying Generative AI concepts (ideally in a front-office/capital market environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Experience working in a fast-paced front-office environment in either engineering or analytical roles. Passion for being hands-on and contributing to a collaborative engineering culture. More ❯
Glasgow, Scotland, United Kingdom Hybrid/Remote Options
Caspian One
experience applying Generative AI concepts (ideally in a front-office/capital markets environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation) Experience working in a fast-paced front-office environment in either engineering or analytical roles Passion for being hands-on and contributing to a collaborative engineering culture Nice More ❯
glasgow, central scotland, united kingdom Hybrid/Remote Options
Caspian One
experience applying Generative AI concepts (ideally in a front-office/capital markets environment) Experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation) Experience working in a fast-paced front-office environment in either engineering or analytical roles Passion for being hands-on and contributing to a collaborative engineering culture Nice More ❯
testing. Demonstrable experience applying GenAI concepts to front-office/capital market environments. Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small engineering team. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost More ❯
testing. Demonstrable experience applying GenAI concepts to front-office/capital market environments. Deep experience with AWS services (S3, Glue, Kinesis, Lambda, ECS, IAM, KMS, API Gateway, Step Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small engineering team. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost More ❯
in play but not limited to and the client are open to new tech: CI/CD pipelines, Jira, Git, Confluence, Jenkins, REST API testing, SNS, SQS, Kafka, AWS MSK, Code Rabbit, Cursor, Claude Code, Perl, JavaScript, C#. A great opportunity taking full ownership of the automation strategy. Designing, building, and scaling frameworks that power high-volume financial transaction More ❯
in play but not limited to and the client are open to new tech: CI/CD pipelines, Jira, Git, Confluence, Jenkins, REST API testing, SNS, SQS, Kafka, AWS MSK, Code Rabbit, Cursor, Claude Code, Perl, JavaScript, C#. A great opportunity taking full ownership of the automation strategy. Designing, building, and scaling frameworks that power high-volume financial transaction More ❯
What you’ll bring Strong commercial experience with PHP 8+ (Laravel or Symfony preferred) Solid skills in JavaScript/TypeScript, Node.js (NestJS), and React.js Experience with AWS services (Aurora, MSKKafka, ECS, EMR) Strong database skills (MySQL and other data paradigms) What’s on offer 4 days onsite in a brand-new Camden office with modern facilities, gym, and More ❯
What you’ll bring Strong commercial experience with PHP 8+ (Laravel or Symfony preferred) Solid skills in JavaScript/TypeScript, Node.js (NestJS), and React.js Experience with AWS services (Aurora, MSKKafka, ECS, EMR) Strong database skills (MySQL and other data paradigms) What’s on offer 4 days onsite in a brand-new Camden office with modern facilities, gym, and More ❯
AWS Kafka platform engineer Bachelor's degree in computer science or related fields Minimum 2 Implementations are mandated Proficiency in Kafka Streams Kafka Connect and ksqlDB. Experience with AWS MSK Confluent Cloud and monitoring tools like Prometheus and Grafana Familiarity with Kubernetes CICD pipelines and GitOps workflows Proficiency in a wide range of public cloud technologies ex Cloud watchAWS … EC2 EKS EBS RDS S3 etc. Experience with Amazon AWS cloud services such as EC2 S3 SQS Kafka and RDS is preferred Design and manage AWS Kafka based streaming data pipelines. Configure and monitor Kafka clusters for performance and scalability. Integrate Kafka with AWS services like EC2 RDS Lambda and S3. Implement security protocols disaster recovery and high More ❯
