and analytics on large-scale datasets. Implement and manage Lake Formation and AWS Security Lake , ensuring data governance, access control, and security compliance. Optimise file formats (e.g., Parquet, ORC, Avro) for S3 storage , ensuring efficient querying and cost-effectiveness. Automate infrastructure deployment using Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation. Monitor and troubleshoot data workflows … Security Lake, and Lake Formation. Data Engineering – Proficiency in building and optimising data pipelines and working with large-scale datasets. File Formats & Storage – Hands-on experience with Parquet, ORC, Avro, and efficient S3 storage solutions. DevOps & Automation – Experience with Terraform, CloudFormation, or CDK to automate infrastructure deployment. Security & Compliance – Familiarity with AWS Security Lake, IAM policies, and access control More ❯
engage with both technical and non-technical stakeholders. A strong grasp of Agile practices. Familiarity with NoSQL databases, big data technologies, and integrating diverse data formats (e.g., JSON, Parquet, Avro). Experience with data cataloguing, metadata management, and data lineage tools. Strong troubleshooting and problem-solving skills for complex data challenges. Desirable Experience & Knowledge: Background in building or deploying More ❯
Join us as an Automation Tester in Private Bank & Wealth Management (PBWM) to design and implement test cases, execute testing strategies to validate functionality, and drive innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings More ❯
multiple heterogenous data sources. • Good knowledge of warehousing and ETLs. Extensive knowledge of popular database providers such as SQL Server, PostgreSQL, Teradata and others. • Proficiency in technologies in the Apache Hadoop ecosystem, especially Hive, Impala and Ranger • Experience working with open file and table formats such Parquet, AVRO, ORC, Iceberg and Delta Lake • Extensive knowledge of automation and More ❯
and analytics on large-scale datasets. Implement and manage Lake Formation and AWS Security Lake , ensuring data governance, access control, and security compliance. Optimise file formats (e.g., Parquet, ORC, Avro) for S3 storage , ensuring efficient querying and cost-effectiveness. Automate infrastructure deployment using Infrastructure as Code (IaC) tools such as Terraform or AWS CloudFormation. Monitor and troubleshoot data workflows More ❯
Birmingham, England, United Kingdom Hybrid / WFH Options
QAD Inc
and pgx Uses database migration patterns, such as, “expand and contract” using go-migrate Writing observable and testable code using libraries such as testify and mockgen Publishing and consuming Avro formatted Kafka messages CI/CD GitHub Actions Trunk Based Development & Continuous Delivery Good collaboration skills at all levels with cross-functional teams Highly developed ownerships and creative thinking More ❯
and pgx Uses database migration patterns, such as, "expand and contract" using go-migrate Writing observable and testable code using libraries such as testify and mockgen Publishing and consuming Avro formatted Kafka messages CI/CD GitHub Actions Trunk Based Development & Continuous Delivery Soft skills: Good collaboration skills at all levels with cross-functional teams Highly developed ownerships and More ❯
Mastery of the Spring Boot ecosystem, including modules for Security, Web, and Data Expertise in building event-driven systems that deliver high reliability and performance Familiarity with message schemas (Avro, Protobuf) and strategies for evolving events Experience integrating with identity systems like Keycloak Strong grasp of system-level concerns like observability, availability, and resilience Background working in secure, regulated More ❯
Mastery of the Spring Boot ecosystem, including modules for Security, Web, and Data Expertise in building event-driven systems that deliver high reliability and performance Familiarity with message schemas (Avro, Protobuf) and strategies for evolving events Experience integrating with identity systems like Keycloak Strong grasp of system-level concerns like observability, availability, and resilience Background working in secure, regulated More ❯
Mastery of the Spring Boot ecosystem, including modules for Security, Web, and Data Expertise in building event-driven systems that deliver high reliability and performance Familiarity with message schemas (Avro, Protobuf) and strategies for evolving events Experience integrating with identity systems like Keycloak Strong grasp of system-level concerns like observability, availability, and resilience Background working in secure, regulated More ❯
Mastery of the Spring Boot ecosystem, including modules for Security, Web, and Data Expertise in building event-driven systems that deliver high reliability and performance Familiarity with message schemas (Avro, Protobuf) and strategies for evolving events Experience integrating with identity systems like Keycloak Strong grasp of system-level concerns like observability, availability, and resilience Background working in secure, regulated More ❯
Mastery of the Spring Boot ecosystem, including modules for Security, Web, and Data Expertise in building event-driven systems that deliver high reliability and performance Familiarity with message schemas (Avro, Protobuf) and strategies for evolving events Experience integrating with identity systems like Keycloak Strong grasp of system-level concerns like observability, availability, and resilience Background working in secure, regulated More ❯
