Data Pipeline Orchestration and ELT tooling such as Apache Airflow, Apache NiFi, Airbyte, and Singer Message Brokers and streaming data processors like Apache Kafka Object Storage solutions such as S3, MinIO, LakeFS CI/CD Pipeline and Integration, ideally with Azure DevOps Python scripting API Management Solutions Automation Key Skills: Design, Configuration, and Usage of Low-code Platforms such More ❯
Focused Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3, MinIO, LakeFS CI/CD Pipeline, Integration, ideally Azure DevOps Python Scripting API Management Solutions Automation Key Skills Experience in the Design/Configuration/Usage in a number More ❯
Java modules. Collaborate with development teams to design and implement automated tests for microservices, emphasizing Spring Boot and Java-based architectures. Implement testing strategies for AWS data lakes (e.g., S3, Glue, Athena) with a focus on schema evolution, data quality rules, and performance benchmarks, prioritizing data lake testing over traditional SQL approaches. Automate data tests within CI/CD … tools like Pytest and Postman. Expertise in Pandas, SQL, and AWS analytics services (Glue, Athena, Redshift) for data profiling, transformation, and validation within data lakes. Solid experience with AWS (S3, Lambda, EMR, ECS/EKS, CloudFormation/Terraform) and understanding of cloud-native architectures and best practices. Advanced skills in automating API and backend testing workflows, ensuring robust and More ❯
knowledge sharing, including handover notes, rollout summaries, and demo materials WHAT YOU'LL BRING " ESSENTIAL " AWS Certified Cloud Practitioner Foundational experience with AWS services such as VPCs, EC2, ECS, S3, Site-to-Site VPN, Transit Gateway, ACM, CloudWatch, CloudFront, and MediaConnect Strong written and verbal communication skills, with an ability to document workflows, processes, and support materials clearly A More ❯
