Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3, MinIO, LakeFS CI/CD Pipeline, Integration, ideally Azure DevOps Python Scripting API Management Solutions Automation Key Skills Experience in the Design/Configuration/Usage in a number of the More ❯
Data Pipeline Orchestration, and ELT tooling such as Apache Airflow, Apark, NiFi, Airbyte and Singer. Message Brokers, streaming data processors, such as Apache Kafka Object Storage, such as S3, MinIO, LakeFS CI/CD Pipeline, Integration, ideally Azure DevOps Python Scripting API Management Solutions Automation Key Skills Experience in the Design/Configuration/Usage in a number of the More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯