Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages The following Technical Skills & Experience would be desirable for Data Devops Engineer: Jupyter Hub Awareness Minio or similar S3 storage technology Trino/Presto RabbitMQ or other common queue technology e.g. ActiveMQ NiFi Rego Familiarity with code development, shell-scripting in Python, Bash etc. As a More ❯
on experience with Big Data open-source technologies such as: Apache Airflow Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake AWS Athena Trino MongoDB AWS S3, MinIO S3 Proven successful hands-on experience in: Setting up data governance tooling and processes (schema registry, data lineage control) and data access control Establishing data pipelines for model training and More ❯
Splunk/ELK stack Ability to pro-actively manage own tasking and react to higher priority tasks Experience of Linux server administration Experience in technologies such as Apache NiFi, MinIO/AWS S3 Experience managing and patching Java and Python applications Experience with containerisation technologies such as Docker/Podman and deployment technologies such Kubernetes/OpenShift Role clearance type More ❯
Experience with distributed file systems, distributed database systems, reliability, or cloud services is a plus Experience scaling databases horizontally and handling partitioning/sharding Understanding of the internals of MinIO, Ceph, or S3 storage architectures would be a big plus Great at breaking down complex tech ideas and working smoothly with teams across the board Where should you be located More ❯
services on top of major cloud providers (GCP, AWS) is a plus Experience with building and operating systems on top of open-source storage technologies (ex. JuiceFS, Fuse, Ceph, Minio) is a plus Experience with developing high performance storage protocols (ex. RDMA, GPUDirect, DPDK) is a plus Excellent communication skills with ability to work effectively in a fast-paced, collaborative More ❯
services on top of major cloud providers (GCP, AWS) is a plus Experience with building and operating systems on top of open-source storage technologies (ex. JuiceFS, Fuse, Ceph, Minio) is a plus Experience with developing high performance storage protocols (ex. RDMA, GPUDirect, DPDK) is a plus Excellent communication skills with ability to work effectively in a fast-paced, collaborative More ❯
services on top of major cloud providers (GCP, AWS) is a plus Experience with building and operating systems on top of open-source storage technologies (ex. JuiceFS, Fuse, Ceph, Minio) is a plus Experience with developing high performance storage protocols (ex. RDMA, GPUDirect, DPDK) is a plus Excellent communication skills with ability to work effectively in a fast-paced, collaborative More ❯
Experience with Elasticsearch, Prometheus, Grafana and/or Datadog. Exposure either AWS or GCP plus IaC, (Terraform or similar) would be beneficial. Knowledge with open-source storage tools (Ceph, Minio, JuiceFS or Fuse) and familiarity with high-performance data transport protocols (RDMA, GPUDirect, DPDK) would be well received. This is a chance to contribute to a mission-critical team operating More ❯
Experience with Elasticsearch, Prometheus, Grafana and/or Datadog. Exposure either AWS or GCP plus IaC, (Terraform or similar) would be beneficial. Knowledge with open-source storage tools (Ceph, Minio, JuiceFS or Fuse) and familiarity with high-performance data transport protocols (RDMA, GPUDirect, DPDK) would be well received. This is a chance to contribute to a mission-critical team operating More ❯
to 4 times a year for internal events Additional skills that you might also bring Experience operating Ceph clusters in production Experience with open source distributed storage like Gluster, Minio, Mayastor, or similar What we offer you We consider location, experience, and performance in shaping compensation worldwide. Compensation is reviewed annually, with additional benefits reflecting our values and local needs. More ❯
travel up to four times annually for internal events Additional skills you might bring: Experience operating Ceph clusters in production Experience with open source distributed storage solutions like Gluster, Minio, Mayastor, or similar What we offer: Distributed work environment with twice-yearly in-person team sprints — we've been remote since 2004! USD 2,000 annual learning and development budget More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team and provide technical direction. Experience ensuring system reliability, scalability, and data integrity More ❯
