San Diego, California, United States Hybrid/Remote Options
Cordial Experience, LLC
NumPy, and MatLab; Experience with data visualization tools, including D3.js and GGplot; Experience using query languages, including SQL, Hive, and Pig; Experience with NoSQL databases, including MongoDB, Cassandra, and HBase; Experience with applied statistics skills, including distributions, statistical testing, and regression; Experience with Dagster or Airflow for ML pipeline management; Experience with Python; and Experience with cloud environments, including More ❯
our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map Reduce, Oozie, Hive, Pig, HBase, Storm). This role involves working in Java, and working on Machine Learning pipelines for data collection or batch inference. This is a remote position, requiring excellent communication skills … Location: US-Remote What you will be doing: Develop scalable and robust code for large scale batch processing systems using Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase Develop, manage, and maintain batch pipelines supporting Machine Learning workloads Leverage GCP for scalable big data processing and storage solutions Implementing automation/DevOps best practices for CI/… CD, IaC, etc. Requirements: Proficiency in in the Hadoop ecosystem with Map Reduce, Oozie, Hive, Pig, HBase, Storm Strong programming skills with Java, Python, and Spark Knowledge in public cloud services, particularly in GCP. Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code More ❯
