and data pipeline orchestration tools such as Apache Airflow and Nifi. Experience with large scale/Big Data technologies, such as Hadoop, Spark, Hive, Impala, PrestoDb, Kafka. Experience with workflow orchestration tools like Apache Airflow. Experience with containerisation using Docker and deployment on Kubernetes. Experience with NoSQL and graph More ❯
implementation Hands-on development and architecture experience in Java or Scala, Microservices Hands-on development and architecture experience in big-data ecosystem - Hadoop, Hive, Impala, NOSQL Hands-on development, architecture and leadership experience in distributed computing technologies - Spark, Flink Hands-on development, and architecture experience in caching, In-memory More ❯
Data Mining, Classical Machine Learning, Deep Learning, NLP and Computer Vision. Experience with Large Scale/Big Data technology, such as Hadoop, Spark, Hive, Impala, PrestoDb. Hands-on capability developing ML models using open-source frameworks in Python and R and applying them on real client use cases. Proficient More ❯
and maintain Dash web application with user-friendly interface for workflow processing, data visualization, exploration, and efficient reporting. Design and implement relational databases in Impala to effectively store and manage data. Develop optimal schemas for Impala tables based on query patterns and data characteristics. Integrate Dash applications with … Impala to efficiently query and process large data sets. Implement and manage Oozie job schedulers for maintaining ETL processes to efficiently load, transform, and distribute daily data. Employ agile development practices to develop effective business solutions based on the business needs. Required Skills Education & Experience: Master's or higher … manipulation and analysis using libraries such as Pandas, NumPy, and SQLAlchemy. Extensive experience with Dash framework for building web applications. In-depth knowledge of Impala or other SQL-on-Hadoop query engines. Understanding of web development concepts (HTML, CSS, JavaScript). Proficiency in data visualization libraries (Plotly, Seaborn). More ❯
