1 to 25 of 48 Hadoop Jobs

n.Cloud Storag e: For scalable and durable object storag e.Cloud Composer (Apache Airflow ): For workflow orchestration and pipeline managemen t.Cloud Datapro c: For managed Hadoop and Spark clusters (good to have ).Cloud SQL/Cloud Spanner/Cloud Bigtabl e: Experience with relational and NoSQL database s.Strong proficiency ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

translate business needs into technical solutions.Professional certifications in cloud platforms, knowledge of web and mobile analytics technologies, experience with big data technologies such as Hadoop or Spark, understanding of data modeling and data warehouse concepts, containerization tools like Docker or Kubernetes, data privacy regulations including GDPR and CCPA ...

ability to think critically and analytically. Strong experience in documentation and data dictionaries. Knowledge of big data technologies and distributed computing frameworks such as Hadoop and Spark. Excellent communication skills to effectively collaborate with cross-functional teams and present insights to business stakeholders. ...

data strategies, optimize pipelines (ETL/ELT), and incorporate technologies such as cloud platforms (e.g., AWS GovCloud, Azure Government), Big Data tools (e.g., Spark, Hadoop), and relational/NoSQL databases for secure, performant solutions. Designs approaches for automated data labeling, lifecycle management, monitoring, real-time ingestion, and integration ...

related field, or in bioinformatics with a demonstrated IT expertise Experience in big data technologies and frameworks, such as Apache Spark, Hadoop or similar platforms Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with Java Familiarity with Google Cloud Platform or AWS Familiarity with ...

complex data flow issues and improve resilience, performance, and operational throughput Utilize SQL, Python/Scala, cloud services, and big data tools (e.g., Spark, Hadoop) to support advanced analytics, AI/ML, and decision advantage missions Additional duties as assigned or required What we are looking for 9 years ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow). Strong ...

manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like Matplotlib ...

experience and expertise in following technologies: Java, Python, Data engineering, Data and Database engineering, Agentic AI, Gen AI, Machine Leaning, Generative AI, Scripting, Spark, Hadoop, SQL, NoSQL, PyTorch and one of the cloud technologies like AWS, Azure or GCP. Should have worked in at least two or more industry ...

with strong collaborator engagement skills. Preferred Experience Digital Twin, asset virtualization, or industrial data platforms Graph technologies (e.g., Neo4j), big data ecosystems (Spark, Hive, Hadoop) Databricks, Python, and modern analytics platforms Delivery of data products at enterprise scale Key Competencies Strategic product thinking with strong execution bias Deep technical ...

Meade, MD 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

week at customer site or in the Enlighten office with ability to flex if needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

Antonio, TX 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

willing/able to help open/close the workspace during regular business hours as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like ...

Columbia, MD 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

Meade, MD 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

Augusta, GA 5 days a week. Flexibility is essential to adapt to schedule changes as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Spark, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers EKS, Diode, CI/CD, and Terraform are a plus We have ...

work from home time to time. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Spark, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers EKS, Diode, CI/CD, and Terraform are a plus Work could ...

Framework (RMF) process Proficiency in system design and meticulous documentation Experience in streaming and/or batch analytics (e.g. Kafka, Spark, Flink, Storm, MapReduce, Hadoop) Experience in distributed databases, NoSQL databases, full text-search engines (e.g. Elasticsearch, MongoDB, Solr) Experience in designing enterprise APIs. Experience in RESTful web services ...

financial markets, risk management and financial instruments. Familiarity with market risk concepts including VaR, Greeks, scenario analysis and stress testing. Hands on experience with Hadoop, Spark. Proficiency on Git, Jenkins and CI/CD pipelines. Excellent problem-solving skills and strong mathematical and analytical mindset. ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

Experience with HTML and Frameworks such as; React.Js, Node.JS, and EXPRESS • Experience with SOAP, REST web service development • May include learning languages such as; Hadoop, Storm, Spark, Kafka, Hive, NFI, Scoop, etc • May include database knowledge in; SQL, MySQL, Oracle DB, PostgreSQL, Cassandra, MongoDB, etc • Proficiency using standard desktop ...

clustering and classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualisation tools (Cassandra, Hadoop, Spark, Tableau). ...