1 to 25 of 38 Hadoop Jobs

Proficient in day‐to‐day use of Python/Java/Scala. Strong understanding of and experience with distributed computing frameworks like Hive/Hadoop and Apache Spark. Expertise in data modeling, schema design, and data visualization tools. Experience working in GCP and/or AWS is a plus. ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

ability to think critically and analytically. Strong experience in documentation and data dictionaries. Knowledge of big data technologies and distributed computing frameworks such as Hadoop and Spark. Excellent communication skills to effectively collaborate with cross-functional teams and present insights to business stakeholders. ...

data strategies, optimize pipelines (ETL/ELT), and incorporate technologies such as cloud platforms (e.g., AWS GovCloud, Azure Government), Big Data tools (e.g., Spark, Hadoop), and relational/NoSQL databases for secure, performant solutions. Designs approaches for automated data labeling, lifecycle management, monitoring, real-time ingestion, and integration ...

complex data flow issues and improve resilience, performance, and operational throughput Utilize SQL, Python/Scala, cloud services, and big data tools (e.g., Spark, Hadoop) to support advanced analytics, AI/ML, and decision advantage missions Additional duties as assigned or required What we are looking for 9 years ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

cloud services and cloud-based data engineering tools , such as AWS, Azure, Microsoft Fabric and Databricks, as well as big data technologies like Hadoop and Spark Skilled in programming languages , including Python, PySpark and Scala, with extensive experience developing robust ETL pipelines and ensuring scalable deployments Experienced in mentoring ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like Matplotlib ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant You'll also work with ...

experience and expertise in following technologies: Java, Python, Data engineering, Data and Database engineering, Agentic AI, Gen AI, Machine Leaning, Generative AI, Scripting, Spark, Hadoop, SQL, NoSQL, PyTorch and one of the cloud technologies like AWS, Azure or GCP. Should have worked in at least two or more industry ...

with strong collaborator engagement skills. Preferred Experience Digital Twin, asset virtualization, or industrial data platforms Graph technologies (e.g., Neo4j), big data ecosystems (Spark, Hive, Hadoop) Databricks, Python, and modern analytics platforms Delivery of data products at enterprise scale Key Competencies Strategic product thinking with strong execution bias Deep technical ...

Meade, MD 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

week at customer site or in the Enlighten office with ability to flex if needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

willing/able to help open/close the workspace during regular business hours as needed. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with K9s, AWS CLI and other AWS services like ...

Columbia, MD 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

Meade, MD 5 days a week. Flexibility is essential to accommodate any changes in the schedule. Preferred Requirements Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill, Impala, Trino, Presto, etc. Experience with containers, EKS, Diode, CI/CD, and Terraform ...

Experience with HTML and Frameworks such as; React.Js, Node.JS, and EXPRESS • Experience with SOAP, REST web service development • May include learning languages such as; Hadoop, Storm, Spark, Kafka, Hive, NFI, Scoop, etc • May include database knowledge in; SQL, MySQL, Oracle DB, PostgreSQL, Cassandra, MongoDB, etc • Proficiency using standard desktop ...

clustering and classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualisation tools (Cassandra, Hadoop, Spark, Tableau). ...

needed. Preferred Requirements Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc ) is a plus. Experience with CI/CD pipelines (e.g. Gitlab-CI, Travis-CI, Jenkins, etc.) Understanding of agile software ...

needed. Preferred Requirements Prior experience or familiarity with DISA's Big Data Platform or other Big Data systems (e.g. Cloudera's Distribution of Hadoop, Hortonworks Data Platform, MapR, etc.) is a plus. Experience with CI/CD pipelines (e.g. Gitlab-CI, Travis-CI, Jenkins, etc.) Understanding of agile software ...

connected, time‐series, geospatial, image, etc. Different types of database – relational; document; graph; columnar; key‐value Large scale data processing platforms, typically based on Hadoop/Spark Business intelligence/analytics products or frameworks Data analysis and data modelling requirements Experience working with cloud platforms and working with relevant ...

social benefits (e.g. UK pension schema) Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, Apache HBase, Apache Nifi, Apache Airflow, Opensearch Proficiency in cloud-native technologies such as containerization and Kubernetes Strong knowledge of DevOps tools (Terraform, Ansible ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

will have experience with database systems, Azure cloud storage, and significant exposure to or experience with modern big data processing tools (such as Spark, Hadoop, and Databricks). Candidates will be expected to be able to design and implement data solutions that use the following Azure services: Azure Cosmos ...