1 to 25 of 266 Hadoop Jobs

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Scala, and SQL. Hands-on experience building and operating large-scale data pipelines using big data and distributed processing technologies (e.g. Apache Spark, Hadoop). Experience designing and maintaining data lakes, distributed storage platforms, and data pipeline orchestration tools. Experience working with cloud-native data platforms, with strong expertise ...

modelling, and visualization to identify patterns and insights Ensure data quality, reliability, and security across systems Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyse large datasets Stay up to date with the latest trends and technologies in big data, analytics, and cloud platforms Hands ...

modelling, and visualization to identify patterns and insights. Ensure data quality, reliability, and security across systems. Work with distributed computing frameworks (e.g., Spark, Hive, Hadoop) to process and analyse large datasets. Stay up to date with the latest trends and technologies in big data, analytics, and cloud platforms. Required ...

driven architectures Airflow dbt Git/GitHub CI/CD Infrastructure as Code Modern data platforms and distributed processing technologies Experience with Databricks or Hadoop-style data processing environments is useful, although candidates with strong transferable experience across modern data platforms will be considered. Customer Data & Retail Context Experience ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

Azure, GCP).Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon).Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop).Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data governance, security, and compliance frameworks. Exposure to AI/ ...

experience in their technologies You have experience in database technologies including writing complex queries against their (relational and non-relational) data stores (e.g. Postgres, Hadoop, Elasticsearch, Graph databases), and designing the database schemas to support those queries You have a good understanding of coding best practices and design patterns ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Reporting tools (e.g. Tableau, PowerBI ...

. Knowledge of data modelling methodologies (star schemas, Data Vault, Kimball, Inmon). Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop). Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. Understanding of data governance, security, and compliance frameworks. Exposure ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

NoSQL) Experience with cloud technologies Experience with cloud platforms Experience with CI/CD practices Experience with big data tools e.g. Spark, Hadoop, NiFi Experience managing direct reports, providing regular guidance and performance feedback Ability to create delivery plans with estimated timelines for personal and team workloads Experience supporting ...

patterns remain appropriate – and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark).Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

threat intelligence automation - Experience with containerization and orchestration (Docker, Kubernetes) - Knowledge of streaming data platforms (Kafka, Kinesis) - Familiarity with big data technologies (Spark, Hadoop) - Experience supporting federal cybersecurity programs Required Education: BS in Computer Science, Data Science, or related degree, or HS Diploma and 7+ years of directly relevant ...

Quantexa components such as: Entity Resolution (ER) Scoring Framework Contextual Network Generation UI Configuration Strong background in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Experience with data modelling and design in the context of large-scale analytics platforms. Strong stakeholder management and communication skills – capable of interfacing ...

scale ETL development. Proficiency in SQL and programming languages such as Python, Java, or Scala. Hands‐on experience with big data frameworks (e.g., Spark, Hadoop, Flink) and cloud platforms (AWS, GCP, or Azure). Familiarity with data warehouse technologies (e.g., Snowflake, Redshift, BigQuery) and workflow orchestration tools (e.g., Airflow ...

planningRequired Skills & ExperienceTechnical SkillsStrong proficiency in SQL and data modellingExcellent programming skills in Python, Scala, or JavaHands-on experience with distributed data frameworks (Spark, Hadoop)Experience with data pipelines and ETL toolsExpertise in at least one cloud platform: Azure (Synapse, Data Factory, Databricks)AWS (S3, Glue, Redshift, Lambda ...

deployment and monitoring using CI/CD tools and infrastructure-as-code practices Hands-on expertise with distributed data processing frameworks (e.g., Apache Spark, Hadoop) and real-time data streaming technologies (e.g., Kafka, Kinesis, Spark) Track record of collaborating with cross-functional teams (engineering, analytics, business stakeholders) to deliver ...

threat intelligence automation Experience with containerization and orchestration (Docker, Kubernetes) Knowledge of streaming data platforms (Kafka, Kinesis) Familiarity with big data technologies (Spark, Hadoop) Experience supporting federal cybersecurity programs Desired Certifications: DoD 8140 IAT Level III CSSLP Required Education: Bachelor's degree in Computer Science, Data Science, or related ...

C++ or Java) is a bonus. Cloud Computing/Big Data Tools: Familiarity with cloud services (AWS, GCP, Azure) or big data tools (Spark, Hadoop) is helpful but not required What Else You Should Know Our internships are full-time positions, in-person at our South San Francisco office. ...

C++ or Java) is a bonus. Cloud Computing/Big Data Tools: Familiarity with cloud services (AWS, GCP, Azure) or big data tools (Spark, Hadoop) is helpful but not required What Else You Should Know Our internships are full-time positions, in-person at our South San Francisco office. ...

picture Experience with cloud computing, virtualization, or containerization technologies Familiarity with Cloud infrastructure (e.g., Azure, AWS, GCP) Experience with big data solutions (e.g. Hadoop, Spark, Kafka, Cassandra) Demonstrated experience using AI coding assistants (e.g., GitHub Copilot, ChatGPT, Claude, Cursor, Codeium) for: Code generation Refactoring and optimization Debugging and root ...

picture Experience with cloud computing, virtualization, or containerization technologies Familiarity with Cloud infrastructure (e.g., Azure, AWS, GCP) Experience with big data solutions (e.g. Hadoop, Spark, Kafka, Cassandra) Demonstrated experience using AI coding assistants (e.g., GitHub Copilot, ChatGPT, Claude, Cursor, Codeium) for: Code generation Refactoring and optimization Debugging and root ...

scalability, and query optimization Minimum of 3 years of experience working in big data environments Experience with at least two of the following technologies: Hadoop Apache Spark PySpark HBase Strong understanding of distributed computing, search architectures, and large-scale data processing Excellent troubleshooting, analytical, and problem-solving skills Strong ...