1 to 25 of 56 Hadoop Jobs

Java Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing ...

Experience Strong experience with SQL, relational databases, and NoSQL systems.Proficiency in Python, Scala, or Java for data engineering tasks.Experience with big data tools (Spark, Hadoop, Kafka, FlinkKnowledge of ETL/ELT tools (Airflow, dbt, Glue, InformaticaFamiliarity with data warehousing (Snowflake, BigQuery, RedshiftUnderstanding of data modeling, normalization, and data governance.Experience ...

environments (AWS, Azure, GCP) including services like S3, BigQuery, Azure ML, etc. Solid understanding of data engineering principles , SQL, and distributed computing frameworks (Spark, Hadoop). Experience in consulting or client-facing roles , with ability to manage stakeholders and deliver strategic insights. Strong knowledge of machine learning algorithms , statistical ...

also valued). Experience with modern data lakehouse concepts and architectures. Experience ingesting and transforming data from sources such as Kafka, REST APIs, Hadoop, etc. Experience with data pipeline orchestration tools (Azure Data Factor or similar). Experience implementing ETL/ELT pipelines using modern data lakehouse solutions. Experience ...

Strong proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional ...

Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years of experience with NoSQL ...

Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years of experience with NoSQL ...

performance of data platforms. Collaborates with data scientists and analysts to enable data accessibility and automation.Skills:Strong SQL and database designBig Data technologies (Hadoop, Spark, Hive)Data pipeline tools (Airflow, Kafka, NiFi)Programming (Python, Scala, Java)Cloud platforms (AWS, Azure, GCP)Data warehousing (Snowflake, Redshift, BigQuery)ETL/ ...

delivery experience Strong knowledge of Entity Resolution, Scoring Framework, Network Generation, and UI configuration 5 -10 years' experience with Big Data technologies (Scala, Spark, Hadoop, Elasticsearch) Solid data modelling and analytics platform design experience Excellent stakeholder communication skills Experience with cloud platforms (AWS, Azure, or GCP) Desirable Experience ...

techniques. Cloud & MLOps: Experience with AWS, GCP, or Azure; Docker/Kubernetes; MLflow or similar tools. Data Handling: Familiarity with big data frameworks (Spark, Hadoop) and data versioning tools (DVC). Soft Skills: Strong problem-solving, communication, and ability to work in agile teams. Preferred Qualifications Experience with transformer ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

control trials to validate model performance and business impact. Perform data analysis on structured and unstructured datasets using Python, SQL, and big data frameworks (Hadoop, PySpark). Develop and optimize data retrieval systems using RAG, FAISS, Elasticsearch, and other retrieval algorithms. Implement time-series forecasting and anomaly detection ...

make informed Expert knowledge of multiple programming languages (i.e. Python, Java, C++decisions, meeting the evolving needs of our customers. With strong familiarity with Hadoop, we develop and deploy scalable AI/ML models that integrate with data pipelines, infrastructure, and applications. WHY JOIN US Providing ongoing training, mentorship ...

years' IT Architecture experience working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment ...

government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana ...

substituted for a bachelor's degree. Demonstrated experience with distributed scale Big Data stores (i.e. Accumulo), Map/Reduce programming model (i.e. Hadoop), Hadoop Distributed File System, and data serialization (i.e. JSON). Experience with programming languages such as Java and scripting languages such as Perl, Python, Bash. ...

experience in the same or similar IT/Computer-related field. Required experience must include experience working with: Development tools: Spark, Scala, Python, Hadoop, and Shell scripts; DevOps tools: GitHub, Jenkins, SonarCube, Checkmarx; AWS Cloud; CI/CD pipeline development; Agile development. Permanent U.S. work authorization is required ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

Neo4J ETL, ESB, API or similar data integration experience Development experience such as Python Exposure to big data tools or architectures such as the Hadoop ecosystem Experience with NLP or OCR technologies Desirable: Knowledge of generative AI concepts or frameworks Experience with containerisation such as Docker Experience in industrial ...

strategizing the roadmap around On-premise and cloud solutions. Experience in designing and developing real time data processing pipelines Expertise in working with Hadoop data platforms and technologies like Kafka, Spark, Impala, Hive and HDFS in multi-tenant environments Expert in Java programming ,SQL and shell script, DevOps Good ...

implementations Should have strong experience in converting SQL/PL, Data transformations, Data quality and complex SQL's into data lake Experience using Hadoop Distribution and it's all services for example: YARN, KUDU, OOZIE, IMPALA, HIVE, HBASE, SPARK Working knowledge of Java/Python & REST API Conducts facilitated ...

intelligence.Key Responsibilities : Collect, process, and analyze large volumes of structured and unstructured data from diverse sources. Utilize big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases. Develop and maintain dashboards, reports, and data visualizations to communicate findings to stakeholders. Collaborate with cross-functional teams ...

Responsibilities will include maintaining current Flink clusters, responding to customer support requests Top 5 skills Flink operational or development exp Big data environment - Kafka, Hadoop or Storm preference. either of these is mandatory Distributed systems experience Java programming exp required for the development role. HM Notes: We need ...

Glue, or MS Fabric. Proficiency in core data integration languages like SQL and Python. Knowledge of data lakes, simulation, and warehousing technologies (e.g., Hadoop, Snowflake, AWS S3). Familiarity with Artificial Intelligence and Machine Learning platforms (e.g., Azure AI, AWS Sagemaker). Strong understanding of data quality, security ...