1 to 25 of 61 Hadoop Jobs

Java Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing ...

Experience Strong experience with SQL, relational databases, and NoSQL systems.Proficiency in Python, Scala, or Java for data engineering tasks.Experience with big data tools (Spark, Hadoop, Kafka, FlinkKnowledge of ETL/ELT tools (Airflow, dbt, Glue, InformaticaFamiliarity with data warehousing (Snowflake, BigQuery, RedshiftUnderstanding of data modeling, normalization, and data governance.Experience ...

environments (AWS, Azure, GCP) including services like S3, BigQuery, Azure ML, etc. Solid understanding of data engineering principles , SQL, and distributed computing frameworks (Spark, Hadoop). Experience in consulting or client-facing roles , with ability to manage stakeholders and deliver strategic insights. Strong knowledge of machine learning algorithms , statistical ...

also valued). Experience with modern data lakehouse concepts and architectures. Experience ingesting and transforming data from sources such as Kafka, REST APIs, Hadoop, etc. Experience with data pipeline orchestration tools (Azure Data Factor or similar). Experience implementing ETL/ELT pipelines using modern data lakehouse solutions. Experience ...

Strong proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional ...

optimised for GenAI workloads. Strong knowledge of data modelling, ETL processes, SQL, and scripting languages such as Python. Experience with Big Data technologies (e.g., Hadoop, Spark) and data visualisation tools (e.g., Tableau, Power BI). Familiarity with AI/ML frameworks (TensorFlow, PyTorch, Hugging Face, etc.). Experience ...

Hands-on experience with AWS AI/ML services (SageMaker, Bedrock, Comprehend,Rekognition) Proven track record with big data technologies (Amazon EMR, Redshift, Spark,Hadoop) Experience deploying machine learning models, deep learning algorithmsIoT & Systems Integration: Deep hands-on IoT knowledge including device connectivity, protocols, and dataingestion Experience with ...

performance of data platforms. Collaborates with data scientists and analysts to enable data accessibility and automation.Skills:Strong SQL and database designBig Data technologies (Hadoop, Spark, Hive)Data pipeline tools (Airflow, Kafka, NiFi)Programming (Python, Scala, Java)Cloud platforms (AWS, Azure, GCP)Data warehousing (Snowflake, Redshift, BigQuery)ETL/ ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

engineering environment. Strong proficiency in Python programming. Hands-on experience with PySpark (Spark with Python API Good understanding of big data technologies and concepts (Hadoop, Spark, etc. Familiarity with SQL and relational databases. Experience with data modeling and schema design. Strong problem-solving skills and attention to detail. Excellent ...

control trials to validate model performance and business impact. Perform data analysis on structured and unstructured datasets using Python, SQL, and big data frameworks (Hadoop, PySpark). Develop and optimize data retrieval systems using RAG, FAISS, Elasticsearch, and other retrieval algorithms. Implement time-series forecasting and anomaly detection ...

languages. Experience and understanding of analytics databases, warehouse, datalakes for both traditional/relational and non-traditional systems (e.g. Oracle, MS-SQL Server, Hadoop, Spark, etc.). Experience with data visualization tools (e.g. Tableau, Power BI, QlikView, etc.). Skilled in Utilizing Process/Performance improvement methodologies (IHI, Lean ...

Need: Experience in architecture & design and consulting services focused on enterprise solutions, data analytics platform, lake houses, data engineering, data processing, data warehousing, ETL, Hadoop & Big Data. Experience in BFSI Industry is required. Experience in defining and designing data governance, data management, and data security solutions for an enterprise ...

make informed Expert knowledge of multiple programming languages (i.e. Python, Java, C++ decisions, meeting the evolving needs of our customers. With strong familiarity with Hadoop, we develop and deploy scalable AI/ML models that integrate with data pipelines, infrastructure, and applications. WHY JOIN US Providing ongoing training, mentorship ...

years' IT Architecture experience working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment ...

government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana ...

substituted for a bachelor's degree. Demonstrated experience with distributed scale Big Data stores (i.e. Accumulo), Map/Reduce programming model (i.e. Hadoop), Hadoop Distributed File System, and data serialization (i.e. JSON). Experience with programming languages such as Java and scripting languages such as Perl, Python, Bash. ...

experience in the same or similar IT/Computer-related field. Required experience must include experience working with: Development tools: Spark, Scala, Python, Hadoop, and Shell scripts; DevOps tools: GitHub, Jenkins, SonarCube, Checkmarx; AWS Cloud; CI/CD pipeline development; Agile development. Permanent U.S. work authorization is required ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

strategizing the roadmap around On-premise and cloud solutions. Experience in designing and developing real time data processing pipelines Expertise in working with Hadoop data platforms and technologies like Kafka, Spark, Impala, Hive and HDFS in multi-tenant environments Expert in Java programming ,SQL and shell script, DevOps Good ...

Boot) for data engineering and services. Proven background working within financial services environments. Hands-on experience building and managing Apache Airflow/Spark and Hadoop clusters. Deep experience in big data engineering, including Hadoop, Kafka, and Spark-based data pipelines. Strong SQL/RDBMS experience: PostgreSQL, SQL Server. ...

implementations Should have strong experience in converting SQL/PL, Data transformations, Data quality and complex SQL's into data lake Experience using Hadoop Distribution and it's all services for example: YARN, KUDU, OOZIE, IMPALA, HIVE, HBASE, SPARK Working knowledge of Java/Python & REST API Conducts facilitated ...

intelligence.Key Responsibilities : Collect, process, and analyze large volumes of structured and unstructured data from diverse sources. Utilize big data tools and technologies such as Hadoop, Spark, Kafka, and NoSQL databases. Develop and maintain dashboards, reports, and data visualizations to communicate findings to stakeholders. Collaborate with cross-functional teams ...