1 to 25 of 59 Hadoop Jobs

Java Commercial experience in client-facing projects is a plus, especially within multi-disciplinary teams Deep knowledge of database technologies: Distributed systems (e.g., Spark, Hadoop, EMR) RDBMS (e.g., SQL Server, Oracle, PostgreSQL, MySQL) NoSQL (e.g., MongoDB, Cassandra, DynamoDB, Neo4j) Solid understanding of software engineering best practices - code reviews, testing ...

Experience Strong experience with SQL, relational databases, and NoSQL systems.Proficiency in Python, Scala, or Java for data engineering tasks.Experience with big data tools (Spark, Hadoop, Kafka, FlinkKnowledge of ETL/ELT tools (Airflow, dbt, Glue, InformaticaFamiliarity with data warehousing (Snowflake, BigQuery, RedshiftUnderstanding of data modeling, normalization, and data governance.Experience ...

environments (AWS, Azure, GCP) including services like S3, BigQuery, Azure ML, etc. Solid understanding of data engineering principles , SQL, and distributed computing frameworks (Spark, Hadoop). Experience in consulting or client-facing roles , with ability to manage stakeholders and deliver strategic insights. Strong knowledge of machine learning algorithms , statistical ...

also valued). Experience with modern data lakehouse concepts and architectures. Experience ingesting and transforming data from sources such as Kafka, REST APIs, Hadoop, etc. Experience with data pipeline orchestration tools (Azure Data Factor or similar). Experience implementing ETL/ELT pipelines using modern data lakehouse solutions. Experience ...

Strong proficiency in programming languages such as Python, Java, or Scala. Experience with cloud platforms like Azure. Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Proficiency in SQL and database management systems. Familiarity with data warehousing concepts and tools. Ability to work collaboratively with cross-functional ...

optimised for GenAI workloads. Strong knowledge of data modelling, ETL processes, SQL, and scripting languages such as Python. Experience with Big Data technologies (e.g., Hadoop, Spark) and data visualisation tools (e.g., Tableau, Power BI). Familiarity with AI/ML frameworks (TensorFlow, PyTorch, Hugging Face, etc.). Experience ...

Hands-on experience with AWS AI/ML services (SageMaker, Bedrock, Comprehend,Rekognition) Proven track record with big data technologies (Amazon EMR, Redshift, Spark,Hadoop) Experience deploying machine learning models, deep learning algorithmsIoT & Systems Integration: Deep hands-on IoT knowledge including device connectivity, protocols, and dataingestion Experience with ...

Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 4+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years of experience with NoSQL ...

Java 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud) 5+ years experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 4+ year experience working on real-time data and streaming applications 4+ years of experience with NoSQL ...

performance of data platforms. Collaborates with data scientists and analysts to enable data accessibility and automation.Skills:Strong SQL and database designBig Data technologies (Hadoop, Spark, Hive)Data pipeline tools (Airflow, Kafka, NiFi)Programming (Python, Scala, Java)Cloud platforms (AWS, Azure, GCP)Data warehousing (Snowflake, Redshift, BigQuery)ETL/ ...

delivery experience Strong knowledge of Entity Resolution, Scoring Framework, Network Generation, and UI configuration 5 -10 years' experience with Big Data technologies (Scala, Spark, Hadoop, Elasticsearch) Solid data modelling and analytics platform design experience Excellent stakeholder communication skills Experience with cloud platforms (AWS, Azure, or GCP) Desirable Experience ...

techniques. Cloud & MLOps: Experience with AWS, GCP, or Azure; Docker/Kubernetes; MLflow or similar tools. Data Handling: Familiarity with big data frameworks (Spark, Hadoop) and data versioning tools (DVC). Soft Skills: Strong problem-solving, communication, and ability to work in agile teams. Preferred Qualifications Experience with transformer ...

engineering environment. Strong proficiency in Python programming. Hands-on experience with PySpark (Spark with Python API Good understanding of big data technologies and concepts (Hadoop, Spark, etc. Familiarity with SQL and relational databases. Experience with data modeling and schema design. Strong problem-solving skills and attention to detail. Excellent ...

control trials to validate model performance and business impact. Perform data analysis on structured and unstructured datasets using Python, SQL, and big data frameworks (Hadoop, PySpark). Develop and optimize data retrieval systems using RAG, FAISS, Elasticsearch, and other retrieval algorithms. Implement time-series forecasting and anomaly detection ...

Need: Experience in architecture & design and consulting services focused on enterprise solutions, data analytics platform, lake houses, data engineering, data processing, data warehousing, ETL, Hadoop & Big Data. Experience in BFSI Industry is required. Experience in defining and designing data governance, data management, and data security solutions for an enterprise ...

make informed Expert knowledge of multiple programming languages (i.e. Python, Java, C++decisions, meeting the evolving needs of our customers. With strong familiarity with Hadoop, we develop and deploy scalable AI/ML models that integrate with data pipelines, infrastructure, and applications. WHY JOIN US Providing ongoing training, mentorship ...

years' IT Architecture experience working in a software development, technical project management, digital delivery, or technology consulting environment • Platform implementation experience (Apache Hadoop - Kafka - Storm and Spark, Elasticsearch and others) • Experience around data integration & migration, data governance, data mining, data visualisation, database modelling in an agile delivery-based environment ...

government, defence, or highly regulated industries with knowledge of relevant standards. Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with monitoring and alerting tools such as Prometheus, Grafana ...

substituted for a bachelor's degree. Demonstrated experience with distributed scale Big Data stores (i.e. Accumulo), Map/Reduce programming model (i.e. Hadoop), Hadoop Distributed File System, and data serialization (i.e. JSON). Experience with programming languages such as Java and scripting languages such as Perl, Python, Bash. ...

experience in the same or similar IT/Computer-related field. Required experience must include experience working with: Development tools: Spark, Scala, Python, Hadoop, and Shell scripts; DevOps tools: GitHub, Jenkins, SonarCube, Checkmarx; AWS Cloud; CI/CD pipeline development; Agile development. Permanent U.S. work authorization is required ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

Neo4J ETL, ESB, API or similar data integration experience Development experience such as Python Exposure to big data tools or architectures such as the Hadoop ecosystem Experience with NLP or OCR technologies Desirable: Knowledge of generative AI concepts or frameworks Experience with containerisation such as Docker Experience in industrial ...

strategizing the roadmap around On-premise and cloud solutions. Experience in designing and developing real time data processing pipelines Expertise in working with Hadoop data platforms and technologies like Kafka, Spark, Impala, Hive and HDFS in multi-tenant environments Expert in Java programming ,SQL and shell script, DevOps Good ...

implementations Should have strong experience in converting SQL/PL, Data transformations, Data quality and complex SQL's into data lake Experience using Hadoop Distribution and it's all services for example: YARN, KUDU, OOZIE, IMPALA, HIVE, HBASE, SPARK Working knowledge of Java/Python & REST API Conducts facilitated ...