1 to 25 of 41 Hadoop Jobs

Required to have experience with one or more AI automations platforms like Kubeflow pipeline, MLFlow, Azure Pipeline, AWS Sage Maker Pipeline, Airflow, Jenkins, Spark, Hadoop, Kafka, Jira and GIT. We provide market-competitive compensation packages, inclusive of base pay, incentives, and benefits. The base pay rate for full-time ...

compliance requirements Excellent communication, problem-solving and documentation skills Desirable: Experience with cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ ...

optimised for GenAI workloads. Strong knowledge of data modelling, ETL processes, SQL, and scripting languages such as Python. Experience with Big Data technologies (e.g., Hadoop, Spark) and data visualisation tools (e.g., Tableau, Power BI). Familiarity with AI/ML frameworks (TensorFlow, PyTorch, Hugging Face, etc.). Experience ...

Ability to communicate complex analytical findings to diverse audiences Preferred Qualifications Experience with cloud platforms (AWS, GCP, Azure) Familiarity with big data technologies (Spark, Hadoop) Experience deploying models into production environments Knowledge of deep learning frameworks (TensorFlow, PyTorch) Experience working in Agile or cross-functional product teams ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

Azure DevOps/GitHub). Excellent communication with technical and non-technical stakeholders. Desired Skills Power BI/Tableau Stakeholder management Spark/Hadoop Unit testing frameworks Azure advanced analytics Data warehousing experience Azure Data Engineer certification Agile/Scrum/Kanban exposure This is a London based role ...

seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark , and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python . Skilled in handling raw, structured, semi-structured, and unstructured data ...

engage technical and non-technical stakeholders Nice to Have: Experience with modern analytics and BI platforms Knowledge of big data technologies (e.g. Spark, Hadoop) Experience with real-time or event-driven architectures Familiarity with data cataloguing and lineage tools Experience working in regulated or data-sensitive environments Relevant certifications ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data ...

advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . AI/ML Practical experience with NLP (HuggingFace) and GenAI frameworks ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. Minimum 5 years in Big Data technologies (e.g., , Hadoop). Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. Minimum 5 years in ML model development, data ...

techniques, A/B testing methodologies, and experiment design. Solid background in ranking, recommendation, and retrieval systems. Familiarity with large-scale data tools (Hadoop, BigQuery, Amazon EMR, etc.). Experience with BI tools and visualization platforms such as Tableau, Qlik, or MicroStrategy. Bonus: Experience with geospatial data and advanced ...

make informed Expert knowledge of multiple programming languages (i.e. Python, Java, C++ decisions, meeting the evolving needs of our customers. With strong familiarity with Hadoop, we develop and deploy scalable AI/ML models that integrate with data pipelines, infrastructure, and applications. WHY JOIN US Providing ongoing training, mentorship ...

Technical Self-Assessment (1-10) Candidates will be asked to rate their knowledge of: Languages: Python, Java, Scala Compute/Distributed: RAY , Spark, Databricks, Hadoop Orchestration/Cloud: Kafka, Airflow, Prefect, AWS Storage/Warehouse: Clickhouse, Snowflake, Redshift, Greenplum Note: Experience with Petabyte/Exabyte scale is a strong ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

including stakeholder management Have experience in some of the following technologies: ETL toolset (Talend, Pentaho, SAS DI, Informatica etc) Database (Oracle, RDS, Redshift, MySQL, Hadoop, Postgres, etc) Job Scheduling toolset (Job Scheduler, TWS, etc) Programming and scripting languages (PL/SQL, SQL, Unix, Java, Python, Hive, HiveQL, HDFS, Impala ...