1 to 25 of 55 Hadoop Jobs

with AI/ML data pipelines and analytics platforms Preferred Qualifications Experience with cloud data platforms (AWS, Azure, GCP) Experience with big data technologies (Hadoop, Spark, Kafka) Familiarity with UML/SysML Strong understanding of API integration and microservices data flows ...

data pipelines and analytics platforms. Preferred Qualifications: Experience with cloud data platforms (e.g., AWS, Azure, Google Cloud). Experience with big data technologies (e.g., Hadoop, Spark, Kafka). Experience with UML/SYSML. Strong understanding of API integration and microservices data flow. If you have a strong background ...

practices with Strong understanding of data modeling principles and techniques A solid understanding of big data technologies such as Apache Spark, and knowledge of Hadoop ecosystems. Knowledge of programming languages such as Python, R, or Java is beneficial. Knowledge of ETL/ELT processes (such as DBT), SQL, NoSQL ...

requirements Excellent communication, problem-solving and documentation skills Desirable: Experience with cloud xohmjla data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ ...

compliance requirements Excellent communication, problem-solving and documentation skills Desirable: Experience with cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ ...

compliance requirements Excellent communication, problem-solving and documentation skills Desirable: Experience with cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ ...

also valued). Experience with modern data lakehouse concepts and architectures. Experience ingesting and transforming data from sources such as Kafka, REST APIs, Hadoop, etc. Experience with data pipeline orchestration tools (Azure Data Factor or similar). Experience implementing ETL/ELT pipelines using modern data lakehouse solutions. Experience ...

/or Computer Vision. Strong knowledge of Machine Learning algorithms and statistics. Experience with SQL/NoSQL databases and big data tools (Spark, Hadoop preferred). Experience with MLOps tools such as Docker, Kubernetes, CI/CD pipelines. Preferred Skills Experience with LLMs/Generative AI (OpenAI, Hugging Face ...

/or Computer Vision. Strong knowledge of Machine Learning algorithms and statistics. Experience with SQL/NoSQL databases and big data tools (Spark, Hadoop preferred). Experience with MLOps tools such as Docker, Kubernetes, CI/CD pipelines. Preferred Skills:- Experience with LLMs/Generative AI (OpenAI, Hugging Face ...

Ability to communicate complex analytical findings to diverse audiences Preferred Qualifications Experience with cloud platforms (AWS, GCP, Azure) Familiarity with big data technologies (Spark, Hadoop) Experience deploying models into production environments Knowledge of deep learning frameworks (TensorFlow, PyTorch) Experience working in Agile or cross-functional product teams ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

work with modern, “shiny” tools and influence what we adopt next. Use workflow tools such as ADF/Airflow and big data technologies (Spark, Hadoop, Kafka) Private healthcare for you and your family Company pension scheme Flexible benefits (gym membership, tech, health assessments and more) Access to an online ...

Azure DevOps/GitHub). Excellent communication with technical and non-technical stakeholders. Desired Skills Power BI/Tableau Stakeholder management Spark/Hadoop Unit testing frameworks Azure advanced analytics Data warehousing experience Azure Data Engineer certification Agile/Scrum/Kanban exposure This is a London based role ...

advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . AI/ML Practical experience with NLP (HuggingFace) and GenAI frameworks ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark , and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python . Skilled in handling raw, structured, semi-structured, and unstructured data ...

engage technical and non-technical stakeholders Nice to Have: Experience with modern analytics and BI platforms Knowledge of big data technologies (e.g. Spark, Hadoop) Experience with real-time or event-driven architectures Familiarity with data cataloguing and lineage tools Experience working in regulated or data-sensitive environments Relevant certifications ...

techniques, A/B testing methodologies, and experiment design. Solid background in ranking, recommendation, and retrieval systems. Familiarity with large-scale data tools (Hadoop, BigQuery, Amazon EMR, etc.). Experience with BI tools and visualization platforms such as Tableau, Qlik, or MicroStrategy. Bonus: Experience with geospatial data and advanced ...