1 to 25 of 32 Hadoop Jobs

Java/Scala. Databases: Experience across Relational (SQL), NoSQL (MongoDB/Cassandra), and Graph (Neo4j). Big Data: Hands-on experience with Hadoop or Spark. Infrastructure: Comfortable with Linux/Bash, Docker, and Cloud IaaS/PaaS environments. Integrations: Familiarity with BI tools (PowerBI/Tableau) and integration platforms ...

Pandas, NumPy, and Matplotlib. · Proficiency with cloud platforms like AWS, Azure, or Google Cloud Platform (GP). · Familiarity with big data technologies like Hadoop, Spark, or Kafka · Experience with SQL/NoSQL databases and data pipelines. · Experience with containerization and orchestration (e.g., Docker, Kubernetes). Preferred Qualifications: · Hands ...

management tools Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL) Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop) Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

seeking a Lead Data Engineering Consultant with proven experience in leading and developing data engineering platforms. Experience required: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

manipulating, and preparing data from relational databases. Experience with NoSQL databases is a plus. Big Data/Cloud: Experience with big data tools ( Spark, Hadoop ) and cloud computing platforms ( AWS, Azure, or GCP ) for scalable ML workflows. Visualization: Ability to create clear, compelling data visualizations using tools like Matplotlib ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

work with modern, “shiny” tools and influence what we adopt next. Use workflow tools such as ADF/Airflow and big data technologies (Spark, Hadoop, Kafka) Private healthcare for you and your family Company pension scheme Flexible benefits (gym membership, tech, health assessments and more) Access to an online ...

Knowledge of MLOps, DevOps, CI/CD, and automated model pipelines within Foundry and cloud-based environments. Familiarity with big data ecosystems (Foundry, Spark, Hadoop) and commercial data source integration. ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault Mandatory and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . AI/ML Practical experience with NLP (HuggingFace) and GenAI frameworks ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. Minimum 5 years in Big Data technologies (e.g., , Hadoop). Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. Minimum 5 years in ML model development, data ...

Technical Self-Assessment (1-10) Candidates will be asked to rate their knowledge of: Languages: Python, Java, Scala Compute/Distributed: RAY , Spark, Databricks, Hadoop Orchestration/Cloud: Kafka, Airflow, Prefect, AWS Storage/Warehouse: Clickhouse, Snowflake, Redshift, Greenplum Note: Experience with Petabyte/Exabyte scale is a strong ...

requiring strong visualisation and data exploration capabilities. Required Skills Proficiency in Python and/or R , with experience using big data technologies such as Hadoop . Strong skills in data visualisation tools (e.g., Tableau). Ability to communicate complex analytical concepts clearly in writing. Demonstrated experience working with large ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and OCR technologies Awareness or hands-on experience with Generative AI solutions Experience with containerisation technologies such as Docker Background ...

exchange and processing experience including ETL, ESB and API-based integrations Development experience, ideally using Python Knowledge of big data technologies such as the Hadoop stack Exposure to NLP and OCR technologies Awareness or hands-on experience with Generative AI solutions Experience with containerisation technologies such as Docker Background ...

DevOps, automation, and CI/CD pipelines across multiple platforms. Strong background in virtualization, storage, networking, and database technologies (VMware, NetApp, Citrix, Oracle, SQL, Hadoop). Demonstrated leadership in project delivery, stakeholder management, and cross-functional collaboration. Excellent communication and presentation skills, with experience engaging C-level stakeholders ...

Agile ceremonies and actively engage with the team. Must Have Skills: Hands-on experience with Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms. AWS administration and platform management experience. Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus). Agile ...

/ELT pipelines integrating large, complex datasets Work with structured, semi-structured, and unstructured data across SQL and NoSQL technologies Develop solutions using Hadoop, Spark, and Splunk in large-scale environments Write maintainable Python code, applying object-oriented and functional programming principles Implement and maintain CI/CD pipelines … resilience, sustainability, and recoverability Essential Skills & Experience Proven experience as a Lead or Senior Data Engineer in enterprise-scale environments Hands-on expertise with Hadoop, Spark, and Splunk Advanced Python development skills Experience designing and optimising high-performance data pipelines Strong understanding of CI/CD, source control ...

Solution Architect About the Role Design and implement a comprehensive strategy for migrating and modernizing existing relational on premise databases, data warehouses (Teradata, Hadoop, Netezza, AWS, Azure) to scalable and cost-effective solution on Google Cloud Platform (GCP). Responsibilities • Prepare Data & AI Industry Specific GTM by conducting Research … relevant experience. Technical/Functional Skills:- • Design and implement a comprehensive strategy for migrating and modernizing existing relational on premise databases, data warehouses (Teradata, Hadoop, Netezza, AWS, Azure) to scalable and cost-effective solution on Google Cloud Platform (GCP). • Experience in designing modern data platforms based on Data ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...