1 to 25 of 28 Hadoop Jobs

Proficient in day‐to‐day use of Python/Java/Scala. Strong understanding of and experience with distributed computing frameworks like Hive/Hadoop and Apache Spark. Expertise in data modeling, schema design, and data visualization tools. Experience working in GCP and/or AWS is a plus. ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

ability to think critically and analytically. Strong experience in documentation and data dictionaries. Knowledge of big data technologies and distributed computing frameworks such as Hadoop and Spark. Excellent communication skills to effectively collaborate with cross-functional teams and present insights to business stakeholders. ...

related field, or in bioinformatics with a demonstrated IT expertise Experience in big data technologies and frameworks, such as Apache Spark, Hadoop or similar platforms Hands-on experience with CI/CD (GitLab CI/GitHub Actions) Familiarity with Java Familiarity with Google Cloud Platform or AWS Familiarity with ...

Methodologies: Understanding of Site Reliability Engineering (SRE) practices.* Data Technologies: Proficiency in data technologies such as relational databases, data warehousing, big data platforms (e.g., Hadoop), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure).* Programming Skills: Programming skills in languages like Python (NumPy, pandas, PySpark), Java ...

data science. Cloud certifications (e.g. Azure, GCP, AWS) and relevant AI/ML credentials. Experience with big data and distributed computing (e.g. Spark, Databricks, Hadoop or cloud-native alternatives). Experience with containerisation and DevOps/MLOps tools (e.g. Docker, Kubernetes, Git, CI/CD, MLflow, Airflow). Strong ...

degree, or experience in a professional field or military - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in consulting, design and implementation of serverless distributed solutions - Experience in cloud based solution (AWS or equivalent), system, network and operating ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant You'll also work with ...

including encryption, consent management, and retention policies Familiarity with data lakes, real‐time analytics, and emerging data technologies Documentation and communication skills Experience with Hadoop, Spark, Kafka, or other big data technologies Exposure to AI/ML integration within enterprise data environments Cloud or data certifications such as Azure ...

experience and expertise in following technologies: Java, Python, Data engineering, Data and Database engineering, Agentic AI, Gen AI, Machine Leaning, Generative AI, Scripting, Spark, Hadoop, SQL, NoSQL, PyTorch and one of the cloud technologies like AWS, Azure or GCP. Should have worked in at least two or more industry ...

Relational databases (SQL Server, PostgreSQL, Oracle, MySQL) Data visualisation tools (Power BI, Tableau, Spotfire) Cloud platforms, particularly Microsoft Azure Big data technologies (Spark, Elasticsearch, Hadoop) Statistical modelling and advanced analytics Machine learning and pattern recognition techniques Web technologies such as HTML and JavaScript ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

connected, time‐series, geospatial, image, etc. Different types of database – relational; document; graph; columnar; key‐value Large scale data processing platforms, typically based on Hadoop/Spark Business intelligence/analytics products or frameworks Data analysis and data modelling requirements Experience working with cloud platforms and working with relevant ...

data warehousing, OLTP systems, data integration, and the software development lifecycle (SDLC). Hands-on experience with big data frameworks such as Spark, Hadoop, or Hive, including derivatives like PySpark (preferred), Spark Scala, or Spark SQL, along with familiarity with development-accelerating libraries and frameworks. Experience using data modelling … tools such as ERwin, ER/Studio, PowerDesigner, or similar. Experience with major database platforms, including SQL Server, Oracle, Azure Data Lake, Hadoop, Azure Synapse (SQL Data Warehouse), Snowflake, Redshift, and others. Strong experience with orchestration tools such as Azure Data Factory, HDInsight, Cloud Composer, Data Pipeline, or equivalent. ...

social benefits (e.g. UK pension schema) Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, Apache HBase, Apache Nifi, Apache Airflow, Opensearch Proficiency in cloud-native technologies such as containerization and Kubernetes Strong knowledge of DevOps tools (Terraform, Ansible ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

related field, or experience in a professional field or military - Experience as technical specialist in design and architecture - Experience in database (eg. SQL, NoSQL, Hadoop, Spark, Kafka, Kinesis) - Experience in software development with object oriented language - Experience in cloud based solution (AWS or equivalent), system, network and operating system ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

data migrator product and contributing to a new orchestration platform. Cloud infrastructure across AWS S3, Google Cloud Storage, and Azure. Big data stores including Hadoop and Apache Ozone. Integration with Snowflake, Databricks, and AI tooling including Claude, Gemini, and Codex. Building AI-powered applications and workflows ...

experience with modeling tools such as Python, PyTorch, TensorFlow, scikit-learn etc.Hands-on experience building large-scale distributed machine learning systems such as Hadoop, Spark etc.Effective communication skills in Chinese.At JD.com, we’re committed to building a diverse and inclusive workplace where everyone can thrive. We’re proud ...

experience with modeling tools such as Python, PyTorch, TensorFlow, scikit-learn etc. Hands-on experience building large-scale distributed machine learning systems such as Hadoop, Spark etc. Effective communication skills in Chinese. EEO At JD.com, we’re committed to building a diverse and inclusive workplace where everyone can thrive. ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

About the Job you are considering: Results-driven Hadoop Spark Data Engineer with strong expertise in designing and implementing scalable big data solutions using Scala and Apache Spark. Experienced in working with the Hadoop ecosystem, including HDFS, Hive, and YARN, to process and analyze large datasets efficiently. Skilled … client sites, and your home; noting that you will be unable to work at home 100% of the time. Your Role: Design and develop Hadoop based applications and data pipelines. Build operate monitor and troubleshoot Hadoop clusters. Write scalable ETL processes using tools like Hive Pig and Spark. ...

mission-critical platform, driving architecture, performance optimisation, automation, and engineering best practice. Strong Java and distributed systems experience required. Exposure to AI, LLMs, Hadoop, Elasticsearch or Oracle would be advantageous. ...

team. Risk & Process Management: Improve workflows and manage project dependencies, blockers, and risks. Tech Collaboration: Work closely with software teams on complex Big Data (Hadoop) and Cybersecurity products. What We Need: Proven experience as a Product Owner in an Agile environment. Strong stakeholder management skills. Basic understanding of cybersecurity ...