20 of 20 Hadoop Jobs

data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply now to be part ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

learn, standard libraries, etc.), Python packages that wrap Machine Learning (packages for NLP, Object Detection, etc.), Linux, AWS/C2S, Apache NiFi, Spark, pySpark, Hadoop, Kafka, ElasticSearch, Solr, Kibana, neo4J, MariaDB, Postgres, Docker, Puppet, and many others. Work on this program takes place in Chantilly, VA, McLean ...

Docker and orchestration tools like Kubernetes Strong problem-solving skills and attention to detail Desirable Skills Experience with big data technologies (e.g., Spark, Hadoop) Knowledge of MLOps practices and tools (e.g., MLflow, Kubeflow) Experience working with NLP, computer vision, or recommendation systems Understanding of data governance and security best ...

experience and expertise in following technologies: Java, Python, Data engineering, Data and Database engineering, Agentic AI, Gen AI, Machine Leaning, Generative AI, Scripting, Spark, Hadoop, SQL, NoSQL, PyTorch and one of the cloud technologies like AWS, Azure or GCP. Should have worked in at least two or more industry ...

Server development Experience designing enterprise data architectures Proven experience leading engineering teams or workstreams Strong stakeholder engagement and consulting skills Working knowledge of Hadoop Experience with test-driven development and CI/CD REST APIs and Kafka experience Nice to Have Experience leading data platform migrations Cloud architecture expertise ...

ERwin) Solid SQL skills Knowledge of data warehousing, ETL, MDM, and BI Strong communication and stakeholder management Preferred Experience with big data tools (e.g. Hadoop, Databricks, Snowflake) Familiarity with DevOps, CI/CD, Java/Scala Knowledge of semantic data models or ontologies Background in healthcare or life sciences ...

using JUnit, Maven, Jenkins Technical Skill Preferred Experience working in an Agile (Scrum) environment using Jira and Confluence Experience with distributed technologies such as Hadoop, Spark and Kafka Experience with MongoDB, ElasticSearch, HBase or Accumulo data stores Basic understanding of Python Basic understanding JavaScript Benefits Offered: Medical, Dental, Vision ...

using JUnit, Maven, Jenkins Technical Skill Preferred Experience working in an Agile (Scrum) environment using Jira and Confluence Experience with distributed technologies such as Hadoop, Spark and Kafka Experience with MongoDB, ElasticSearch, HBase or Accumulo data stores Basic understanding of Python Basic understanding JavaScript Benefits Offered: Medical, Dental, Vision ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

Spring Boot Experience working with DevOps methodologies and scalable CI/CD pipelines Microservices Architecture Exposure to Big Data technologies such as: Kafka, Spark, Hadoop etc Strong understanding of clean code principles Experience working with AWS Cloud Kotlin experience (preferred ...

tuning Solr/Elastic for performance and query optimization Minimum of 3 years of experience in a big data environment using tools such as Hadoop, Pyspark, Spark, and Hbase (prefer at least two of the list) Minimum of 5 years of hands-on, back-end Java development experience ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We understand ...

performing schema updates and tuning Lucene queries for performance and efficiency. Architect and implement big data solutions and ingestion pipelines using tools such as Hadoop, PySpark, Spark, and Hbase. Possess significant experience in query optimization and managing the underlying sharding mechanisms of Solr or Elastic Search to ensure system … tuning Solr/Elastic for performance and query optimization Minimum of 3 years of experience in a big data environment using tools such as Hadoop, Pyspark, Spark, and Hbase (prefer at least two of the list) Preferred Qualifications Demonstrated experience working with several AWS services. Demonstrated experience with JIRA ...