1 to 25 of 26 Hadoop Jobs

data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply now to be part ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

data modeling . Experience with relational and NoSQL databases such as Oracle, Sybase, PostgreSQL, SQL Server, MongoDB . Familiarity with big data platforms (e.g., Hadoop, Snowflake). Prior experience with ETL tools or as a SQL developer . Proficiency in Python for data engineering and Tableau for reporting ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

Docker and orchestration tools like Kubernetes Strong problem-solving skills and attention to detail Desirable Skills Experience with big data technologies (e.g., Spark, Hadoop) Knowledge of MLOps practices and tools (e.g., MLflow, Kubeflow) Experience working with NLP, computer vision, or recommendation systems Understanding of data governance and security best ...

tools such as Tableau. Having a good understanding of relational databases, warehouse design and architecture principles. Familiarity with big data frameworks (e.g., such as Hadoop, Hive, Spark). Good scripting and programming skills (e.g. familiarity with SQL, Python, Java). Strong foundation in statistical, mathematical, predictive modeling as well ...

ERwin) Solid SQL skills Knowledge of data warehousing, ETL, MDM, and BI Strong communication and stakeholder management Preferred Experience with big data tools (e.g. Hadoop, Databricks, Snowflake) Familiarity with DevOps, CI/CD, Java/Scala Knowledge of semantic data models or ontologies Background in healthcare or life sciences ...

libraries such as Scikit-learn, TensorFlow, PyTorch, or Keras ✔ Knowledge of SQL/NoSQL databases ✔ Familiarity with data analytics and statistical techniques ✔ Exposure to Hadoop, Spark, or Kafka is a plus Education Master’s degree in Data Science, Computer Science, Statistics, Mathematics, or related field Candidates with a Bachelor ...

PostgreSQL , MongoDB ) Understanding of enterprise-level platforms Experience with agile development methodologies Strong problem-solving and analytical skills Experience with big data technologies (e.g., Hadoop , PySpark ...

clustering and classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualisation tools (Cassandra, Hadoop, Spark, Tableau). ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

Spring Boot Experience working with DevOps methodologies and scalable CI/CD pipelines Microservices Architecture Exposure to Big Data technologies such as: Kafka, Spark, Hadoop etc Strong understanding of clean code principles Experience working with AWS Cloud Kotlin experience (preferred ...

Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job ID: 172543 Job Overview: As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank ...

senior technical contributor Preferred/Nice-to-Have Skills: Agentic AI frameworks: LangGraph, LangChain, A2A Programming Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms: AWS (Glue, Lambda, Redshift, S3, CloudWatch) ETL/ELT Tools: AWS Glue, PySpark, Databricks Data Integration & Migration … Hadoop ecosystems, Kafka, real-time streaming, data lakes Data Modeling: dimensional models, structured and unstructured data processing CI/CD & Automation: GitHub Actions, Azure DevOps, Jenkins, Git, Autosys, Airflow Containerization and Orchestration: Kubernetes Required Skills: Full Stack Python FrontEnd: React/Angular Backend: FastAPI/Flask Data layer: SQLServer ...

documentation Skills & Key Requirements: • Strong Slurm or equivalent job scheduler experience • Deep Docker knowledge (Kubernetes a plus) • Big data database design: PostgreSQL, MongoDB, or Hadoop/S3 • Python/Flask for API development • Infrastructure-as-Code: Terraform or Ansible • Observability stacks: Prometheus, Grafana, ELK Contract Details: • Day Rate ...

organisational cyber controls response to these threats Exposure to Big Data technologies at enterprise scale Skills Mandatory Skills : Agile (Value-Driven Delivery), Big Data Hadoop Ecosystem, Cybersecurity & AI Laws, Risk Management (Credit/Market/IT/Ops), Stakeholder Management ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

team. Risk & Process Management: Improve workflows and manage project dependencies, blockers, and risks. Tech Collaboration: Work closely with software teams on complex Big Data (Hadoop) and Cybersecurity products. What We Need: Proven experience as a Product Owner in an Agile environment. Strong stakeholder management skills. Basic understanding of cybersecurity ...

voice compliance assurance Low‐latency record matching and reconciliation engines handling billions of events Scalable data services operating across Spark, Kafka, Hive and Hadoop Production‐grade pipelines supporting regulatory evidence, audit and controls Foundations for near‐real‐time compliance signal generation across global voice platforms Key Responsibilities Design … latency Develop robust data matching and reconciliation logic across heterogeneous voice data sources Define and implement scalable data models using Hive and Hadoop ecosystems Apply software engineering best practices : version control, code reviews, testing, CI/CD and documentation Reverse‐engineer and modernise legacy batch or reporting‐oriented implementations ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We understand ...

Master’s Degree Preferred Strong data warehousing, OLTP systems, data integration and SDLC Strong experience in big data frameworks & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), Spark Scala or Spark SQL) or Similar, along with experience in libraries/frameworks to accelerate code … using major data modelling tools (examples: ERwin, ER/Studio, PowerDesigner, etc.) Experience with major database platforms (e.g. SQL Server, Oracle, Azure Data Lake, Hadoop, Azure Synapse/SQL Data Warehouse, Snowflake, Redshift etc. ...