1 to 25 of 26 Hadoop Jobs

Experience with Airflow for orchestration. p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Exposure to big data frameworks such as Spark, Hadoop, or Presto. p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Experience supporting AI/ML data pipelines. ...

Proficient in day‐to‐day use of Python/Java/Scala. Strong understanding of and experience with distributed computing frameworks like Hive/Hadoop and Apache Spark. Expertise in data modeling, schema design, and data visualization tools. Experience working in GCP and/or AWS is a plus. ...

data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply now to be part ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

/Studio, ERwin, or Sparx EA (preferred). Experience reverse engineering models from existing databases.* Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop).* Experience with API management and gateway tools and services.* Experience of RESTful APIs for ingesting and exposing data.* Proven track record with data ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant You'll also work with ...

Docker and orchestration tools like Kubernetes Strong problem-solving skills and attention to detail Desirable Skills Experience with big data technologies (e.g., Spark, Hadoop) Knowledge of MLOps practices and tools (e.g., MLflow, Kubeflow) Experience working with NLP, computer vision, or recommendation systems Understanding of data governance and security best ...

ERwin) Solid SQL skills Knowledge of data warehousing, ETL, MDM, and BI Strong communication and stakeholder management Preferred Experience with big data tools (e.g. Hadoop, Databricks, Snowflake) Familiarity with DevOps, CI/CD, Java/Scala Knowledge of semantic data models or ontologies Background in healthcare or life sciences ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

Global Markets or Investment Banking environments Deep expertise in modern data lake technologies, cloud platforms (AWS, Azure, GCP), and big data ecosystems including Hadoop, Spark, Kafka, and related technologies Comprehensive understanding of Global Markets business operations, including Fixed Income, Equities, FX, Commodities, and Derivatives trading workflows and data requirements ...

level software development, architecture, and design. Solid coding skills, including proficiency in Java and at least a basic understanding of Python. Experience with Spark, Hadoop, Kafka, MapReduce or other big data technologies experience highly desirable. Solid DB skills (relational, document and key-value) and SQL-like languages would ...

connected, time‐series, geospatial, image, etc. Different types of database – relational; document; graph; columnar; key‐value Large scale data processing platforms, typically based on Hadoop/Spark Business intelligence/analytics products or frameworks Data analysis and data modelling requirements Experience working with cloud platforms and working with relevant ...

social benefits (e.g. UK pension schema) Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, Apache HBase, Apache Nifi, Apache Airflow, Opensearch Proficiency in cloud-native technologies such as containerization and Kubernetes Strong knowledge of DevOps tools (Terraform, Ansible ...

support and migration experience Desirable knowledge and experience: AWS accreditation Knowledge of COTS products (including but not limited to; Elasticsearch, NiFi, Rabbit, Kafka, MongoDB, Hadoop, Ansible, Git and Kubernetes) Development of dashboards for monitoring and alerting through Grafana, Splunk, Prometheus and OpenText Om and Ops Bridge On prem ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

Spring Boot Experience working with DevOps methodologies and scalable CI/CD pipelines Microservices Architecture Exposure to Big Data technologies such as: Kafka, Spark, Hadoop etc Strong understanding of clean code principles Experience working with AWS Cloud Kotlin experience (preferred ...

least one. You are a great fit for this role if you have: Strong desire to tackle hard technical problems in K8s, Hadoop + cloud and proven ability to do so with little or no direct daily supervision. Experience operating Linux systems (configure, tune, and troubleshoot both ...

structures and algorithms We would love to see: Prior experience with or knowledge of large-scale, high volume systems Hands-on experience with HBase, Hadoop, Redis, Cassandra or Spark Experience designing for iterative and experimental features If indicated, please note that years of experience are a guide; we will ...

Position: Data Engineer II Location: Sunnyvale, California Duration: Contract Job ID: 175305 Job Overview: We are seeking a skilled and detail-oriented Data Engineer II to join our team. The ideal candidate will be responsible ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

team. Risk & Process Management: Improve workflows and manage project dependencies, blockers, and risks. Tech Collaboration: Work closely with software teams on complex Big Data (Hadoop) and Cybersecurity products. What We Need: Proven experience as a Product Owner in an Agile environment. Strong stakeholder management skills. Basic understanding of cybersecurity ...

voice compliance assurance Low‐latency record matching and reconciliation engines handling billions of events Scalable data services operating across Spark, Kafka, Hive and Hadoop Production‐grade pipelines supporting regulatory evidence, audit and controls Foundations for near‐real‐time compliance signal generation across global voice platforms Key Responsibilities Design … latency Develop robust data matching and reconciliation logic across heterogeneous voice data sources Define and implement scalable data models using Hive and Hadoop ecosystems Apply software engineering best practices : version control, code reviews, testing, CI/CD and documentation Reverse‐engineer and modernise legacy batch or reporting‐oriented implementations ...

scalable ELT/ETL flows (batch and streaming) Interface between Data Analysts and Data Scientists Enrich data and load into big data environment (Apache Hadoop on Cloudera) Profil Technical education (Computer Science HTL, Computer Science Degree, Data Science etc.) Experience in data modeling (relational databases and Apache Hadoop) Know-how of core technologies such as SQL (MS SQL Server), Apache Hadoop (Kafka, NiFi, Flink, Scala and/or Java, Python) and Linux Showing interest in working with high-frequency data processing in a near-realtime environment Wir bieten State-of-the-Art Technologies We understand ...