14 of 14 Hadoop Jobs in London

Experience with Airflow for orchestration. p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Exposure to big data frameworks such as Spark, Hadoop, or Presto. p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Experience supporting AI/ML data pipelines. ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

comparable technologies. Examples of technologies in scope include: Data processing and logic: ANSI SQL, Apache Spark, Kafka Platforms and storage: Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ Engineering and deployment: CI/CD tooling, containerised or Kubernetes‐based deployment approaches where relevant You'll also work with ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

Global Markets or Investment Banking environments Deep expertise in modern data lake technologies, cloud platforms (AWS, Azure, GCP), and big data ecosystems including Hadoop, Spark, Kafka, and related technologies Comprehensive understanding of Global Markets business operations, including Fixed Income, Equities, FX, Commodities, and Derivatives trading workflows and data requirements ...

connected, time‐series, geospatial, image, etc. Different types of database – relational; document; graph; columnar; key‐value Large scale data processing platforms, typically based on Hadoop/Spark Business intelligence/analytics products or frameworks Data analysis and data modelling requirements Experience working with cloud platforms and working with relevant ...

social benefits (e.g. UK pension schema) Strong hands-on experience working with modern Big Data technologies such as Apache Spark, Trino, Apache Kafka, Apache Hadoop, Apache HBase, Apache Nifi, Apache Airflow, Opensearch Proficiency in cloud-native technologies such as containerization and Kubernetes Strong knowledge of DevOps tools (Terraform, Ansible ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

Spring Boot Experience working with DevOps methodologies and scalable CI/CD pipelines Microservices Architecture Exposure to Big Data technologies such as: Kafka, Spark, Hadoop etc Strong understanding of clean code principles Experience working with AWS Cloud Kotlin experience (preferred ...

least one. You are a great fit for this role if you have: Strong desire to tackle hard technical problems in K8s, Hadoop + cloud and proven ability to do so with little or no direct daily supervision. Experience operating Linux systems (configure, tune, and troubleshoot both ...

structures and algorithms We would love to see: Prior experience with or knowledge of large-scale, high volume systems Hands-on experience with HBase, Hadoop, Redis, Cassandra or Spark Experience designing for iterative and experimental features If indicated, please note that years of experience are a guide; we will ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

voice compliance assurance Low‐latency record matching and reconciliation engines handling billions of events Scalable data services operating across Spark, Kafka, Hive and Hadoop Production‐grade pipelines supporting regulatory evidence, audit and controls Foundations for near‐real‐time compliance signal generation across global voice platforms Key Responsibilities Design … latency Develop robust data matching and reconciliation logic across heterogeneous voice data sources Define and implement scalable data models using Hive and Hadoop ecosystems Apply software engineering best practices : version control, code reviews, testing, CI/CD and documentation Reverse‐engineer and modernise legacy batch or reporting‐oriented implementations ...