24 of 24 Hadoop Jobs in the UK

Experience with Airflow for orchestration. p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Exposure to big data frameworks such as Spark, Hadoop, or Presto. p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Experience supporting AI/ML data pipelines. ...

data security, governance, and access controls Desirable Experience Experience working within UK defence, intelligence, or national security programmes Exposure to Apache Kafka, Spark, Hadoop, or similar technologies Experience supporting data science or advanced analytics use cases Background working with classified datasets Contract Details Apply now to be part ...

cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins, Azure DevOps, Terraform ...

Methodologies: Understanding of Site Reliability Engineering (SRE) practices. Data Technologies: Knowledge of data technologies such as relational databases, data warehousing, big data platforms (e.g., Hadoop), data streaming (e.g., Kafka), and cloud services (e.g., AWS, GCP, Azure). Programming Skills: Programming skills in languages like Python (NumPy, pandas, PySpark), Java ...

applying emerging ML techniques. Desirable: Experience with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes). Exposure to big data technologies (Spark, Hadoop) and Apache tools. Knowledge of NLP, computer vision, and deep learning architectures. Familiarity with Agile and DevOps practices. STEM degree or equivalent experience ...

with version control systems such as Git Basic understanding of cloud platforms such as Microsoft Azure or Amazon Web Services Interest in tools like Hadoop, Spark, or Kafka Internship or self-learning in data engineering is a plus Skills Data Handling & Processing Basics SQL & Database Fundamentals Programming (Python/ ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

remain appropriate - and where modern approaches add measurable value. Data Engineering & Platform Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/ ...

Lambda, Glue, Redshift, RDS, Athena, IAM Experience working with open-source data technologies and frameworks such as Apache Airflow, Spark, Kafka, dbt, Hadoop Experience working with APIs and data integration patterns Understanding of CI/CD, version control, and engineering best practices Experience working within Agile/Scrum delivery ...

Docker and orchestration tools like Kubernetes Strong problem-solving skills and attention to detail Desirable Skills Experience with big data technologies (e.g., Spark, Hadoop) Knowledge of MLOps practices and tools (e.g., MLflow, Kubeflow) Experience working with NLP, computer vision, or recommendation systems Understanding of data governance and security best ...

classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau ...

ERwin) Solid SQL skills Knowledge of data warehousing, ETL, MDM, and BI Strong communication and stakeholder management Preferred Experience with big data tools (e.g. Hadoop, Databricks, Snowflake) Familiarity with DevOps, CI/CD, Java/Scala Knowledge of semantic data models or ontologies Background in healthcare or life sciences ...

applications Required Skills: ✔ Strong experience with Python ✔ Good understanding of Machine Learning algorithms and statistical concepts ✔ Experience with SQL/NoSQL databases ✔ Familiarity with Hadoop, Spark, or Kafka is a plus ✔ Strong analytical and problem-solving skills Education: Bachelor’s or Master’s degree in Computer Science, Data Science ...

emerging data technologies, products and delivery approaches Familiarity with cloud platforms such as Azure, AWS or GCP, alongside technologies including Databricks, Snowflake, Power BI, Hadoop, SQL and Python Experience working with delivery methodologies including Agile, SAFe and Waterfall Strong proficiency with tools such as Jira, Confluence and Planview ...

clustering and classification techniques. Fluency in a programming language (Python, C, C++, Java, SQL). Familiarity with Big Data frameworks and visualisation tools (Cassandra, Hadoop, Spark, Tableau). ...

scale analytics platforms Expert knowledge of Quantexa, Entity Resolution (ER), Scoring Framework, Contextual Network Generation Expertise in Big Data technologies, including: Scala, Apache Spark, Hadoop, ElasticSearch Strong stakeholder management and communication skills - capable of interfacing with both business and technical audiences. The work is heavily weighted toward Financial Services ...

Spring Boot Experience working with DevOps methodologies and scalable CI/CD pipelines Microservices Architecture Exposure to Big Data technologies such as: Kafka, Spark, Hadoop etc Strong understanding of clean code principles Experience working with AWS Cloud Kotlin experience (preferred ...

least one. You are a great fit for this role if you have: Strong desire to tackle hard technical problems in K8s, Hadoop + cloud and proven ability to do so with little or no direct daily supervision. Experience operating Linux systems (configure, tune, and troubleshoot both ...

documentation Skills & Key Requirements: • Strong Slurm or equivalent job scheduler experience • Deep Docker knowledge (Kubernetes a plus) • Big data database design: PostgreSQL, MongoDB, or Hadoop/S3 • Python/Flask for API development • Infrastructure-as-Code: Terraform or Ansible • Observability stacks: Prometheus, Grafana, ELK Contract Details: • Day Rate ...

New Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time ...

team. Risk & Process Management: Improve workflows and manage project dependencies, blockers, and risks. Tech Collaboration: Work closely with software teams on complex Big Data (Hadoop) and Cybersecurity products. What We Need: Proven experience as a Product Owner in an Agile environment. Strong stakeholder management skills. Basic understanding of cybersecurity ...

voice compliance assurance Low‐latency record matching and reconciliation engines handling billions of events Scalable data services operating across Spark, Kafka, Hive and Hadoop Production‐grade pipelines supporting regulatory evidence, audit and controls Foundations for near‐real‐time compliance signal generation across global voice platforms Key Responsibilities Design … latency Develop robust data matching and reconciliation logic across heterogeneous voice data sources Define and implement scalable data models using Hive and Hadoop ecosystems Apply software engineering best practices : version control, code reviews, testing, CI/CD and documentation Reverse‐engineer and modernise legacy batch or reporting‐oriented implementations ...

Technical Business Analyst will work closely with stakeholders and engineering teams to support the delivery of data platform solutions, including a major migration from Hadoop to Databricks. This is a client-facing role with real ownership, acting as the bridge between business needs and technical delivery. What … background in a technical or consultancy environment would be highly beneficial Nice to have Exposure to modern data platforms such as Databricks, Snowflake or Hadoop Experience working within financial services or other regulated industries Understanding of cloud-based data environments (AWS, Azure or GCP) Salary ...

Scala/JVM Developer | Global Core Platforms (Financial Services) The Opportunity We are proud to continue our long-standing partnership with one of the world's premier global financial institutions. As a trusted, deeply integrated ...