24 of 24 Hadoop Jobs in the UK excluding London

with AI/ML data pipelines and analytics platforms Preferred Qualifications Experience with cloud data platforms (AWS, Azure, GCP) Experience with big data technologies (Hadoop, Spark, Kafka) Familiarity with UML/SysML Strong understanding of API integration and microservices data flows ...

data pipelines and analytics platforms. Preferred Qualifications: Experience with cloud data platforms (e.g., AWS, Azure, Google Cloud). Experience with big data technologies (e.g., Hadoop, Spark, Kafka). Experience with UML/SYSML. Strong understanding of API integration and microservices data flow. If you have a strong background ...

compliance requirements Excellent communication, problem-solving and documentation skills Desirable: Experience with cloud data platforms (AWS, Azure or GCP) Exposure to big data technologies (Hadoop, Spark, Kafka) Familiarity with ETL/orchestration tools (e.g. Informatica, Talend, Airflow) Experience with API integration and microservices data flows Familiarity with AI/ ...

Ability to communicate complex analytical findings to diverse audiences Preferred Qualifications Experience with cloud platforms (AWS, GCP, Azure) Familiarity with big data technologies (Spark, Hadoop) Experience deploying models into production environments Knowledge of deep learning frameworks (TensorFlow, PyTorch) Experience working in Agile or cross-functional product teams ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . AI/ML Practical experience with NLP (HuggingFace) and GenAI frameworks ...

distributed environments and values technical excellence through CI/CD and Agile. The Essentials Pipeline Tech: 5+ years of experience with Kafka, Spark, Hadoop, and DBT . Modern Modeling: Expert skills in Data Vault and Dimensional modeling. Cloud & DevOps: Strong AWS experience with a focus on CI/ ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark , and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python . Skilled in handling raw, structured, semi-structured, and unstructured data ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

Python skills; experience with deep learning frameworks (TensorFlow, PyTorch) Solid understanding of ML algorithms, statistics, and data modelling Experience with large-scale data tools (Hadoop, Spark, Kafka) Cloud & MLOps experience (AWS, Azure, or GCP) NLP experience highly beneficial Strong leadership, communication, and stakeholder management ...

support and migration experience Desirable knowledge and experience: AWS accreditation Knowledge of COTS products (including but not limited to; Elasticsearch, NiFi, Rabbit, Kafka, MongoDB, Hadoop, Ansible, Git and Kubernetes) Development of dashboards for monitoring and alerting through Grafana, Splunk, Prometheus and OpenText Om and Ops Bridge On prem ...

define OKRs and track the success of new features. Data Storytelling: Don't just pull the data-explain it. You'll translate complex Hadoop/SQL datasets into actionable insights for non-technical stakeholders. Innovate: Use Python, R, and Tableau to build intuitive visualizations and experiment with new ways ...

developed vetting) cleared & willing to undertake DV clearance Essential Skills required for the role: Java Spring Boot AWS Python Spark Hadoop Kafka ElasticSearch OpenShift/Kubernetes NiFi ...

developed vetting) cleared or eligible to undertake DV Security Clearance. Essential Skills required for the role: Java Spring Boot AWS Python Spark Hadoop Kafka ElasticSearch OpenShift/Kubernetes NiFi Please apply to this advertisement if you are interested SmartSourcing are a Disability Confident Employer and we promote, celebrate ...

Data standards ISO 10303 experience Experience in working with engineering data integration Desirable Skills: Hands-on experience with tools such as Databricks and Hadoop, and distributed data platforms. Knowledge of modern data warehousing and big data processing frameworks. Ability to work with Azure-based ecosystems and integrate emerging services. ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark , and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python click apply for full job details ...

Title: Lead Data Engineer - Hadoop, Spark, Pytthon Location: Sheffield - 3 days per week in the office Salary/Rate: Up to £617 per day inside IR35 Start Date: 02/03/2026 Job Type: Contract until November We are seeking a Lead Data Engineering Consultant with proven experience … leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark, and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python. Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Hadoop Platform Engineer Location: Edinburgh or London (1-2 days per week on-site) Contract- day rate 6 Month Contract Our UK leading banking client is undergoing a major enterprise data transformation, and we're looking for a skilled Hadoop Platform Engineer to help shape and evolve … migration, this is a unique opportunity to work at the heart of one of the UK's largest financial institutions. The Role As a Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ...