13 of 13 Hadoop Jobs in the UK excluding London

management tools Strong expertise in SQL, data modelling, and database optimisation (relational, vector and NoSQL) Proficiency in distributed data processing frameworks (e.g., Spark, Flink, Hadoop) Deep knowledge of cloud data platforms (AWS, Azure, or GCP) and associated services, with proven data governance and security practices Strong programming skills ...

with cloud platforms (AWS) and containerisation (such as Docker, Podman, Kubernetes) Experience working in secure or regulated environments Exposure to big data technologies (Spark, Hadoop) and Apache tools Familiarity with Agile and DevOps practices Industry certifications (e.g., TensorFlow Developer, AWS Machine Learning Specialty) Knowledge of NLP, computer vision ...

years in Python programming, including OOPs, data structures, Stacks, Queues, Scripting, Linkedlists, Arrays, and API development. •Minimum 5 years in Big Data technologies (e.g., , Hadoop). •Minimum 4 years in cloud platforms (AWS, Azure, GCP) and their AI/ML services. •Minimum 5 years in ML model development, data ...

work with modern, “shiny” tools and influence what we adopt next. Use workflow tools such as ADF/Airflow and big data technologies (Spark, Hadoop, Kafka) Private healthcare for you and your family Company pension scheme Flexible benefits (gym membership, tech, health assessments and more) Access to an online ...

Knowledge of MLOps, DevOps, CI/CD, and automated model pipelines within Foundry and cloud-based environments. Familiarity with big data ecosystems (Foundry, Spark, Hadoop) and commercial data source integration. ...

technologies skills (e.g. MongoDB, InfluxDB, Neo4J...) Data exchange and processing skills (e.g. ETL, ESB, API...) Development (e.g. Python) skills Big data technologies knowledge (e.g. Hadoop stack) Knowledge in NLP (Natural Language Processing) Knowledge in OCR (Object Character Recognition) Knowledge in Generative AI (Artificial Intelligence) would be advantageous Experience ...

Agile ceremonies and actively engage with the team. Must Have Skills: Hands-on experience with Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms. AWS administration and platform management experience. Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus). Agile ...

/ELT pipelines integrating large, complex datasets Work with structured, semi-structured, and unstructured data across SQL and NoSQL technologies Develop solutions using Hadoop, Spark, and Splunk in large-scale environments Write maintainable Python code, applying object-oriented and functional programming principles Implement and maintain CI/CD pipelines … resilience, sustainability, and recoverability Essential Skills & Experience Proven experience as a Lead or Senior Data Engineer in enterprise-scale environments Hands-on expertise with Hadoop, Spark, and Splunk Advanced Python development skills Experience designing and optimising high-performance data pipelines Strong understanding of CI/CD, source control ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

driven trading. Tech Stack Programming: Python AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and Databricks On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. What we are looking for 5 – 10 years of experience in data engineering, ideally in platform or infra roles. Strong programming skills in Python; passion … life. Visibility: Be a big player in a small, high-impact team with exposure across the organisation. Nice to Have Experience with on-prem Hadoop and Kubernetes. Familiarity with AWS cost management and optimisation tools. Knowledge of front-office developer workflows in financial services. ...

Programming: Python (Java familiarity is a plus). • AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. • On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different • Direct Impact: Build AI tools that traders and quants use daily to optimize strategies. • Creative Freedom: Open collaboration … Functions, MSK, CloudFormation). • Passion for being hands-on while enabling and growing a small engineering team. Nice to Have • Experience with on-prem Hadoop and Kubernetes. • Familiarity with AWS cost management and optimisation tools. • Knowledge of front-office developer workflows in financial services. ...

level Python (Java familiarity is a plus). AWS: S3, Kinesis, Glue, Lambda, Step Functions, SageMaker, and more. On-Prem: Managed Kubernetes Platform and Hadoop ecosystem. Why This Role is Different Direct Impact: Build AI tools that traders and quants use daily to optimise strategies. Creative Freedom: Open collaboration … Functions, MSK, CloudFormation). Passion for being hands-on while enabling and growing a small engineering team. Nice to Have Experience with on-prem Hadoop and Kubernetes. Experience with LangChain & LangGraph. Familiarity with AWS cost management and optimisation tools. Knowledge of front-office developer workflows in financial services. ...