20 of 20 Hadoop Jobs in London

practices with Strong understanding of data modeling principles and techniques A solid understanding of big data technologies such as Apache Spark, and knowledge of Hadoop ecosystems. Knowledge of programming languages such as Python, R, or Java is beneficial. Knowledge of ETL/ELT processes (such as DBT), SQL, NoSQL ...

/or Computer Vision. Strong knowledge of Machine Learning algorithms and statistics. Experience with SQL/NoSQL databases and big data tools (Spark, Hadoop preferred). Experience with MLOps tools such as Docker, Kubernetes, CI/CD pipelines. Preferred Skills:- Experience with LLMs/Generative AI (OpenAI, Hugging Face ...

Experience in commodities markets or broader financial markets. Knowledge of quantitative modeling, risk management, or algorithmic trading. Familiarity with big data technologies like Kafka, Hadoop, Spark, or similar. Why Work With Us? Impactful Work: Directly influence the profitability of the business by building technology that drives trading decisions. Innovative ...

energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem-solving skills and ability to work ...

Azure DevOps/GitHub). Excellent communication with technical and non-technical stakeholders. Desired Skills Power BI/Tableau Stakeholder management Spark/Hadoop Unit testing frameworks Azure advanced analytics Data warehousing experience Azure Data Engineer certification Agile/Scrum/Kanban exposure This is a London based role ...

engage technical and non-technical stakeholders Nice to Have: Experience with modern analytics and BI platforms Knowledge of big data technologies (e.g. Spark, Hadoop) Experience with real-time or event-driven architectures Familiarity with data cataloguing and lineage tools Experience working in regulated or data-sensitive environments Relevant certifications ...

techniques, A/B testing methodologies, and experiment design. Solid background in ranking, recommendation, and retrieval systems. Familiarity with large-scale data tools (Hadoop, BigQuery, Amazon EMR, etc.). Experience with BI tools and visualization platforms such as Tableau, Qlik, or MicroStrategy. Bonus: Experience with geospatial data and advanced ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

DevOps and broader software engineering standards. Cloud experience (any platform). Previous mentoring experience. Nice to have: Snowflake or Databricks Spark, PySpark, Hadoop or similar big data tooling BI exposure (PowerBI, Tableau, etc.) Interview Process The process is fully structured, transparent, and efficient: Video call - high-level overview ...

. Proven experience in building and deploying ML models (forecasting, classification, regression, time-series, recommendation systems, etc.). Familiarity with big data technologies (Spark, Hadoop, or similar) is a plus. Excellent problem-solving and communication skills, with the ability to influence cross-functional stakeholders. Why Join Us Opportunity ...

experience in leading and developing data engineering platforms. The ideal candidate will possess hands-on expertise in the following areas: Extensive enterprise experience with Hadoop, Spark , and Splunk. Proficiency in object-oriented and functional scripting, particularly in Python . Skilled in handling raw, structured, semi-structured, and unstructured data ...

support and migration experience Desirable knowledge and experience: AWS accreditation Knowledge of COTS products (including but not limited to; Elasticsearch, NiFi, Rabbit, Kafka, MongoDB, Hadoop, Ansible, Git and Kubernetes) Development of dashboards for monitoring and alerting through Grafana, Splunk, Prometheus and OpenText Om and Ops Bridge On prem ...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Senior Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/ ...

build a new on-prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines and analytics infrastructure. Using Hadoop, Big Data, and Spark technologies, you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses … Data technologies. Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design. Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. ...

build a new on-prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines and analytics infrastructure. Using Hadoop, Big Data, and Spark technologies, you will ensure data quality through automated validation, monitoring, and testing. You will also enable seamless integration across data warehouses … Data technologies. Experience designing and building on-prem data platforms, from high-level architecture to detailed technical design. Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands-onexperiencewithcloudplatforms(AWSorAzure;GCPbeneficial) StrongSQLskillsandexperiencewithrelationaldatabases Pythondevelopmentexperienceandfamiliaritywithframeworks(e.g.Flask,Django) ExperiencebuildingandorchestratingETLpipelines(e.g.Airflow,Luigi,Argo) Exposuretobigdatatechnologies(e.g.Spark,Kafka,Hadoop) ExperienceworkinginAgileenvironments Solidunderstandingofdataarchitectureanddataqualitybestpractices ...

/Fintech) | London | 6-Month Contract Role: Backend Software Engineer Team: RegTech (Fintech Business Unit) The Stack Primary: Java (Expert level) & Microservices. Data: Cassandra, Hadoop, MySQL. Cloud: AWS (Kinesis, Step Functions, EC2). Focus: Distributed systems, batch processing, and data integrity. The Mission Build and scale automated KYC/ ...

/Fintech) London 6-Month Contract Role: Backend Software Engineer Team: RegTech (Fintech Business Unit) The Stack Primary: Java (Expert level) & Microservices. Data: Cassandra, Hadoop, MySQL. Cloud: AWS (Kinesis, Step Functions, EC2) click apply for full job details ...

Hadoop Platform Engineer Location: Edinburgh or London (1-2 days per week on-site) Contract- day rate 6 Month Contract Our UK leading banking client is undergoing a major enterprise data transformation, and we're looking for a skilled Hadoop Platform Engineer to help shape and evolve … migration, this is a unique opportunity to work at the heart of one of the UK's largest financial institutions. The Role As a Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ...