20 Permanent Hadoop Jobs in London with Remote Work Options

/ELT tools.Experience with NoSQL type environments, Data Lakes, Lake-Houses (Cassandra, MongoDB or Neptune).Experience with distributed storage, processing engines such as Apache Hadoop and Apache Spark.Experience with message brokering/stream processing services such as Apache Kafka, Confluent, Azure Stream Analytics.Experience in Test Driven Development (TDD) and more »

a team environment.Preferred Qualifications:Previous experience in designing and implementing data engineering solutions in a cloud environment.Knowledge of big data technologies and frameworks like Hadoop, Spark, and Kafka.Come join our team and be part of an organisation that values innovation and empowers its employees to make a meaningful impact more »

of technology to automate data pipelines and build analytical warehouses· Deep understanding of cloud-based data platforms (Azure SQL DB, Azure Synapse, ADLS, AWS, Hadoop, Spark, Snowflake, No-SQL etc).· Proficient scripting in programming languages such as Java, Python, Scala· Expert in SQLMachine Learning· Good basic understanding of more »

governance (Unity Catalogue), security and access design on Cloud technologies (AWS, GCP, Azure).Experience with design and implementation in big data technologies such as Hadoop, NoSQL, MPP, OLTP, and OLAP or full lifecycle data science solutions.Experience with Data Acquisition, Integration & Transformation solutions leveraging Batch, Micro-batch, CDC and Event more »

and classification techniques, and algorithms Fluency in a programming language (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark, Tableau more »

JMeter or similar tools Web services technology such as REST, JSON or Thrift Testing web applications with Selenium WebDriver Big data technology such as Hadoop, MongoDB, Kafka or SQL Network principles and protocols such as HTTP, TLS and TCP Continuous integration systems such as Jenkins or Bamboo Continuous delivery more »

essential: -Proven experience as an Architect and excellent knowledge of Big Data -Great understanding of Cloud e.g. Azure and or AWS -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very more »

and NoSQL databases • Programming languages such as Spark or Python • Amazon Web Services, Microsoft Azure or Google Cloud and distributed processing technologies such as Hadoop Benefits : • Base Salary: £45,000 - £75,000 (DoE) • Discretionary Bonus: Circa 10% per annum • DV Bonus: Circa £5,000 • Flex Fund: £5000 • Health: Private more »

scalable systems. Deep knowledge of distributed and scalable systems, including proficiency with PostgreSQL, Ray, RabbitMQ, and Cassandra. Familiarity with big data technologies such as Hadoop, Spark, or Kafka . Experience with CI/CD Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems. Excellent more »

scalable systems. Deep knowledge of distributed and scalable systems, including proficiency with PostgreSQL, Ray, RabbitMQ, and Cassandra. Familiarity with big data technologies such as Hadoop, Spark, or Kafka . Experience with CI/CD Strong problem-solving skills and the ability to troubleshoot complex issues in distributed systems. Excellent more »

scaling, and troubleshooting of cloud systems.- Operational experience running a 24x7 production infrastructure at scale.- Proficiency working with data structures, schemas, and technologies like Hadoop, Hive, Redis, and MySQL- Experience in using cloud-native services like GKE, EKS, AWS/GCP load balancing, AWS/GCP cloud storage platforms more »

The following skills/experience is essential: -Proven experience as a Lead Big Data Engineer with excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very more »

following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellence experience across Azure -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very more »

scalability, and extensibility. The following skills/experience is essential: -Proven experience as an Architect and excellent knowledge of Big Data -Excellent knowledge of Hadoop and tools such as Hbase/Hive and Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very more »

Testing performance with JMeter or similar toolsWeb services technology such as REST, JSON or ThriftTesting web applications with Selenium WebDriverBig data technology such as Hadoop, MongoDB, Kafka or SQLNetwork principles and protocols such as HTTP, TLS and TCPContinuous integration systems such as Jenkins or BambooContinuous delivery concepts#LI-HybridWhat you more »

standard methodology methods and tooling used across the engineering teamRequirements:5-7 years of Java experienceCapital markets Front office experienceExperience working with Data lake (Hadoop) consumption, specifically Hive experienceKafka experienceRules engine experience (Ideally open source/vendor products, e.g. Drools or Camunda)Unix scripting knowledgeMarkets Regulatory/Trade control more »

No Sponsorship provided Responsibilities & Skills: Strong Snowflake Development experience Hands on experience on Data Modelling/Data Migration and related tools Sound Knowledge on Hadoop Architecture Strong knowledge of SQL Best pointers for working with the client Ø Opportunity to shape the future of a rapidly growing company. Ø more »

your time for being hands on to stay current with tools and technology.Traditionally our work has been implemented on-premise on EDH (LBG’s Hadoop platform) and we are also in the process of transitioning our teams onto Google Cloud Platform (GCP), which makes it a very exciting time … excellence and a passion for automation.Expertise in building, deploying, and maintaining large scale ETL/ELT data solutions (ideally on GCP and/or Hadoop)Good understanding of metadata management and data quality concerns, as well as the ability to validate and challenge team’s engineering designs, code and more »

BASED WITH VERY OCCASIONAL TRAVEL TO CLIENT SITES AND OFFICE. Would you like to the opportunity to expand your skillset across Java, Python, Spark, Hadoop, Trino & Airflow across the Banking & Financial Services industries? How about if you worked with an Innovation Partner of the Year Winner (2023 Oracle EMEA … with the latest trends and best practices, and share knowledge with the team. Qualifications You will have expertise within the following: Java, Python, Spark, Hadoop (Essential) Trino, Airflow (Desirable) Architecture and capabilities. Designing and implementing complex solutions with a focus on scalability and security. Excellent communication and collaboration skills. more »

responsibilities will include building microservices, using Docker and Kubernetes and 3rd party API integrations. You will also be working with big data technologies like Hadoop, Kafka and Cassandra.This Senior Java Engineer (Multithreading) role will be a strong fit if you:Have extensive Core Java, multihreading, low-latency, concurrency experienceEnjoy … working with big data technologies like Hadoop (or if you are keen to learn!)Have messaging experience with Kafka, RabbitMQ or MongoDBAs the Senior Java Engineer, you will be a strong advocate for modern development ways of working including pair programming, Agile and BDD/TDD. This company (during more »