7 of 7 Hadoop Jobs in London

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production environments ...

with Apache Kafka and Apache Flink. Experience helping customers build distributed systems or streaming solutions that use Kafka alongside technologies such as Spark, Flink, Hadoop, Cassandra, etc. Other Relevant Job Details For additional information about location requirements, please discuss with the recruiter following submission of your application. Some travel ...

Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists and engineering teams Opportunity to shape platform ...

lineage. Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained. Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies. Collaborate with technical and business stakeholders within Agile delivery environments. Support data architecture and data modelling activities across enterprise platforms. … skills and proficiency in Python or similar programming languages. Experience with ETL/ELT tools, data warehousing and automated data pipelines. Knowledge of Spark, Hadoop or similar big data technologies. Strong understanding of Data Governance principles, policies, controls and data lifecycle management. Experience working within Agile delivery environments. Familiarity ...

stakeholders. Preferred qualifications, capabilities, and skills Experience designing/implementing pipelines using DAGs (e.g. Kubeflow, DVC, Ray) Experience of big data technologies (e.g. Spark, Hadoop) Have constructed batch and streaming microservices exposed as REST/gRPC endpoints Familiarity with GraphQL Level of experience Senior (5+ years of experience) Tagged ...

processes and systems within the domain of expertise Knowledge of Puppet or similar configuration management tools Knowledge of ‘big data' platforms, e.g. Horton Works, Hadoop etc. ...