6 of 6 Hadoop Jobs in the South East

quality checks into pipelines. Knowledge of cloud infrastructure (AWS, Azure, or GCP) and database technologies including relational and non-relational stores such as Postgres, Hadoop, Elasticsearch, and Graph databases. Solid understanding of coding best practices, design patterns, CI/CD tooling, versioning, dependency management, error handling, monitoring, and alerting. ...

closely with stakeholders and translate business requirements into effective AI solutions Desirable Generative AI experience Large Language Models (LLMs) LangChain or similar frameworks Spark, Hadoop or other big data technologies Experience with distributed computing, streaming platforms or workflow orchestration tools Experience monitoring and optimising model performance in production environments ...

performance and reliability Collaborate with Agile teams to deliver secure, high-quality solutions Write clean, tested, maintainable code Required Skills: Experience with Apache Spark, Hadoop or similar big data technologies AWS Apache NiFi Python or Java Experience building data pipelines and ETL processes Desirable: CI/CD, Infrastructure ...

experience with MLOps, production ML systems, model lifecycle management, and monitoring.* Experience working with large-scale data systems and distributed computing frameworks (e.g. Spark, Hadoop).* Knowledge of experimental design, scientific methodology, and analysis.* Strong partner management and confirmed ability to influence large organisations without direct authority.* Demonstrated ability ...

Docker, Kubernetes) Nice to have: Experience with CI/CD pipelines (GitLab, Jenkins) Exposure to data tooling (Airflow, NiFi, Elasticsearch) Experience with Cloudera/Hadoop ecosystems (Spark, Hive, HDFS) Why join? Work on modern data platforms at scale Collaborate with data scientists and engineering teams Opportunity to shape platform ...

lineage. Support Data Governance initiatives, ensuring data security, privacy and compliance standards are maintained. Work with large and complex datasets using SQL, Python, Spark, Hadoop and modern data technologies. Collaborate with technical and business stakeholders within Agile delivery environments. Support data architecture and data modelling activities across enterprise platforms. … skills and proficiency in Python or similar programming languages. Experience with ETL/ELT tools, data warehousing and automated data pipelines. Knowledge of Spark, Hadoop or similar big data technologies. Strong understanding of Data Governance principles, policies, controls and data lifecycle management. Experience working within Agile delivery environments. Familiarity ...