9 of 9 Hadoop Jobs in Watford

and DevOps infrastructure (CI/CD pipelines, Terraform for infrastructure-as-code on cloud). Big Data & Analytics: Experience with big data technologies (Spark, Hadoop) or real-time data streaming (Kafka) in the context of analytics projects. This demonstrates ability to manage projects dealing with large-scale data and More ❯

have: Hands-on experience with data warehouse and lakehouse architectures (e.g., Databricks, Snowflake, or similar). Experience with big data frameworks (e.g., Apache Spark, Hadoop) and cloud platforms (e.g., AWS, Azure, or GCP). More ❯

on data accuracy, quality, and reliability Desirable (Nice to Have): Background in defence, government, or highly regulated sectors Familiarity with Apache Kafka, Spark, or Hadoop Experience with Docker and Kubernetes Use of monitoring/alerting tools such as Prometheus, Grafana, or ELK Understanding of machine learning algorithms and data More ❯

engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence in evaluating and selecting development tools and technologies Sound like the role More ❯

Java, with experience in AI frameworks (e.g., TensorFlow, PyTorch, Keras). Strong knowledge of data analysis, visualisation tools, and big data technologies (e.g., SQL, Hadoop, Spark). Experience with machine learning techniques, including NLP, recommendation algorithms, and computer vision. Familiarity with cloud platforms (Azure) for deploying AI solutions . More ❯

What we’re looking for Proven experience as a Data Engineer in cloud environments (Azure ideal) Proficiency in Python, SQL, Spark, Databricks Familiarity with Hadoop, NoSQL, Delta Lake Bonus: Azure Functions, Logic Apps, Django, CI/CD tools 💼 What you’ll get from Mars A competitive salary & bonus Hybrid More ❯

a Kubernetes infrastructure environment. Requirements: Kubernetes implementation, Kubernetes-specific architecture, hands-on migration work, Kubernetes Security Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL – on prem background/container management Grafana or Elastic Search– for observability Desirable: experience with Open Telemetry and/or Argo More ❯

required) and at least one other server-side language Solid hands-on experience with microservices and distributed systems Familiarity with data technologies like MySQL, Hadoop, or Cassandra Experience working with AWS services (RDS, EC2, Step Functions, Kinesis) is a plus Strong background in testing, KPIs/SLOs, and performance More ❯

on AWS + GCP , must also have multiple Kubernetes certs (administrator, developer, expert etc).** Our client is looking to migrate its on-prem Hadoop-based data and analytics capability to a Kubernetes-based infrastructure. They already have a Kubernetes platform (the Internal Kubernetes Platform or IKP) but this … see people who have worked on Kubernetes implementation, involved in architecture, hands on migration etc K8S, Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL - on prem background/container management Grafanna or Elastic Search- for observability Kubernetes security Observability - Open telemetry Argo Other Skills Required More ❯