6 of 6 Hadoop Jobs in Merseyside

and knowledge of when and how to use dedicated hardware. Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Hadoop, Beam) Familiarity with Databricks as a data and AI platform or the Lakehouse Architecture. Experience with data quality and/or and data lineage More ❯

databases (e.g., MongoDB, Cassandra) Experience with AWS S3 and other AWS services related to big data solutions Hands-on experience with big data tooling (Hadoop, Spark, etc.) for processing large datasets In-depth understanding of data security best practices, including encryption, access controls, and compliance standards Familiarity with ETL More ❯

on data accuracy, quality, and reliability Desirable (Nice to Have): Background in defence, government, or highly regulated sectors Familiarity with Apache Kafka, Spark, or Hadoop Experience with Docker and Kubernetes Use of monitoring/alerting tools such as Prometheus, Grafana, or ELK Understanding of machine learning algorithms and data More ❯

ML algorithms, model optimization, and deploying scalable solutions in cloud environments. Experience with version control (Git), Linux, Docker, and data engineering tools such as Hadoop, Spark, and Elasticsearch. Strong problem-solving, team collaboration, and communication skills. Business Development (either in a commercial environment or through ‘selling your ideas’) a More ❯

responsible for defining and migrating a host of applications suites to a Kubernetes infrastructure environment. Requirements: Spark S3 Engine Terraform Ansible CI/CD Hadoop Linux/RHEL – on prem background/container management Grafana or Elastic Search– for observability Desirable: experience with Open Telemetry and/or Argo More ❯

required) and at least one other server-side language Solid hands-on experience with microservices and distributed systems Familiarity with data technologies like MySQL, Hadoop, or Cassandra Experience working with AWS services (RDS, EC2, Step Functions, Kinesis) is a plus Strong background in testing, KPIs/SLOs, and performance More ❯