6 of 6 Permanent Apache Jobs in Colchester

your cloud/platform engineering capabilities Experience working with Big Data Experience of data storage technologies: Delta Lake, Iceberg, Hudi Knowledge and understanding of Apache Spark, Databricks or Hadoop Ability to take business requirements and translate these into tech specifications Competence in evaluating and selecting development tools and technologies More ❯

/CD Contribute to platform resiliency and production support Must-Have Skills 10+ years of experience in backend development Proficient in Java , Python , and Apache Spark Strong hands-on experience with AWS services (EKS, ECS, Lambda, RDS, Aurora, SQS, SNS) Deep knowledge of Spring/Spring Boot Familiarity with More ❯

Rust) you will: Design and build a cloud-native analytical database system optimised for sparse, wide, and multimodal logs. Work with technologies like Rust, Apache Arrow, and Datafusion to build scalable, low-latency systems. Collaborate on every part of the stack—from data ingestion and indexing to query planning More ❯

Live Tables, Data Streaming , Unity Catalogue etc.) Prove experience designing high volume, live data streaming solutions using Azure DLT (Delta Live Tables) Expert with Apache Spark and PySpark (ability to review quality of code and debug issues) Background in Data warehousing (SAP Hana, BI/BW, Oracle etc.) Proficient More ❯

ingestion, and processing pipelines pulling from sources such as social media and public data leaks. Supporting data processing and analysis at scale – think Elasticsearch, Apache Spark (or equivalents), and PHP generators. Writing clean, testable code using PHPUnit, service containers, and SOLID principles. Participating in DevOps and deployment workflows via … OpenAPI OAuth2, Laravel Sanctum Kafka, Redis AWS (ECS, ECR, RDS, CloudWatch) Terraform GitLab CI/CD Pipelines Docker SPA Frontend (React, Next.js, TailwindCSS) Elasticsearch, Apache Spark Sentry, Grafana, AWS Logs Python, Java, Golang Requirements/experience: 5+ years of experience in backend PHP development, ideally with Laravel. Strong understanding More ❯

to obtain DV level security clearance *** Responsibilities : Design, develop, and maintain secure and scalable data pipelines using the Elastic Stack (Elasticsearch, Logstash, Kibana) and Apache NiFi. Implement data ingestion, transformation, and integration processes, ensuring data quality and security. Collaborate with data architects and security teams to ensure compliance with … Engineer in secure or regulated environments. Expertise in the Elastic Stack (Elasticsearch, Logstash, Kibana) for data ingestion, transformation, indexing, and visualization. Strong experience with Apache NiFi for building and managing complex data flows and integration processes. Familiarity with containerization and orchestration tools such as Docker and Kubernetes. Experience with More ❯