2 of 2 Apache Spark Jobs in the East of England

scripting skills in Python for automation, logging, and observability integrations. Expertise in SQL, especially Redshift, and in managing large-scale data processing frameworks like Spark and EMR. Hands-on experience with containerization (Docker, Kubernetes). Professional certifications such as AWS Certified Solutions Architect and AWS Certified DevOps Engineer … provisioning automation. Nice to Have Skills: Experience with Power BI, DAX, and data modeling for optimized reporting. Knowledge of big data orchestration tools like Apache Airflow. Previous exposure to regulated environments such as finance, healthcare, or gaming. Experience in a lottery or similar domain is a plus. Preferred Education ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...