6 of 6 Contract Apache Spark Jobs in the UK

/CD, and Infrastructure as Code. Desirable: Experience within UK Defence, Intelligence, or National Security sectors. Knowledge of big data tools such as Kafka, Spark, or Hadoop. Support for machine learning or advanced analytics workloads. Experience working with classified datasets and Elastic Stack (ELK). If you're ready ...

messaging architectures. Data Platforms & Cloud Technologies Hands-on experience with: Azure Data Lake Databricks Snowflake Delta Lake Azure Synapse Analytics/Microsoft Fabric Spark/PySpark Strong understanding of: Data Lake and Lakehouse architecture Hybrid cloud environments Enterprise integration patterns Modern data formats including Parquet, Avro, and ORC DevOps ...

Jenkins, Bamboo, Concourse etc. Monitoring utilising products such as: Prometheus, Grafana, ELK, filebeat etc. Observability - SRE Big Data solutions (ecosystems) and technologies such as: Apache Spark and the Hadoop Ecosystem Edge technologies e.g. NGINX, HAProxy etc. Excellent knowledge of YAML or similar languages It is essential for this ...

serving - training/inference, focusing on cost efficiency, performance, and resilience. Big data & distributed processing:* Develop and tune large-scale batch/stream workloads (Spark or similar); improve job efficiency, stability, and operational readiness in production. Software engineering:* Strong Python + SQL; apply CI/CD, automated testing, modular ...

Qlik). Knowledge of Python or R for advanced analytics and automation is highly desirable. Familiarity with cloud/big data platforms (Snowflake, Databricks, Spark) is preferred. Key Requirements Minimum 5+ years of hands-on experience in Data Analytics or Data Science (experience within Customer Success, Operations, or Digital ...

Senior Data Engineer 6 Month contract with extension Full-time Inside IR35 Hybrid 1 day every two weeks in the office Nottingham - NG1 4BX Join our client in embarking on an ambitious data transformation journey ...