10 of 10 Apache Spark Jobs in the Midlands

Data Engineer 6 Month Contract Location: Hereford (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy. This will … Work across Azure environments on the low side Support data engineering workloads within Kubernetes environments on the high side Develop and maintain workflows using Apache Airflow Work with Apache Spark for large-scale data processing Support the ongoing development and improvement of established data pipelines Help ensure ...

should have specialist experience in one or more of the following technologies**Azure Databricks*** Design and build high-performance data pipelines: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.* Experience of Databricks ML and Azure … develop predictive models and drive business insights.* Proven expertise in Databricks, Apache Spark, and data pipeline development and strong understanding of data warehousing concepts and practices.* Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks and Azure Data Factory.* Azure Data Engineer Associate and Databricks ...

model: Hybrid 3 days on site each week Rate: up to £530 per day --- Responsibilities Design, implement, and maintain high-throughput data pipelines using Apache Spark and cloud-native tools Develop ETL/ELT workflows for managing structured and unstructured data in AWS cloud environments Collaborate with … analytics enablement --- Requirements (Must Have Skills) 5+ years of data engineering experience building high-performing and large-scale data solutions Hands-on expertise in Apache Spark development using Java or Scala (Python experience considered) Strong proficiency in AWS cloud services (S3, EMR, Glue, IAM, etc.) and cloud-native ...

Data Engineer 6 Month Contract Location: Hereford (Onsite 4 days a week) Rate: £700 - £800 per day (INSIDE IR35) Skills: Python, Azure, Kubernetes, Apache Airflow, Apache Spark, DV Clearance We are looking to recruit a DV Cleared Data Engineer for a leading technology consultancy click apply ...

with Microsoft Azure (a plus): Azure SQL Database, Analysis Services, Databricks, Data Lake, Logic Apps and Data Factory. Understanding of big data technologies (Hadoop, Spark). Able to create rich visualisations that appropriately represent the underlying datasets. Review and align the reporting attributes against the enterprise and conceptual data ...

Proficiency in Python scripting, including experience using Python modules for data munging. Up‐to‐date knowledge of data processing technologies and platforms, such as Spark (Databricks). Experience in data modelling to optimise solution performance. Experience using Azure DevOps, with exposure to Continuous Integration and Continuous Delivery/Deployment ...

skills Experience with agentic AI coding tools (Claude Code, Copilot Agent Mode, Devin) and spec-driven development Big data/Lakehouse (Snowflake), ETL pipelines (Spark, Glue), or event streaming (Kafka) Interest in investment banking or financial instruments ABOUT GOLDMAN SACHS At Goldman Sachs, we commit our people, capital ...

services, with secure integration of enterprise data sources. AWS engineering experienceincluding containers, Kubernetes, CI/CD , a pplication resilience and security . Experience with Apache Spark or similar data-processing frameworks and large structured datasets. Sound judgement when using AI-assisted development tools , including validation of outputs ...

into robust approaches and measurable outcomes. Strong practical capability in Python and SQL across data exploration, feature engineering, modelling and validation, with experience of Spark and modern cloud data platforms. Expertise in statistical analysis, forecasting, predictive modelling, classification, clustering and optimisation, including developing and deploying production machine-learning solutions. ...

clear SLAs and backups. Own the observability platform (ClickHouse, OpenTelemetry): logs, metrics, traces, synthetics, SLOs and actionable alerting. Own the data platform: Glue pipelines, Apache Iceberg lakehouse, Redshift and CDC; serve BI users with traceable datasets and handle data requests with strong privacy practice. Operate platform security controls (identity … security practice; willing to participate in the on‐call rota. Excellent communication; comfortable prioritising, working with stakeholders and reporting upwards. Desirable ClickHouse, Redshift or Apache Iceberg; data engineering with AWS Glue or Spark. Delivering the technical side of a security standard (Cyber Essentials Plus, ISO 27001). Experience overseeing ...