9 of 9 Permanent Apache Spark Jobs in the South West

data estate. Deep expertise in Microsoft Azure cloud services — ADF, ADLS, Synapse, Purview. Databricks — Delta Lake architecture, optimisation and advanced data processing. Apache Spark for large‐scale distributed computing and performance tuning. Microsoft Fabric — OneLake and DirectLake integration. Azure Synapse Analytics for enterprise‐scale data warehousing. Infrastructure ...

promote DevOps. Support internal and external stakeholders, including customers and regulatory authorities. Tools, Systems & Continuous Improvement Manage and optimise the use of tools (e.g. Apache Spark, AWS Glue, Databricks or equivalent). Support system enhancements of data processing and transformation, migrations, and process improvements. Contribute to the development ...

scaling data platforms, with a strong focus on Azure Cloud technologies (e.g., Azure Data Factory, Azure Synapse, Azure Data Lake, Azure SQL Database, Databricks, Apache Spark). Proven experience leading the implementation of data platform strategies and managing large‐scale data infrastructure initiatives using Azure. Demonstrated experience implementing ...

design and implementation) Strong SQL & Data Modeling (query optimization, schema design) Programming Skills (Python/Scala for data processing) Big Data xxuwjjq Processing (Spark/Databricks) Cloud Data Platforms (Azure/AWS/GCP - especially data services ...

Kafka, messaging systems, and event-driven architecture • Cloud-native development (AWS or similar) • Reactive programming (Spring WebFlux) • Big Data/streaming technologies such as Spark, Storm, Cassandra, Elasticsearch, HBase • Experience with highly available, resilient systems using clustering and load balancing ...

source tools. Understanding of database and data analysis technologies like Azure Data Explorer (ADX), PostgreSQL, MongoDB, and data‐driven machine learning tools such as Spark, Power BI. Experience with optimisation, simulation and data analysis tools such as Matlab Simulink (e.g. optimisation and ML toolboxes), PySpark and Jupyter notebooks. Work ...

platform role Strong hands-on experience with AWS (EC2, S3, RDS, Lambda, Redshift, Glue, Athena) Experience with real-time and batch data processing - Apache Flink, Kafka, Spark, or similar Proficiency in one or more of: Python, Java, Scala Experience with data modelling , ETL processes, and distributed systems Comfortable ...

Strong hands-on experience wi th AWS (EC2, S3, RDS, Lambda, Redshift, Glue, Athena) Experience wi th real-time and batch data process ing — Apache Flink, Kafka, Spark, or similar Proficiency in one or more o f: Python, Java, Scala Experience wi th data modell ing, ETL processes ...

teams and setting best practice standards Designing data models, ETL pipelines, warehousing solutions and distributed systems Building and supporting real-time streaming platforms using Apache Flink and related technologies Ensuring compliance with industry standards and government regulations Tracking delivery against agreed designs and managing design deviations Supporting pre-sales … data architecture on complex, secure programmes Strong hands-on AWS experience (EC2, S3, RDS, Lambda, Redshift); Azure or GCP a bonus Proven experience using Apache Flink for real-time, high-throughput data processing Experience leading, mentoring and developing technical teams Confident engaging with senior technical and non-technical stakeholders ...