3 of 3 Distributed Computing Jobs in the South West

expertise in Microsoft Azure cloud services — ADF, ADLS, Synapse, Purview. Databricks — Delta Lake architecture, optimisation and advanced data processing. Apache Spark for large‐scale distributed computing and performance tuning. Microsoft Fabric — OneLake and DirectLake integration. Azure Synapse Analytics for enterprise‐scale data warehousing. Infrastructure‐as‐Code (Terraform ...

right now. Main Responsibilities Develop scalable systems and reusable components that serve as reference points for new team members. Create efficient data workflows using distributed computing tools, particularly for large-scale processing and aggregation. Build responsive, asynchronous APIs and backend processes capable of handling high data volumes with … driven development and modular design. Preferred Background Hands-on experience with Spark and Scala in commercial environments. Familiarity with Java and Python. Exposure to distributed data systems and cloud storage platforms. Experience designing data schemas and analytical databases. Use of AI tools to streamline development and debugging. Strong grasp ...

Design and build data pipelines and data-intensive applications Work across large-scale datasets in complex engineering environments Contribute to modern data platforms and distributed systems Collaborate with engineers and clients to deliver production-ready solutions Take ownership of delivery within high-impact programmes Work with modern tools … data engineering Your Responsibilities: Design and build scalable data pipelines and processing systems Develop data solutions using Python, SQL, or similar technologies Work with distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow ...