5 of 5 Distributed Computing Jobs in the North West

into production‐level data processing pipelines. Proficient in day‐to‐day use of Python/Java/Scala. Strong understanding of and experience with distributed computing frameworks like Hive/Hadoop and Apache Spark. Expertise in data modeling, schema design, and data visualization tools. Experience working ...

bring Must-haves 8+ years in data engineering/data architecture Deep experience with Databricks (Lakehouse, Delta Lake, Unity Catalog) Expert SQL and distributed computing knowledge Strong experience with data modelling (star/snowflake schemas) Proven experience migrating legacy data platforms Ability to optimise performance across large datasets ...

right now. Main Responsibilities Develop scalable systems and reusable components that serve as reference points for new team members. Create efficient data workflows using distributed computing tools, particularly for large-scale processing and aggregation. Build responsive, asynchronous APIs and backend processes capable of handling high data volumes with … driven development and modular design. Preferred Background Hands-on experience with Spark and Scala in commercial environments. Familiarity with Java and Python. Exposure to distributed data systems and cloud storage platforms. Experience designing data schemas and analytical databases. Use of AI tools to streamline development and debugging. Strong grasp ...

transform diverse data sources into valuable insights for our client’s National Security customers. You will collaborate with clients to solve complex challenges, utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration ...

Design and build data pipelines and data-intensive applications Work across large-scale datasets in complex engineering environments Contribute to modern data platforms and distributed systems Collaborate with engineers and clients to deliver production-ready solutions Take ownership of delivery within high-impact programmes Work with modern tools … data engineering Your Responsibilities: Design and build scalable data pipelines and processing systems Develop data solutions using Python, SQL, or similar technologies Work with distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow ...