deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »
Edinburgh, City of Edinburgh, United Kingdom Hybrid / WFH Options
Cathcart Technology
Lead Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You'll be joining the batchprocessing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »
Edinburgh, Midlothian, Scotland, United Kingdom Hybrid / WFH Options
Cathcart Technology
Lead Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You'll be joining the batchprocessing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »
