2 Batch Processing Jobs in Scotland

deadlines. Your main responsibilities will be: Designing and implementing highly performant data ingestion & transformation pipelines from multiple sources using Databricks and Spark Streaming and Batch processes in Databricks SPARK performance\tuning\optimisation Providing technical guidance for complex geospatial problems and spark dataframes Developing scalable and re-usable frameworks for more »

Staff Data Platform Engineer, you'll be helping the team handle vast amounts of data which constantly pours in. You’ll be joining the batch processing team where you'll play a pivotal role in developing products utilized in-house by both Data Engineers and Software Engineers. For more »