1 of 1 Batch Processing Jobs in Worcestershire

strong fit. The Role Work with multi-terabyte to large-scale datasets (100TB+), primarily text-based Build and optimise data ingestion and processing pipelines Improve batch processing performance and throughput across large datasets Solve challenges related to scalability, reliability, and data flow Contribute to the development … optimise data pipelines at scale Solid Python skills with exposure to tools such as Spark, PySpark, and Hadoop Strong understanding of data ingestion and batch processing methodologies Experience with text or unstructured data is advantageous but not essential A hands-on, problem-solving mindset with a focus ...