2 of 2 Batch Processing Jobs in the Midlands

strong fit. The Role Work with multi-terabyte to large-scale datasets (100TB+), primarily text-based Build and optimise data ingestion and processing pipelines Improve batch processing performance and throughput across large datasets Solve challenges related to scalability, reliability, and data flow Contribute to the development … optimise data pipelines at scale Solid Python skills with exposure to tools such as Spark, PySpark, and Hadoop Strong understanding of data ingestion and batch processing methodologies Experience with text or unstructured data is advantageous but not essential A hands-on, problem-solving mindset with a focus ...

expert IT users. Experienced in creating technical and process documentation Demonstrable practical experience of at least some of the following: Data Manipulation, Batch Processing, case flow management Power BI, Power Automate, SQL, Microsoft Fabric, ETL/ELT Pipelines Housing Management and/or large database systems management ...