1 of 1 Contract Data Ingestion Jobs in the North West

responsibilities and skills Build and maintain real-time and batch ETL pipelines using Python on large, complex datasets Write clean, scalable Python code for data ingestion, transformation, and processing Design and optimise SQL queries for performance, cost, and reliability across large data volumes Model and transform data into well-structured, reusable datasets for downstream use Work with distributed data processing tools such as Apache Spark to handle high-volume workloads Improve existing pipelines by identifying bottlenecks and refactoring code and queries Develop and maintain data workflows, scheduling, and orchestration processes Provision and manage ...