9 of 9 Permanent Batch Processing Jobs in Scotland

alongside data science colleagues, model versioning, automated retraining, and the monitoring that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena … domain-driven modelling), this is the load-bearing, provider-agnostic skill underneath almost all of our pipeline work Have strong Python and PySpark for batch processing, with production-grade, well-tested code. The bulk of this work is batch and ELT, but you’ll need to have ...

Engineer II within our Engineering Maritime & Logistics division, you will play a pivotal role in designing, building, and operating high-throughput data processing and API distribution systems. You will take end-to-end ownership of real-time streaming applications, backend services, and reliable pipelines that deliver critical maritime intelligence … build, and maintain high-performance backend microservices and APIs using Java, Scala, and Python. Design, develop, and operate real-time data pipelines and stream-processing applications using Java, Scala, Kafka Streams, and Apache Flink, as well as batch-processing workflows using Python and Apache Airflow. Drive ...

/or Oracle Cloud, together with a detailed understanding of Finance business processes Strong experience designing complex enterprise integration architectures involving APIs, middleware, batch processing, messaging technologies and event-driven integration patterns Extensive understanding of Finance data architecture, master data management, reference data, chart of accounts design ...

Lead Application Operations Engineer to join our Digital Services Branch, providing technical leadership and specialist expertise for our Case Management System (Cúram) and associated batch processing services. As part of our Digital, Delivery and Change Division, you will lead a hybrid support team of in-house Application Operations … supplier System Business Analysts. Together, the team supports 17 benefit products delivered through the Case Management System, ensuring service availability, platform stability, integration processing, and the accurate generation of client payments. As the senior operational lead and subject matter expert, you will drive incident triage and resolution across ...

deployment, working with ML, MLOps and software engineering to deliver impactful personalization capabilities. The role emphasizes productionising models as APIs, real-time and batch processing, and ongoing research. It is a hybrid role with two days per week in the Dundee office, and requires eligibility to work ...

/automation, HMI/SCADA mods and instrumentation support. You will collaborate with Maintenance and Project Engineers, provide call-out capability, and help program batch processes while upholding safety and cyber-security standards. #J-18808-Ljbffr ...

calibration.Have a sound understanding of Allen-Bradley PLC systems including diagnosing and fixing faults, I/O, programming and graphics.Prior experience in programming of batch processesHave awareness of industrial communication protocols, Cyber Security and a commitment to Health & Safety legislation.Possess a full UK driving licence.Why join us Collective SpiritYou ...

sound understanding of Allen-Bradley PLC systems including diagnosing and fixing faults, I/O, programming and graphics. Prior experience in programming of batch processes Have awareness of industrial communication protocols, Cyber Security and a commitment to Health & Safety legislation. Possess a full UK driving licence. Why join ...

with strong Spark, Scala, and Python skills to develop, maintain, and troubleshoot data orchestration workflows and reusable engineering components. The role will support the processing, transformation, validation, and delivery of large-scale financial datasets, while contributing to platform engineering, production support, monitoring, automation, and operational resilience. The successful candidate … security, and change standards. Responsibilities Develop, maintain, and troubleshoot data orchestration workflows using Apache Airflow for extract generation, data publishing, feed delivery, and operational batch processes. Build and support reusable engineering components using Python, Scala, and Sharedview Spark to process, transform, and validate large-scale financial datasets. Design, write ...