23 of 23 Remote Batch Processing Jobs in England

/09/2025 End Date: 27/03/2026 Rate: £650 per day - PAYE via Umbrella Only Role Overview: We are looking for a seasoned Azure Batch Cloud Architect to lead the design and implementation of scalable, secure, and high-performance batch processing solutions in Microsoft Azure. This role is pivotal in supporting data-intensive … workloads and compute-heavy operations critical to financial services, including risk modelling, regulatory reporting, and large-scale data transformation. Key Responsibilities: Architect and implement Azure Batch solutions to support large-scale, parallel compute workloads. Design and optimise cloud-native batch processing pipelines for financial analytics, simulations, and reporting. Collaborate with data engineering, DevOps, and security teams to … ensure end-to-end automation, compliance, and observability. Define and enforce governance, cost optimisation, and security best practices for batch workloads in Azure. Lead proof-of-concept initiatives, performance tuning, and capacity planning for compute-intensive applications. Provide architectural guidance on containerised batch jobs using Docker and Azure Kubernetes Service (AKS) where applicable. Maintain documentation and provide training More ❯

UK's energy future while working with state-of-the-art technology in a highly innovative environment. What You'll Do: Design and implement HPC environments supporting interactive and batch processing workloads, including MPI-capable systems. Deliver HPC solutions that are operating system agnostic, with a strong focus on both Windows and Linux platforms. Architect platform-agnostic HPC … technical guidance and best practices for HPC deployment, scalability, and performance tuning. What We're Looking For: Proven experience in High Performance Computing design and implementation, including interactive environments, batch processing, and MPI. Expertise working across multiple operating systems, specifically Windows and Linux. Ability to design HPC solutions deployable on both MS Azure and AWS cloud platforms. Experience More ❯

UK's energy future while working with state-of-the-art technology in a highly innovative environment. What You'll Do: Design and implement HPC environments supporting interactive and batch processing workloads, including MPI-capable systems. Deliver HPC solutions that are operating system agnostic, with a strong focus on both Windows and Linux platforms. Architect platform-agnostic HPC … technical guidance and best practices for HPC deployment, scalability, and performance tuning. What We're Looking For: Proven experience in High Performance Computing design and implementation, including interactive environments, batch processing, and MPI. Expertise working across multiple operating systems, specifically Windows and Linux. Ability to design HPC solutions deployable on both MS Azure and AWS cloud platforms. Experience More ❯

intelligent, scalable systems that power innovative, user-facing products. As the technical leader in a highly skilled team, you'll take ownership of designing distributed systems, APIs, and event processing platforms in a cloud-first environment, primarily on AWS. You'll collaborate across engineering and product to deliver high-performance software, working hands-on across the stack with languages … event-driven architecture patterns Implement logging, tracing, and observability practices from day one Contribute to the design and development of cloud-native data platforms that support real-time and batch processing AI & LLM Enablement: Collaborate with data scientists and ML engineers to integrate AI/LLM capabilities into applications Build and expose intelligent APIs that leverage models from … and managing containerized services on Amazon EKS Proven ability to design and build modern, API-driven systems in a scalable resilient cloud-based platform Experience developing or integrating data processing systems (batch or streaming) and working with large amounts of data. Exposure to integrating LLMs or other AI models in production environments and utilising to provide applications functionality More ❯

intelligent, scalable systems that power innovative, user-facing products. As the technical leader in a highly skilled team, you'll take ownership of designing distributed systems, APIs, and event processing platforms in a cloud-first environment, primarily on AWS. You'll collaborate across engineering and product to deliver high-performance software, working hands-on across the stack with languages … event-driven architecture patterns Implement logging, tracing, and observability practices from day one Contribute to the design and development of cloud-native data platforms that support real-time and batch processing AI & LLM Enablement: Collaborate with data scientists and ML engineers to integrate AI/LLM capabilities into applications Build and expose intelligent APIs that leverage models from … and managing containerized services on Amazon EKS Proven ability to design and build modern, API-driven systems in a scalable resilient cloud-based platform Experience developing or integrating data processing systems (batch or streaming) and working with large amounts of data. Exposure to integrating LLMs or other AI models in production environments and utilising to provide applications functionality More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

proactive mindset to help ensure the stability, efficiency, and resilience of applications across esure. Good working knowledge of Java is needed for this position. What you’ll do: Support batch processing and carry out proactive analysis across squads and services. Review Java code and suggest improvements to enhance quality and performance. Investigate and resolve production incidents, problems, and … change requests. Offer expertise on business processes for projects and production support issues. Maintain core Insurance systems and related infrastructure like Kubernetes and SOLR. Improve batch efficiency and reduce costs, including audit-ready data archiving strategies. Provide data analysis to support business decisions across Operations and Claims. Deliver patching, database fixes, and business-critical data correction services. Qualifications What More ❯

modelling, data access patterns, and efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including Real Time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security engineers to integrate security throughout More ❯

and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

/review code/paired programming/debugging code related performance issues, SQL tuning etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka) Experience with batch processing/ETL using Glue Jobs, AWS Lambda and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

ORM Frameworks: Entity Framework, Dapper. Experience in building and consuming web services using micro-services architecture using REST APIs. Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery. Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams. Experience More ❯

ORM Frameworks: Entity Framework, Dapper Experience in building and consuming web services using micro-services architecture using REST APIs Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams Experience More ❯

and scaling cloud-based data infrastructure. Key Responsibilities: Design, build, and optimize data pipelines using Airflow, DBT, and Databricks. Monitor and improve pipeline performance to support real-time and batch processing. Manage and optimize AWS-based data infrastructure, including S3 and Lambda, as well as Snowflake. Implement best practices for cost-efficient, secure, and scalable data processing. Enable and More ❯

passion for working in: Java Spring Boot Developing and using enterprise APIs Various testing methodologies System design at high scale and commercial experience with: SQL and NoSQL databases Async processing Cloud native applications Working in a Continuous Delivery environment Modern observability practices Nice to have Not vital, but you'll have the edge if you also have experience with … Grafana Prometheus Kotlin or a least the willingness to learn it Batch processing data pipelines or have worked in: an eCommerce organisation a shipping/logistics/exports organisation What you bring Agile: Test-Driven Development, collaboration and continuous delivery are your preferred engineering practices? We take the best bits of Lean, Scrum and Kanban too. Architecture: In More ❯

Python, SKLearn, XGBoost, SparkML, etc. Experience with deep learning frameworks like TensorFlow or PyTorch. Knowledge of ML model deployment options (e.g., Azure Functions, FastAPI, Kubernetes) for real-time and batch processing. Experience with CI/CD pipelines (e.g., DevOps pipelines, Git actions). Knowledge of infrastructure as code (e.g., Terraform, ARM Template, Databricks Asset Bundles). Understanding of advanced … machine learning techniques, including graph-based processing, computer vision, natural language processing, and simulation modeling. Experience with generative AI and LLMs, such as LLamaIndex and LangChain Understanding of MLOps or LLMOps. Familiarity with Agile methodologies, preferably Scrum We are actively seeking candidates for full-time, remote work within the UK. More ❯

moving from a successful proof-of-concept to beta-product phase. You will have the opportunity to learn new techniques and algorithms at the cutting edge of Natural Language Processing (NLP), specifically in compensating for Large Language Model limitations. You will also have the opportunity to innovate and contribute to algorithm development. Dr G.A.McHale, Technical Director, AI & Data Science … About the Team The team is led by someone with significant AI experience in bio-inspired architectures, reinforcement learning, expert systems, scheduling, meta-heuristics, robotics, and natural language processing (including LLMs). We have recruited an experienced scientific computing developer with a strong mathematics background in theoretical physics, responsible for distributed systems and GPU optimisation of AI algorithms. The … hardware-specific optimisation related to memory and CPU utilisation, hybrid-LLM system optimisation, and possible pre-filtering algorithms to reduce computational loads. Success is measured by significant improvements in batch processing and inference costs. About You This is a hands-on programming role. Expertise in LLMs (programming or hybrid systems) is essential. You have a background in Telecommunications More ❯

Experience working with AI tolls for data analysis, process automation is preferred. Demonstrated experience in business process design and requirements analysis. Knowledge of and experience with Web APIs and Batch Processes is preferred. Ability to promote and maintain a positive and inclusive work environment with project team members, co-workers, management, and vendors by behaving, collaborating, and communicating in More ❯

Safety): DCS software configuration generated from client's design documentation such as user requirement specifications or control philosophies Alarm rationalisation and understanding of EEMUA 191 Continuous Process control and Batch process software programming Functional Safety SIL classifications and SIF calculations Supervise or implement the detailed design, by producing function block programming (using engineering software tools), implement the Safety system More ❯

Sr QA Manual Engineer We are looking for a detail-oriented Functional QA Engineer to join a data-centric project focused on real-time processing and system reliability. You will be responsible for validating business-critical workflows, ensuring data accuracy in CSV imports/exports, and maintaining traceability for audit and compliance purposes. The ideal candidate is analytical, structured … testing with sprint goals. Perform regression, integration, and exploratory testing. Manage defect reporting and tracking, while ensuring traceability and timely resolution. Contribute to the testing of real-time and batch processes using CSV and other input formats. Ensure proper documentation of test cases, results, and traceability matrices to support audit and compliance needs. What you'll bring to us More ❯

achieves operational maturity. Main Responsibilitis Technical Leadership & Strategy Define and evangelize architectural vision, ensuring alignment with organizational goals and cloud-native principles. Offer expert guidance on large-scale data processing, infrastructure patterns, and operational resilience to establish best practices. Lead evaluations of emerging technologies (e.g., streaming, IaC, observability tools) and advocate for adoption where they solve critical business needs. … disaster recovery strategies to instill trust in data products. Delivery & Scalability Oversee the development of modular, scalable data infrastructure that supports diverse use cases, from real-time analytics to batch processing. Drive initiatives to improve platform performance, cost efficiency, and reliability-measured through metrics like MTTR, deployment velocity, and incident reduction. Ensure robust metadata management, lineage tracking, and governance More ❯