15 of 15 Remote Batch Processing Jobs in London

/09/2025 End Date: 27/03/2026 Rate: £650 per day - PAYE via Umbrella Only Role Overview: We are looking for a seasoned Azure Batch Cloud Architect to lead the design and implementation of scalable, secure, and high-performance batch processing solutions in Microsoft Azure. This role is pivotal in supporting data-intensive … workloads and compute-heavy operations critical to financial services, including risk modelling, regulatory reporting, and large-scale data transformation. Key Responsibilities: Architect and implement Azure Batch solutions to support large-scale, parallel compute workloads. Design and optimise cloud-native batch processing pipelines for financial analytics, simulations, and reporting. Collaborate with data engineering, DevOps, and security teams to … ensure end-to-end automation, compliance, and observability. Define and enforce governance, cost optimisation, and security best practices for batch workloads in Azure. Lead proof-of-concept initiatives, performance tuning, and capacity planning for compute-intensive applications. Provide architectural guidance on containerised batch jobs using Docker and Azure Kubernetes Service (AKS) where applicable. Maintain documentation and provide training More ❯

UK's energy future while working with state-of-the-art technology in a highly innovative environment. What You'll Do: Design and implement HPC environments supporting interactive and batch processing workloads, including MPI-capable systems. Deliver HPC solutions that are operating system agnostic, with a strong focus on both Windows and Linux platforms. Architect platform-agnostic HPC … technical guidance and best practices for HPC deployment, scalability, and performance tuning. What We're Looking For: Proven experience in High Performance Computing design and implementation, including interactive environments, batch processing, and MPI. Expertise working across multiple operating systems, specifically Windows and Linux. Ability to design HPC solutions deployable on both MS Azure and AWS cloud platforms. Experience More ❯

UK's energy future while working with state-of-the-art technology in a highly innovative environment. What You'll Do: Design and implement HPC environments supporting interactive and batch processing workloads, including MPI-capable systems. Deliver HPC solutions that are operating system agnostic, with a strong focus on both Windows and Linux platforms. Architect platform-agnostic HPC … technical guidance and best practices for HPC deployment, scalability, and performance tuning. What We're Looking For: Proven experience in High Performance Computing design and implementation, including interactive environments, batch processing, and MPI. Expertise working across multiple operating systems, specifically Windows and Linux. Ability to design HPC solutions deployable on both MS Azure and AWS cloud platforms. Experience More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

/review code/paired programming/debugging code related performance issues, SQL tuning etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka) Experience with batch processing/ETL using Glue Jobs, AWS Lambda and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

ORM Frameworks: Entity Framework, Dapper. Experience in building and consuming web services using micro-services architecture using REST APIs. Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery. Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams. Experience More ❯

ORM Frameworks: Entity Framework, Dapper Experience in building and consuming web services using micro-services architecture using REST APIs Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams Experience More ❯

passion for working in: Java Spring Boot Developing and using enterprise APIs Various testing methodologies System design at high scale and commercial experience with: SQL and NoSQL databases Async processing Cloud native applications Working in a Continuous Delivery environment Modern observability practices Nice to have Not vital, but you'll have the edge if you also have experience with … Grafana Prometheus Kotlin or a least the willingness to learn it Batch processing data pipelines or have worked in: an eCommerce organisation a shipping/logistics/exports organisation What you bring Agile: Test-Driven Development, collaboration and continuous delivery are your preferred engineering practices? We take the best bits of Lean, Scrum and Kanban too. Architecture: In More ❯

Python, SKLearn, XGBoost, SparkML, etc. Experience with deep learning frameworks like TensorFlow or PyTorch. Knowledge of ML model deployment options (e.g., Azure Functions, FastAPI, Kubernetes) for real-time and batch processing. Experience with CI/CD pipelines (e.g., DevOps pipelines, Git actions). Knowledge of infrastructure as code (e.g., Terraform, ARM Template, Databricks Asset Bundles). Understanding of advanced … machine learning techniques, including graph-based processing, computer vision, natural language processing, and simulation modeling. Experience with generative AI and LLMs, such as LLamaIndex and LangChain Understanding of MLOps or LLMOps. Familiarity with Agile methodologies, preferably Scrum We are actively seeking candidates for full-time, remote work within the UK. More ❯

moving from a successful proof-of-concept to beta-product phase. You will have the opportunity to learn new techniques and algorithms at the cutting edge of Natural Language Processing (NLP), specifically in compensating for Large Language Model limitations. You will also have the opportunity to innovate and contribute to algorithm development. Dr G.A.McHale, Technical Director, AI & Data Science … About the Team The team is led by someone with significant AI experience in bio-inspired architectures, reinforcement learning, expert systems, scheduling, meta-heuristics, robotics, and natural language processing (including LLMs). We have recruited an experienced scientific computing developer with a strong mathematics background in theoretical physics, responsible for distributed systems and GPU optimisation of AI algorithms. The … hardware-specific optimisation related to memory and CPU utilisation, hybrid-LLM system optimisation, and possible pre-filtering algorithms to reduce computational loads. Success is measured by significant improvements in batch processing and inference costs. About You This is a hands-on programming role. Expertise in LLMs (programming or hybrid systems) is essential. You have a background in Telecommunications More ❯

achieves operational maturity. Main Responsibilitis Technical Leadership & Strategy Define and evangelize architectural vision, ensuring alignment with organizational goals and cloud-native principles. Offer expert guidance on large-scale data processing, infrastructure patterns, and operational resilience to establish best practices. Lead evaluations of emerging technologies (e.g., streaming, IaC, observability tools) and advocate for adoption where they solve critical business needs. … disaster recovery strategies to instill trust in data products. Delivery & Scalability Oversee the development of modular, scalable data infrastructure that supports diverse use cases, from real-time analytics to batch processing. Drive initiatives to improve platform performance, cost efficiency, and reliability-measured through metrics like MTTR, deployment velocity, and incident reduction. Ensure robust metadata management, lineage tracking, and governance More ❯