1 to 25 of 27 Permanent Batch Processing Jobs in London

/09/2025 End Date: 27/03/2026 Rate: £650 per day - PAYE via Umbrella Only Role Overview: We are looking for a seasoned Azure Batch Cloud Architect to lead the design and implementation of scalable, secure, and high-performance batch processing solutions in Microsoft Azure. This role is pivotal in supporting data-intensive … workloads and compute-heavy operations critical to financial services, including risk modelling, regulatory reporting, and large-scale data transformation. Key Responsibilities: Architect and implement Azure Batch solutions to support large-scale, parallel compute workloads. Design and optimise cloud-native batch processing pipelines for financial analytics, simulations, and reporting. Collaborate with data engineering, DevOps, and security teams to … ensure end-to-end automation, compliance, and observability. Define and enforce governance, cost optimisation, and security best practices for batch workloads in Azure. Lead proof-of-concept initiatives, performance tuning, and capacity planning for compute-intensive applications. Provide architectural guidance on containerised batch jobs using Docker and Azure Kubernetes Service (AKS) where applicable. Maintain documentation and provide training More ❯

systems are written in Elixir, but where necessary, we use small amounts of Python and Java where vendor SDKs require it. Designing, developing and maintaining realtime data streaming, and batch processing workloads. Providing on-call support as part of our teamwide rotation. Our on-call rotation is split across US and UK time zones, ensuring coverage whilst keeping … parallelism for speed/space performance tradeoffs. Bonus Experience: Exchange traded financial instruments. Statistics, discrete mathematics, linear algebra. Problem-solving and proof construction. For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at . California residents, please review the California Privacy Notice for information about certain legal rights More ❯

management, data lineage tracking, and access control to ensure data integrity and compliance. Optimize data pipelines and transformation logic using SAP Datasphere's capabilities to support real-time and batch processing needs. Collaborate with business and technical teams to translate data requirements into robust, reusable data products and services. Monitor and tune system performance, proactively identifying and resolving More ❯

they operate. Hands on Experience in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use the Caching technologies. Understanding of More ❯

building scalable, reliable, highly available and fault-tolerant systems, broad knowledge of software engineering and site reliability engineering in areas such as Large-Scale Data and Compute Infrastructure, Stream Processing, Kubernetes, High-Performance Networking, Observability and Infrastructure Automation. RESPONSIBILITIES Set the technology strategy for our cloud infrastructure, factoring in the AD/ADAS cloud development needs and our cloud … to automate routine tasks. NICE TO HAVES Master's degree in Computer Science. Experience working as a Software Engineer on data-intensive applications, data platforms, data pipelines, workflow orchestration, batch processing, and/or distributed databases. Previous experience in monitoring, tracking and optimising cloud compute and storage costs Experience working with RPC protocols and their formats, e.g., gRPC More ❯

Data Scientists, Business Analysts Extensive experience using Python, SQL and AWS Define and enforce data architecture across mesh and domain-driven data products. Implement and govern real-time/batch processing (Kafka, Spark, Glue). Ensure strong metadata, cataloguing, and lineage practices across the enterprise. Lead teams of engineers across global hubs, mentoring and supporting high standards. Knowledge More ❯

needs within each department. MAIN RESPONSIBILITIES Database estate administration and monitoring Managing application system Disaster Recovery and high availability Managing backup and recovery strategies/automation of maintenance and batch processing Database performance tuning including TSQL/Procedural performance tuning (Optimizer and Index usage) Database design and architecture, development and administration Setting up best practice database development and More ❯

needs within each department. MAIN RESPONSIBILITIES Database estate administration and monitoring Managing application system Disaster Recovery and high availability Managing backup and recovery strategies/automation of maintenance and batch processing Database performance tuning including TSQL/Procedural performance tuning (Optimizer and Index usage) Database design and architecture, development and administration Setting up best practice database development and More ❯

ORM Frameworks: Entity Framework, Dapper. Experience in building and consuming web services using micro-services architecture using REST APIs. Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery. Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams. Experience More ❯

ORM Frameworks: Entity Framework, Dapper. Experience in building and consuming web services using micro-services architecture using REST APIs. Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery. Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams. Experience More ❯

ORM Frameworks: Entity Framework, Dapper. Experience in building and consuming web services using micro-services architecture using REST APIs. Experience in keeping multiple applications in synch - real time/batch processing. Experience of leading teams of technical specialists through to successful delivery. Experience of providing technical leadership and oversight with offshore and/or third-party delivery teams. Experience More ❯

mindset with strong organizational skills and attention to detail. Familiarity with tools like JIRA or ServiceNow. Certifications in ITIL, Linux, or cloud platforms (e.g., AWS, Azure). Experience with batch processing, data interfaces, or monitoring tools. Exposure to automation or scripting. Learn more about the LexisNexis Risk team and how we work We are committed to providing a More ❯

that serve,process and transform large quantities of data in the cloud Minimum Qualifications: Experience with Python (or other Object Oriented language) Experience building reliable, distributed applications for Data Processing or similar areas Hands-on experience developing cloud applications (e.g. AWS, GCP, Azure) Experience with technologies like BigQuery and SnowFlake Preferred Qualifications: Experience writing testable and modular code Experience … working in a fast-paced environment, collaborating across teams and disciplines Experience designing, deploying, and maintaining distributed systems Data pipelines, data platforms, workflow orchestration, batch processing Experience on building ML pipelines WHAT WE OFFER We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best More ❯

testable and modular code Experience working in a fast-paced environment, collaborating across teams and disciplines Experience designing, deploying, and maintaining distributed systems Data pipelines, data platforms, workflow orchestration, batch processing WHAT WE OFFER We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many options of the best More ❯

passion for working in: Java Spring Boot Developing and using enterprise APIs Various testing methodologies System design at high scale and commercial experience with: SQL and NoSQL databases Async processing Cloud native applications Working in a Continuous Delivery environment Modern observability practices Nice to have Not vital, but you'll have the edge if you also have experience with … Grafana Prometheus Kotlin or a least the willingness to learn it Batch processing data pipelines or have worked in: an eCommerce organisation a shipping/logistics/exports organisation What you bring Agile: Test-Driven Development, collaboration and continuous delivery are your preferred engineering practices? We take the best bits of Lean, Scrum and Kanban too. Architecture: In More ❯

Python, SKLearn, XGBoost, SparkML, etc. Experience with deep learning frameworks like TensorFlow or PyTorch. Knowledge of ML model deployment options (e.g., Azure Functions, FastAPI, Kubernetes) for real-time and batch processing. Experience with CI/CD pipelines (e.g., DevOps pipelines, Git actions). Knowledge of infrastructure as code (e.g., Terraform, ARM Template, Databricks Asset Bundles). Understanding of advanced … machine learning techniques, including graph-based processing, computer vision, natural language processing, and simulation modeling. Experience with generative AI and LLMs, such as LLamaIndex and LangChain Understanding of MLOps or LLMOps. Familiarity with Agile methodologies, preferably Scrum We are actively seeking candidates for full-time, remote work within the UK. More ❯

ministers and the nation's digitised history from the 11th to the early 21st century are all to be preserved in the system. We currently operate a series of batch-processing workflows constructed predominantly in Scala, Java, XSLT and XML Schema running in a Linux environment. You will influence the future design of the system and will be More ❯

Integration). Expert-level understanding of API design principles (REST, SOAP), API management platforms, and microservices architecture. Proficient in various integration patterns (e.g., ETL, EAI, B2B, real-time streaming, batch processing). Strong experience with cloud-native integration services and hybrid cloud environments. Expertise in various data formats (JSON, XML, EDI) and messaging protocols (Kafka, RabbitMQ, JMS). More ❯

operating effectively, delivering regular maintenance, performance monitoring, and timely resolution of technical issues. Enhance system usability and maximise the value of available tools. Build and maintain workflows, user journeys, batch processes, and data integrations. Lead system upgrades, testing cycles, and configuration updates. Oversee system documentation, access governance, and change control protocols. Represent the People function in third-party supplier More ❯

operating effectively, delivering regular maintenance, performance monitoring, and timely resolution of technical issues. Enhance system usability and maximise the value of available tools. Build and maintain workflows, user journeys, batch processes, and data integrations. Lead system upgrades, testing cycles, and configuration updates. Oversee system documentation, access governance, and change control protocols. Represent the People function in third-party supplier More ❯

moving from a successful proof-of-concept to beta-product phase. You will have the opportunity to learn new techniques and algorithms at the cutting edge of Natural Language Processing (NLP), specifically in compensating for Large Language Model limitations. You will also have the opportunity to innovate and contribute to algorithm development. Dr G.A.McHale, Technical Director, AI & Data Science … About the Team The team is led by someone with significant AI experience in bio-inspired architectures, reinforcement learning, expert systems, scheduling, meta-heuristics, robotics, and natural language processing (including LLMs). We have recruited an experienced scientific computing developer with a strong mathematics background in theoretical physics, responsible for distributed systems and GPU optimisation of AI algorithms. The … hardware-specific optimisation related to memory and CPU utilisation, hybrid-LLM system optimisation, and possible pre-filtering algorithms to reduce computational loads. Success is measured by significant improvements in batch processing and inference costs. About You This is a hands-on programming role. Expertise in LLMs (programming or hybrid systems) is essential. You have a background in Telecommunications More ❯

working with modern tools in a fast-moving, high-performance environment. Your responsibilities may include: Build and maintain scalable, efficient ETL/ELT pipelines for both real-time and batch processing. Integrate data from APIs, streaming platforms, and legacy systems, with a focus on data quality and reliability. Design and manage data storage solutions, including databases, warehouses, and lakes. … Leverage cloud-native services and distributed processing tools (e.g., Apache Flink, AWS Batch) to support large-scale data workloads. Operations & Tooling Monitor, troubleshoot, and optimize data pipelines to ensure performance and cost efficiency. Implement data governance, access controls, and security measures in line with best practices and regulatory standards. Develop observability and anomaly detection tools to support Tier … maintaining scalable ETL/ELT pipelines and data architectures. Hands-on expertise with cloud platforms (e.g., AWS) and cloud-native data services. Comfortable with big data tools and distributed processing frameworks such as Apache Flink or AWS Batch. Strong understanding of data governance, security, and best practices for data quality. Effective communicator with the ability to work across technical More ❯

a BA coupled with at least 2 years experience of Nice Actimize. - Analyzing current installation of Actimize WLF solution at a client side - Recommend improvements on data ingestion and batch process performance - Recommend optimal Threshold setting and Scoring configuration which adhere to the client requirements - Improve detection and alert generation Must Have: - Minimum 2 years experience supporting Nice Actimize More ❯

tech Driving data integrity, data governance, data protection and automation to support strategic decision-making Champion continuous improvement in HRIS and related platforms Building and maintaining workflows, user journeys, batch processes and data integrations Overseeing system documentation and change control protocols in line with firmwide IT standards Representing the People function in all 3rd party relationships Skills and experience More ❯

quality technical solutions. Key Responsibilities: Design, develop, and maintain applications using the VisionPLUS framework (CMS, FAS, TRAMS, MBS, CTA, etc.) Perform system configuration, enhancements, and customizations in VisionPLUS Develop batch processes, online transactions, and user interfaces as needed Analyze functional requirements and translate them into technical specifications Troubleshoot production issues and support post-implementation activities Ensure code quality and … Financial Authorization System), TRAMS, CTA, MBS, etc. Experience in COBOL , JCL , CICS , VSAM , and Mainframe utilities Knowledge of Card Payments , Loyalty Programs , EMV , and Authorization Flows Experience working with batch cycles , file processing, and job scheduling tools Good understanding of software development lifecycle (SDLC) Experience in production support , incident handling , and bug fixing More ❯