1 to 25 of 33 Batch Processing Jobs in the UK

engineering standards. Key Responsibilities: Build and operate scalable data pipelines using Microsoft Fabric (OneLake/Delta Lake, Data Factory, Synapse Data Engineering). Develop batch processing solutions using PySpark, Spark SQL, Python, and SQL , with a focus on performance, resilience, and data quality. Support reporting ...

architects, compliance officers, and cybersecurity specialists to integrate data from various systems such as databases, APIs, and cloud platforms. Your work will directly support batch processing, real-time streaming, and event-driven data pipelines across a variety of use cases. We’re looking for candidates with over … experience: Apache NiFi Expertise: Deep understanding of core NiFi concepts: FlowFiles, Processors, Controller Services, Schedulers, Web UI. Experience designing and optimizing data flows for batch, real-time streaming, and event-driven architectures. Ability to identify and resolve flow issues, optimize performance, and implement error-handling strategies. Optional scripting skills ...

efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security ...

looking for Solid experience with PySpark (or Spark with Python) and strong SQL skills. Experience working with existing data pipelines, ETL jobs or batch processes (investigating and fixing issues rather than only building new systems). Comfortable reading other people’s code, understanding complex logic, and making safe changes. ...

DevOps teams to manage capacity and performance Troubleshoot incidents and perform root cause analysis Ensure environments meet security, compliance, and operational standards Support batch processing and certificate management activities Contribute to automation and continuous improvement initiatives Must Have Skills & Experience You should have solid hands-on experience … Ansible .NET-based automation or scripting Nice-to-Have Skills Financial services or banking domain experience Experience supporting large, integrated test environments Exposure to batch scheduling or batch operations Strong documentation and knowledge-sharing mindset All profiles will be reviewed against the required skills and experience. ...

experience using Python, SQL and AWS Define and enforce data architecture across mesh and domain-driven data products. Implement and govern real-time/batch processing (Kafka, Spark, Glue). Ensure strong metadata, cataloguing, and lineage practices across the enterprise. Lead teams of engineers across global hubs, mentoring ...

front-end developers on UI integration Develop and maintain Azure-native services supporting a multi-tenant SaaS platform Work with asynchronous and event-driven processing (e.g. messaging, background services) Troubleshoot, refactor, and optimise code for performance, security and maintainability Participate in design reviews and contribute to technical architecture discussions … features and maintain functionality on an existing enterprise software product Coordinate workflows with analysts, developers, and DevOps engineers Implement data audit trails, archiving processes, batch workflows and system recovery Integrate external APIs and manage secure data flow with SQL Server and related tools What You Bring Minimum ...

delivering the data infrastructure, pipelines, and reporting capabilities the wider business depends on. The platform is evolving. The business is moving away from traditional batch processing toward a real-time, event-driven architecture and you will be leading that technical journey while keeping everything running reliably … similar Stakeholder managemenT Useful but not essential: Lakehouse or cloud-native data platform architecture experience Data lakes, object storage, and large-scale analytical processing ML or advanced analytics exposure AWS security, networking and access control GDPR and data governance awareness DAY TO DAY No two days will look ...

Development experience. Advanced skills in SSIS. Understanding of XSL. Understanding of Java and APIs desirable. Strong understanding of integrations, data flows, and batch processing. Basic scripting (Sybase, Python, Power BI) Awareness/experience of workflow solutions within Application Software. Experience in wealth management, life administration, pensions, and savings ...

with Docker, Cloud, Jenkins, Splunk Experience with exploratory testing Stakeholder management and communication skills Experience in data migration, database testing, feed files, and understanding batch processes/scheduling Experience mentoring/upskilling junior team members Desirable: Experience in GCP/cloud transformation projects Advanced database testing experience Knowledge ...

Python, Shell scripting, and GitLab pipeline. Required Skills and Qualifications: Proven experience in mainframe environments, particularly with CICS webservices, ZOS Connect EE, DB2, and batch processing. Strong skills in mainframe transaction management, JCL, and system debugging tools. Familiarity with SOAP, WSDL, JSON, and integration patterns such ...

configuration and scripting Experience from a Development background Experience of message queues (Rabit MQ) Infrastructure as code experience (Teraform) Server-side scripting, automation and batch processes - PowerShell and Bash are essential Experience of Git version control and branching strategies Observability (Grafana, Prometheus, Dynatrace or a similar tool ...

organizational data is agent-ready by aligning data access, availability, and technical architecture. Design, build, and maintain robust data pipelines supporting real-time and batch processing for AI agents. Contribute to the technical implementation of agent systems using frameworks such as Google AI Development Kit (ADK) or comparable ...

cause analysis for complex production issues and ensure long-term fixes. Development & Delivery Act as a hands-on lead developer for complex RPG programs, batch jobs, and core banking extensions. Design and implement enhancements to accounts, deposits, lending, interest, fees, GL, and transaction processing. Oversee batch processing ...

Service Bus, and Event Grid. Good knowledge of common integration design approaches such as API-centric design, publish/subscribe, event-driven, synchronous, and batch processing patterns. Experience working with distributed systems and microservices, including container technologies (e.g., Docker) and orchestration platforms (e.g., AKS). Familiarity with DevOps ...

Service Bus, and Event Grid. Good knowledge of common integration design approaches such as API-centric design, publish/subscribe, event-driven, synchronous, and batch processing patterns. Experience working with distributed systems and microservices, including container technologies (e.g., Docker) and orchestration platforms (e.g., AKS). Familiarity with DevOps ...

data, risk, and settlement systems. Troubleshoot and resolve technical and functional issues while managing incident tickets and maintaining knowledge documentation. Monitor trading applications and batch processes, responding to alerts and minimising disruption to trading activity. Support traders and other front-office users with application queries, permissions, and system usage. ...

both PeopleSoft and SAP environments. Troubleshoot issues in development and production systems. Complete high-level checks during month-end and year-end to ensure batch processes run successfully. Build strong working relationships with business users, helping with reporting requirements, audits, and enhancement requests. Gather requirements and produce documentation ...

both PeopleSoft and SAP environments. Troubleshoot issues in development and production systems. Complete high-level checks during month-end and year-end to ensure batch processes run successfully. Build strong working relationships with business users, helping with reporting requirements, audits, and enhancement requests. Gather requirements and produce documentation ...

both PeopleSoft and SAP environments. Troubleshoot issues in development and production systems. Complete high-level checks during month-end and year-end to ensure batch processes run successfully. Build strong working relationships with business users, helping with reporting requirements, audits, and enhancement requests. Gather requirements and produce documentation ...

both PeopleSoft and SAP environments. Troubleshoot issues in development and production systems. Complete high-level checks during month-end and year-end to ensure batch processes run successfully. Build strong working relationships with business users, helping with reporting requirements, audits, and enhancement requests. Gather requirements and produce documentation ...

NatWest, including payee checks. Accounts Payable Post all AP for three UK entities. Manage AP cycles and advise on payment timing. Raise payments through batch processing and online banking. Forward foreign-currency invoices to relevant global teams. Process invoices paid by other regions and handle supplier queries. ...

parameterization, customisations, and scripts Build and enhance Avaloq modules including Reports, Workflows, Context Actions, Order Validations, Keys, and Additions Develop and support interfaces and batch processes Perform unit testing , defect resolution, and technical documentation Ensure solutions meet regulatory, technical, and quality standards Required Skills Proven experience as an Avaloq ...

persistent memory. Build a high-performance Runtime/Framework that defines the next-generation Serverless AI foundation through elastic scaling, cold start optimization, batch processing, function-based inference, request orchestration, dynamic decoupled deployment, and other features to support performance scenarios such as multiple models, multi-tenancy, and high ...

persistent memory. Build a high-performance Runtime/Framework that defines the next-generation Serverless AI foundation through elastic scaling, cold start optimization, batch processing, function-based inference, request orchestration, dynamic decoupled deployment, and other features to support performance scenarios such as multiple models, multi-tenancy, and high ...