12 of 12 Batch Processing Jobs in London

self-service capabilities Your Responsibilities As a Senior Data Engineer , you will: Design and implement data ingestion pipelines using ETL, streaming, scraping, and batch approaches Clean, enrich, and transform datasets for analytical and operational consumption Persist data across databases, warehouses, and data lakes Distribute data internally via APIs, Python … packages, and direct querying Maintain and enhance production data pipelines and databases Support post-processing automation, including analytics, models, and visualisation workflows Enable Data Scientists through shared libraries, cloud resources, and documented data access Maintain knowledge bases covering data sources, pipelines, and usage Key Requirements As a Senior Data ...

sources and apis, with good understanding of event and message-based integrations using Active MQ/Kafka/AWS kinesis etc, as well as batch processes of synchronous integration involving change pointers and delta refresh · Designing reporting solutions with visualisation suite covering Tableau, PowerBI, SAP BOBJ, Bex, SAP analytics ...

maintain microservices-based applications and data engineering pipelines. This role requires strong hands-on development experience across Java services, backend systems, and data processing platforms, with a focus on building scalable, reliable, and maintainable solutions. The role involves close collaboration with data engineers, QA, product, and platform teams … microservices architecture. Solid experience building and maintaining backend services and APIs. Experience contributing to data engineering pipelines, including ETL/ELT workflows, batch processing, and scheduled data builds. Strong understanding of data modelling, transformations, and downstream data consumption. Experience with performance tuning for backend services or data pipelines. ...

enterprise databases into AWS using DMS and CDC patterns Ensure automation, scalability, and resilience across platform and data pipelines Enable event-driven and batch processing architectures (e.g., S3, Lambda) Enforce engineering standards and best practices across the platform Ensure data lineage, cataloguing, and governance are maintained Collaborate with ...

function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

Python, Shell scripting, and GitLab pipeline. Required Skills and Qualifications: Proven experience in mainframe environments, particularly with CICS webservices, ZOS Connect EE, DB2, and batch processing. Strong skills in mainframe transaction management, JCL, and system debugging tools. Familiarity with SOAP, WSDL, JSON, and integration patterns such ...

support complex commercial lending workflows and integrations across the broader loan servicing ecosystem The role requires a deep understanding of syndicated and bilateral loan processing, strong technical acumen and experience with Loan IQ. Background Loan IQ provides loan booking and servicing functionality across two of the three product pillars … govern Level 2/3 support activities across incident, problem, and change management, ensuring audit ready processes and documentation. Provide executive oversight of daily batch cycles and upstream/downstream interfaces, proactively addressing bottlenecks and performance risks. Review root-cause analyses for major incidents and champion long term remediation ...

happy for you to learn Worked at a cutting edge tech company – Think FAANG level companies or similar Exposure to Data Engineering and Batch Processing Systems is highly advantageous They are paying between £140,000 and £180,000 with up to a 15% bonus and shares available. ...

Kafka/MQ, ESB/iPaaS platforms Experience with REST APIs, event-driven systems and distributed architectures Understanding of data platforms, real-time vs batch processing and AI/ML integration Familiarity with GDPR, DORA and regulated environment requirements Strong stakeholder engagement and communication skills A strong opportunity ...

Guidewire xCenters (version 10.x & SaaS) customization and integration (Intra and Inter system integration) using REST and SOAP APIs • Technical Skills: o Experience with batch processes, Guidewire Messaging framework, and OOTB plugins o Familiarity with Infra concepts and deployment architecture (WMB, WAS, and Apache) o Strong knowledge on Software architecture ...

understanding of .NET memory management internals - GC generations, LOH, pinned objects, finalisation, and how allocation patterns affect runtime behaviour Experience optimising high-throughput data processing pipelines - including async/await patterns, Channel, pipelines, and avoiding synchronisation bottlenecks Proven ability to diagnose large dataset query performance issues across both relational … patterns, LOH fragmentation, finaliser queues, and GC tuning (gen0/1/2, server vs. Workstation, DATAS) Investigate and optimise high-throughput data pipelines - batch processing, streaming patterns, buffer management, and backpressure handling Identify and resolve large dataset query performance issues - index utilisation, query plan analysis, pagination strategies ...

Billing Project Costing Travel & Expense (T&E) Validate financial processes - journals, vouchers, payments, reconciliations, asset capitalization, procurement flows, project allocations, invoicing, etc. Test PeopleSoft batch processes (AE, BI, AP, AM jobs), workflow routing, security roles, and financial configuration setups. Perform end-to-end validation of financial integrations (banking, payment … working. Essential Skills & Experience 7+ years of experience in software testing with strong Test Lead experience. Strong understanding of PeopleSoft Financials functionality, tables, batch jobs, and configuration. Strong SQL skills (Oracle/SQL Server) for financial data validation. Strong client-facing experience on complex transformation programmes. Hands-on experience ...