15 of 15 Batch Processing Jobs in London

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

stop breaches, and we've redefined modern security with the world's most advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per day and this traffic is growing daily. Our customers span all industries, and they count on CrowdStrike to keep … seeking a talented Senior Software Engineer to join our Real-Time Streaming Platform team. Our mission is to provide enterprise-grade streaming processing capabilities that empower teams across CrowdStrike to build real-time data pipelines, perform complex event processing, and derive actionable insights from massive data streams. ...

memory footprint, and scalability, including for CPU-constrained andairgappeddeployment targets. Develop andmaintainproduction-grade model pipelines and supporting software with strongMLOpspractices — covering real-time inference, batch processing, performance monitoring, drift detection, scheduled retraining, observability, governance, version control, and reproducibility. Providetechnicalguidance— architectural input, peer review, and mentoring of mid-level … match with the position. Beneficial Knowledge, experience, and values Familiarity with containerisation (Docker, Kubernetes), event-driven or microservices architectures, and distributed data processing at scale. Experience with embedding pipelines, vector search, and semantic retrieval for RAG systems. Knowledge of LLM evaluation techniques including structured evals frameworks, hallucination mitigation, benchmarking ...

platforms used by banks, governments and regulated organisations. Their software helps organisations understand exactly who they're doing business with, combining large-scale data processing, entity resolution, graph intelligence and modern cloud architecture. Join an engineering team solving genuinely difficult technical problems - processing millions of records through asynchronous … Design and evolve backend services for high-volume, distributed screening workloads Build event-driven pipelines (AWS SNS/SQS) with idempotent consumers, DLQs and batch processing Design clean APIs and contribute to architecture across multiple products Integrate external identity, KYC and payments platforms (e.g. Senzing, Auth0, Stripe ...

Develop and optimise Oracle database objects (PL/SQL procedures, functions, queries) Write and maintain UNIX shell scripts for automation, job scheduling, and data processing Perform data analysis, mapping, and transformation for complex data sources Ensure data quality, integrity, and performance optimisation across ETL processes Collaborate with business … experience working in Data Warehouse/ETL environments Experience in data integration, transformation, and performance tuning Strong understanding of ETL frameworks, data pipelines, and batch processing Desirable Skills Working knowledge of SAS (especially in ETL context) Experience in migrating SAS workloads to Informatica ETLs Familiarity with data modelling ...

Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

Ability to compartmentalise complex problems and propose practical, controlled solutions for production environments Strong problem-solving, analytical and troubleshooting skills across application, infrastructure and batch processing issues Excellent verbal and written communication skills, with ability to work effectively across technology, infrastructure and business stakeholders Experience working as part ...

microservices, APIs, cloud-native design). AI & Data Platform Architecture/Deployment: Architect robust, secure AI and data platforms that support real-time inference, batch processing, and scalable enterprise workloads, integrating with clients' incumbent technology estates. Implement hybrid-cloud and multi-cloud strategies using modern data infrastructure (Kafka ...

Full-Stack Engineers across various seniority levels. You will design and deliver secure, scalable and resilient financial technology solutions, developing Java services, APIs and batch-processing applications while contributing to modern Angular frontends. What you'll do: Build backend services, microservices, APIs and batch applications using Java ...

Design and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systems Shape integration and data architecture patterns across APIs, messaging, batch, event-driven flows, canonical data models and enterprise data platforms Facilitate architecture, solution design and requirements workshops with business and technology stakeholders Advise clients … Endur architecture, configuration principles and application deployment models Strong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerations Proven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environments ...

Design and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systems Shape integration and data architecture patterns across APIs, messaging, batch, event-driven flows, canonical data models and enterprise data platforms Facilitate architecture, solution design and requirements workshops with business and technology stakeholders Advise clients … Endur architecture, configuration principles and application deployment models Strong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerations Proven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environments ...

perform data reconciliation and root cause analysis. Understanding of system integration and risk architecture. Working knowledge of: SQL Server Azure platforms APIs Messaging architectures Batch processes Data feeds Ability to communicate effectively with Development, Infrastructure and Architecture teams. Testing & Change Management Experience managing User Acceptance Testing (UAT). Experience ...

modern engineering and platform standards. Duties and Responsibilities Lead technical analysis, solution design and hands‐on development of applications, services, APIs, event‐driven components, batch processes and platform‐aligned capabilities. Act as a C#/.NET SME, setting engineering direction and ensuring solutions are clean, maintainable, testable and aligned … event‐driven solutions using appropriate messaging patterns including publish/subscribe, competing consumers, retries, dead‐letter handling, schema/version management and effectively‐once processing where required. Use AI‐enabled engineering tooling responsibly to improve delivery productivity, including integrated agentic coding assistants, prompt engineering, code review support and, where ...

offers the chance to shape the future-state data platform for a large, complex financial services organisation. The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction. The Company They … Databricks-based medallion architecture, with a strong focus on a robust Gold layer for analytics. Improve data availability by shifting from monthly batch processes towards more frequent or streaming ingestion where appropriate. Act as the senior technical decision-maker on data use cases, prioritisation, and trade-offs. Work closely ...