18 of 18 Batch Processing Jobs in London

About The Role FDM is a global business and technology consultancy seeking a DevOps Engineer (Batch Monitoring) to work for our client within the Banking & Financial Services sector. This is initially a 12 month contract with the potential to extend and will be a hybrid role that will … management, platform stability, automation, and continuous improvement to ensure key reporting processes are delivered reliably and efficiently. ------------------ Responsibilities Monitor the health and performance of batch processing, applications, infrastructure, and data pipelines across the SFRC platform Perform first line incident management, root cause analysis, and operational troubleshooting activities Coordinate ...

quantitative specialists to understand complex computational problems Investigating areas such as memory usage, concurrency, parallelism and computational performance Contributing to distributed computing and batch-processing systems Designing reliable, maintainable software for demanding production environments Working across multiple technical domains rather than being restricted to a single technology stack … Performance Computing/HPC C++ Python Rust Java or C# GPU programming CUDA or ROCm Parallel programming Distributed systems Cluster computing Job schedulers or batch-processing frameworks Linux Numerical computing Monte Carlo simulation Quantitative finance Trading technology Financial risk systems Performance optimisation Low-latency or high-throughput systems ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows. Mandatory experience analysing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms. Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

cutting edge What we’re looking for Software & Data Engineering Strong expertise in Python Passion for writing: clean reliable production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience ...

consumers. You’ve built architectures that held up as they grew with a focus on data warehousing, data lakes, and both real-time and batch processing. Teams bring you their hardest data problems. You’ve made the hard tradeoffs in distributed, multi-tenant systems and lived with the consequences. ...

Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise in data warehousing concepts, advanced ETL/ELT processes, and analytics engineering best practices. Exceptional programming ...

trading activities. Take full ownership of data products, guiding them from initial concept through to stable production. Design, build, and maintain systems for both batch processing and real‐time streaming of time series datasets, ensuring high data quality and reliability. Develop APIs and data access methods for fast … databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW’s processing activities and our use of job applicants’ data, please view our Privacy Notice at https://drw.com/privacy-notice. California residents, please ...

resilience, availability, performance and capacity. * Manage deployments, releases, production readiness and failover activities. * Implement monitoring, alerting and observability solutions. * Troubleshoot complex application, infrastructure and batch-processing issues. * Identify root causes and deliver sustainable technical solutions. * Contribute to CI/CD, automation and wider DevOps and engineering best practices. ...

Ability to compartmentalise complex problems and propose practical, controlled solutions for production environments Strong problem-solving, analytical and troubleshooting skills across application, infrastructure and batch processing issues Excellent verbal and written communication skills, with ability to work effectively across technology, infrastructure and business stakeholders Experience working as part ...

microservices, APIs, cloud-native design). AI & Data Platform Architecture/Deployment: Architect robust, secure AI and data platforms that support real-time inference, batch processing, and scalable enterprise workloads, integrating with clients' incumbent technology estates. Implement hybrid-cloud and multi-cloud strategies using modern data infrastructure (Kafka ...

Full-Stack Engineers across various seniority levels. You will design and deliver secure, scalable and resilient financial technology solutions, developing Java services, APIs and batch-processing applications while contributing to modern Angular frontends. What you'll do: Build backend services, microservices, APIs and batch applications using Java ...

Design and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systems Shape integration and data architecture patterns across APIs, messaging, batch, event-driven flows, canonical data models and enterprise data platforms Facilitate architecture, solution design and requirements workshops with business and technology stakeholders Advise clients … Endur architecture, configuration principles and application deployment models Strong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerations Proven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environments ...

supporting end users with reporting, analytics, and data-related queries. Ability to investigate and resolve data anomalies and unexpected reporting results. Experience monitoring BW batch processing and service performance. Exposure to enterprise reporting, data integration, and business intelligence platforms. Experience working across cross-functional teams to deliver business ...

payment gateways, document management), data platforms, digital front ends, and third‐party services. Define messaging/event‐driven integrations, API‐first architecture, batch vs real‐time processing strategies and secure, reliable, scalable integration patterns. Define data models, data flows and governance standards; guide data migration and conversion strategies … Architecture Design integrations with external systems, data platforms, digital front ends, and third‐party services. Define API‐first architecture, messaging/event‐driven integrations, batch vs real‐time processing strategies. Ensure secure, reliable, scalable integration patterns. Data & Technology Architecture Define data models, data flows and governance standards. Guide ...

modern engineering and platform standards. Duties and Responsibilities Lead technical analysis, solution design and hands‐on development of applications, services, APIs, event‐driven components, batch processes and platform‐aligned capabilities. Act as a C#/.NET SME, setting engineering direction and ensuring solutions are clean, maintainable, testable and aligned … event‐driven solutions using appropriate messaging patterns including publish/subscribe, competing consumers, retries, dead‐letter handling, schema/version management and effectively‐once processing where required. Use AI‐enabled engineering tooling responsibly to improve delivery productivity, including integrated agentic coding assistants, prompt engineering, code review support and, where ...

several of our products Minimum Qualifications: Extensive experience in Python (or another object-oriented language). Experience building reliable, distributed applications for Data Processing or similar areas. Experience with SumoSushi Flow orchestration is strongly preferred Working with RPC protocols such as gRPC/protobuf. Preferred Qualifications: 5+ years … working in a fast-paced environment, collaborating across teams and disciplines. Experience designing, deploying, and maintaining distributed systems. Data pipelines, data platforms, workflow orchestration, batch processing. WHAT WE OFFER We are committed to creating a modern work environment that supports our employees and their loved ones. We offer many ...

offers the chance to shape the future-state data platform for a large, complex financial services organisation. The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction. The Company They … Databricks-based medallion architecture, with a strong focus on a robust Gold layer for analytics. Improve data availability by shifting from monthly batch processes towards more frequent or streaming ingestion where appropriate. Act as the senior technical decision-maker on data use cases, prioritisation, and trade-offs. Work closely ...