1 to 25 of 50 Batch Processing Jobs in London

stability.**Technical Responsibilities*** Monitor and support applications, infrastructure, databases, middleware, integrations, and cloud services across hybrid environments.* Triage application, database, server, network, middleware, integration, batch-processing, and cloud-service issues.* Support controlled deployments, validation, environment readiness, and production release activities.* Automate support, deployment, validation, monitoring, and documentation activities … using approved DevOps and scripting tools.* Analyze SQL and Oracle data, logs, APIs, middleware, batch processing, and data pipelines to restore service and support root-cause analysis.* Support operational readiness, backup, recovery, resiliency, availability, performance, and disaster-recovery activities.**Success Profile**To thrive in this role ...

within a complex enterprise landscape. Working as part of a hybrid team, you will play a key role in maintaining business-critical services, supporting batch processing activities, and driving continuous improvement across the application estate. Key Responsibilities Develop, maintain, and support Java-based applications. Investigate and resolve live … service incidents and production issues. Support and optimise batch processing activities. Deliver application enhancements through controlled release processes. Collaborate with development, testing, and support teams to ensure service stability. Contribute to documentation, testing, and continuous improvement initiatives. Essential Skills & Experience Strong experience developing and supporting Java applications. Solid ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

enterprise data, APIs and microservices. Ensure AI solutions integrate cleanly into cloud-native PaaS and SaaS environments, with robust approaches to real-time and batch processing where required. Establish best practices for prompt engineering, model selection, grounding, evaluation and guardrails across AI solutions. Lead AI and LLM proof … guardrails. Experience working with cloud environments and enterprise platforms, with Azure experience preferred, and an understanding of PaaS, SaaS, real-time and batch processing patterns. Familiarity with Docker, CI/CD, infrastructure approaches, MLOps, LLMOps, AIOps, observability, versioning and production operations would be advantageous. Strong understanding of responsible ...

requirements are met. Mainframe Engineering: Support IBM z/OS infrastructure and associated mainframe technologies. Work with JCL, TSO/ISPF, SDSF, CICS, and batch processing environments. Analyse system and application performance using available monitoring and diagnostic tools. Participate in disaster recovery testing and business continuity exercises. Collaborate … requirements. Mainframe Technologies: Extensive experience in IBM z/OS environments. Strong working knowledge of: JCL TSO/ISPF SDSF CICS VSAM RACF Mainframe batch processing Familiarity with system monitoring and diagnostic tools. Development & Engineering: Experience supporting applications developed in COBOL. Good understanding of relational database concepts ...

comfortable taking ownership of architecture, engineering standards and complex technical decisions. Responsibilities: Lead technical design and delivery across the full SDLC. Build reliable batch-processing services for market and historical data. Design durable, searchable data stores and publish trusted datasets downstream. Ensure risk outputs are traceable and reproducible. … operations and an on-call rota when required. Set engineering standards, review designs and drive technical decisions. Key Skills: Strong experience building data-intensive, batch-processing platforms, ideally using market or time-series data. Advanced Java 11+ development, with Java 17+ preferred. Strong Spring/Spring Boot experience. ...

This involves working across the data lake, reporting systems, and downstream feeds to ensure data integrity and smooth transitions. Key responsibilities include large-scale batch processing, meticulous data validation, and comprehensive regression testing. You will also be instrumental in preparing for migration readiness activities within a dynamic financial … processes are robust and reliable. Requirements Proven experience as a Data Engineer or Data Analyst, particularly within financial services. Strong background in large-scale batch processing and data validation. Experience with regression testing and migration readiness activities. Proficiency in data extraction, transformation, reconciliation, and validation. Excellent problem-solving ...

meticulous work across the data lake, reporting systems, and downstream feeds, ensuring data integrity and operational efficiency. Key responsibilities include engaging in large-scale batch processing, robust data validation, thorough regression testing, and preparing for migration readiness within a dynamic financial services environment. You will be instrumental … success of critical projects. Requirements Proven experience as a Data Engineer or Data Analyst, particularly within financial services. Strong background in large-scale batch processing and data validation. Familiarity with ledger migration activities, including data extraction, transformation, reconciliation, and validation. Ability to perform regression testing and support migration ...

involves working across the data lake, reporting systems, and various downstream feeds to ensure data integrity and system functionality. Key responsibilities include large-scale batch processing, meticulous data validation, comprehensive regression testing, and preparing for migration activities within a fast-paced financial services environment. You will be instrumental … Data Analyst, particularly in ledger migration projects. Strong understanding of data validation, regression testing, and data clean-up methodologies. Experience with large-scale batch processing within a financial services context. Proficiency in data extraction, transformation, and reconciliation techniques. Existing right-to-work in the UK is required; foreign ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows. Mandatory experience analysing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms. Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows Mandatory experience analyzing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

collaborate more effectively, work smarter, and produce high-quality research more efficiently.**Key responsibilities:*** Design, build, and maintain scalable data pipelines and services* Develop batch and ELT/ETL data workflows for ingesting and processing large datasets* Work with technologies such as Python, Java, Spark, SQL, and Airflow … Strong skills in Python and experience with at least one backend language (such as Java)* Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems* Experience building or operating data pipelines using tools like Spark and Airflow* Familiarity with cloud platforms (AWS preferred ...

learning techniques, including supervised ML, unsupervised ML, and LLMs Experience with deployment tools and processes, such as Azure Data Factory (ADF), Azure ML and batch processing Experience using DevOps or equivalent agile development environments 4+ years’ experience leading clients through complex technical projects — you know how to navigate ...

Experiment with open source tools Participate in community-building initiatives such as meetups Continuously learn and improve engineering practices What we’re looking for batch processing distributed data processing Experience with technologies such as: Kafka Flink Spark Databricks experience is a plus Experience implementing: Data Lakes ...

implementation of data quality, monitoring, observability, operational controls, and governance requirements. Lead the delivery of scalable data integration solutions across APIs, event‐driven architectures, batch processing, and file‐based integration patterns. Establish and govern engineering practices including CI/CD, automated testing, version control, infrastructure‐as‐code ...

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

cutting edge What we’re looking for Software & Data Engineering Strong expertise in Python Passion for writing: clean reliable production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience ...

native technologies, and applying robust software engineering practices. Key Responsibilities Design, develop, and optimise scalable, testable data pipelines using Python and Apache Spark. Implement batch workflows and ETL processes adhering to modern engineering standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such as Glue, EMR Serverless … experience writing clean, maintainable Python code, ideally using type hints, linters, and test frameworks such as pytest. Solid understanding of data engineering fundamentals including batch processing, schema evolution, and ETL pipeline development. Experience with—or strong interest in learning—Apache Spark for large-scale data processing. Familiarity with ...

with performance or load testing tools (JMeter, Gatling). Familiarity with Kubernetes, Terraform, or Infrastructure as Code. Exposure to data validation, ETL pipelines, or batch processing systems. At the company, we believe diverse perspectives lead to better outcomes, and inclusion creates the conditions for everyone to thrive. ...

complex enterprise application landscapes undergoing legacy transformation. You will focus on shaping scalable, resilient, secure, and governable architectures that progressively move monolithic, tightly coupled, batch-oriented systems toward modular, event-driven, cloud-enabled and operationally observable platforms. The role requires strong hands‐on architecture depth across application modernization, integration … modernization, distributed systems, integration platforms, database ecosystems, cloud-enabled platforms, and regulated enterprise environments. Strong ability to assess monolithic, tightly coupled, database-centric and batch-driven estates and translate findings into practical target-state architecture and migration roadmaps. Deep understanding of microservices architecture, domain-driven design, service decomposition, database ...

placement, policy, claims, exposure, bordereaux, and risk analytics. Strong knowledge of data integration patterns including ETL/ELT, APIs, event-driven architecture, and batch processing. Experience with modern cloud-based data platforms and distributed data architectures. Experience with both relational and non-relational data platforms , including exposure to MongoDB ...

Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise in data warehousing concepts, advanced ETL/ELT processes, and analytics engineering best practices. Exceptional programming ...

Guidewire xCenters (version 10.x & Cloud/SaaS) customization and integration (Intra and Inter system integration) using REST and SOAP APIs. Technical Skills: Experience with batch processes, Guidewire Messaging framework and OOTB plugins; familiarity with infra concepts and deployment architecture (WMB, WAS and Apache); strong knowledge of software architecture ...

experience of developing complex solutions in a corporate environment. Solid understanding of working with production codebases, such as version control, CI/CD, and batch processing. Practical experience working on cloud-based ML platforms. Development and coaching A strong awareness and understanding of technology trends and direction in Data ...