1 to 25 of 66 Batch Processing Jobs in London

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management:Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing:Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality:Ensure code quality through code ...

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management: Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing: Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality: Ensure code quality through code ...

/Servlets) Dependency injection, IoC, AOP Functional programming concepts Test‐driven development (TDD) Data access frameworks (JPA/Hibernate or similar) Transaction management Batch processing concepts API development and integration DevOps practices (CI/CD, automation, Git‐based workflows) Debugging and problem‐solving Communication and collaboration skills Ability … functionality and user experience. Knowledge of Functional Programming: Exposure to applying functional programming principles, improving code efficiency and scalability in application development. Familiarity with Batch Processing: Exposure to batch processing frameworks and tools, ensuring efficient data processing and system integration. IBM is committed to creating ...

Posted 11/06/2026 Design, develop, test, deploy, and maintain scalable ETL/ELT pipelines for structured and unstructured data. Build batch and real-time processing solutions using BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services. Develop data-processing components and integrations … transformation frameworks supporting full, incremental, and event-driven loads. Design data models and optimize BigQuery tables through partitioning, clustering, efficient SQL, and cost-aware processing patterns. Produce high-level and low-level technical designs, document assumptions, and contribute to architecture reviews. Implement data-quality checks, schema validation, reconciliation, audit ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

Description We are seeking an experienced Java Developer to join our team. This role requires experience in Java development, AWS, database management, and batch processing. As a Java Developer, you will contribute to designing, developing, and maintaining applications that meet business needs. Key Responsibilities Design and develop scalable Java … deploy cloud-based solutions, supporting availability and scalability Design, implement, and maintain database schemas, write SQL queries, and improve performance Develop and maintain batch processing systems to handle large volumes of data Maintain code quality through reviews, testing, and adherence to standards Work with cross-functional teams including ...

infrastructure team. You will be responsible for the design and management of our AWS environment, ensuring high availability through robust networking, scalable data processing pipelines (ETL/ELT), and secure API management. You will bridge the gap between infrastructure stability, automated deployment via GitHub Actions, and a seamless developer … scaling of API Gateways and serverless functions to ensure reliable service delivery. Data Engineering Support: Design and maintain robust ETL/ELT pipelines and batch processing workflows to ensure seamless data flow across the platform. CI/CD & Automation: Own and improve GitHub Workflows, automating deployments and reducing ...

enterprise data, APIs and microservices. Ensure AI solutions integrate cleanly into cloud-native PaaS and SaaS environments, with robust approaches to real-time and batch processing where required. Establish best practices for prompt engineering, model selection, grounding, evaluation and guardrails across AI solutions. Lead AI and LLM proof … guardrails. Experience working with cloud environments and enterprise platforms, with Azure experience preferred, and an understanding of PaaS, SaaS, real-time and batch processing patterns. Familiarity with Docker, CI/CD, infrastructure approaches, MLOps, LLMOps, AIOps, observability, versioning and production operations would be advantageous. Strong understanding of responsible ...

. Job DescriptionWe are seeking an experienced Java Developer to join our team. This role requires experience in Java development, AWS, database management, and batch processing. As a Java Developer, you will contribute to designing, developing, and maintaining applications that meet business needs. Key ResponsibilitiesDesign and develop scalable Java … build and deploy cloud-based solutions, supporting availability and scalabilityDesign, implement, and maintain database schemas, write SQL queries, and improve performanceDevelop and maintain batch processing systems to handle large volumes of dataMaintain code quality through reviews, testing, and adherence to standardsWork with cross-functional teams including product managers ...

tuning, monitoring, and troubleshooting.· Administer and support Integration Broker, gateways, web services, and APIs.· Collaborate with functional teams, developers, and DBAs to resolve application, batch processing, search, and integration issues.· Support production releases, system monitoring, incident response, root cause analysis, and operational improvements.· Develop and maintain automation solutions … WebLogic, Tuxedo and JDK environments.· Support single sign-on (SSO), SSL certificates, and security integrations.· Assist with vulnerability management and infrastructure planning.· Optimize PeopleSoft batch processing, Application Engine programs, Process Scheduler performance, and reporting workloads.· Troubleshoot database performance issues impacting PeopleSoft online and batch operations.Performance Tuning & Optimization ...

functional experience supporting & configuring JDE EnterpriseOne 9.2, particularly Sales & Distribution modules - ideally 3 years' experience. Sales Order Management: Hands-on experience supporting sales order processing, order management workflows and associated Order-to-Cash processes. Distribution Management: Strong knowledge of JDE Pricing, Sales Order Management & Address Book functionality. JDE Functional … Configuration: Experience configuring & maintaining JDE application processing options, batch processes & UBE jobs. EDI Integration: Experience supporting Electronic Data Interchange (EDI) transactions, sales order integrations & customer/supplier interfaces - ideally 1 year's experience Business Analysis: Requirements gathering, process mapping, functional specifications & translating business needs into system solutions. Production ...

quality, integration, and unit testing Understanding of CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch processing and ETL/ELT Basic understanding of various data architectures, such as Lakes and Warehouses Knowledge of data cleansing and transformation within ...

Experiment with open source tools Participate in community-building initiatives such as meetups Continuously learn and improve engineering practices What we’re looking for batch processing distributed data processing Experience with technologies such as: Kafka Flink Spark Databricks experience is a plus Experience implementing: Data Lakes ...

build the services and infrastructure behind portfolio risk and analytics calculations. You’ll turn analytical models into reliable production services, building APIs, cloud processing and workflows that connect portfolio data with calculation engines and deliver results to existing systems. There is also scope to provide hands‐on technical leadership … across the wider team. The role Build Python APIs and calculation services. Develop cloud-based processing for scheduled batch and on‐demand jobs. Implement containers, orchestration and queues, with robust retries and recovery. Integrate SQL data sources and downstream systems, ensuring accurate, traceable inputs and outputs. Build deployment ...

looking for an experienced Mainframe Automation Engineer with strong CA7 expertise to support their client environments. You will take responsibility for maintaining and improving batch schedules, investigating production issues and developing automation that reduces manual intervention. This is a hands-on technical role for somebody who understands complex mainframe … workloads and the importance of reliable, timely processing. Key Responsibilities Create, maintain and amend CA7 job definitions, schedules, calendars, triggers and dependencies. Monitor batch processing, investigate failed or delayed jobs and resolve issues affecting production schedules. Develop and maintain automation to improve workload management, reduce repetitive tasks ...

data platforms—particularly Snowflake—covering performance, workload management, security, access controls, cost governance, multi-environment deployment, data sharing, replication and disaster recovery. Define scalable batch, real-time, event-driven, API, orchestration and ELT/ETL integration patterns using modern data integration technologies. Establish standards for analytics engineering … Experience with BigQuery, Databricks, Synapse, Redshift or similar platforms is highly desirable. Expertise in scalable enterprise ELT/ETL, data integration, real-time and batch processing, event-driven systems, APIs and orchestration patterns. Experience with Fivetran, Workato, Boomi, Airbyte or similar integration platforms. Ability to evaluate technology options ...

understanding of dimensional modelling, including Kimball-style fact tables, dimensions and slowly changing dimensions.Understanding of enterprise integration patterns including APIs, messaging, event-driven integration, batch processing and secure file transfer.Experience implementing automated testing, CI/CD, source control using Azure DevOps and infrastructure-as-code practices.Strong understanding ...

dimensional modelling, including Kimball-style fact tables, dimensions and slowly changing dimensions. Understanding of enterprise integration patterns including APIs, messaging, event-driven integration, batch processing and secure file transfer. Experience implementing automated testing, CI/CD, source control using Azure DevOps and infrastructure-as-code practices. Strong understanding ...

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

Overview My client arelooking for an experienced Python & SQL Developer with strong hands‐on experience in developing, maintaining, and optimising applications and data‐processing solutions. The ideal candidate will have excellent Python programming skills, advanced SQL expertise, and practical experience working in Linux environments and with Apache Kafka. Strong … database performance issues. Work with relational databases to retrieve, transform, validate, and process large volumes of data. Develop and maintain scripts, automation tasks, and batch‐processing jobs in Linux environments. Work with Apache Kafka for event‐driven processing, data streaming, and message‐based integrations. Monitor application performance ...

engineering velocity.Key Responsibilities:Backend Microservices: Design, build, and maintain production-grade REST APIs and microservices using Java 21/25 and Spring Boot.Data Ingestion & Processing: Build resilient ETL and reconciliation services that ingest, validate, and deduplicate complex monthly datasets from multiple upstream sources into a unified data model.Data Modeling … expertise in relational databases (SQL), schema design, data indexing, transactions, and performance tuning (PostgreSQL, Oracle, or MySQL).Solid experience building data ingestion, transformation, or batch processing pipelines.Strong testing discipline: unit testing, integration testing, and mock frameworks (JUnit, Mockito, Testcontainers).Experience with modern DevOps pipelines (Git, Maven/Gradle ...

Overview My client arelooking for an experienced Python & SQL Developer with strong hands-on experience in developing, maintaining, and optimising applications and data-processing solutions. The ideal candidate will have excellent Python programming skills, advanced SQL expertise, and practical experience working in Linux environments and with Apache Kafka. Strong … database performance issues. Work with relational databases to retrieve, transform, validate, and process large volumes of data. Develop and maintain scripts, automation tasks, and batch-processing jobs in Linux environments. Work with Apache Kafka for event-driven processing, data streaming, and message-based integrations. Monitor application performance ...

learning techniques, including supervised ML, unsupervised ML, and LLMs Experience with deployment tools and processes, such as Azure Data Factory (ADF), Azure ML and batch processing Experience using DevOps or equivalent agile development environments 4+ years’ experience leading clients through complex technical projects — you know how to navigate ...

native technologies, and applying robust software engineering practices. Key Responsibilities Design, develop, and optimise scalable, testable data pipelines using Python and Apache Spark. Implement batch workflows and ETL processes adhering to modern engineering standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such as Glue, EMR Serverless … experience writing clean, maintainable Python code, ideally using type hints, linters, and test frameworks such as pytest. Solid understanding of data engineering fundamentals including batch processing, schema evolution, and ETL pipeline development. Experience with—or strong interest in learning—Apache Spark for large-scale data processing. Familiarity with ...

cutting edge What we’re looking for Software & Data Engineering Strong expertise in Python Passion for writing: clean reliable production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience ...