1 to 25 of 56 Batch Processing Jobs in London

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … deploy cloud-based solutions, ensuring high availability and scalability.Database Management: Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance.Batch Processing: Develop and manage batch processing systems to handle large volumes of data efficiently.Code Quality: Ensure code quality through code reviews, unit testing ...

business analysis and production support groups, ensuring platform improvements translate into stronger production stability, better compute utilisation, more reliable lower-lane execution, improved batch observability, data quality controls, disciplined regression and release processes, and sustained adoption of agreed engineering changes.Role Description:This is a critical technical platform leadership role … Risk and FRTB Standardised Approach.This is not a programme management, advisory or coordination role. You should be technically credible, able to understand platform architecture, batch execution, data flows, dependencies, production failure modes, hardware utilisation, computation cost and engineering trade-offs, and capable of challenging technical assumptions.We require an execution ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data.Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark.Orchestration & Workflow: Build automated data ...

requirements are met. Mainframe Engineering: Support IBM z/OS infrastructure and associated mainframe technologies. Work with JCL, TSO/ISPF, SDSF, CICS, and batch processing environments. Analyse system and application performance using available monitoring and diagnostic tools. Participate in disaster recovery testing and business continuity exercises. Collaborate … requirements. Mainframe Technologies: Extensive experience in IBM z/OS environments. Strong working knowledge of: JCL TSO/ISPF SDSF CICS VSAM RACF Mainframe batch processing Familiarity with system monitoring and diagnostic tools. Development & Engineering: Experience supporting applications developed in COBOL. Good understanding of relational database concepts ...

About The Role FDM is a global business and technology consultancy seeking a DevOps Engineer (Batch Monitoring) to work for our client within the Banking & Financial Services sector. This is initially a 12 month contract with the potential to extend and will be a hybrid role that will … management, platform stability, automation, and continuous improvement to ensure key reporting processes are delivered reliably and efficiently. Responsibilities Monitor the health and performance of batch processing, applications, infrastructure, and data pipelines across the SFRC platform Perform first line incident management, root cause analysis, and operational troubleshooting activities Coordinate ...

Documents, functional and technical specifications, acceptance criteria, current- and future-state process mapping. Requirements elicitation through workshops and stakeholder interviews. Ability to specify interfaces, batch processing, file‐based feeds and data mapping between ALS, core banking and treasury systems. SQL and RDBMS concepts, sufficient to validate your … upgrade and enhancement initiatives. Technical analysis Prepare detailed functional and technical specifications for development. Analyse system interfaces and data flows. Work with developers on batch processing, file‐based interfaces, integrations, and data mapping and transformation. Support solution design discussions and release activity through to production. What we offer ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows. Mandatory experience analysing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms. Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

understanding of market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows.Mandatory experience analysing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms.Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows. Mandatory experience analysing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms. Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

implementation of data quality, monitoring, observability, operational controls, and governance requirements. Lead the delivery of scalable data integration solutions across APIs, event-driven architectures, batch processing, and file-based integration patterns. Establish and govern engineering practices including CI/CD, automated testing, version control, infrastructure-as-code ...

implementation of data quality, monitoring, observability, operational controls, and governance requirements. Lead the delivery of scalable data integration solutions across APIs, event‐driven architectures, batch processing, and file‐based integration patterns. Establish and govern engineering practices including CI/CD, automated testing, version control, infrastructure‐as‐code ...

them to collaborate more effectively, work smarter, and produce high-quality research more efficiently.Key responsibilities:Design, build, and maintain scalable data pipelines and servicesDevelop batch and ELT/ETL data workflows for ingesting and processing large datasetsWork with technologies such as Python, Java, Spark, SQL, and AirflowApply good … systemsStrong skills in Python and experience with at least one backend language (such as Java)Understanding of data engineering concepts such as data lakes, batch processing, and distributed systemsExperience building or operating data pipelines using tools like Spark and AirflowFamiliarity with cloud platforms (AWS preferred) and production monitoringClear ...

data into analytics repositories or feature stores, guaranteeing that AI models have consistent, well-prepared data to work with. This includes setting up stream processing for real-time data when required and automating pipeline orchestration for efficiency.Data Governance & Quality: Establish and enforce data governance policies and standards. This means … custom scripting with Python/SQL) to gather and transform data. You should understand how to optimise data flow and have experience with batch processing; experience with real-time streaming data (e.g. using Kafka or equivalent) is a plus.Ontologies & Knowledge Graphs: Exposure to semantic data modelling, ontologies ...

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

cutting edge What we’re looking for Software & Data Engineering Strong expertise in Python Passion for writing: clean reliable production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience ...

metadata-forward, CI/CD-driven platform represents and enables the entire application and analysis lifecycle including interactive development and explorations (notebooks), large-scale batch processing, observability and production application deployments. A Sr. Compute Platform Engineer is a leading technical contributor who can consistently take a poorly defined … business problems, Responsible for development of key components of a hybrid on-prem/cloud compute platform for both interactive and scalable batch computing and establishing of processes and workflows to transition existing HPC users and teams to this platform, Responsible for code-driven environment, applications, and container/ ...

solutions using APIs, ESB, Event-Driven Architecture, and Messaging platforms. Define integration patterns between banking applications and third-party systems. Architect real-time and batch processing solutions. Governance & Security Ensure architecture compliance with banking regulatory requirements. Define security architecture, authentication, authorization, and data protection strategies. Support audit, governance … DevOps & Automation CI/CD Pipelines GitHub Jenkins Terraform Infrastructure as Code Banking Domain Knowledge Required Must Have Experience In Core Banking Systems Payment Processing SWIFT Messaging SEPA/CHAPS/Faster Payments Open Banking PSD2 Regulations Basel Frameworks KYC & AML Processes Financial Crime Prevention Regulatory Reporting Required Qualifications ...

placement, policy, claims, exposure, bordereaux, and risk analytics. Strong knowledge of data integration patterns including ETL/ELT, APIs, event-driven architecture, and batch processing. Experience with modern cloud-based data platforms and distributed data architectures. Experience with both relational and non-relational data platforms , including exposure to MongoDB ...

transformation technologies such as Liquid templates and XSLT for data manipulation.• Design, document, and build integration solutions using a variety of approaches including APIs, batch processes, and flat-file exchanges.• Integrate core business applications across multiple business domains, spanning on premises systems and SaaS platforms.• Lead data mapping ...

consumers. You’ve built architectures that held up as they grew with a focus on data warehousing, data lakes, and both real-time and batch processing.Teams bring you their hardest data problems. You’ve made the hard tradeoffs in distributed, multi-tenant systems and lived with the consequences. ...

Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise in data warehousing concepts, advanced ETL/ELT processes, and analytics engineering best practices. Exceptional programming ...

Just Eat Takeaway.com is seeking a Senior Data Platform Engineer to join the Batch Data Tools team, advancing Mobius, our internal analytics platform. You will own batch processing components, work on a Kubernetes-native stack, and collaborate across teams to deliver scalable data products. The role requires ...

client inquiries in a timely and professional manner in support superior customer experience model • Install my clients software products on site or remotely • Use batch processes to integrate products into client processes • Use software application programming to integrate products into client systems as needed Technical Support Consultants Must have … years commercial experience • Arabic Speaker • Experience with SQL databases and SQL programming language • Experience of Application support or Implementation • Experience with scripting, batch processing, data file manipulation, or Web services • Knowledge of data management concepts, data analytics, data quality, data integration, business intelligence, CRM, Report Writer, or similar ...

support diverse trading activities.Take full ownership of data products, guiding them from initial concept through to stable production.Design, build, and maintain systems for both batch processing and real-time streaming of time series datasets, ensuring high data quality and reliability.Develop APIs and data access methods for fast, intuitive … relational databasesHave a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experienceFor more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at . California residents, please review the California Privacy Notice for information ...

trading activities. Take full ownership of data products, guiding them from initial concept through to stable production. Design, build, and maintain systems for both batch processing and real‐time streaming of time series datasets, ensuring high data quality and reliability. Develop APIs and data access methods for fast … databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW’s processing activities and our use of job applicants’ data, please view our Privacy Notice at https://drw.com/privacy-notice. California residents, please ...