26 to 50 of 91 Batch Processing Jobs in London

building scalable, reliable, highly available and fault-tolerant systems, broad knowledge of software engineering and site reliability engineering in areas such as Large-Scale Data and Compute Infrastructure, Stream Processing, Kubernetes, High-Performance Networking, Observability and Infrastructure Automation. RESPONSIBILITIES Set the technology strategy for our cloud infrastructure, factoring in the AD/ADAS cloud development needs and our cloud … to automate routine tasks. NICE TO HAVES Master’s degree in Computer Science. Experience working as a Software Engineer on data-intensive applications, data platforms, data pipelines, workflow orchestration, batch processing, and/or distributed databases. Previous experience in monitoring, tracking and optimising cloud compute and storage costs Experience working with RPC protocols and their formats, e.g., gRPC More ❯

with users or clients from technical or business backgrounds. Comfortable with presentations covering business, technical, or sales topics. Knowledge of project phasing, on-site delivery, systems support, operational procedures, batch processing, system sizing, capacity planning, backup, contingency, disaster recovery, and regional rollouts. Education & Qualifications A third-level qualification, ideally a technical bachelor's degree, is essential. Fluency in More ❯

from either a technical or business area. Comfortable making presentations covering business, technical or sales. Detailed knowledge of; Project phasing and reporting On-site delivery Systems support Operational procedures Batch processing System sizing and capacity planning System backup, contingency and disaster recovery Regional roll outs Education & Preferred Qualifications Third level qualification essential ideally a Technical Bachelors Degree. Fluency More ❯

Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation. Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation, and self-service analytics. Excellent leadership and More ❯

Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation, and self-service analytics. Excellent leadership and More ❯

Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation, and self-service analytics. Excellent leadership and More ❯

field Experience: Proven experience in ML model lifecycle management Core Competencies: Model lifecycle: You’ve got hands-on experience with managing the ML model lifecycle, including both online and batch processes Statistical Methodology: You have worked with GLMs and other machine learning algorithms and have in-depth knowledge of how they work Python: You have built and deployed production More ❯

Conduct descriptive and exploratory analysis to uncover patterns, trends, and potential applications across a wide range of datasets. Maintain robust and scalable data infra to support real-time and batch processing workflows. Provide domain expertise to help shape financial knowledge representation in LLM outputs. Develop and apply custom quality metrics to assess and guide model performance. Actively participate … Computer Science, Finance, Economics, Statistics, Engineering). 3+ years of professional experience in Data Science or Quantitative roles within finance. Proficiency in Python and SQL with exp. in data processing libraries such as pandas/numpy. Experience with machine learning frameworks and statistical analysis tools. Familiarity with financial data sources, APIs, and data modelling techniques. Ability to design, implement More ❯

Conduct descriptive and exploratory analysis to uncover patterns, trends, and potential applications across a wide range of datasets. Maintain robust and scalable data infra to support real-time and batch processing workflows. Provide domain expertise to help shape financial knowledge representation in LLM outputs. Develop and apply custom quality metrics to assess and guide model performance. Actively participate … Computer Science, Finance, Economics, Statistics, Engineering). 3+ years of professional experience in Data Science or Quantitative roles within finance. Proficiency in Python and SQL with exp. in data processing libraries such as pandas/numpy. Experience with machine learning frameworks and statistical analysis tools. Familiarity with financial data sources, APIs, and data modelling techniques. Ability to design, implement More ❯

EPM programming/development. Knowledge and experience in analysis, design, and optimization of Oracle-Hyperion EPM products Knowledge and experience supporting and building integration methodologies using standard ETL for batch-oriented integration and real-time integration through ODI and windows batches and scheduling. Knowledge and experience in performance tuning and optimizations for data/dimension loads, ESSBASE database restructuring … the entire SDLC from Requirements, Design, Development, Testing and Production Support. Knowledge and experience in trouble shooting, maintaining and preparing technical documents and assisting training the clients. Knowledge of batch processing tools like Autosys Ability to work with customers and good communication skills. Desired Qualifications: Experience in Finance ERP Experience in Agile Methodology Skills: Application Development Automation DevOps … EPM programming/development. Knowledge and experience in analysis, design, and optimization of Oracle-Hyperion EPM products Knowledge and experience supporting and building integration methodologies using standard ETL for batch-oriented integration and real-time integration through ODI and windows batches and scheduling. Knowledge and experience in performance tuning and optimizations for data/dimension loads, ESSBASE database restructuring More ❯

ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns. Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, handling data from third-party suppliers, supporting documentation, and supplying data to researchers—all while considering the unique domain knowledge of the client's business. As a More ❯

and review code, paired programming, and debugging code related performance issues, SQL tuning, etc. Experience with AWS services such as S3, RDS, Aurora, NoSQL, MSK (Kafka). Experience with batch processing/ETL using Glue Jobs, AWS Lambda, and Step functions. Experience with designing bespoke & tailored front-end solutions (GUI based) using open source technology such as React More ❯

a part of our Wellcreator development team. Duties & Responsibilities: Hands-on experience in developing applications using Java EE platforms, Spring Framework, Spring Boot, Hibernate, Java Swing, Java FX, JPA, Batch Processing, Java 8, or higher versions. Expertise in producing RESTful APIs and back-end services. Experience in agile development, GIT, or Maven. Familiarity with continuous integration and build More ❯

modelling, data access patterns, and efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security engineers to integrate security throughout More ❯

modelling, data access patterns, and efficient use of databases (MSSQL, PostgreSQL, MySQL). Work with data engineers to enable secure, efficient data movement between systems, including real-time and batch processing pipelines. Support analytics and reporting needs through the engineering of clean, reliable data sources and APIs. Security Engineering & Governance Partner with security engineers to integrate security throughout More ❯

for clients utilizing messaging standards (incl. FIX, SWIFT and custom XML formats) over MQ, APIs, SFTP, TCP/IP and other protocols. Typically solutions include a combination of messaging, batch processing and data transformation, and are commonly written in Python. This role can be performed in a hybrid model, where you can balance work from home and office More ❯

tools such as Visio. A good knowledge of financial products used in Asset Management including, Equities, Cash, Fixed Income and complex Swap instruments. Nice to have skills Knowledge of Batch processing Knowledge of Jira, Aha! and Confluence Ability to communicate, present, influence, reason and demonstrate the ability to articulate fund accounting concepts to non-fund accounting personnel in More ❯

quant researchers and engineers to enhance model performance, accuracy, and reliability. Conduct analysis to uncover patterns, trends, and applications across datasets. Maintain scalable data infrastructure for real-time and batch processing. Provide domain expertise to shape financial knowledge representation in LLM outputs. Develop and apply custom metrics to assess and guide model performance. Participate in development cycles, research discussions More ❯

join our team and help us achieve this goal. Key Responsibilities: Architect and design reference architectures and applications for various cloud hosting patterns, including message-driven, web applications, and batch processes. Mentor and guide other engineers, fostering continuous learning and improvement. Develop flexible and customizable solutions for advanced users. Enable rapid provisioning of cloud infrastructure, ensuring compliance and auditability. More ❯

scalability, and maintainability. Data Integration & Pipeline Engineering: Design and implement resilient ETL/ELT workflows using technologies such as BigQuery, Dataflow, Informatica, or IBM DataStage, supporting real-time and batch processing. Governance & Data Quality Management: Establish data governance frameworks, including metadata management and quality assurance, using platforms like Unity Catalog, Alation, Profisee, or DQ Pro. Strategic Advisory & Stakeholder Engagement More ❯

change and configuration management. Experience configuring and working with JBOSS Application Server 7. Knowledge of file transfer protocols and configuration, e.g., SFTP, FTP. Experience providing production support. Understanding of batch processing. Knowledge of enterprise scheduling tools, e.g., Control-M. Personal attributes Good analytical skills. A 'can-do' problem-solving approach. Ability to manage workload and switch between tasks, prioritizing More ❯

Month Contract Hybrid Working leading London Based Investment Bank You will: Design and build foundation components that will underpin our data mesh ecosystem. Build enterprise class real-time and batch solutions that support mission critical processes. Building solutions in line with our Digital Principles. Partner with our Product team(s) to create sustainable and resilient solutions. Your experience: Bachelor … more; Azure (preferred). Demonstrate hands-on engineering in large scale complex Enterprise(s), ideally in the banking/financial industry. Worked with modern tech '?? data streaming, real-time & batch processing and compute clusters. Working knowledge of relational and NoSQL databases, designing and implementing scalable solutions. Experience of working in continuous architecture environment, iterating and improving solutions including More ❯

a culture of continuous learning, collaboration, and high performance. Hold team members accountable for their performance and professional growth. Technical Expertise: Bring a deep understanding of data technologies, including batch processing, stream processing, storage, analytics, machine learning, and AI. Collaborate with Engineering teams to ensure the data platform meets technical requirements and supports product initiatives. Evaluate and … a product team in a data-focused environment. Strong technical background and a degree in Computer Science, Engineering, or a related field. Hands-on experience with data technologies, including batch processing, stream processing, data warehousing, and analytics platforms. Proven track record of successfully leading product strategies that drive significant business outcomes. Experience in managing complex product portfolios … Strong people management skills with experience in mentoring and developing Product Managers. Ability to inspire and lead cross-functional teams toward common goals. Deep understanding of data architectures, data processing frameworks, and data modelling. Familiarity with technologies such as AWS and other cloud-based data services. Knowledge of data privacy laws and compliance requirements (e.g., GDPR, CCPA). Deep More ❯

of back-office systems that provide services to traders, risk management, and accounting. Responsibilities: Work alongside other software engineers, risk management, accounting, and traders to provide real-time and batch processing of data. Generate daily reports for the firm and traders from overnight data. Design and use of database schemas to facilitate processing of data. Monitoring of … intraday position and trade data to risk management and traders. Requirements: Bachelor’s degree or higher in CS, Engineering, or other technical discipline. 2+ years professional experience developing data processing software. Demonstrated ability to program in Python, preferably in a Linux environment. Experience with SQL and database schema design. Experience with C# and C++ on Linux is a plus. More ❯

the implementation of the client's Cloud Native Big Data Analytics infrastructure layer. This infrastructure serves as the backbone for supporting AI/ML workflows, enabling real-time and batch processing for training and inference purposes. The typical data throughput involves analysis on continuous streams of Terabytes of data per hour. We are seeking candidates with the following … background: Software development experience, with extensive expertise in: Back-end data processing Data lakehouse architecture Hands-on experience with Big Data open-source technologies such as: Apache Airflow Apache Kafka Apache Pekko Apache Spark & Spark Structured Streaming Delta Lake AWS Athena Trino MongoDB AWS S3, MinIO S3 Proven successful hands-on experience in: Setting up data governance tooling and More ❯