1 to 25 of 103 Permanent Batch Processing Jobs in the UK

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management: Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing: Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality: Ensure code quality through code ...

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management: Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing: Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality: Ensure code quality through code ...

business analysis and production support groups, ensuring platform improvements translate into stronger production stability, better compute utilisation, more reliable lower-lane execution, improved batch observability, data quality controls, disciplined regression and release processes, and sustained adoption of agreed engineering changes. Role Description: This is a critical technical platform leadership … FRTB Standardised Approach. This is not a programme management, advisory or coordination role. You should be technically credible, able to understand platform architecture, batch execution, data flows, dependencies, production failure modes, hardware utilisation, computation cost and engineering trade-offs, and capable of challenging technical assumptions. We require an execution ...

stability.**Technical Responsibilities*** Monitor and support applications, infrastructure, databases, middleware, integrations, and cloud services across hybrid environments.* Triage application, database, server, network, middleware, integration, batch-processing, and cloud-service issues.* Support controlled deployments, validation, environment readiness, and production release activities.* Automate support, deployment, validation, monitoring, and documentation activities … using approved DevOps and scripting tools.* Analyze SQL and Oracle data, logs, APIs, middleware, batch processing, and data pipelines to restore service and support root-cause analysis.* Support operational readiness, backup, recovery, resiliency, availability, performance, and disaster-recovery activities.**Success Profile**To thrive in this role ...

within a complex enterprise landscape. Working as part of a hybrid team, you will play a key role in maintaining business-critical services, supporting batch processing activities, and driving continuous improvement across the application estate. Key Responsibilities Develop, maintain, and support Java-based applications. Investigate and resolve live … service incidents and production issues. Support and optimise batch processing activities. Deliver application enhancements through controlled release processes. Collaborate with development, testing, and support teams to ensure service stability. Contribute to documentation, testing, and continuous improvement initiatives. Essential Skills & Experience Strong experience developing and supporting Java applications. Solid ...

Support containerized service delivery and operational readiness using Kubernetes, and contribute to CI/CD pipelines and automation Build and support scheduled and background processing (e.g., scheduled jobs and batch processing such as Spring Batch) where applicable to platform capabilities Support operational stability and reliability … hands-on experience with CI/CD pipelines (e.g., Jenkins) and containerized deployment and operations using Kubernetes Experience building and supporting scheduled jobs and batch processing workloads (e.g., Spring Batch or equivalent patterns) Working knowledge of search/indexing concepts, including designing and querying Elasticsearch indexes Hands ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

enterprise data, APIs and microservices. Ensure AI solutions integrate cleanly into cloud-native PaaS and SaaS environments, with robust approaches to real-time and batch processing where required. Establish best practices for prompt engineering, model selection, grounding, evaluation and guardrails across AI solutions. Lead AI and LLM proof … guardrails. Experience working with cloud environments and enterprise platforms, with Azure experience preferred, and an understanding of PaaS, SaaS, real-time and batch processing patterns. Familiarity with Docker, CI/CD, infrastructure approaches, MLOps, LLMOps, AIOps, observability, versioning and production operations would be advantageous. Strong understanding of responsible ...

This involves working across the data lake, reporting systems, and downstream feeds to ensure data integrity and smooth transitions. Key responsibilities include large-scale batch processing, meticulous data validation, and comprehensive regression testing. You will also be instrumental in preparing for migration readiness activities within a dynamic financial … processes are robust and reliable. Requirements Proven experience as a Data Engineer or Data Analyst, particularly within financial services. Strong background in large-scale batch processing and data validation. Experience with regression testing and migration readiness activities. Proficiency in data extraction, transformation, reconciliation, and validation. Excellent problem-solving ...

meticulous work across the data lake, reporting systems, and downstream feeds, ensuring data integrity and operational efficiency. Key responsibilities include engaging in large-scale batch processing, robust data validation, thorough regression testing, and preparing for migration readiness within a dynamic financial services environment. You will be instrumental … success of critical projects. Requirements Proven experience as a Data Engineer or Data Analyst, particularly within financial services. Strong background in large-scale batch processing and data validation. Familiarity with ledger migration activities, including data extraction, transformation, reconciliation, and validation. Ability to perform regression testing and support migration ...

involves working across the data lake, reporting systems, and various downstream feeds to ensure data integrity and system functionality. Key responsibilities include large-scale batch processing, meticulous data validation, comprehensive regression testing, and preparing for migration activities within a fast-paced financial services environment. You will be instrumental … Data Analyst, particularly in ledger migration projects. Strong understanding of data validation, regression testing, and data clean-up methodologies. Experience with large-scale batch processing within a financial services context. Proficiency in data extraction, transformation, and reconciliation techniques. Existing right-to-work in the UK is required; foreign ...

data Lakehouse solutions using Databricks, Snowflake, and cloud-native servicesDesign high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloadsEstablish best practices for data governance, lineage, security, metadata management, and platform observabilityBuild and optimise analytical platforms capable of processing large ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows. Mandatory experience analysing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms. Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

surfaces (website, mobile app, and customer communications), and drive GenAI, Analytical, and DSML initiatives at petabyte scale. Our team builds and maintains: Streaming and batch data platforms that unlock data across Tripadvisor ETL pipelines and data models serving terabytes and growing datasets in Snowflake, BigQuery, and Hive, Orchestration, scheduling … integrity, validation, documentation, and governance. Platform & Software Engineering Write production Java and Python code across our evolving platform stack — from data ingestion and event processing to REST services and internal tooling. Build and maintain streaming and batch processing systems (Flink, Spark, Kafka) that power real‐time ...

market data, reference data, pricing data, data quality, data lineage, data controls, and integration workflows Mandatory experience analyzing and documenting data pipelines, APIs, batch processes, event-driven workflows, databases, file-based interfaces, or cloud-based data platforms Ability to write clear functional specifications, data mappings, user stories, acceptance criteria ...

collaborate more effectively, work smarter, and produce high-quality research more efficiently.**Key responsibilities:*** Design, build, and maintain scalable data pipelines and services* Develop batch and ELT/ETL data workflows for ingesting and processing large datasets* Work with technologies such as Python, Java, Spark, SQL, and Airflow … Strong skills in Python and experience with at least one backend language (such as Java)* Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems* Experience building or operating data pipelines using tools like Spark and Airflow* Familiarity with cloud platforms (AWS preferred ...

learning techniques, including supervised ML, unsupervised ML, and LLMs Experience with deployment tools and processes, such as Azure Data Factory (ADF), Azure ML and batch processing Experience using DevOps or equivalent agile development environments 4+ years’ experience leading clients through complex technical projects — you know how to navigate ...

Experiment with open source tools Participate in community-building initiatives such as meetups Continuously learn and improve engineering practices What we’re looking for batch processing distributed data processing Experience with technologies such as: Kafka Flink Spark Databricks experience is a plus Experience implementing: Data Lakes ...

collaborate more effectively, work smarter, and produce high-quality research more efficiently. Key responsibilities: Design, build, and maintain scalable data pipelines and servicesDevelop batch and ELT/ETL data workflows for ingesting and processing large datasetsWork with technologies such as Python, Java, Spark, SQL, and AirflowApply good software … systemsStrong skills in Python and experience with at least one backend language (such as Java)Understanding of data engineering concepts such as data lakes, batch processing, and distributed systemsExperience building or operating data pipelines using tools like Spark and AirflowFamiliarity with cloud platforms (AWS preferred) and production monitoringClear ...

implementation of data quality, monitoring, observability, operational controls, and governance requirements. Lead the delivery of scalable data integration solutions across APIs, event‐driven architectures, batch processing, and file‐based integration patterns. Establish and govern engineering practices including CI/CD, automated testing, version control, infrastructure‐as‐code ...

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

details, including source-to-target data mappings, message and file transformations, system-to-system interactions, interface contracts, validation rules, exception paths, and processing logic. The analyst will help a non-technical Product Owner convert business outcomes and priorities into technically precise requirements that engineering teams can design, build … source-to-target mappings, field-level specifications, message structures, and validation requirements. Document end-to-end system interactions, including upstream and downstream dependencies, interfaces, processing sequences, handoffs, exception scenarios, and operational impacts. Review existing application behavior, technical documentation, schemas, specifications, logs, and, where necessary, pseudo code or logic representations ...

methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills … ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What youll do Orchestrate the ingestion, processing, and storage of raw data within structured and unstructured data repositories. Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable ...

methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills … ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What you’ll do Orchestrate the ingestion, processing, and storage of raw data within structured and unstructured data repositories. Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable ...