1 to 25 of 34 Batch Processing Jobs in the UK

analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient data platforms, optimising real-time and batch processing pipelines, and ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures … using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards of data quality, integrity and traceability across all systems Elastic Stack & Platform Management - Configure, optimise and maintain Elasticsearch clusters ...

Mainframe Automation & Batch Scheduling Analyst 18-24 months FTC Hybrid (Bradford, West Yorkshire, 2 days onsite in Bradford per week) Exalto Consulting is working with a well established UK retail business to appoint an experienced Automation & Batch Scheduling Analyst . This organisation operates large scale, business critical systems … where reliable processing and system stability are essential to day to day operations. This is a hands on technical role focused on maintaining and improving the automation and batch environments that sit at the heart of core services. You will join a team responsible for ensuring systems ...

Design Implement enterprise-level features such as: Dependency Injection/Inversion of Control (IoC) Aspect-Oriented Programming (AOP) Functional programming patterns Transaction management frameworks Batch processing solutions Participate in systems design and architecture discussions Support systems integration across enterprise platforms and services DevOps & Delivery Apply DevOps methodologies …/JEE and web technologies Knowledge of: Dependency Injection (e.g., Spring) AOP and IoC Data access frameworks (e.g., Hibernate/JPA) Transaction management systems Batch processing frameworks Familiarity with DevOps tools and practices Understanding of: Information security principles System integration and APIs Modern software engineering standards Key Competencies ...

help build modern cloud-based applications focused on real-time data and streaming technologies. The Role Youll be working across: Real-time streaming applications Batch processing systems Cloud-based data engineering solutions Modern Java development within a GCP environment This is a highly technical role suited to experienced … building scalable applications. Tech Stack Heavy Java focus Google Cloud Platform (GCP) - experience in other cloud platforms is considered Real-time data streaming Batch processing pipelines Contract Details £550 per day Inside IR35 Initial 6-month contract Belfast based Hybrid working 2 days per week onsite Skills: java ...

experience AWS Azure Desirable Skills: Hands-on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large-scale batch processing. Data engineering at scale in government or similarly complex domains, including performance tuning and data quality management. CI/CD & DevOps: pipelines ...

modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab and modern software development practices. API integration and data services. Data ...

noting that you will be unable to work at home 100% of the time. Your Role: Design, develop, and maintain scalable data pipelines and processing frameworks using Databricks, Python, and PySpark Build and optimize data workflows to support analytics, reporting, and operational needs Collaborate with cross-functional teams … data lakes and (optionally) Snowflake Your Skills: Strong hands-on experience with Databricks (must-have) Proficiency in Python and PySpark for large-scale data processing Solid understanding of data engineering fundamentals (ETL/ELT, batch processing, transformations) Proven experience building scalable and efficient data pipelines Exposure ...

with observability frameworks (Prometheus, ElasticSearch , Grafana, OpenTelemetry ) for metrics, logs and traces Platform Technologies & BSS Vendor Platforms - Open source workflow engines (Temporal) - Stream/batch processing (Flink, Spark) - Test automation: Robot Framework and BDD - can review BDD robot files - BSS vendor platforms: Salesforce, Amdocs, Ciena - BSS/ ...

priorities and ensuring high-quality delivery. Design, build, and maintain scalable OT-to-business data architectures and ingestion pipelines, supporting both real-time and batch processing. Integrate operational technology platforms, including AVEVA PI, with ERP, maintenance, quality, and other enterprise systems. Develop and maintain standardised, granular datasets and data ...

Rate: 300 GBP Per Day Eight years of experience with Mainframe technologies including COBOL, CICS, JCL, DB2, and VSAM, with proven expertise in batch processing and online transaction processing (OLTP) environmen tsSolid experience in application support, with a good understanding of Incident and Problem Management processes, along ...

leadership and mentorship to cross-functional data teams Define best practices across data architecture, cloud engineering, and security Design and oversee real-time and batch processing solutions, including streaming architectures Ensure compliance with government standards, security policies, and data regulations Monitor delivery against architectural designs and manage ...

Data analytical and reporting skills Experienced in creating technical and process documentation Demonstrable practical experience of at least some of the following: Data Manipulation, Batch Processing, case flow management Power BI, Power Automate, SQL, Microsoft Fabric, ETL/ELT Pipelines Housing Management and/or large database systems ...

Oracle Forms, Oracle Reports, Oracle APEX, ODI, or other Oracle development tools. * Experience with Unix/Linux scripting. * Experience with data migration, ETL, or batch processing. * Experience using source control tools such as Git, SVN, or similar. * Familiarity with Agile, Waterfall, or hybrid delivery methodologies. * Previous experience working ...

function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

company based near Cambridge, is seeking a Senior RF Data Scientist/Research Engineer to work at the intersection of RF hardware, digital signal processing, and machine learning. This hands-on R&D role involves analysing complex RF datasets, developing advanced signal-processing pipelines, and contributing to cutting … classify, and interpret RF signal features Building diagnostic RF analysis tools (time–frequency plots, cyclic spectra, EVM, autocorrelation, constellation tracking, etc.) Designing RF data-processing pipelines built around practical hardware constraints (bandwidth, ADC limits, gain stages, timing jitter) Modelling RF front-end behaviour (filters, mixers, LOs, AGC, noise figure ...

projects. Knowledge of Azure, AWS or GCP environments would be an advantage. Oracle SQL/PLSQL and data modelling expertise. SITS configuration, workflows, security, batch processing, and role based access. Integration experience using StuTalk, APIs, middleware, and data feeds . Agile delivery experience within complex enterprise environments. Higher ...

Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

dataset publishing* Build and maintain FastAPI backends, vanilla JavaScript frontends, CLI tooling, and supporting services* Improve recording workflows, state machines, config validation, batch processing, stale-data recovery, and archival processes* Containerise and orchestrate services to ensure reliable deployment across machines and lab environments* Partner with ML engineers … pipelines, distributed systems, or performance-sensitive IO workloads* Experience orchestrating external CLI tools from Python via subprocess, ideally ffmpeg or similar data/media processing tools Nice to Have It would be useful to have: * Distributed ML training infrastructure experience, such as PyTorch DDP, FSDP, DeepSpeed, sharded datasets, streaming ...

join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

highly desirable. Strong capability across Salesforce Lightning, Flow automation, and security configuration is expected, along with familiarity in Apex development (including triggers and batch processing) and Lightning Web Components. Experience with Omnistudio (including Omniscripts, Flex Cards, DataRaptors, and Integration Procedures) will be highly advantageous, particularly in enterprise-scale ...

application incidents related to database logic, Oracle Forms, Reports, and WebLogic deployments. Conduct root cause analysis for recurring issues and implement permanent fixes. Support batch processes, scheduled jobs, and integration feeds to ensure business continuity. Work closely with business users to analyse defects and translate requirements into system enhancements. ...