1 to 25 of 34 Batch Processing Jobs in the UK

Senior Data Engineer

Hiring Organisation
Winsearch
Location
Bristol, Avon, South West, United Kingdom
Employment Type
Contract
Contract Rate
£68 per hour
analytics capabilities across complex secure systems. The successful candidate will play a key role in architecting resilient data platforms, optimising real-time and batch processing pipelines, and ensuring compliance with strict governance and security standards. KEY RESPONSIBILITIES Data Architecture & Engineering - Design and implement scalable, resilient data pipeline architectures … using Elastic Stack and Apache NiFi - Develop secure frameworks for data ingestion, transformation and integration - Build and maintain batch and real-time data processing pipelines - Ensure high standards of data quality, integrity and traceability across all systems Elastic Stack & Platform Management - Configure, optimise and maintain Elasticsearch clusters ...

Mainframe Automation & Batch Analyst

Hiring Organisation
Exalto Consulting ltd
Location
Bradford, West Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent
Mainframe Automation & Batch Scheduling Analyst 18-24 months FTC Hybrid (Bradford, West Yorkshire, 2 days onsite in Bradford per week) Exalto Consulting is working with a well established UK retail business to appoint an experienced Automation & Batch Scheduling Analyst . This organisation operates large scale, business critical systems … where reliable processing and system stability are essential to day to day operations. This is a hands on technical role focused on maintaining and improving the automation and batch environments that sit at the heart of core services. You will join a team responsible for ensuring systems ...

Software Developer

Hiring Organisation
Experis
Location
City of London, London, United Kingdom
Employment Type
Permanent
Salary
£48000/annum
Design Implement enterprise-level features such as: Dependency Injection/Inversion of Control (IoC) Aspect-Oriented Programming (AOP) Functional programming patterns Transaction management frameworks Batch processing solutions Participate in systems design and architecture discussions Support systems integration across enterprise platforms and services DevOps & Delivery Apply DevOps methodologies …/JEE and web technologies Knowledge of: Dependency Injection (e.g., Spring) AOP and IoC Data access frameworks (e.g., Hibernate/JPA) Transaction management systems Batch processing frameworks Familiarity with DevOps tools and practices Understanding of: Information security principles System integration and APIs Modern software engineering standards Key Competencies ...

Contract Java Engineer Belfast Hybrid (Inside IR35, £550PD) JBLE1 NI

Hiring Organisation
Adepta Partners Limited
Location
Belfast, UK
help build modern cloud-based applications focused on real-time data and streaming technologies. The Role Youll be working across: Real-time streaming applications Batch processing systems Cloud-based data engineering solutions Modern Java development within a GCP environment This is a highly technical role suited to experienced … building scalable applications. Tech Stack Heavy Java focus Google Cloud Platform (GCP) - experience in other cloud platforms is considered Real-time data streaming Batch processing pipelines Contract Details £550 per day Inside IR35 Initial 6-month contract Belfast based Hybrid working 2 days per week onsite Skills: java ...

Senior Data Engineer (Informatica)

Hiring Organisation
Experis
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£400 - £460/day
experience AWS Azure Desirable Skills: Hands-on expertise in AWS & Spark: Amazon EMR, S3, Lambda; strong PySpark/Python and SQL for large-scale batch processing. Data engineering at scale in government or similarly complex domains, including performance tuning and data quality management. CI/CD & DevOps: pipelines ...

Data Engineer

Hiring Organisation
CBSbutler Holdings Limited trading as CBSbutler
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£400 - £429/day
modern data engineering principles. Desirable Skills Python and PySpark development. AWS services including EMR, S3, Lambda, Athena, and Redshift. Apache Spark and large-scale batch processing. Terraform, CI/CD pipelines, and Infrastructure as Code. Git/GitLab and modern software development practices. API integration and data services. Data ...

AWS Databricks Engineer

Hiring Organisation
Capgemini
Location
London Area, United Kingdom
noting that you will be unable to work at home 100% of the time. Your Role: Design, develop, and maintain scalable data pipelines and processing frameworks using Databricks, Python, and PySpark Build and optimize data workflows to support analytics, reporting, and operational needs Collaborate with cross-functional teams … data lakes and (optionally) Snowflake Your Skills: Strong hands-on experience with Databricks (must-have) Proficiency in Python and PySpark for large-scale data processing Solid understanding of data engineering fundamentals (ETL/ELT, batch processing, transformations) Proven experience building scalable and efficient data pipelines Exposure ...

OSS/BSS Solution architect

Hiring Organisation
IBU CONSULTING LTD
Location
London, United Kingdom
Employment Type
Contract
with observability frameworks (Prometheus, ElasticSearch , Grafana, OpenTelemetry ) for metrics, logs and traces Platform Technologies & BSS Vendor Platforms - Open source workflow engines (Temporal) - Stream/batch processing (Flink, Spark) - Test automation: Robot Framework and BDD - can review BDD robot files - BSS vendor platforms: Salesforce, Amdocs, Ciena - BSS/ ...

Business Analytics Lead

Hiring Organisation
DS SMITH PACKAGING LIMITED
Location
Sittingbourne, Kent, South East, United Kingdom
Employment Type
Permanent
priorities and ensuring high-quality delivery. Design, build, and maintain scalable OT-to-business data architectures and ingestion pipelines, supporting both real-time and batch processing. Integrate operational technology platforms, including AVEVA PI, with ERP, maintenance, quality, and other enterprise systems. Develop and maintain standardised, granular datasets and data ...

Mainframe Developer

Hiring Organisation
Avensys Consulting UK
Location
City of London, London, United Kingdom
Rate: 300 GBP Per Day Eight years of experience with Mainframe technologies including COBOL, CICS, JCL, DB2, and VSAM, with proven expertise in batch processing and online transaction processing (OLTP) environmen tsSolid experience in application support, with a good understanding of Incident and Problem Management processes, along ...

Lead Data Architect (DV Clearable) - Up to £130,000

Hiring Organisation
Sanderson Government and Defence
Location
London, United Kingdom
Employment Type
Permanent
leadership and mentorship to cross-functional data teams Define best practices across data architecture, cloud engineering, and security Design and oversee real-time and batch processing solutions, including streaming architectures Ensure compliance with government standards, security policies, and data regulations Monitor delivery against architectural designs and manage ...

Business Systems Analyst

Hiring Organisation
Acis Group
Location
Gainsborough, Lincolnshire, East Midlands, United Kingdom
Employment Type
Permanent
Salary
£40,000
Data analytical and reporting skills Experienced in creating technical and process documentation Demonstrable practical experience of at least some of the following: Data Manipulation, Batch Processing, case flow management Power BI, Power Automate, SQL, Microsoft Fabric, ETL/ELT Pipelines Housing Management and/or large database systems ...

Senior Oracle Developer

Hiring Organisation
Henderson Scott
Location
Glasgow, Lanarkshire, Scotland, United Kingdom
Employment Type
Contract
Contract Rate
£280.00 - £300.00 per day
Oracle Forms, Oracle Reports, Oracle APEX, ODI, or other Oracle development tools. * Experience with Unix/Linux scripting. * Experience with data migration, ETL, or batch processing. * Experience using source control tools such as Git, SVN, or similar. * Familiarity with Agile, Waterfall, or hybrid delivery methodologies. * Previous experience working ...

Data Engineer

Hiring Organisation
Halian Technology Limited
Location
South West London, London, United Kingdom
Employment Type
Permanent
Salary
£95,000
function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

Data Engineer

Hiring Organisation
Halian | Managed Services, Recruitment Agency & Contract Staffing
Location
London Area, United Kingdom
function, setting standards, mentoring engineers, and working closely with both internal teams and external delivery partners. The Role Data Engineering & Pipeline Development Transform legacy batch processes into scalable, observable data pipelines Build and deliver high-quality data products in line with architectural designs Work across modern cloud platforms including ...

Senior RF Data Scientist / Research Engineer

Hiring Organisation
Adria Solutions
Location
Cambridge, Cambridgeshire, England, United Kingdom
Employment Type
Full-Time
Salary
£80,000 - £110,000 per annum
company based near Cambridge, is seeking a Senior RF Data Scientist/Research Engineer to work at the intersection of RF hardware, digital signal processing, and machine learning. This hands-on R&D role involves analysing complex RF datasets, developing advanced signal-processing pipelines, and contributing to cutting … classify, and interpret RF signal features Building diagnostic RF analysis tools (time–frequency plots, cyclic spectra, EVM, autocorrelation, constellation tracking, etc.) Designing RF data-processing pipelines built around practical hardware constraints (bandwidth, ADC limits, gain stages, timing jitter) Modelling RF front-end behaviour (filters, mixers, LOs, AGC, noise figure ...

SITS Developer

Hiring Organisation
Click Digital
Location
Sheffield, Leeds, West Yorkshire, United Kingdom
Employment Type
Contract
Contract Rate
£550 - £650/day
projects. Knowledge of Azure, AWS or GCP environments would be an advantage. Oracle SQL/PLSQL and data modelling expertise. SITS configuration, workflows, security, batch processing, and role based access. Integration experience using StuTalk, APIs, middleware, and data feeds . Agile delivery experience within complex enterprise environments. Higher ...

Lead Mulesoft Developer

Hiring Organisation
Akkodis
Location
City of London, London, United Kingdom
Employment Type
Permanent
Salary
£65000 - £72000/annum
Role Design and deliver APIs using API-led connectivity (System, Process, Experience layers) Build complex integration solutions including event-driven architectures, orchestration, streaming, and batch processing Lead development on key projects, ensuring high-quality engineering standards Produce reusable assets, modules, and DataWeave transformations Contribute to API specifications (RAML ...

Senior ML Platform Engineer - Robotics

Hiring Organisation
Harnham - Data & Analytics Recruitment
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£500 - £750 per day
dataset publishing* Build and maintain FastAPI backends, vanilla JavaScript frontends, CLI tooling, and supporting services* Improve recording workflows, state machines, config validation, batch processing, stale-data recovery, and archival processes* Containerise and orchestrate services to ensure reliable deployment across machines and lab environments* Partner with ML engineers … pipelines, distributed systems, or performance-sensitive IO workloads* Experience orchestrating external CLI tools from Python via subprocess, ideally ffmpeg or similar data/media processing tools Nice to Have It would be useful to have: * Distributed ML training infrastructure experience, such as PyTorch DDP, FSDP, DeepSpeed, sharded datasets, streaming ...

Lead Technical Architect

Hiring Organisation
DWP Digital
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£95,000
join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

Lead Technical Architect

Hiring Organisation
DWP Digital
Location
Sheffield, South Yorkshire, Yorkshire, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£95,000
join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

Lead Technical Architect

Hiring Organisation
DWP Digital
Location
Manchester, North West, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£95,000
join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

Lead Technical Architect

Hiring Organisation
DWP Digital
Location
Newcastle Upon Tyne, Tyne and Wear, North East, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£95,000
join us. What skills, knowledge and experience will you need? Experience bringing together data from lots of different systems, including real-time and batch processing Strong understanding of ETL/ELT tools and how data is extracted, transformed and loaded into platforms Knowledge of data warehousing, data lakes … operate across the entire Data & Analytics architecture, focusing on assurance and coherence. Our data landscape can be thought of as layered - covering ingestion, storage, processing and consumption - but users experience seamless services end-to-end. Your role is to ensure those layers work together as a joined-up whole ...

Salesforce Engineer (Financial Services Cloud)

Hiring Organisation
Morson Edge
Location
City of London, London, United Kingdom
Employment Type
Contract
highly desirable. Strong capability across Salesforce Lightning, Flow automation, and security configuration is expected, along with familiarity in Apex development (including triggers and batch processing) and Lightning Web Components. Experience with Omnistudio (including Omniscripts, Flex Cards, DataRaptors, and Integration Procedures) will be highly advantageous, particularly in enterprise-scale ...

Oracle Developer

Hiring Organisation
Expleo Group
Location
Preston, Lancashire, North West, United Kingdom
Employment Type
Permanent
application incidents related to database logic, Oracle Forms, Reports, and WebLogic deployments. Conduct root cause analysis for recurring issues and implement permanent fixes. Support batch processes, scheduled jobs, and integration feeds to ensure business continuity. Work closely with business users to analyse defects and translate requirements into system enhancements. ...