1 to 25 of 265 Batch Processing Jobs in England

collaboration, and high performance. Hold team members accountable for their performance and professional growth. Technical Expertise: Bring a deep understanding of data technologies, including batch processing, stream processing, storage, analytics, machine learning, and AI. Collaborate with Engineering teams to ensure the data platform meets technical requirements and … data-focused environment. Strong technical background and a degree in Computer Science, Engineering, or a related field. Hands-on experience with data technologies, including batch processing, stream processing, data warehousing, and analytics platforms. Proven track record of successfully leading product strategies that drive significant business outcomes. Experience … experience in mentoring and developing Product Managers. Ability to inspire and lead cross-functional teams toward common goals. Deep understanding of data architectures, data processing frameworks, and data modelling. Familiarity with technologies such as AWS and other cloud-based data services. Knowledge of data privacy laws and compliance requirements More ❯

and experience in analysis, design, and optimization of Oracle-Hyperion EPM products Knowledge and experience supporting and building integration methodologies using standard ETL for batch-oriented integration and real-time integration through ODI and windows batches and scheduling. Knowledge and experience in performance tuning and optimizations for data/… Design, Development, Testing and Production Support. Knowledge and experience in trouble shooting, maintaining and preparing technical documents and assisting training the clients. Knowledge of batch processing tools like Autosys Ability to work with customers and good communication skills. Desired Qualifications: Experience in Finance ERP Experience in Agile Methodology … and experience in analysis, design, and optimization of Oracle-Hyperion EPM products Knowledge and experience supporting and building integration methodologies using standard ETL for batch-oriented integration and real-time integration through ODI and windows batches and scheduling. Knowledge and experience in performance tuning and optimizations for data/ More ❯

of-concept to beta-product phase. You will have the opportunity to learn new techniques and algorithms at the cutting edge of Natural Language Processing (NLP), specifically in compensating for Large Language Model limitations. You will also have the opportunity to innovate and contribute to algorithm development. Dr G.A.McHale … team is led by someone with significant AI experience in bio-inspired architectures, reinforcement learning, expert systems, scheduling, meta-heuristics, robotics and natural language processing (including LLMs). We have recruited an experienced scientific computing developer with a strong mathematics background in theoretical physics, whose responsibilities relate to distributed … work includes hybrid-LLM system optimisation, and possible pre-filtering algorithms for reduced computational loads. Success amounts to significant improvements in the costs of batch processing and inference costs. About You This is a hands-on programming role. It is essential that you have some expertise in LLMs More ❯

agreed and documented administrative systems (for example re-sending faxes which have failed delivery) Running & monitoring (not building, but see Additional Responsibilities below) traditional batch schedules, including using automated tools such as Control/M, Visualcron etc. Running (not building, but see Additional Responsibilities below) weekend release jobs/… in addition to watching automatic building management alert systems) All other ad hoc activities reasonably required or expected to ensure smooth operation of the batch processing and datacentre operations as requested by the company under the supervision of an of a company Operations Coordinator Ensure security and access … and understand changes in market trends where these are relevant to the role. In addition the applicant would ideally possess: A proven background in batch processing and job scheduling. Experience of a job scheduling tool, particularly Control-M, would be an advantage as would experience of a Microfocus More ❯

stability, reliability, and compliance Support the implementation and configuration of new NEC modules including CA-SPA , Email Connect , and Integration Hub Manage and monitor batch processing routines , including those related to revenues recovery workflows Administer access controls, user provisioning, and permission audits Troubleshoot system issues and liaise with … and end users Key Skills & Experience: Strong experience supporting NEC Revenues (Northgate) systems within a local government or public sector setting Confident in handling batch processing, revenue reconciliation tasks, and system integration Familiarity with NEC modules such as CA-SPA , Email Connect , and Integration Hub Proven problem-solving More ❯

Technical Requirements: Multi-cloud expertise: AWS, Google Cloud, and Azure experience required Data infrastructure: Building data lakes, warehouses, and ETL pipelines Real-time + batch processing: Ingesting and processing data at scale Feature stores: Building and managing ML feature pipelines API architecture: Hybrid API design, load balancing … AWS, Google Cloud, AND Azure platforms Proven track record building data lakes, warehouses, and complex ETL systems Skilled in both real-time streaming and batch data processing at scale Experience with feature stores, hybrid API architectures, and load balancing Ready to work directly with customers during beta onboarding More ❯

with Big Data technologies, distributed systems, and cloud platforms . If you enjoy solving complex data challenges and working with large-scale streaming and batch processing systems, we want to hear from you! Key Responsibilities: Design and develop scalable, high-performance data processing applications using Scala. Build … in Computer Science Engineering, or a related field. 10+ years of experience in software development with Scala . Hands-on experience with Apache Spark (batch & streaming) using Scala. Experience in developing and maintaining data lake and warehouses using technologies like Databricks Delta Lake, Apache Iceberg, or Apache Hudi . … Experience working with open-source data formats JSON, Parquet, Avro , etc. Deep understanding of distributed computing and parallel processing . Experience working on cloud platforms (preferably AWS) and services like S3, EMR, Glue, Redshift, BigQuery . Proficiency in CI/CD pipelines, Docker, Kubernetes, and Terraform . Knowledge of More ❯

Development Train and fine‐tune Stable Diffusion checkpoints, LoRAs, and custom datasets at scale Design and maintain ComfyUI graphs and custom nodes for efficient batch generation Prototype new AI-video tooling leveraging image workflows as foundational blocks Automation & Tooling Author robust Python scripts and services to review, sort, tag … and organize huge quantities of images/day Implement multi‐processing, threading, and distributed batch pipelines for speed and reliability Build dashboard backends and lightweight frontends to monitor job status, results, and metrics Cloud Infrastructure & Architecture Help deploy, manage, and optimize GPU cloud instances Automate provisioning, scaling, and … practices, and mentor junior engineers as the team grows Required Qualifications 5+ years of hands‐on experience in Python automation and scripting (large‐scale batch processing) Deep familiarity with Stable Diffusion training/inference, LoRA methods, and checkpoint management Proven track record building and optimizing custom ComfyUI workflows More ❯

data from sources like Facebook, Google Analytics, and payment providers. Using tools like AWS Redshift, S3, and Kafka, you'll optimize data models for batch and real-time processing. Collaborating with stakeholders, you'll deliver actionable insights on player behavior and gaming analytics, enhancing experiences and driving revenue with … robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

systems development e.g. in a hedge fund or investment bank Expertise in building distributed systems with large data warehouses and both on-line and batch processing Experience of web-based development and visualisation technology for portraying large and complex data sets and relationships Substantial quant development engineering experience More ❯

C#/Java, microservices, containerization (Docker, OpenShift, Kubernetes), React, AWS, Terraform. Integration - Expertise in Real Time messaging (eg, AMQ), API design (JSON, Swagger), and batch processes. Infrastructure & Operations - DevOps practices, CI/CD pipelines, Git, Ansible, cloud elasticity, cost optimization, and grid computing. Delivery Approach: Deep familiarity with Agile More ❯

team at Pismo is responsible for integrating data produced by Pismo's Banking as a Service/Payments platform with its clients, whether through batch processing (files) or near real-time (events). With a robust, low-latency, and 100% cloud-based architecture, the team excels in technology … and resolving production incidents, while proactively implementing preventative measures. Build and optimize ETL/ELT processes to handle large-scale data, leveraging advanced data processing and distributed systems techniques. Maintain rigorous data governance and platform standards, working closely with data stakeholders to ensure consistent, high-quality data assets. Introduce … Minimum Qualifications Technical Skills: 4+ Years experience as a Data Engineer Strong experience of AWS Services (eg Lambda, Kinesis, SQS, Firehose, and S3) Stream Processing and Delivery: Kinesis, Confluent Cloud, Amazon SNS, SQS and Event Bridge. Monitoring Tools: Grafana and Cloudwatch. (Logs/tracing/spans/monitor/ More ❯

join wider cross-functional teams. You’ll have some experience building distributed systems both on-prem and in public cloud, CI/CD pipelines, batch compute tooling and developer productivity tooling. You will be excited and committed to providing an excellent developer experience, with a constant eye on continuous … Software Engineering teams, as well as providing the mechanism for discovering and consuming shared components. Including but not limited to: K8s configuration and usability, batch processing and HPC interactions and hybrid cloud deployments Stay informed on open source and 3rd party tooling that we should consider adopting rather … Exposure to the following would be beneficial: Developer portals and software catalogues Infrastructure-as-code tools such as Ansible or Terraform Experience in using batch compute frameworks, HPC tooling Company Description For almost 50 years, Williams Racing has been at the forefront of one of the fastest sports on More ❯

initiatives. Architect end-to-end data platforms using Dataproc, Dataflow, Pub/Sub, BigQuery, Cloud Spanner, and Bigtable. Define and implement real-time and batch processing pipelines for complex use cases involving streaming analytics, ML feature engineering, and automation. Act as a trusted advisor to senior technical and … Hands-on experience with orchestration tools like Apache Airflow or Cloud Composer. Hands-on experience with one or more of the following GCP data processing services: Dataflow (Apache Beam), Dataproc (Apache Spark/Hadoop), or Composer (Apache Airflow). Proficiency in at least one scripting/programming language (e.g. More ❯

initiatives. Architect end-to-end data platforms using Dataproc, Dataflow, Pub/Sub, BigQuery, Cloud Spanner, and Bigtable. Define and implement real-time and batch processing pipelines for complex use cases involving streaming analytics, ML feature engineering, and automation. Act as a trusted advisor to senior technical and … Hands-on experience with orchestration tools like Apache Airflow or Cloud Composer. Hands-on experience with one or more of the following GCP data processing services: Dataflow (Apache Beam), Dataproc (Apache Spark/Hadoop), or Composer (Apache Airflow). Proficiency in at least one scripting/programming language (e.g. More ❯

robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

robust ETL pipelines to integrate data from diverse sources, including APIs like Facebook, Google Analytics, and payment providers. Develop and optimize data models for batch processing and real-time streaming using tools like AWS Redshift, S3, and Kafka. Lead efforts in acquiring, storing, processing, and provisioning data More ❯

Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data modeling, warehousing, real-time and batch processing, and big data frameworks. Proficiency with modern data tools and technologies such as Spark, Databricks, Kafka, or Snowflake (bonus). Knowledge of More ❯

in Java , Spark , Scala ( or Java) Production scale hands-on Experience to write Data pipelines using Spark/any other distributed real time/batch processing. Strong skill set in SQL/Databases Strong understanding of Messaging tech like Kafka, Solace , MQ etc. Writing production scale applications to use More ❯

across Product, Data, and Engineering to translate strategic goals into platform capabilities. Lead and mentor 1-2 squads responsible for experimentation, analytics event logging, batch data platform, real-time infrastructure, data observability and governance. Collaborate closely with stakeholders to define and drive the technical roadmap for Depop's modern … and modern data ecosystems - including experience with Databrick, Apache Spark, Apache Kafka and DBT. Demonstrated success in managing data platforms at scale, including both batch processing and real-time streaming architectures. Deep understanding of data warehousing concepts, ETL/ELT processes, and analytics engineering. Strong programming skills, particularly More ❯

working closely with squad members and stakeholders. Handle data in multiple formats (structured, semi-structured, and unstructured) and manage data at various latencies - from batch processing to real-time streaming. Collaborate cross-functionally across the business to enable self-service analytics and innovation through well-organised and accessible … architectures (e.g., data lakes, data vaults, data warehouses). Experience in working with Agile frameworks such as Scrum, Kanban, Lean. Experience with distributed data processing platforms such as Databricks. Understanding of data modelling and architectures (e.g. data vaults, data warehousing, data lakes etc.) Version control and best practices using More ❯

working closely with squad members and stakeholders. Handle data in multiple formats (structured, semi-structured, and unstructured) and manage data at various latencies – from batch processing to real-time streaming. Collaborate cross-functionally across the business to enable self-service analytics and innovation through well-organised and accessible … architectures (e.g., data lakes, data vaults, data warehouses). Experience in working with Agile frameworks such as Scrum, Kanban, Lean. Experience with distributed data processing platforms such as Databricks. Understanding of data modelling and architectures (e.g. data vaults, data warehousing, data lakes etc.) Version control and best practices using More ❯

and fault-tolerant systems, broad knowledge of software engineering and site reliability engineering in areas such as Large-Scale Data and Compute Infrastructure, Stream Processing, Kubernetes, High-Performance Networking, Observability and Infrastructure Automation. RESPONSIBILITIES Set the technology strategy for our cloud infrastructure, factoring in the AD/ADAS cloud … TO HAVES Master’s degree in Computer Science. Experience working as a Software Engineer on data-intensive applications, data platforms, data pipelines, workflow orchestration, batch processing, and/or distributed databases. Previous experience in monitoring, tracking and optimising cloud compute and storage costs Experience working with RPC protocols More ❯

AWS API Gateway and Lambda Functions (Python) for the internal web application. The individual will be able to demonstrate a strong background in backend batch processing (ETL) using Python and SQL skills. Whilst having good knowledge developing web applications using ReactJS/Python. Our technology team uses the More ❯