26 to 50 of 109 Batch Processing Jobs in the UK

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

details, including source-to-target data mappings, message and file transformations, system-to-system interactions, interface contracts, validation rules, exception paths, and processing logic. The analyst will help a non-technical Product Owner convert business outcomes and priorities into technically precise requirements that engineering teams can design, build … source-to-target mappings, field-level specifications, message structures, and validation requirements. Document end-to-end system interactions, including upstream and downstream dependencies, interfaces, processing sequences, handoffs, exception scenarios, and operational impacts. Review existing application behavior, technical documentation, schemas, specifications, logs, and, where necessary, pseudo code or logic representations ...

methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills … ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What youll do Orchestrate the ingestion, processing, and storage of raw data within structured and unstructured data repositories. Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable ...

methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills … ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What you’ll do Orchestrate the ingestion, processing, and storage of raw data within structured and unstructured data repositories. Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable ...

cutting edge What we’re looking for Software & Data Engineering Strong expertise in Python Passion for writing: clean reliable production-grade code Distributed Data Processing Experience building and operating: batch processing systems distributed data systems near real-time streaming pipelines Familiarity with: Kafka Flink Spark Databricks experience ...

Experience with AWS Glue Experience deploying Python‐based data engineering workloads into production environments Experience automating data workflows using cloud‐native services Understanding of batch processing, scheduling, and scalable data solutions Experience within insurance, financial services, or another data‐intensive industry What Success Looks Like In this role ...

fast-paced environmentPreferred skillsExperience with AWS GlueExperience deploying Python-based data engineering workloads into production environmentsExperience automating data workflows using cloud-native servicesUnderstanding of batch processing, scheduling, and scalable data solutionsExperience within insurance, financial services, or another data-intensive industryWhat success looks likeIn this role, success ...

native technologies, and applying robust software engineering practices. Key Responsibilities Design, develop, and optimise scalable, testable data pipelines using Python and Apache Spark. Implement batch workflows and ETL processes adhering to modern engineering standards. Develop Cloud-Based Workflows Orchestrate data workflows using AWS services such as Glue, EMR Serverless … experience writing clean, maintainable Python code, ideally using type hints, linters, and test frameworks such as pytest. Solid understanding of data engineering fundamentals including batch processing, schema evolution, and ETL pipeline development. Experience with—or strong interest in learning—Apache Spark for large-scale data processing. Familiarity with ...

with performance or load testing tools (JMeter, Gatling). Familiarity with Kubernetes, Terraform, or Infrastructure as Code. Exposure to data validation, ETL pipelines, or batch processing systems. At the company, we believe diverse perspectives lead to better outcomes, and inclusion creates the conditions for everyone to thrive. ...

Experience with AWS Glue Experience deploying Python-based data engineering workloads into production environments Experience automating data workflows using cloud-native services Understanding of batch processing, scheduling, and scalable data solutions Experience within insurance, financial services, or another data-intensive industry What success looks like In this role ...

national GP clinical research datasets. The role focuses on maintaining and improving a mature on‐premises SQL Server 2019 environment responsible for ingesting and processing high‐volume clinical data used in real‐world research. This role requires strong hands‐on SQL Server and SSIS experience. … engineering role. The position is script‐heavy and database‐centric, involving significant T‐SQL development, ETL scripting, SSIS package maintenance, and large‐scale data processing across very large databases. Key Responsibilities SQL Server ETL Development Develop and maintain T‐SQL based ETL pipelines running on SQL Server 2019. Data ...

complex enterprise application landscapes undergoing legacy transformation. You will focus on shaping scalable, resilient, secure, and governable architectures that progressively move monolithic, tightly coupled, batch-oriented systems toward modular, event-driven, cloud-enabled and operationally observable platforms. The role requires strong hands‐on architecture depth across application modernization, integration … modernization, distributed systems, integration platforms, database ecosystems, cloud-enabled platforms, and regulated enterprise environments. Strong ability to assess monolithic, tightly coupled, database-centric and batch-driven estates and translate findings into practical target-state architecture and migration roadmaps. Deep understanding of microservices architecture, domain-driven design, service decomposition, database ...

placement, policy, claims, exposure, bordereaux, and risk analytics. Strong knowledge of data integration patterns including ETL/ELT, APIs, event-driven architecture, and batch processing. Experience with modern cloud-based data platforms and distributed data architectures. Experience with both relational and non-relational data platforms , including exposure to MongoDB ...

transformation technologies such as Liquid templates and XSLT for data manipulation. Design, document, and build integration solutions using a variety of approaches including APIs, batch processes, and flat-file exchanges. Integrate core business applications across multiple business domains, spanning on premises systems and SaaS platforms. Lead data mapping ...

production and non‐production environments on an ongoing basis. Cloud & Application Operations Proactively monitor infrastructure and application health — including CPU, memory, file systems, databases, batch jobs, and network performance — and respond swiftly to anomalies. Identify and resolve operational issues including infrastructure failures, batch processing errors, network disruptions ...

Databricks, Apache Spark, Apache Kafka, Apache Flink, Apache Beam and DBT. Demonstrated success in designing, building, and operating data platforms at scale, encompassing both batch processing and real-time streaming architectures. Expertise in data warehousing concepts, advanced ETL/ELT processes, and analytics engineering best practices. Exceptional programming ...

degree in Computer Science, Electrical Engineering or a related field, or equivalent practical experience. Experience with AWS or GCP, Kubernetes, SQL warehouse and batch-processing technologies such as Trino, Presto or Spark, Kafka or other streaming systems, and Go or Python would be useful. Node.js experience ...

continued success of a high‐revenue, mission‐critical client. What you’ll do Act as the overall technical architect for the VisionPLUS card processing platform and its integrations Serve as the primary senior technical contact for client, handling complex queries, escalations, and design discussions Lead major incident management, including … deep‐dive diagnostics, cross‐team coordination, and root‐cause analysis. Provide hands‐on support for critical production issues across online and batch processing Design and govern distributed‐to‐mainframe integrations, including APIs and middleware. Review and approve technical changes, enhancements, and release plans to ensure system stability Mentor ...

supporting and enhancing a suite of internal applications within a complex enterprise environment. You'll play a key role in maintaining live services, supporting batch processing, and delivering high-quality enhancements while ensuring system stability and performance. This is an excellent opportunity for someone who enjoys balancing production ...

Execution Execute and coordinate testing for: Monitoring and alert validation Alert simulation and escalation testing Backup and restore validation Failover and disaster recovery testing Batch processing and restart validation Stability and soak testing Operational support procedures Security and access validation Environment verification Defect & Evidence Management Produce comprehensive operational ...

Guidewire xCenters (version 10.x & Cloud/SaaS) customization and integration (Intra and Inter system integration) using REST and SOAP APIs. Technical Skills: Experience with batch processes, Guidewire Messaging framework and OOTB plugins; familiarity with infra concepts and deployment architecture (WMB, WAS and Apache); strong knowledge of software architecture ...

experience of developing complex solutions in a corporate environment. Solid understanding of working with production codebases, such as version control, CI/CD, and batch processing. Practical experience working on cloud-based ML platforms. Development and coaching A strong awareness and understanding of technology trends and direction in Data ...

client inquiries in a timely and professional manner in support superior customer experience model Install my clients software products on site or remotely Use batch processes to integrate products into client processes Use software application programming to integrate products into client systems as needed Technical Support Consultants Must have … years commercial experience Arabic Speaker Experience with SQL databases and SQL programming language Experience of Application support or Implementation Experience with scripting, batch processing, data file manipulation, or Web services Knowledge of data management concepts, data analytics, data quality, data integration, business intelligence, CRM, Report Writer, or similar ...

Design and oversee integration approaches between Endur and surrounding applications, data platforms and enterprise systems Shape integration and data architecture patterns across APIs, messaging, batch, event-driven flows, canonical data models and enterprise data platforms Facilitate architecture, solution design and requirements workshops with business and technology stakeholders Advise clients … Endur architecture, configuration principles and application deployment models Strong understanding of Endur technical components, including JVS/OpenComponents, Connex or equivalent integration mechanisms, reporting, batch processing, environment strategy, upgrade impacts and performance considerations Proven capability designing integrations between Endur and surrounding enterprise applications, data platforms and reporting environments ...

trading activities. Take full ownership of data products, guiding them from initial concept through to stable production. Design, build, and maintain systems for both batch processing and real-time streaming of time series datasets, ensuring high data quality and reliability. Develop APIs and data access methods for fast … databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW's processing activities and our use of job applicants' data, please view our Privacy Notice at https://drw.com/privacy-notice #J-18808-Ljbffr ...