1 to 25 of 96 Batch Processing Jobs in the UK

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management:Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing:Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality:Ensure code quality through code ...

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management: Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing: Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality: Ensure code quality through code ...

dynamic team. The ideal candidate will have a strong background in Java development, extensive experience with AWS, database management, and preferred work experience in batch processing. As a Senior Java Developer, you will play a crucial role in designing, developing, and maintaining high-performance applications that meet our business … cloud-based solutions, ensuring high availability and scalability. Database Management: Design, implement, and maintain database schemas, write complex SQL queries, and optimize database performance. Batch Processing: Develop and manage batch processing systems to handle large volumes of data efficiently. Code Quality: Ensure code quality through code ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

enterprise data platform. In this role, you will implement a modern data lakehouse architecture capable of supporting raw and curated data zones, scalable batch processing, and future analytical workloads. You will play a key role in integrating our existing data pipelines, models, and transformation logic into a unified … Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers) while securely handling identifiable data. Scalable Data Processing: Develop, tune, and monitor large-scale batch processing pipelines using Azure Databricks (Spark-based processing) and PySpark. Orchestration & Workflow: Build automated ...

data insights to non-technical stakeholders; Experience in developing and maintaining ETL (Extract, Transform, Load) processes; Experience with data pipelines and stream or micro-batch processing to convert real-time events to business intelligence data-points; Experience in creating insightful data visualizations, dashboards, and reports; Experience in analysing … similar. Experience with scripting languages like Python or R Experience with Apache Spark, Apache Flink, or other frameworks for stream or micro-batch processing #J-18808-Ljbffr ...

Description We are seeking an experienced Java Developer to join our team. This role requires experience in Java development, AWS, database management, and batch processing. As a Java Developer, you will contribute to designing, developing, and maintaining applications that meet business needs. Key Responsibilities Design and develop scalable Java … deploy cloud-based solutions, supporting availability and scalability Design, implement, and maintain database schemas, write SQL queries, and improve performance Develop and maintain batch processing systems to handle large volumes of data Maintain code quality through reviews, testing, and adherence to standards Work with cross-functional teams including ...

enterprise data, APIs and microservices. Ensure AI solutions integrate cleanly into cloud-native PaaS and SaaS environments, with robust approaches to real-time and batch processing where required. Establish best practices for prompt engineering, model selection, grounding, evaluation and guardrails across AI solutions. Lead AI and LLM proof … guardrails. Experience working with cloud environments and enterprise platforms, with Azure experience preferred, and an understanding of PaaS, SaaS, real-time and batch processing patterns. Familiarity with Docker, CI/CD, infrastructure approaches, MLOps, LLMOps, AIOps, observability, versioning and production operations would be advantageous. Strong understanding of responsible ...

functional experience supporting & configuring JDE EnterpriseOne 9.2, particularly Sales & Distribution modules - ideally 3 years' experience. Sales Order Management: Hands-on experience supporting sales order processing, order management workflows and associated Order-to-Cash processes. Distribution Management: Strong knowledge of JDE Pricing, Sales Order Management & Address Book functionality. JDE Functional … Configuration: Experience configuring & maintaining JDE application processing options, batch processes & UBE jobs. EDI Integration: Experience supporting Electronic Data Interchange (EDI) transactions, sales order integrations & customer/supplier interfaces - ideally 1 year's experience Business Analysis: Requirements gathering, process mapping, functional specifications & translating business needs into system solutions. Production ...

Applied AI. This is an influential position combining technical leadership, platform ownership and line management. Youll modernise the organisations data capabilities, introduce scalable batch and real-time processing, and eliminate manual or fragile processes through intelligent automation. Youll lead a small team of Data Engineers while remaining closely … reliability, security and evolution of the organisations data platform. Modernise an existing SQL Server, SSIS/SSDT and Power BI environment. Develop scalable batch and real-time data-processing capabilities. Lead the design of a Customer Data Platform. Build and evolve a modern AWS lakehouse architecture. Create governed ...

AI. This is an influential position combining technical leadership, platform ownership and line management. You’ll modernise the organisation’s data capabilities, introduce scalable batch and real-time processing, and eliminate manual or fragile processes through intelligent automation. You’ll lead a small team of Data Engineers while … reliability, security and evolution of the organisation’s data platform. Modernise an existing SQL Server, SSIS/SSDT and Power BI environment. Develop scalable batch and real-time data-processing capabilities. Lead the design of a Customer Data Platform. Build and evolve a modern AWS lakehouse architecture. Create ...

scalability are critical to service success. The role will support the development of a modern digital system that enables secure, reliable, and efficient processing and exchange of information between government services and external organisations, helping to provide customers with a seamless experience across digital and other service channels. … optimisation activities, including database query tuning and optimisation of application-level caching using existing framework capabilities. Oversee the design, monitoring, and optimisation of overnight batch jobs and high-volume transactional processing. Provide technical leadership, coaching, mentoring, and knowledge sharing across the engagement. Contribute to the Scrumconnect developer community ...

build the services and infrastructure behind portfolio risk and analytics calculations. You’ll turn analytical models into reliable production services, building APIs, cloud processing and workflows that connect portfolio data with calculation engines and deliver results to existing systems. There is also scope to provide hands‐on technical leadership … across the wider team. The role Build Python APIs and calculation services. Develop cloud-based processing for scheduled batch and on‐demand jobs. Implement containers, orchestration and queues, with robust retries and recovery. Integrate SQL data sources and downstream systems, ensuring accurate, traceable inputs and outputs. Build deployment ...

learning techniques, including supervised ML, unsupervised ML, and LLMs Experience with deployment tools and processes, such as Azure Data Factory (ADF), Azure ML and batch processing Experience using DevOps or equivalent agile development environments 4+ years’ experience leading clients through complex technical projects — you know how to navigate ...

quality, integration, and unit testing Understanding of CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch processing and ETL/ELT Basic understanding of various data architectures, such as Lakes and Warehouses Knowledge of data cleansing and transformation within ...

quality, integration, and unit testing Understanding of CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch processing and ETL/ELT Basic understanding of various data architectures, such as Lakes and Warehouses Knowledge of data cleansing and transformation within ...

quality, integration, and unit testing Understanding of CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch processing and ETL/ELT Basic understanding of various data architectures, such as Lakes and Warehouses Knowledge of data cleansing and transformation within ...

Experiment with open source tools Participate in community-building initiatives such as meetups Continuously learn and improve engineering practices What we’re looking for batch processing distributed data processing Experience with technologies such as: Kafka Flink Spark Databricks experience is a plus Experience implementing: Data Lakes ...

systems while preserving provenance and auditability. Build APIs and services that make processed data available to products, customers and AI systems. Develop workflows for batch processing, event-driven processing and long-running computational jobs. Create monitoring and alerting for pipeline failures, unexpected data changes and quality regressions. ...

data platforms—particularly Snowflake—covering performance, workload management, security, access controls, cost governance, multi-environment deployment, data sharing, replication and disaster recovery. Define scalable batch, real-time, event-driven, API, orchestration and ELT/ETL integration patterns using modern data integration technologies. Establish standards for analytics engineering … Experience with BigQuery, Databricks, Synapse, Redshift or similar platforms is highly desirable. Expertise in scalable enterprise ELT/ETL, data integration, real-time and batch processing, event-driven systems, APIs and orchestration patterns. Experience with Fivetran, Workato, Boomi, Airbyte or similar integration platforms. Ability to evaluate technology options ...

platform. Key Responsibilities Design, build and optimise AWS-native data pipelines and cloud data platform capabilities. Deliver ingestion solutions using CDC, event-driven and batch processing patterns. Build scalable ETL/ELT frameworks and reusable data products using Python and SQL. Support migration of data from a large ...

platform. Key Responsibilities Design, build and optimise AWS-native data pipelines and cloud data platform capabilities. Deliver ingestion solutions using CDC, event-driven and batch processing patterns. Build scalable ETL/ELT frameworks and reusable data products using Python and SQL. Support migration of data from a large ...

alongside data science colleagues, model versioning, automated retraining, and the monitoring that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena … domain-driven modelling), this is the load-bearing, provider-agnostic skill underneath almost all of our pipeline work Have strong Python and PySpark for batch processing, with production-grade, well-tested code. The bulk of this work is batch and ELT, but you’ll need to have ...

alongside data science colleagues, model versioning, automated retraining, and the monitoring that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena … domain-driven modelling), this is the load-bearing, provider-agnostic skill underneath almost all of our pipeline work Have strong Python and PySpark for batch processing, with production-grade, well-tested code. The bulk of this work is batch and ELT, but you’ll need to have ...

alongside data science colleagues, model versioning, automated retraining, and the monitoring that catches drift and degradation before a client does Build and maintain the batch and ELT pipelines the ML work sits on, using Python, PySpark, and cloud data services (e.g., AWS Glue, EMR, S3, Redshift, Athena … domain-driven modelling), this is the load-bearing, provider-agnostic skill underneath almost all of our pipeline work Have strong Python and PySpark for batch processing, with production-grade, well-tested code. The bulk of this work is batch and ELT, but you’ll need to have ...