1 to 25 of 33 Batch Processing Jobs in London

Data Platform, Technical components, and Data Engg. related activities for supporting the key capabilities o Technical Data Architecture o Data Ingestion framework ( Batch/Micro Batch processing ) o Data Contract & Data management( including DQ, metadata & lineage) o Delivery, Scaling & Op Model • Discovery/assessment along with … integration points and any design considerations/framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/technical requirements for both batch and micro-batch processing. • Define the E2E Data architecture framework Required skills: Should have strong experience ...

Data Platform, Technical components, and Data Engg. related activities for supporting the key capabilities o Technical Data Architecture o Data Ingestion framework ( Batch/Micro Batch processing ) o Data Contract & Data management( including DQ, metadata & lineage) o Delivery, Scaling & Op Model • Discovery/assessment along with … integration points and any design considerations/framework and patterns for the data factory as per the need for TSA and Non-TSA batch business/technical requirements for both batch and micro-batch processing. • Define the E2E Data architecture framework Required skills: Should have strong experience ...

means of enabling the technical thought leadership and excellence required for the purpose. Your responsibilities: Design, build, and optimise scalable data pipelines for batch and streaming workloads Develop and manage dataflows, and semantic models to support specific analytics related business requirements Implement complex transformations, aggregations, and joins ensuring performance … Azure Cloud Platform Experience of programming under Microsoft Fabric Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric ...

means of enabling the technical thought leadership and excellence required for the purpose. Your responsibilities: Design, build, and optimise scalable data pipelines for batch and streaming workloads Develop and manage dataflows, and semantic models to support specific analytics related business requirements Implement complex transformations, aggregations, and joins ensuring performance … Azure Cloud Platform Experience of programming under Microsoft Fabric Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric ...

means of enabling the technical thought leadership and excellence required for the purpose. Your responsibilities: Design, build, and optimise scalable data pipelines for batch and streaming workloads Develop and manage dataflows, and semantic models to support specific analytics related business requirements Implement complex transformations, aggregations, and joins ensuring performance … Azure Cloud Platform Experience of programming under Microsoft Fabric Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, Data Frames, and Spark SQL Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric ...

/experience: Experience of programming under Microsoft Azure Cloud Platform Have knowledge of Spark Programming Ability to write Spark code for large scale data processing, including RDDs, DataFrames, and Spark SQL Hands-on experience with lakehouses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time … collaborative mindset to work with and manage stakeholders Experience of programming under Microsoft Fabric Platform Python/Notebook programming PySpark programming Spark Streaming/batch processing Delta table Optimization Fabric Spark jobs Java programming language, OOP knowledge Database knowledge, including Relational Database and Non-SQL database. Experience ...

target mappings and define data architecture. Re-engineer manual data flows to enable scalability and reusability. Support the build of data streaming and batch processing systems. Write ETL (extract, transform, load) scripts and code to ensure optimal ETL performance. Develop reusable business intelligence reports and dashboards. Build accessible ...

target mappings and define data architecture. Re-engineer manual data flows to enable scalability and reusability. Support the build of data streaming and batch processing systems. Write ETL (extract, transform, load) scripts and code to ensure optimal ETL performance. Develop reusable business intelligence reports and dashboards. Build accessible ...

Role: Oracle Batch Developer Location: UK Remote but occasional client site visits in either Newcastle or Manchester Duration: 6 Months Day rate: £510 Umbrella Only Candidates are required to have been a UK resident for a minimum of 5 years About the Role We are seeking an experienced Oracle … Batch Developer to support a major Government department operating a highly integrated, mission-critical Oracle 19c OLTP environment . This role supports backend workloads that underpin essential business processes across multiple government departments and local authorities. You will play a key role in maintaining, optimising, and modernising the batch ...

pipelines, and processes to support transparency and knowledge sharing. Contribute to the development of a modern data platform that supports both real-time and batch processing. ...

pipelines, and processes to support transparency and knowledge sharing. Contribute to the development of a modern data platform that supports both real-time and batch processing. ...

pipelines, and processes to support transparency and knowledge sharing. Contribute to the development of a modern data platform that supports both real-time and batch processing. Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built ...

Bring Strong experience in .NET backend development Knowledge of data modelling, performance tuning, SQL/NoSQL Experience with data pipelines, streaming, or batch processing Familiarity with CI/CD, automated testing, and version control Passion for data, analytics, and AI-driven problem solving Nice to Have: Cloud … Azure), Kafka/gRPC, React, Infrastructure as Code, ML/data processing experience Why Join? Work on greenfield data and AI initiatives Build scalable systems for millions of transactions Influence product and architecture decisions Join a rapidly growing company with ambitious plans ...

Bring Strong experience in .NET backend development Knowledge of data modelling, performance tuning, SQL/NoSQL Experience with data pipelines, streaming, or batch processing Familiarity with CI/CD, automated testing, and version control Passion for data, analytics, and AI-driven problem solving Nice to Have: Cloud … Azure), Kafka/gRPC, React, Infrastructure as Code, ML/data processing experience Why Join? Work on greenfield data and AI initiatives Build scalable systems for millions of transactions Influence product and architecture decisions Join a rapidly growing company with ambitious plans ...

target mappings and define data architecture. Re-engineer manual data flows to enable scalability and reusability. Support the build of data streaming and batch processing systems. Write ETL (extract, transform, load) scripts and code to ensure optimal ETL performance. Develop reusable Business Intelligence reports and dashboards. Build accessible ...

target mappings and define data architecture. Re-engineer manual data flows to enable scalability and reusability. Support the build of data streaming and batch processing systems. Write ETL (extract, transform, load) scripts and code to ensure optimal ETL performance. Develop reusable Business Intelligence reports and dashboards. Build accessible ...

heavy. Prior experience in securities lending is helpful but not essential. Responsibilities: • Develop and maintain Python-based data pipelines, with a primary focus on batch processing. • Integrate external vendor data sources (e.g., EquiLend Spire, Marex, Euroclear) and standardise inbound datasets. • Deliver production-ready data flows and reporting for trading ...

with enterprise data models for credit, counterparty, and exposure reporting. Strong understanding of integration design patterns (REST APIs, message queues, event-driven integration, ETL, batch processing). Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge: Experience with industry-standard ...

with enterprise data models for credit, counterparty, and exposure reporting. Strong understanding of integration design patterns (REST APIs, message queues, event-driven integration, ETL, batch processing). Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge: Experience with industry-standard ...

with enterprise data models for credit, counterparty, and exposure reporting. Strong understanding of integration design patterns (REST APIs, message queues, event-driven integration, ETL, batch processing). Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge Experience with industry-standard ...

with enterprise data models for credit, counterparty, and exposure reporting. Strong understanding of integration design patterns (REST APIs, message queues, event-driven integration, ETL, batch processing). Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge Experience with industry-standard ...

engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database … solutions and embedding generation pipelines for semantic search. Implement document processing workflows (PDF parsing, OCR, metadata extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. ...

engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database … solutions and embedding generation pipelines for semantic search. Implement document processing workflows (PDF parsing, OCR, metadata extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. ...

Guidewire customization and integrations (intra-system and inter-system). Expertise in REST and SOAP APIs for system integration. Technical Skills Experience with batch processing, Guidewire Messaging Framework, and OOTB plugins. Familiarity with infrastructure and deployment architectures (WMB, WAS, Apache). Strong understanding of software architecture and design ...

Guidewire xCenters (version 10.x & Cloud) customization and integration (Intra and Inter system integration) using REST and SOAP APIs Technical Skills: o Experience with batch processes, Guidewire Messaging framework, and OOTB plugins o Familiarity with Infra concepts and deployment architecture (WMB, WAS, and Apache) o Strong knowledge on Software architecture ...