4 of 4 Batch Processing Jobs in the South East

pipelines, and processes to support transparency and knowledge sharing. Contribute to the development of a modern data platform that supports both real-time and batch processing. Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built ...

based access, Microsoft Entra ID, conditional access, and PIM Performance tuning and non-functional requirements, including Dataverse capacity, query optimization, offline considerations, concurrency, and batch processing Familiarity with Copilot Studio (bots/agents), Azure OpenAI integrations, prompt safety, and data compliance Proficiency in Power BI architectural alignment (datasets ...

with enterprise data models for credit, counterparty, and exposure reporting. Strong understanding of integration design patterns (REST APIs, message queues, event-driven integration, ETL, batch processing). Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge Experience with industry-standard ...

engagement, offering flexibility and autonomy. Key Responsibilities Design and implement ETL/ELT pipelines with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database … solutions and embedding generation pipelines for semantic search. Implement document processing workflows (PDF parsing, OCR, metadata extraction). Integrate data from REST APIs , PIM systems, and potentially SAP. Ensure data quality, governance, and lineage tracking throughout the project. Required Skills ETL/ELT pipeline design and data validation frameworks. ...