2 of 2 Batch Processing Jobs in South London

to support LLM-based querying, semantic search, and metadata retrieval. Integrate structured (SQL-based) and unstructured (documents, reports) data sources for real-time and batch processing. Maintain and troubleshoot Airflow pipelines for embedding extraction and document processing. Ensure data governance, security, and compliance across all applications. Manage Vector Database More ❯

use of associated tools and applications to complete these tasks. Ability to travel to client site, where required, will be a consideration. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native … or custom programming. Knowledge of data mining, machine learning, natural language processing is an advantage. You enjoy working within cross-functional Agile teams and you are familiar with Scrum ceremonies. Youll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that … AWS best practices. Your AWS experience spans data engineering, data science and product development projects, plus you will have an understanding of stream and batch processing. Sound interesting? Apply now! Skills: AWS Data engineer Benefits: Annual Bonus/13th Cheque hybrid pension Medical Aid/Health Care More ❯