3 of 3 Contract Amazon S3 Jobs in Central London

innovating with cutting-edge innovation and leadership? We're on the look out for a Senior Data Engineer who has experience in: AWS - S3 for storage, Lambda functions, Athena (thus strong SQL). Open to interchangable Azure experience. Databricks Python Devops experience a bonus e.g. Terraform, Drone, Kubernetes cluster ...

error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval ...

with strong error handling and retry logic. Develop incremental data processing patterns for large-scale datasets. Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge. Build and optimise vector database solutions and embedding generation pipelines for semantic search. Implement document processing workflows (PDF parsing ...