Data Engineer - £350PD - Remote
- Hiring Organisation
- Tenth Revolution Group
- Location
- London, South East, England, United Kingdom
- Employment Type
- Contractor
- Contract Rate
- £300 - £350 per day
reconciliation checks Strong error handling, monitoring, and retry strategies in production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations … performance considerations AWS Lambda for scalable data processing and orchestration Amazon EventBridge for event-driven and decoupled data pipelines Vector Databases & Embeddings Strong understanding of vector database concepts, indexing strategies, and performance trade-offs Design and implementation of embedding generation pipelines Optimization techniques for semantic search and retrieval ...