AWS Data Engineer

Data Engineer - 14-Week Contract (Outside IR35) Likely to Extend

Start Date: 12th January
Rate: £350 per day
Location: Remote (UK-based)
Interview: Immediate - Offer before Christmas

We are seeking an experienced Data Engineer to join a 14-week project focused on building robust data pipelines and integrating complex data sources. This is an outside IR35 engagement, offering flexibility and autonomy.

Key Responsibilities

• Design and implement ETL/ELT pipelines with strong error handling and retry logic.
• Develop incremental data processing patterns for large-scale datasets.
• Work with AWS services including Glue, Step Functions, S3, DynamoDB, Redshift, Lambda, and EventBridge.
• Build and optimise vector database solutions and embedding generation pipelines for semantic search.
• Implement document processing workflows (PDF parsing, OCR, metadata extraction).
• Integrate data from REST APIs, PIM systems, and potentially SAP.
• Ensure data quality, governance, and lineage tracking throughout the project.

Required Skills

• ETL/ELT pipeline design and data validation frameworks.
• Advanced Python (pandas, numpy, boto3) and SQL (complex queries, optimisation).
• Experience with AWS Glue, Step Functions, and event-driven architectures.
• Knowledge of vector databases, embeddings, and semantic search strategies.
• Familiarity with document parsing libraries (PyPDF2, pdfplumber, Textract) and OCR tools.
• Understanding of data governance, schema validation, and master data management.
• Strong grasp of real-time vs batch processing trade-offs.

Beneficial Experience

• CockroachDB deployment and management.
• PySpark or similar for large-scale processing.
• SAP data structures and PIM systems.
• E-commerce and B2B data integration patterns.

Why Apply?

• Fully remote contract
• Outside IR35
• Competitive day rate
• Immediate interviews - secure your next role before Christmas