AWS Senior Data Engineer (LDW Data Warehouse Discovery) - MUST HAVE SC CLEARANCE
- Hiring Organisation
- Octopus Computer Associates
- Location
- Telford, Shropshire, United Kingdom
- Employment Type
- Contract
- Contract Rate
- GBP Daily
reporting. Implement ETL/ELT Processes: Develop and Test Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses/Data Lakes/Lake Houses using Open Source and AWS tools. Adopt DevOps Practices: Utilise DevOps methodologies … experience with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets. Nice-to-have skills: Knowledge of Open Table Formats (Iceberg/Delta). AWS Tools: Experience with Amazon CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis. Data modelling Job scheduling/orchestration Data ...