AWS Senior Data Engineer (LDW Data Warehouse Discovery) - MUST HAVE SC CLEARANCE
AWS Senior Data Engineer (LDW Data Warehouse Discovery) - MUST HAVE SC CLEARANCE - Remote and Telford or Hove - 6 months+/RATE: £459 per day inside IR35
One of our Blue Chip Clients is urgently looking for an AWS Senior Data Engineer.
Hybrid role: requires attendance for occasional workshops (typically a couple of days per month) at one of our sites - Telford or Hove
Please find some details below:
Clearance Required: SC - holding SC with a governing body
Location: Hybrid role: requires attendance for occasional workshops (typically a couple of days per month) at one of our sites - Telford or Hove
Job Description:
This role involves migrating data from Legacy on-premise systems (primarily Oracle and Informatica) to a new AWS cloud-native architecture.
You will be part of an Agile software delivery team working closely with other engineers and supported by project managers, business analysts and architects. With additional client and key stakeholder interaction as required.
We are looking for strong AWS Senior Data Engineer who can design and deliver cloud transformation projects.
Your work will be to:
As part of a cloud transformation team, supporting the technical lead with design and client interactions, and supporting junior engineers with their development.
Design, Develop and Test Data Pipelines: Create robust pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.
Implement ETL/ELT Processes: Develop and Test Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses/Data Lakes/Lake Houses using Open Source and AWS tools.
Adopt DevOps Practices: Utilise DevOps methodologies and tools for continuous integration and deployment (CI/CD).
Must-have skills:
Proficiency with Core AWS Tools
Programming Skills (Python)
SQL and Data Storage Technologies: Some knowledge of Data Warehouse, Database technologies, and technologies (AWS Redshift, AWS RDS).
AWS Data Lakes: Some experience with AWS data lakes on AWS S3 to store and process both structured and unstructured data sets.
Nice-to-have skills:
Knowledge of Open Table Formats (Iceberg/Delta).
AWS Tools: Experience with Amazon CloudWatch, SNS, Athena, DynamoDB, EMR, Kinesis.
Data modelling
Job scheduling/orchestration
Data virtualisation tools (Denodo)
ALM Tooling (Jira, Confluence)
CI/CD toolsets (GitLab, Terraform)
Reporting tools (Business Objects, Power BI, Pentaho BA)
Data Analytics toolset (SAS Viya)
Observability tools (Grafana, Dynatrace)
Experience:
You should have experience as a senior data engineer delivering within large scale data analytics solutions and the ability to operate at all stages of the software engineering life cycle, as well as some experience in the following
Awareness of DevOps culture and modern engineering practices
Experience of Agile Scrum based delivery
Proactive in nature, personal drive, enthusiasm, willingness to learn
Excellent communications skills including stakeholder management
Developing solutions within the given architecture and adhering to specified NFRs
Supporting other engineers within your team
Continually looking for ways to improve
Hybrid role: requires attendance for occasional workshops (typically a couple of days per month) at one of our sites - Telford or Hove
Please send CV for full details and immediate interviews. We are a preferred supplier to the client.