Data Platform Engineer

Job Description

Data Platform EngineerLondon (Hybrid)6 Month Contract£550-600/day (Inside IR35)Data Platform Engineer needed with strong AWS cloud platform migration and Terraform expertise.6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London .A chance to work with a leading global IT transformation business specialising in large-scale Government projects:In-depth Data Engineering experience + AWS cloud data platform migration experience.The role will focus on Data Engineering, cloud platform migration, infrastructure automation + supporting the delivery of large-scale data processing solutions.Supporting a major Data platform modernisation programme including migration of data pipelines, notebooks + data workloads from legacy Databricks environment to modern AWS cloud-based data platforms.Strong Terraform + Infrastructure as Code (IaC) skills including developing + maintaining Terraform code to support data platform deployments.Supporting deployment of data platform components, jobs, permissions + environment configurations.Analysing current Data Engineering solutions + identifying data migration requirements.Onboarding datasets, users + workloads onto target platform.Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation.AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps principles, Agile Delivery.Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS / Healthcare data experience.Government / GOV.UK / Public Sector domain experience strongly preferred.Must be active SC Cleared or fully eligible to undergo the full SC Security Clearance process.TPBN1_UKTJ