Platform Engineer (AWS / Databricks)
Platform Engineer (AWS / Databricks)
London (Hybrid)
6 Month Contract
£600/day (Inside IR35)
Platform Engineer needed with strong AWS, Databricks and Unity Catalog experience. Start ASAP in May/June 2026.
6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.
Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.
A chance to work with a leading global IT transformation business specialising in large-scale Government projects:
- Supporting secure integration between AWS hosted data sources, Databricks workspaces and downstream enterprise data platforms.
- Design and support secure integration across AWS S3, Databricks and downstream data platforms.
- Strong hands-on experience with AWS IAM, S3, KMS and secure cloud access patterns.
- Hands-on Databricks on AWS experience, including Hive Metastore, Delta tables, SQL Warehouse and workspace access controls.
- Practical Unity Catalog experience, including grants, external locations, storage credentials and governed data access.
- Scope includes data held in S3, registered through Databricks Hive Metastore, governed or exposed through Unity Catalog, and consumed through approved connector-based patterns.
- Configure least-privilege access to S3 using IAM roles, bucket policies, KMS permissions and approved access controls.
- Support Databricks access patterns where S3-backed data is registered through Hive Metastore and exposed or migrated into Unity Catalog.
- Configure and validate Unity Catalog objects, including catalogs, schemas, tables, views, grants, storage credentials and external locations.
- Support downstream connectivity to Databricks using SQL Warehouse, tables, views or connector-based integration patterns.
- Develop Terraform/IaC for AWS IAM, S3, KMS and Databricks-related configuration.
- Troubleshoot access, metadata, schema, query and connectivity issues across AWS, Databricks and downstream integrations.
- Technical Environment: AWS, Databricks, Unity Catalog, Palantir Foundry, Terraform, IaC, Delta, Parquet, CSV, JSON, Python, PySpark, SQL, CI/CD, GitLab, GitHub Actions.