Data Engineer

Data Engineer

Duration: 3 Months

Location: Remote

Rate: £450 - £470 per day DOE

Status: OUTSIDE IR35

Clearance: Eligible for SC

Start Date: ASAP

Summary:

My market leading client are looking to secure the services of a contract based Data Engineer to assist with critical project work over the coming months. Ideally coming from a consultancy background with extensive experience working in secure and regulated environments. Experience and knowledge of working in a public sector environment is essential.

Key Responsibilities

• Strong stakeholder engagement and collaboration.
• Design, build and maintain scalable data pipelines.
• Develop using Azure Databricks (PySpark, Spark SQL, Python).
• Contribute to Lakehouse architecture (Delta Lake patterns, Databricks capabilities).
• Build and manage workflows (Databricks Workflows, Delta Live Tables).
• Implement data governance (Unity Catalog – access, discovery, control).
• Support analytics/reporting using Databricks SQL.
• Ingest and transform API, structured, semi-structured and geospatial data.
• Write clean, testable, maintainable code.
• Contribute to agile delivery (ceremonies, peer reviews, planning).

Key Skills & Experience

• Strong Data Engineering experience with Azure Databricks.
• Proven delivery of production-grade data pipelines.
• Strong Python, SQL, PySpark and Spark SQL capability.
• Experience with Lakehouse / modern data platform design.
• Hands-on with Databricks tools (Unity Catalog, Workflows, Delta Live Tables, Databricks SQL).
• Data ingestion from APIs and external sources.
• Geospatial data processing experience (real-world use cases).
• Experience with geospatial formats (Shapefile, GeoParquet, GeoPackage, GeoTIFF).
• Knowledge of Apache Sedona or similar frameworks.
• Understanding of data modelling, quality, monitoring and optimisation.
• Experience with version control, CI/CD and cloud environments.
• Strong analytical and problem-solving skills.

If you’d like more information on the assignment, please drop me an email Adam.Rees@IdentifySolutions.co.uk – or give me a call on 07400 28 3333.

Data Engineer