Data Engineer – Azure Databricks / Python – Financial Services - remote

Data Engineer / Data Engineering / Azure / Databricks / Ingestion / Pipelines / Financial Services (Insurance, Banking etc) – 2-3 month contract / Outside IR35 / Fully remote / £350 – 500 per day.

One of our leading clients is looking to recruit a Data Engineer.

Location – fully remote / home based

Duration – 2-3 months plus possible extension

Day Rate – £350-500 per day Outside IR35

Role / Responsibilities:

• Define and build a data lake architecture on Azure (ADLS + Databricks)
• Implement layered data model (bronze / silver / gold) for ingestion, processing, and reporting
• Develop ingestion patterns from API sources (batch and streaming)
• Establish data governance, metadata, and access controls
• Define storage structures, naming conventions, and schema design
• Develop API connectors and ingestion pipelines using Python
• Implement integration services feeding into the Databricks environment
• Build data transformation logic using PySpark / Python (data cleansing, standardisation, validation)
• Configure monitoring, logging, and alerting
• Execute unit and integration testing across pipelines

Experience:

• Azure
• Databricks
• Python
• Financial Services sector experience – Insurance or Banking etc