Data Engineer
Data Engineer (Pharma Background Essential)
Role Purpose
Required Skills and Experience
Desirable Skills
- £550 per day - INSIDE IR35
- 6 Months
- Hybrid - 1 day per week in London
Role Purpose
We are currently looking for a Data Engineer to be responsible for designing, building and maintaining our clients data pipelines and platform infrastructure on Microsoft Fabric. Operating within a consulting model, this role deploys across engagements of varying scope and duration, delivering production-grade data solutions that meet client requirements.
Required Skills and Experience
- Expereince of working within the pharma/lifesciences sector.
- Demonstrable experience building data pipelines in production environments.
- Proficiency with Microsoft Fabric, including Data Factory, lakehouses, warehouses, notebooks and semantic models.
- Strong skills in PySpark, Spark SQL and T-SQL for data transformation.
- Experience with medallion architecture or equivalent layered data processing patterns.
- Working knowledge of OneLake, delta tables and Fabric capacity management.
- Proficiency with version control (Git) and CI/CD practices for data platform assets.
- Understanding of data governance principles, including cataloguing, lineage and access control.
- Experience working in a consulting, professional services or client-facing delivery environment.
- Strong written and verbal communication skills, with the ability to explain technical concepts to non-technical audiences
Desirable Skills
- Experience with Azure Data Lake Storage, Azure Synapse Analytics or Azure Data Factory prior to Fabric migration.
- Familiarity with Microsoft Purview for data governance and compliance.
- Exposure to Power BI semantic models and report development within Fabric.
- Experience with event-driven architectures using Azure Event Hubs or Kafka.
- Knowledge of infrastructure-as-code tools such as Terraform or Bicep for Azure resource provisioning.
- DP-600 (Fabric Analytics Engineer) certification or equivalent Microsoft certifications.