Senior Data Engineer

Senior Data Engineer
Hybrid: 3 days in office, Warwick
Duration: 6-Month Contract
Rate: £450/day (Inside IR35)

A leading organization is seeking a Senior Data Engineer to join their cloud data platform team on a hybrid basis (3 days in office, Warwick). This is a 6-month contracting role offering competitive daily rates and the opportunity to contribute to a modern, cloud-native data platform.

The Role
You will be responsible for driving the design and implementation of scalable, high-performing data architectures and pipelines. Working with the Interconnectors Data Platform (ICDP), you will provide both technical leadership and hands-on development, supporting the transition to modern Azure-based ingestion patterns and Medallion Architecture.

Key Responsibilities

• Lead the design and implementation of scalable data architectures and layered models (Bronze/Silver/Gold).
• Develop robust, secure, and observable ingestion and transformation pipelines using Azure-based tools.
• Lead the migration from legacy ETL tools to modern cloud pipelines (ADF, Azure Functions, event-driven frameworks).
• Build performant SQL transformations and reusable data models.
• Implement CI/CD, automated testing, version control, and observability in workflows.
• Ensure data quality, validation, reconciliation, and auditability across platform layers.
• Collaborate with business and product teams to deliver high-quality analytical outputs.
• Mentor junior data engineers and contribute to team capability development.

Required Skills & Experience

• Strong hands-on experience with Python for production-grade pipelines.
• Expert-level SQL, including optimization and data modelling.
• Azure Cloud experience (ADF, Functions, Storage, Key Vault).
• Deep understanding of data warehousing, dimensional modelling, and scalable architectures.
• Proficiency in Git, CI/CD, automated testing, and modern engineering best practices.
• Experience with API and SFTP ingestion and resilient pipeline design.
• Strong problem-solving, communication, and stakeholder collaboration skills.

Desirable

• Experience with Medallion/Lakehouse patterns or Databricks-style ecosystems.
• Experience in regulated or high-assurance data environments.
• Collaboration with modeling teams in engineering-modelling interfaces