Data Engineer

Data Engineer

Location: Warwick, UK (office based)

Day Rate: Market rate (Inside IR35)

Duration: 6 months

Role description

This role is for an experienced Azure Data Engineer to support the design, development and optimisation of data solutions within a modern cloud-based environment. The successful candidate will contribute to building scalable and reliable data pipelines, enabling data-driven decision-making across the organisation.

Working within a fast-paced delivery environment, the role offers exposure to cloud technologies and advanced data platforms, supporting the transformation and integration of large and complex datasets. The position plays a key role in ensuring data quality, accessibility and performance across business-critical systems.

Key responsibilities

• Design, build and maintain scalable data pipelines using Azure data services
• Develop and manage data integration workflows using Azure Data Factory
• Perform data transformation and processing using tools such as Databricks and Python
• Troubleshoot and debug data pipelines to ensure reliability and performance
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions
• Optimise data storage and processing using platforms such as Snowflake
• Ensure data quality, governance and security standards are maintained
• Support deployment and monitoring of data solutions in production environments
• Document data processes and maintain technical documentation

Key skills, knowledge and experience

• Strong experience with Azure data services, including Azure Data Factory
• Advanced expertise in Azure Data Factory development and optimisation
• Experience working with Snowflake for data warehousing solutions
• Hands-on experience with Databricks for large-scale data processing
• Proficiency in Python for data engineering tasks
• Strong SQL knowledge and experience working with relational databases
• Experience in debugging and resolving data pipeline issues
• Understanding of data architecture and best practices in data engineering
• Good communication skills with the ability to work collaboratively

Desirable skills, knowledge and experience

• 6 to 8 years of relevant data engineering experience
• Exposure to additional cloud data platforms or modern data stack tools
• Experience working in agile delivery environments