Data Engineer

Job Title: Data Engineer

Location: Warwick/London (2-3 days per week onsite)

Contract Length: 6 Months

Day Rate: £375 per day (Umbrella)

Overview

Our client is seeking a highly capable Data Engineer to join an established data platform team and play a key role in delivering a critical migration programme. This is an excellent opportunity for an individual eager to take ownership of technical delivery, engage with stakeholders, and mentor junior team members.

The successful candidate will contribute to the evolution of the Interconnectors Data Platform (ICDP), a cloud-based data warehouse that drives commercial, financial modelling, and operational decision-making across the organisation. The immediate focus will be on migrating existing products and workloads to a modern Azure-based data platform, ensuring that key activities are successfully delivered in the upcoming year.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines utilising Python, SQL, and Snowflake technologies.
  • Support the migration of existing products and workloads to Azure-based services and modern data architectures.
  • Deliver migration activities into a Medallion Architecture environment (Bronze, Silver, Gold data layers).
  • Build and enhance Azure-native ingestion solutions for data sources, including APIs and SFTP platforms.
  • Analyse, troubleshoot, and improve existing pipelines and legacy codebases.
  • Contribute to the development of reusable ETL/ELT frameworks and engineering standards.
  • Develop and maintain data quality, observability, monitoring, and reliability processes.
  • Operate within established CI/CD pipelines, promoting engineering best practises and continuous improvement.
  • Provide production support and investigate platform issues as needed.
  • Mentor and support junior Data Engineers, sharing knowledge and enhancing team capabilities.
  • Collaborate effectively with technical teams, analysts, and business stakeholders to deliver robust data solutions.

Required Skills & Experience Essential:

  • Strong Python development skills, with experience in building production-grade data solutions.
  • Solid SQL expertise, including data modelling, performance tuning, optimisation, and troubleshooting.
  • Hands-on experience with Snowflake or a similar modern cloud data platform.
  • Familiarity with Snowflake-native technologies such as Snowpipe and Snowpark.
  • Experience working with ETL/ELT frameworks and large-scale data pipelines.
  • Strong understanding of Azure cloud services, including data ingestion and storage solutions.
  • Intermediate to advanced experience with CI/CD pipelines and DevOps practises.
  • Experience working with APIs, SFTP integrations, and external data sources.
  • Ability to work independently, quickly grasp existing solutions, and hit the ground running.
  • Proficiency with Git and version control best practises.

Desirable:

  • Knowledge of Matillion.
  • Exposure to Azure Data Factory, Microsoft Fabric, Airflow, or dbt.
  • Experience in energy, utilities, trading, or market data environments.
  • Familiarity with event-driven or real-time data architectures.
  • Experience supporting production platforms and driving continuous improvement initiatives.

This is a fantastic opportunity for a Data Engineer looking to make a significant impact within a dynamic team. If you possess the required skills and are ready to tackle new challenges, please submit your application today!

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone's chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.

We use generative AI tools to support our candidate screening process. This helps us ensure a fair, consistent, and efficient experience for all applicants. Rest assured, all final decisions are made by our hiring team, and your application will be reviewed with care and attention.

Job Details

Company
Pontoon
Location
Warwick, Warwickshire, United Kingdom
Employment Type
Full-Time
Salary
£375.00 - £450.00 per day
Posted