Trading Data Engineer

Trading Data Engineer Abingdon, Oxfordshire (Hybrid – 1–2 days per week in office)£45,000 - £55,000 DOE + Bonus + Excellent Benefits Applicants must be within a 1 hour 30 minute commute of Abingdon. Due to significant company growth, a newly created and exciting opportunity has arisen for a Trading Data Engineer to join a fast-growing energy business supporting its live Trading desk. This role sits at the intersection of data engineering and energy trading, giving you the opportunity to build robust data pipelines, improve data reliability and have a direct impact on trading operations.This position would suit someone who enjoys taking ownership of systems, working autonomously and continuously improving processes to make data pipelines more efficient, reliable and scalable.Key Responsibilities:

• Build and maintain high-availability data pipelines for energy market data using Python, SQL and Spark.
• Support data flows ensuring generation and storage assets deliver the correct contracted schedules.
• Design and manage Delta Lake tables and SQL databases, applying strong data modelling and optimisation strategies.
• Develop monitoring dashboards and alerting to ensure transparency around pipeline health and data freshness.
• Implement data validation and reconciliation checks across multiple market data sources.
• Optimise pipeline performance and manage compute costs through efficient Spark and SQL design
• Produce clear documentation for data schemas, pipelines and operational processes.
• Contribute to Git-based development workflows and CI/CD pipelines.
• Support internal teams by ensuring settlement and industry data is delivered accurately and reliably.

Key skills & Requirements: Essential

• 2–5 years’ experience in data engineering or a similar production-focused role
• Strong Python (Pandas) and SQL skills
• Experience building and maintaining data pipelines
• Hands-on experience with Spark, Databricks or Delta Lake / Lakehouse architectures
• Familiarity with cloud data platforms, particularly within Azure environments
• Good understanding of data modelling, storage formats and performance optimisation
• Experience working with Git and CI/CD pipelines
• Comfortable working in environments where data reliability is business critical
• A proactive mindset with the ability to take ownership and work autonomously

Desirable

• Exposure to energy markets, trading systems or financial market data
• Experience with Microsoft Azure services (e.g. Function Apps)
• Experience integrating REST APIs or event-driven data
• Familiarity with orchestration tools such as Azure Data Factory
• Basic awareness of trading concepts such as positions, P&L or market schedules

Benefits:

• Performance Bonus
• Clear career path
• Shift allowance
• 25 days’ annual leave plus bank holidays.
• Pension Scheme.
• SimplyHealth health cashback plan.
• 24/7 Private GP access.
• Flexible working arrangements.
• Ongoing Training and Development opportunities.
• Salary sacrifice Electric Vehicle (EV) scheme.
• Discounts on Lightwave RF smart home products.