Trading Data Engineer
- Hiring Organisation
- Frossell Recruitment
- Location
- Abingdon, Oxfordshire, England, United Kingdom
- Employment Type
- Full-Time
- Salary
- £55,000 per annum
make data pipelines more efficient, reliable and scalable. Key Responsibilities: Build and maintain high-availability data pipelines for energy market data using Python, SQL and Spark. Support data flows ensuring generation and storage assets deliver the correct contracted schedules. Design and manage Delta Lake tables and SQL databases, applying strong … data freshness. Implement data validation and reconciliation checks across multiple market data sources. Optimise pipeline performance and manage compute costs through efficient Spark and SQL design Produce clear documentation for data schemas, pipelines and operational processes. Contribute to Git-based development workflows and CI/CD pipelines. Support internal teams ...