Senior Data Engineer - Short Term Power Markets
Castleton Commodities International ( is a global leader in energy commodity trading and asset investment. Our Data Science & Technology team is central to our success, engineering the high-performance data, systems and innovative tools that power our commercial decision-making. We build platforms and forecasts that help our front-office teams understand market behavior, forecast price movements, and manage risk.
Our team solves complex, high-impact challenges using a modern technology stack, including the latest in GenAI and the latest technologies. We develop everything in cloud-native infrastructure from structured data and real-time analytics to back testing engines, third party integrations, and internal libraries, all designed to give CCI a competitive edge in global commodities markets. This role is an opportunity to build solutions that have a direct commercial impact from day one.
Castleton Commodities International is seeking a skilled Senior Data Engineer to join our DS&T team in London, supporting the Intraday Short-Term Power business. The Data Engineer will play a critical role in engineering the availability, quality, and performance of real-time data feeds that drive execution strategies, analytics, and decision-making. This is an exciting opportunity to work within a fast-paced, data-driven trading environment, contributing directly to systematic trading and risk management efforts.
Responsibilities:
CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:
Our team solves complex, high-impact challenges using a modern technology stack, including the latest in GenAI and the latest technologies. We develop everything in cloud-native infrastructure from structured data and real-time analytics to back testing engines, third party integrations, and internal libraries, all designed to give CCI a competitive edge in global commodities markets. This role is an opportunity to build solutions that have a direct commercial impact from day one.
Castleton Commodities International is seeking a skilled Senior Data Engineer to join our DS&T team in London, supporting the Intraday Short-Term Power business. The Data Engineer will play a critical role in engineering the availability, quality, and performance of real-time data feeds that drive execution strategies, analytics, and decision-making. This is an exciting opportunity to work within a fast-paced, data-driven trading environment, contributing directly to systematic trading and risk management efforts.
Responsibilities:
- Design, build, and maintain scalable data pipelines to deliver real-time and historical data for back-testing, modeling, and execution of trading strategies.
- Integrate and manage data feeds from multiple sources, including fundamental market data, grid operations, weather providers, and internal trading systems.
- Collaborate closely with Technology and Trading teams to ensure the timely availability and reliability of data across all systems supporting the Intraday Power desk.
- Organize and structure Power data, including both reference and transactional data.
- Monitor, troubleshoot, and optimize streaming data infrastructure, proactively resolving issues to minimize downtime and ensure data integrity.
- Partner with Technology & Commercial teams to enhance the back-testing and signal generation frameworks that support systematic trading models.
- Implement best practices in data governance, versioning, and lineage, ensuring compliance and traceability across the data stack.
- Develop internal tools, APIs, and dashboards that improve data accessibility, transparency, and usability for Traders & Analysts.
- Bachelor's degree in Computer Science, Engineering, Mathematics, or related field of study.
- 5 -10 years of professional experience as a Senior Data Engineer, preferably supporting Intraday Short-Term Power trading or similar real-time energy market environments.
- Experience working with energy commodity time-series datasets is required; familiarity with short-term power market data sources such as EPEX, ENTSO-E, or Nord Pool is strongly preferred but not required.
- Understanding of systematic trading workflows, including signal generation, back-testing, and model validation.
- Proven ability to work in a high-frequency, intraday trading environment with tight feedback loops between data, models, and execution.
- Experience with ETL/ELT frameworks to write pipelines to load millions/billions of records.
- Advanced skills in writing highly optimized SQL code.
- Hands-on experience developing data solutions in Python, Pandas, Numpy, etc.
- Experience with relational databases; Snowflake highly preferred.
- Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.
CCI offers competitive benefits and programs to support our employees, their families and local communities. These include:
- Competitive comprehensive medical, dental, retirement and life insurance benefits
- Employee assistance & wellness programs
- Parental and family leave policies
- CCI in the Community: Each office has a Charity Committee and as a part of this program employees are allocated 2 days annually to volunteer at the selected charities.
- Charitable contribution match program
- Tuition assistance & reimbursement
- Quarterly Innovation & Collaboration Awards
- Employee discount program, including access to fitness facilities
- Competitive paid time off
- Continued learning opportunities