Data Engineer
Senior Data Engineer - Commodities Trading
Compensation up to £100,000
Hybrid working 3 days on site Central London
A top market leading Commodities Trading Firm is looking for Data Engineers to join a greenfield initiative to build a brand-new data platform on the principles of a modern data Lakehouse architecture.
In this role, you will be a key member in the processing of real-time data streams and create scalable ingestion and transformation workflows using Python, SQL, and modern Lakehouse technologies such as Iceberg, Parquet, and Apache Hudi.
This is a rare opportunity to join at an early stage and become one of the most senior technical contributors, helping define architecture, set engineering best practices, and drive the firm's transition to a modern data platform that underpins critical trading decisions.
Required:
- 5+ years of Python development experience in an enterprise environment.
- Experienced with end-to-end involvement in building a data Lakehouse.
- Solid knowledge of related data Lakehouse technologies like Parquet, Apache Iceberg, Apache Hudi, Spark (or similar).
- Strong Computer Science, Engineering (or a related subject) background.
- Able to work in a modern software engineering environment, using Agile and DevOps methodologies and tools including Scrum, git and CI/CD.
Benefits:
- Market leading Compensation and Benefit packages.
- Working in a modern office in the heart of London, with the ability to work from home when required.
- The opportunity to work for a top Commodities Trading firm in an incredibly collaborative culture.