Senior Data Engineer
Lightfoot turns vast volumes of in-vehicle telemetry into products that change driver's behaviour and cut emissions and cost for the fleets we serve. Delivering on our AI ambition depends on having the data foundations to support it. This is a senior, hands-on engineering role that builds and operates those foundations. You'll:
- Own the end-to-end data platform: architecture, build, maintenance, security, and governance — serving as the internal go-to expert and trusted voice on all data engineering matters
- Be at the forefront of turning data into real impact — solving meaningful business and customer challenges while unlocking new levels of fleet efficiency and commercial ROI.
- Design, build, andmaintainrobust data pipelines with automated validation, ensuring data integrity across every layer
- Lead the transformation of legacy reporting (Python, SQL, Excel) into a secure,scalableand fully observable platform powered by Apache Airflow (WMAA).
- Define and publish data quality metrics that drive engineering decisions anddemonstrateplatform health to stakeholders
- Champion AI and modern data tooling —you'llpush the boundaries ofwhat'spossible, with hands-on ML product experiencerequiredand LLMexpertisea serious bonus.
- 5+ years in a data engineering or data science role, with a proventrack recordof delivering production-grade data products
- Advanced Python (PySparkor Polars preferred) and SQL across multipleflavours— comfortable owning and evolving live production codebases
- Hands-on experience building and shipping ML products, not just prototyping
- Deep familiarity with Azure Data Lake and file-based storage architectures
- Strong Git discipline and version control best practices
- A genuine advocate for AI — you understand its value in modern data products and actively champion its adoption
- A proactive builder: you spot problems before they escalate and default to creating scalable, market-leading solutions
- Streaming / IoT data.Experience with high-volume telemetry or event-streaming pipelines.
- BI tooling.Power BI or similar, to support and enable the analytics team.
- Agile delivery.Comfortable working in an agile, iterative team.
- Senior, self-directed and pragmatic— hates manual repetition and automates relentlessly.
- A standard-setterwho raises the engineering bar for those around them.
- A confident communicatorwho can make complex engineering and ML concepts clear to non-technical stakeholders.
- A continuous learnerwho stays current with cloud,dataand AI tooling.
- A natural mentorwho raises the capability of those around you