Data Engineer

Data Engineer for a major offshore wind project in The United Kingdom

Responsibilities

• Design and implement scalable ingestion pipelines from multiple source systems including and internal business data sources.
  * Ensure reliable, automated, and monitored data flows into the Bronze layer of the Medallion architecture.
  * Work within clients existing security framework to establish compliant connectivity to operational data sources.
  * Build and maintain Silver and Gold layer transformations in Databricks using Python and SQL.
  * Onboard datasets into Unity Catalog, ensuring proper governance, lineage, and discoverability. Platform Collaboration & Delivery
  * Support the ML/Data Scientist in preparing clean, structured datasets for anomaly detection and asset performance modelling.
  * Contribute to technical documentation and ensure pipelines are maintainable and transferable.
  * Stay current on Databricks and Azure platform developments relevant to the stack.
  * Support the Digital & AI Strategy Manager in assessing feasibility of new data source integrations as the roadmap evolves.
  
  Experience
  * Master's degree in Computer Science, Data Engineering, Software Engineering, or a related technical field.
  * Professional certifications in Azure, Databricks preferred
  * Training or background in energy systems, renewable energy, offshore wind or BESS technologies is a strong plus.
  * 4-7 years of hands-on data engineering experience in a cloud environment.
  * Demonstrated experience delivering production pipelines on Databricks and Azure (ADLS Gen2, ADF or equivalent).
  * Proven ability to implement Medallion architecture or equivalent layered data modelling patterns.
  * Experience with REST API ingestion and integration of business systems (ERP, finance tools).
  * Experience in a contractor or project-based delivery model preferred.
  * Exposure to OT/SCADA environments or energy sector data.
  * Exposure to MLOps workflows or collaboration with data science teams.