2 of 2 Permanent Data Pipeline Jobs in Kings Langley

with expertise working with MS Fabric, SQL and Python. We are looking for an experienced engineer who can drive the automated data pipeline development process, starting from requirements gathering, data extraction & loading, through to data modelling, reporting, and ultimately supporting the business. … responsibilities include: Work with the Engineering Operations team to understand and define their data pipeline requirements for their new data projects Collaborate with the wider Engineering teams to understand existing data ingestion and design suitable methods for extraction Design and implement the necessary ...

Meltano/Singer (or comparable tooling). Write and optimise advanced SQL in Snowflake, including transformations, performance tuning and data modelling. Implement pipeline monitoring, logging, alerting and error handling, including data freshness and data health checks. Troubleshoot pipeline failures, investigate data quality issues and carry out root-cause analysis. Use Git and sound version-control practices (branching, code review, documentation) across all pipeline code. Automate operational tasks with Bash/shell scripting where appropriate. Contribute to architecture decisions, including the potential future evolution of our backend platform toward ...