2 of 2 Permanent Data Lake Jobs in South Wales

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling’s such as CI/CD pipelines and version control. The ability … will be responsible for the Design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisations architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping stakeholders ...

maintain Python-based ETL pipelines across extract, transform, and load stages SQL development - stored procedures, views, and complex ad hoc queries Data lake development within Azure Synapse, working to our Bronze/Silver/Gold medallion architecture Leading feature specification - working with business stakeholders to define requirements … Strong Python for data engineering - production-quality ETL code, error handling, logging, and testing Hands-on experience with cloud data lake platforms and layered architectures (medallion/Bronze–Silver–Gold or similar) - Azure Synapse, Databricks, or equivalent Experience with orchestration tooling, CI/CD pipelines ...