3 of 3 Data Lake Jobs in Wales

complex end-to-end ETL pipelines using Python and SQL Design and develop data solutions across a cloud-based data lake using a layered (Bronze/Silver/Gold) architecture Build and maintain SQL objects (stored procedures, views, complex queries) Translate business requirements into clear … improve quality, and enhance documentation Technology Environment Primary cloud platform: Microsoft Azure Core tools and services may include: Azure SQL Cloud data lake/analytics services (e.g. Synapse or equivalent) Data orchestration tools CI/CD and version control systems Familiarity with modern analytics platforms ...

experience working with SQL Server Strong experience working with Azure Data Factory and Azure DevOps Hands-on experience with data lake platforms, Azure Synapse, Databricks, or equivalent experience/skills Experience with tooling’s such as CI/CD pipelines and version control. The ability … will be responsible for the Design, build, and maintenance of Python-based ETL pipelines Accounting and leading the SQL development Data lake development within Azure Synapse, working to the organisations architecture standards Meeting with business stakeholders to define requirements and translate them into solution designs Keeping stakeholders ...

maintain Python-based ETL pipelines across extract, transform, and load stages SQL development - stored procedures, views, and complex ad hoc queries Data lake development within Azure Synapse, working to our Bronze/Silver/Gold medallion architecture Leading feature specification - working with business stakeholders to define requirements … Strong Python for data engineering - production-quality ETL code, error handling, logging, and testing Hands-on experience with cloud data lake platforms and layered architectures (medallion/Bronze–Silver–Gold or similar) - Azure Synapse, Databricks, or equivalent Experience with orchestration tooling, CI/CD pipelines ...