skilled and motivated Data Engineer to join a forward-thinking startup team. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we want to hear from you! Key Responsibilities: Data Engineering: Design, develop, and maintain robust data pipelines … and ETL processes for a Dynamic Metadata system and risk index technology. Implement Real Time data processing solutions to ensure timely and accurate data for the clients product Optimize data storage and retrieval processes to enhance system performance and scalability. AWS: Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to … monitoring, and cost management within the AWS ecosystem. Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions. Data Governance and Metadata Management: Establish and enforce data governance policies to ensure data quality, integrity, and compliance. Develop and maintain metadata management frameworks to support dynamic data processing more »
skilled and motivated Data Engineer to join a forward-thinking startup team. If you have a strong background in data engineering, data governance, and metadata management, along with expertise in AWS and Python, we want to hear from you! Key Responsibilities: Data Engineering: Design, develop, and maintain robust data pipelines … and ETL processes for a Dynamic Metadata system and risk index technology. Implement real-time data processing solutions to ensure timely and accurate data for the clients product Optimize data storage and retrieval processes to enhance system performance and scalability. AWS: Utilize AWS services (S3, Redshift, EMR, Lambda, Kinesis) to … monitoring, and cost management within the AWS ecosystem. Collaborate with DevOps teams to ensure seamless deployment and integration of data solutions. Data Governance and Metadata Management: Establish and enforce data governance policies to ensure data quality, integrity, and compliance. Develop and maintain metadata management frameworks to support dynamic data processing more »
Manchester, North West, United Kingdom Hybrid / WFH Options
Cloud Decisions
APIs, multiple file formats, and databases. Specific experience with ( most of these ): Fabric, Azure Synapse Analytics, ADLS2, Databricks, PySpark, Python, Azure Data Factory (including metadata-driven pipelines), Azure SQL, Keyvault, Azure Security, Microservices, CI/CD and Azure DevOps Experience mentoring and guiding Junior Engineers within a team Ready to more »
in clinical record data handling and database management. Use of basic IT packages including Microsoft Excel. Familiarity with archival clinical tissue handling and clinical metadata collection is advantageous. A background in biological sciences (HNC or equivalent) is desirable. COMMUNICATION & WORKING RELATIONSHIPS This post is an important component of the operational more »
York, North Yorkshire, United Kingdom, Knapton, City of York
Pavers Ltd
clear and compelling vision, driving the strategic execution of plans. Well-versed in data management and data governance disciplines, particularly data quality, data cataloguing, metadata management, data lineage, master data management and reference data. Experience in data modelling within the media and communications industry is also beneficial. Credible leader with more »
Lead the implementation and digitalization agenda in a cross-functional team of architects from business and technology Create the design pillars for Data Governance, Metadata Management, MDM, Data Quality, Data Warehousing, Sourcing and Staging of data, BI, Advanced Analytics and R&D in close alignment with business functions and enterprise more »
using industry recognised data modelling patterns/standards and knows when to apply them Understands a range of tools for storing and working with metadata Able to compare and align different data models Working in team environments being a team player Able to provide simple clarity on large volumes of more »
