1 to 25 of 217 Permanent Metadata Jobs

technical direction. Collaborate with stakeholders across business, product, and IT to gain buy-in and drive data-driven decisions. Define data models, data flows, metadata standards, and integration patterns. Contribute to data engineering, automation, and infrastructure-as-code practices for delivery at scale. Ensure data security, privacy, compliance, and risk ...

coexistence, and centralised models. Data modelling (conceptual, logical, canonical models) Data quality frameworks (profiling, cleansing, validation rules) Matching & survivorship logic, entity resolution, hierarchy management Metadata management, reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex ...

consistency across development teams and services Support established Data Governance and Data Quality frameworks, including tooling, policy enforcement, and stewardship models Ensure robust metadata management, lineage tracking, and data cataloguing using business glossaries and modern catalog tools Review and approve data architecture for major features, platforms, and technical initiatives Collaborate ...

heterogeneous migrations where applicable). Optimize performance of source and target systems pre- and post-migration. Manage and govern S3-based data lakes and metadata using Glue Data Catalog. Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization. Implement monitoring, rollback, and failure recovery mechanisms. Ensure adherence ...

Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with Apache Airflow, data modelling, and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit your CV. ...

Data Quality, Testing & Governance Implement automated testing suites, data contracts, lineage, and monitoring frameworks. Partner with Data Governance to embed quality rules, SLAs, and metadata standards into pipelines. Resolve data quality issues proactively and own improvements to source-to-target data flows. Cross-Functional Collaboration Work with business areas ...

scalable, secure and cost-effective cloud hybrid data solution aligned with Omnia enterprise architecture and Army training objectives. Design innovative data models and metadata systems to interpret and enhance business needs, promoting data as a strategic asset. Develop transitional data architectures and road maps in alignment with Omnia digital transformation ...

Design and maintain robust data models and data architecture structures. Ensure efficient data flow, integration, and accessibility across platforms. Develop and maintain data dictionaries, metadata frameworks, and governance models. Support compliance with data quality, security, and regulatory requirements. Oversee storage, archiving, and lifecycle management of data assets. Collaborate with technical ...

engineer data pipelines to be scalable, robust, automatable, and repeatable Navigate, explore and query large scale datasets Build processes supporting data transformation, data structures, metadata, dependency and workload management Identify and resolve data issues including data quality, data mapping, database and application issues Implement data flows to connect operational systems ...

native data architectures covering ingestion, processing, storage, and consumption Translate business and analytical requirements into practical, scalable data solutions Support data governance practices including metadata, lineage, data quality checks, and access controls Work within hybrid environments (on-prem to cloud) and support modernization initiatives Understand and apply data mesh concepts ...

between business stakeholders, analytics teams, and engineering - translating commercial requirements into robust, well-reasoned architectural designs. Set the standard for data governance, data quality, metadata management, and master data management - and hold the organisation to it. Ensure all data practices meet security, privacy, and regulatory obligations, proactively identifying and mitigating ...

frameworks (batch/streaming) using ADF, Databricks or Fabric pipelines. •Strong programming skills in PySpark, SQL, Python. •Experience implementing medallion architecture, delta lakes, and metadata‐driven pipelines. •Hands-on experience with DQ frameworks, validation rules and reconciliation logic. •Ability to integrate Azure/Fabric datasets with Power BI semantic models ...

programmes across multiple sectors Modern integration patterns including event streaming, messaging, CDC, and data virtualisation Broader architectural domains such as data governance, lineage, MDM, metadata management, and data quality Cloud‐native engineering practices, robust platform engineering, and large‐scale solution delivery You’ll be part of a collaborative, ambitious technical ...

Experience in designing technology solutions with complex end-to-end data flows. Experience in implementing data governance, including data cataloging, data lineage tracking, and metadata management to ensure data accuracy, accessibility, and compliance. Preferred: Experience with Databricks Understanding of how data platforms interact with marketing and customer engagement platforms. Knowledge ...

star-schema design Extensive hands-on experience delivering analytics and business intelligence data models, Strong grounding in data warehousing principles Expertise in data and metadata management Thorough understanding of security standards and controls Experience working with cloud data warehouse technologies, ideally Amazon Redshift, Advanced SQL skills Experience in these areas ...

star-schema design Extensive hands-on experience delivering analytics and business intelligence data models, Strong grounding in data warehousing principles Expertise in data and metadata management Thorough understanding of security standards and controls Experience working with cloud data warehouse technologies, ideally Amazon Redshift, Advanced SQL skills Experience in these areas ...

Experiment Tracking & Model Registry Maintain and improve the MLflow-based experiment tracking and model registry infrastructure. Establish conventions for experiment logging, artifact storage, model metadata, and lineage tracking. Enable ML engineers to move seamlessly from experimentation to production deployment with minimal friction. Data & Model Versioning Implement and maintain training data ...

strategic objectives Review and challenge vendor designs to ensure quality and scalability Drive best practices across: Data modelling Data pipelines Storage (lakehouse/warehouse) Metadata, lineage, and data quality Operating Model Align with and enhance data governance frameworks, ownership, and stewardship Establish sustainable operating models and run-state processes Support ...

strategic objectives Review and challenge vendor designs to ensure quality and scalability Drive best practices across: Data modelling Data pipelines Storage (lakehouse/warehouse) Metadata, lineage, and data quality Operating Model Align with and enhance data governance frameworks, ownership, and stewardship Establish sustainable operating models and run-state processes Support ...

secure, reliable, and scalable data pipeline architecture. Ensure robust implementation and operation of secure data infrastructure. Data Governance Implement strong governance frameworks covering stewardship, metadata, and privacy controls. Champion best practice in data quality, lineage, and lifecycle management. Stakeholder Engagement Build strong relationships with senior business leaders and key partners. ...

using Power BI. Hands-on experience with Python, or/and SQL (or relatable languages). Knowledge of data practices, including business glossary management, metadata, lineage, and data quality. Experience building a business data catalogues. Ability to document and map data lineage using Data Governance tools. A basic understanding ...

data concepts into clear requirements, delivery plans, and consumable documentation for technical & non-technical partners. Experience with data product management principles, including data modelling, metadata management, data quality, and lifecycle governance. Experience with data governance, privacy, and regulatory obligations relevant to enterprise data use. Strong partner management skills with ...

looking for experience across the following areas: Data architecture Data platform design Data modelling, cataloguing and associated governance Data lakes, distributed storage Metadata management Experience with Snowflake is preferred Cloud & Platform Architecture Proficient in AWS, but familiarity with Azure/GCP also useful Strong understanding of cloud computing principles ...

with Kubernetes based development. Experience with feature engineering pipelines and Feature Store management. Understanding of lineage tracking: training data snapshot, feature versions, code versioning, metadata tracking, reproducibility. Hands-on experience with AWS Bedrock and Agentcore service. Experience with CloudWatch, SageMaker Model Monitor, Prometheus/Grafana. Strong foundation in Python ...

efficiency Work closely with data scientists, analysts and engineering teams to support advanced analytics and reporting initiatives Implement best practices for data modelling, metadata management and data lineage Produce technical documentation including data architecture, pipeline design and data flow diagrams Support continuous improvement of data platforms through optimisation, automation … with Spark or distributed data processing frameworks Proven experience building and maintaining data pipelines, data lakes and data warehouses Strong understanding of data modelling, metadata management and data governance principles Experience working with large-scale distributed data systems and high-volume datasets Familiarity with CI/CD, version control ...