1 to 25 of 62 Permanent Metadata Jobs in London

with Databricks. Data Engineering & Platform Build Build and optimize large-scale ETL/ELT pipelines using PySpark, SQL, and Delta. Oversee data quality frameworks, metadata management, lineage, and monitoring. Leadership & Stakeholder Engagement Work closely with business leaders and product teams to translate requirements into robust technical solutions. Guide development teams ...

oversee ETL/ELT pipelines to integrate batch and streaming data from multiple sources. Establish data governance, quality, security, privacy, and compliance standards. Implement metadata management and data lineage for transparency and traceability. Collaborate with data, ML, and analytics teams to deliver AI-ready datasets and features. Monitor, optimise ...

Strong hands-on experience with Snowflake – architecture, performance tuning, security, and data sharing features. Proficient in data modelling, data integration (ETL/ELT), and metadata management. Deep understanding of data governance, data security, and compliance in cloud environments. Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation) is a plus. ...

data models, pipelines, and integration frameworks. Support the implementation of Customer Data Platforms (CDPs), MDM, and CRM systems. Ensure compliance with data governance, metadata standards, and data quality frameworks. Collaborate with stakeholders to define data architecture vision and roadmap. Contribute to the development of reusable architecture assets and design patterns. ...

DataHub upgrades, GDA framework enhancements, and integrations into cloud analytics platforms. Mentor onshore and offshore engineers , guiding best practices in DataHub modelling, GDA patterns, metadata standards, and integration strategy. Design and govern Guidewire-based data architectures , ensuring alignment with enterprise cloud infrastructure (Azure/AWS) and downstream BI/reporting ...

data models for insurance systems. Ensure alignment with Lloyd's market standards, including Core Data Record (CDR) and Blueprint Two initiatives. Develop data dictionaries, metadata, and governance frameworks. Data Integration & Transformation Collaborate with business analysts, actuaries, and IT teams to integrate data from multiple sources (policy, claims, bordereaux, exposure). ...

Comfortable leading iterative delivery using Agile practices. Exposure to tools such as dbt, Airflow/ADF/Dagster, Snowflake/Databricks/Fabric, and metadata/governance systems is beneficial. Ready to Lead in a Role with Real Influence? If you want ownership, visibility and the chance to shape analytical ...

Experience in designing technology solutions with complex end-to-end data flows. Experience in implementing data governance, including data cataloging, data lineage tracking, and metadata management to ensure data accuracy, accessibility, and compliance. Preferred: Experience with Databricks Understanding of how data platforms interact with marketing and customer engagement platforms. Knowledge ...

Proficiency in Python, Java, or similar for semantic data processes. Analytical Skills: Ability to troubleshoot ontology logic and query performance. Desired Experience Familiarity with metadata standards (Dublin Core, schema.org). Experience integrating semantic technologies with AI/LLM workflows. Proven track record of embedding semantic layers into enterprise systems. Hands ...

advanced analytics to enhance market data governance, including automated data classification, usage pattern detection, anomaly identification, and cost optimisation insights. Understanding of data lineage, metadata, and data quality controls as applied to market data within enterprise data platforms. Professional Skills Strong stakeholder management and communication skills across business, technology, procurement ...

such as Databricks, Snowflake, Azure Synapse, and BigQuery. Oversee data engineering with Apache Airflow, dbt, and Prefect, ensuring performance, governance, and alignment with enterprise metadata standards (Collibra, Alation, Microsoft Purview). Drive adoption of Delta Lake, Iceberg, and Hudi to support scalable data lakehouse architectures. Ensure high‐quality, compliant ...

implementation. Strong expertise in cloud technologies (AWS, Azure, GCP) with relevant certifications highly desirable. In-depth knowledge of data modeling, data lake design, and metadata management tools. Proven ability to design secure, scalable, and cost-effective data solutions in cloud ecosystems. Experience in the financial services sector, with a track ...

suite audiences. Hands-on data modelling capability across conceptual, logical and physical layers. Deep understanding of data management -data quality, MDM, reference data, metadata, governance and analytics/BI. Experience defining architecture patterns and applying structured methodologies. Proven ability to document and standardise data semantics , including taxonomies and vocabularies. Experience ...

product teams to deliver robust data solutions. Experience working with Terraform for infrastructure-as-code and automated deployment of cloud resources (desirable) Understanding of metadata based ingestion frameworks and data contracts (desirable) Person Specification Able to clearly communicate with business and technology stakeholders. Attention to detail, focused on the finer ...

Data & AI Strategy, including adherence to front door intake and governance policies. Maintain and evolve the data catalogue for your products, ensuring metadata, lineage, and definitions are accurate, accessible, and up to date. Define and communicate a clear product vision and strategy, ensuring alignment with departmental and company goals. Ensure ...

Cloud ecosystems such as AWS, Azure, and GCP Databricks, Snowflake, and similar modern data platforms Infrastructure automation, DevOps, and secure deployment patterns Data governance, metadata, and secure access frameworks Analytics, semantic layers, and enterprise reporting platforms Seniority and Leadership Expectations Operate at Principal Consultant or equivalent leadership level Own architecture ...

/TPA partner systems and monthly bordereaux submissions Develop data models using Dimensional (Star/Snowflake), Data Vault, and 3NF methodologies. Create and manage metadata and modelling artefacts using Erwin with traceability and governance. Support Medallion Architecture (Bronze, Silver, Gold) across ingestion and curation layers. Collaborate with engineering teams ...

decision engines Ontology & Knowledge Graph Collaboration Translate conceptual ontologies into implementable schemas and data flows Partner with ontology architects on entity modelling, semantic definitions, metadata and lineage Deploy pipelines into ontology-aware platforms (e.g. graph databases, semantic layers, Foundry-style systems) Ensure semantic compliance, data integrity and reasoning-readiness Data ...

Proven ability to design and build scalable, automated data pipelines. * Experience creating data quality rules, validation checks, and reconciliation logic. * Strong understanding of lineage, metadata, and control frameworks. * Ability to investigate data discrepancies, trace lineage across multiple layers, and resolve root causes. * Familiarity with troubleshooting ETL job failures, performance issues ...

than owning or delivering data solutions. KEY REQUIREMENTS: Financial Services Experience is essential Strong experience shaping enterprise data architectures Significant experience in governance, MDM, metadata, lineage, modelling, quality management and data security. Have experience in cloud data platforms Have an understanding of regulatory and compliance requirements impacting data Strong stakeholder ...

cloud-based data platforms (AWS, Azure, or GCP) Strong knowledge of data modelling (conceptual, logical, physical) and data lake design Experience with data cataloguing, metadata management, and governance tools Understanding of data security, privacy, and access frameworks Excellent stakeholder management and leadership skills Desirable: Cloud certifications (AWS, Azure, GCP) Experience ...

Python, SQL, PySpark and Spark SQL Experience delivering production pipelines in AWS, Azure, or GCP environments. Solid understanding of data modeling, schema design, metadata management, and governance. Familiarity with CI/CD, Git-based workflows, and software engineering best practices. This will be a remote working opportunity, which may require ...

data quality tooling• Implement and operationalize data governance and data cataloguing using Microsoft Purview and Ataccama, including RBAC/ABAC, PII/DLP, metadata standards, business glossaries, and schema evolution• Define scope and objectives for platform and data engineering initiatives, and deliver structured, risk-managed, and Agile delivery plans• Oversee ...

integration tools and patterns (OIC, APIs, FBDI, ETL). Proven delivery of large‐scale data migration. Strong grounding in data governance, quality, and metadata practices. Able to explain complex data concepts and influence stakeholders. Experience designing analytics and semantic models. Familiarity with cloud data platforms and modern data architecture. Awareness ...

Experiment Tracking & Model Registry Maintain and improve the MLflow-based experiment tracking and model registry infrastructure. Establish conventions for experiment logging, artifact storage, model metadata, and lineage tracking. Enable ML engineers to move seamlessly from experimentation to production deployment with minimal friction. Data & Model Versioning Implement and maintain training data ...