1 to 25 of 61 Data Lineage Jobs in London

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with … large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within More ❯

Job Title: Senior Data Engineer Location: London, UK (3 days in the office) SC Cleared: Required Job Type: Full-Time Experience: 8+ years Job Summary : We are seeking a highly skilled and experienced Senior Data Engineer to join our team and contribute to the development and maintenance of our cutting-edge Azure Databricks platform for economic data. This … platform is critical for our Monetary Analysis, Forecasting, and Modelling activities. The Senior Data Engineer will be responsible for building and optimising data pipelines, implementing data transformations, and ensuring data quality and reliability. This role requires a strong understanding of data engineering principles, big data technologies, cloud computing (specifically Azure), and experience working with … large datasets. Key Responsibilities : Data Pipeline Development & Optimisation : Design, develop, and maintain robust and scalable data pipelines for ingesting, transforming, and loading data from various sources (e.g., APIs, databases, financial data providers) into the Azure Databricks platform. Optimise data pipelines for performance, efficiency, and cost-effectiveness. Implement data quality checks and validation rules within More ❯

Business Analyst - Data Warehouse Delivery (London Market Insurance) Department: Project Management Employment Type: Contract Location: London Reporting To: Hugh Griffiths Compensation: £600 - £800/day Description To support the successful delivery of a new Data Warehouse (DWH) capability for Polo Managing Agency (PMA), this role will provide expert business analysis across the build and implementation lifecycle. The BA … will be responsible for capturing business and data requirements, mapping data from source systems (primarily PAS), and ensuring alignment between business needs and the technical DWH solution. This role requires strong experience in London Market insurance operations, data modelling, and systems integration, particularly between PAS and reporting/analytics platforms. Key Responsibilities Lead business and data requirement gathering from underwriting, finance, claims, and operations teams. Develop source-to-target mappings from PAS and other upstream systems into the DWH. Analyse end-to-end data flows across operational and reporting systems. Document and optimise processes relating to data extraction, transformation, and load (ETL). Translate business requirements into clear, testable functional and non-functional More ❯

world-class opportunity to help shape our organisation for the next stage of its journey. To drive towards this ambition, we are seeking a motivated individual to join our Data Platform team and support Aztec's new technology strategy using Azure Databricks. You will lead our Data Engineering capability and collaborate with others passionate about solving business problems. … Key responsibilities: Data Platform Design and Architecture Design, develop, and maintain a high-performing, secure, and scalable data platform, leveraging Databricks Corporate Lakehouse and Medallion Architectures. Utilise our metadata-driven data platform framework combined with advanced cluster management techniques to create and optimise scalable, robust, and efficient data solutions. Implement comprehensive logging, monitoring, and alerting tools … to manage the platform, ensuring resilience and optimal performance are maintained. Data Integration and Transformation Integrate and transform data from multiple organisational SQL databases and SaaS applications using end-to-end dependency-based data pipelines, to establish an enterprise source of truth. Create ETL and ELT processes using Azure Databricks, ensuring audit-ready financial data pipelines More ❯

The role Position: Data Architect Contract type: Full Time/Permanent Reporting to: Head of Data Location: London Overview of role As the Data Architect you will join a small but powerful data team, with a mission to transform Zodiac Maritime into a data driven organisation. You will be responsible for designing, developing, and maintaining … Zodiac Maritime’s enterprise data architecture, ensuring alignment with business objectives and long-term scalability. Reporting to the Head of Data, this role will be responsible to define and maintain data standards, data models, and data governance frameworks to enable effective data management and analytics across the organization. The ideal candidate will have strong … expertise in data architecture, data modelling, and data governance, with hands-on experience in Azure Databricks and Unity Catalog for metadata management and scalable data & analytics. Key responsibilities and primary deliverables Define and enforce enterprise data architecture principles, policies, and standards in collaboration with the Head of Data. Develop and maintain current (“as-is”) and More ❯

The role Position: Data Architect Contract type: Full Time/Permanent Reporting to: Head of Data Location: London Overview of role As the Data Architect you will join a small but powerful data team, with a mission to transform Zodiac Maritime into a data driven organisation. You will be responsible for designing, developing, and maintaining … Zodiac Maritime’s enterprise data architecture, ensuring alignment with business objectives and long-term scalability. Reporting to the Head of Data, this role will be responsible to define and maintain data standards, data models, and data governance frameworks to enable effective data management and analytics across the organization. The ideal candidate will have strong … expertise in data architecture, data modelling, and data governance, with hands-on experience in Azure Databricks and Unity Catalog for metadata management and scalable data & analytics. Key responsibilities and primary deliverables Define and enforce enterprise data architecture principles, policies, and standards in collaboration with the Head of Data. Develop and maintain current (“as-is”) and More ❯

Voluntary Benefits Health Cash Plan, Dental, Will Writing etc Annual Leave 23 days rising to 27 with length of service Sick Pay Increasing with length of service The Role: Data Architect As the Data Architect you will join a small but powerful data team, with a mission to transform the business into a data driven organisation. … You will be responsible for designing, developing, and maintaining the enterprise data architecture, ensuring alignment with business objectives and long-term scalability. Reporting to the Head of Data, this role will be responsible to define and maintain data standards, data models, and data governance frameworks to enable effective data management and analytics across the … organisation. The ideal candidate will have strong expertise in data architecture, data modelling, and data governance, with hands-on experience in Azure Databricks and Unity Catalog for metadata management and scalable data & analytics. Key responsibilities Define and enforce enterprise data architecture principles, policies, and standards in collaboration with the Head of Data. Develop and maintain More ❯

experiences and building platforms that handle the complexity of modern cruising — all while keeping things collaborative and fun. ⭐ Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You'll play … a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. 🎯 What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and reliable data pipelines, focusing … on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks More ❯

money is spent. We drive forward improved outcomes and efficiency in public services and make sure value for money is at the centre of decision-making through better evaluation, data and analysis. We advise on overall government policy on public sector pay and pensions, the biggest single driver of public spending. We collaborate with and directly support departments to … Model to share, improve and drive efficiency in the delivery of finance services. NOVA contains a full suite of functional design artefacts—Processes, KPIs, Business Glossary and a comprehensive Data Dictionary—to be adopted by all government organisations through the delivery of shared services and back-office systems. We are committed to enhancing finance performance by supporting the adoption … of the NOVA finance functional design and its data standards. Driving up finance data maturity, improving data architecture, and creating data integration solutions are central to our GFF 2030 Strategy and ambition for an Insightful and Data Driven finance function. The seventeen-person team works across a wide range of partners, providing the individual with More ❯

experiences and building platforms that handle the complexity of modern cruising - all while keeping things collaborative and fun. Your Mission: Are you passionate about unlocking the power of customer data? We're looking for a talented Lead Data Engineer to spearhead the design, development, and optimisation of our critical CRM and customer data transformation. You'll play … a pivotal role in building the data foundations for advanced analytics, personalised customer experiences, and effective marketing activation. As a senior member of the team, you will lead data engineers and champion best practices within our data environment. What You'll Do: Design & Build: Architect, build, test, and deploy robust, scalable, and reliable data pipelines, focusing … on ingesting and transforming CRM and customer data from various sources. Lead & Innovate: Take technical ownership of customer data integration solutions within our data platform (AWS/SQL Server). Drive improvements and implement best-in-class data engineering practices. Ensure Quality: Champion data quality and governance for customer datasets. Implement robust monitoring, validation checks More ❯

Director , Data Governance Location: Global Reporting to: VP - Data Excellence WHO WE ARE Choreograph is WPP's global data products and technology company. Our mission is to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We partner with agencies and clients to unlock the full value of … data by combining technology, data, and analytics expertise. This is delivered through the Open Media Studio, an AI-enabled media and data platform designed for the future of advertising. Our team of over 1,000 thinkers, builders, creators, and problem-solvers spans 20 markets worldwide, driving innovation and excellence in the advertising industry. Situated within Choreograph's … Reporting and Analytics group, the Collective Intelligence d ata m odelling product team is responsible for realising the strategic value of combining data assets from across the GroupM business to unlock insights and power cross-functional data driven use cases. They will lead teams building scalable, reusable data modelling assets -libraries of data transformation scripts, APIs More ❯

today and tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role Join our fast-growing & collaborative Data-Driven Financial Risk & Compliance (DFRC) team and shape the future of risk and finance! We harness cutting-edge technology, AI-powered models, and cloud-first data platforms to … that's redefining how businesses anticipate, manage, and capitalize on risk. In this role you will have the opportunity to demonstrate the following: Stakeholder Collaboration: Partner with business and data teams to understand data requirements, define data ownership, and ensure governance policies are effectively applied. Data Governance: Implement and support data governance and data quality initiatives, ensuring compliance with organizational policies and regulatory standards. Governance Framework Development: Develop and maintain a comprehensive data and records governance framework aligned with regulatory requirements and industry standards. Metadata Management: Manage and maintain metadata to enhance data discoverability, consistency and accuracy Data Quality Assurance: Conduct data validation and data quality checks to More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines, ensure data quality and governance, and collaborate across cross-functional teams to deliver … high-performance data platforms in production environments. This role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data feeds from diverse sources. … Manage data pipelines for analytics and operational use , ensuring data integrity, timeliness, and accuracy across systems. Implement data quality tools and validation frameworks within transformation pipelines. Data Processing & Optimization: Build efficient, high-performance systems by leveraging techniques like data denormalization , partitioning , caching , and parallel processing . Develop stream-processing applications using Apache Kafka and optimize More ❯

Job Title: Senior Data Engineer Location: Abu Dhabi Job Summary: As a Senior Data Engineer , you will be responsible for designing, developing, and maintaining advanced, scalable data systems that power critical business decisions. You will lead the development of robust data pipelines, ensure data quality and governance, and collaborate across cross-functional teams to deliver … high-performance data platforms in production environments. This role requires a deep understanding of modern data engineering practices, real-time processing, and cloud-native solutions. Key Responsibilities: Data Pipeline Development & Management: Design, implement, and maintain scalable and reliable data pipelines to ingest, transform, and load structured, unstructured, and real-time data feeds from diverse sources. … Manage data pipelines for analytics and operational use , ensuring data integrity, timeliness, and accuracy across systems. Implement data quality tools and validation frameworks within transformation pipelines. Data Processing & Optimization: Build efficient, high-performance systems by leveraging techniques like data denormalization , partitioning , caching , and parallel processing . Develop stream-processing applications using Apache Kafka and optimize More ❯

of time. If you're looking for a rewarding career path, look no further. The Role: Right now, one of the world's largest technology consultancies are expanding their data & AI advisory team, a capability that allows blue-chip clients to harness their entire data life cycle, supports them in becoming truly data-driven, and in turn … solves complex industry challenges faced across a variety of sectors. Here, you will become a specialist in data management, with projects spanning data governance, data ethics, data quality and data architecture, through managing and delivering work streams that expose the true value of clients' data. Additionally, you'll use gain invaluable experience supporting large scale … data transformations through the strategic implementation of data solutions. On top of this technical challenge, you will also be the bridge between clients and the business through the relationships you will maintain with them. This role aligns with those who like to see their clients grow as they do, in a company that strives for exponential progression for More ❯

Role Purpose We have a great opportunity for an individual with strong Data Lineage skills to lead the roll out of PIC's Data Comprehension initiative across the business and setup/manage the BAU production process. Key Responsibilities Setup a delivery roadmap for Data Comprehension/Solidatus across all business areas. Work with the Architecture … and IT teams to design/build the appropriate structure, properties and standards needed to create an Enterprise data model that meets the requirements of PIC's data strategy. Develop and maintain appropriate documentation in relation to data comprehension activities. Oversee delivery of Solidatus models and provide regular feedback on success. Work with business SMEs in developing … for underlying models. Work with technical SMEs in translating underlying code into Solidatus models where appropriate. Awareness of legal and regulatory matters and internal policies relevant to PIC's data management. Work with members of the Data Office to successfully deliver against the department's objectives. Knowledge, Experience, Skills and Abilities Technical An understanding of both data More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

Job Description: Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents at … to demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and storage More ❯

PLEASE READ JOB DESCRIPTION** Location: London (Hybrid Working) Department: IT – Data Team Employment Type: Full-time/Permanent Salary : Circa 50k + Bonus About the Role We are hiring a Data Team Analyst to join a clients growing Data Team within the IT department. This role is a great opportunity for someone with a passion for data governance, quality, and cross-functional collaboration, particularly within the financial services sector. As a key member of the team, you'll help implement and evolve the organisation’s Data Strategy, focusing on introducing robust data governance frameworks and supporting the business in better understanding and managing its data assets. Key Responsibilities Assist in the development and … refinement of Data Governance policies and procedures. Maintain and enhance the Data Catalogue, including Business Glossary, Data Lineage, and associated governance components. Collaborate with business stakeholders to promote data best practices and ensure clarity on roles and responsibilities. Support and coordinate Data Governance meetings, capturing key decisions and follow-up actions. Work closely with More ❯

PLEASE READ JOB DESCRIPTION** Location: London (Hybrid Working) Department: IT – Data Team Employment Type: Full-time/Permanent Salary : Circa 50k + Bonus About the Role We are hiring a Data Team Analyst to join a clients growing Data Team within the IT department. This role is a great opportunity for someone with a passion for data governance, quality, and cross-functional collaboration, particularly within the financial services sector. As a key member of the team, you'll help implement and evolve the organisation’s Data Strategy, focusing on introducing robust data governance frameworks and supporting the business in better understanding and managing its data assets. Key Responsibilities Assist in the development and … refinement of Data Governance policies and procedures. Maintain and enhance the Data Catalogue, including Business Glossary, Data Lineage, and associated governance components. Collaborate with business stakeholders to promote data best practices and ensure clarity on roles and responsibilities. Support and coordinate Data Governance meetings, capturing key decisions and follow-up actions. Work closely with More ❯

Location: London (2-3 days on site) Department: Data & Analytics About the Role We are looking for a skilled and strategic Data Architect to lead the design and implementation of scalable, secure, and high-performing data solutions across our cloud environment. In this role, you will play a critical part in shaping our enterprise data architecture … using Microsoft Azure, Microsoft Fabric, and related technologies. You will work across teams to integrate diverse data sources, optimize database performance, and ensure compliance with evolving data governance standards. Key Responsibilities Architect Scalable Data Solutions: Design and implement efficient data models and database architectures to support current and future business needs. Develop Documentation & Metadata Standards: Maintain … clear and up-to-date architectural documentation, including metadata definitions and data lineage diagrams. Establish Data Standards & Best Practices: Define and enforce data architecture principles, governance policies, and operational procedures to maintain consistency and compliance. Enhance Performance & Reliability: Continuously refine and optimize database environments for speed, availability, and resilience. Enable Cross-Platform Integration: Collaborate with engineering More ❯

an enriching work experience on several levels: relational, professional, and cultural. Every day, our teams are making trade happen. Join us! Job Description We are seeking an experienced Business Data Architect – Keying and Linking to lead the design, development, and optimization of keying and linking processes that support enterprise-wide data integration, master data management (MDM), and … identity resolution. You will be responsible for creating data architecture strategies that enable the accurate identification, deduplication, and unification of data entities across complex systems and business domains. Qualifications Key Responsibilities: Design and implement keying and linking architectures to enable accurate entity resolution and data deduplication across diverse data sources. Define and maintain data matching … rules , and record linkage strategies in support of Multi-sourcing and product 360 initiatives. Collaborate with business stakeholders to gather requirements and translate them into technical design for data integration and unification. Developing data profiling, data quality assessment , and cleansing activities to support accurate keying and linking. Partner with IT and business teams to ensure governance and More ❯

an enriching work experience on several levels: relational, professional, and cultural. Every day, our teams are making trade happen. Join us! Job Description We are seeking an experienced Business Data Architect – Keying and Linking to lead the design, development, and optimization of keying and linking processes that support enterprise-wide data integration, master data management (MDM), and … identity resolution. You will be responsible for creating data architecture strategies that enable the accurate identification, deduplication, and unification of data entities across complex systems and business domains. Qualifications Key Responsibilities: Design and implement keying and linking architectures to enable accurate entity resolution and data deduplication across diverse data sources. Define and maintain data matching … rules , and record linkage strategies in support of Multi-sourcing and product 360 initiatives. Collaborate with business stakeholders to gather requirements and translate them into technical design for data integration and unification. Developing data profiling, data quality assessment , and cleansing activities to support accurate keying and linking. Partner with IT and business teams to ensure governance and More ❯

The team you'll be working with: We are seeking a highly skilled and experienced Data Architect to join our dynamic team. The ideal candidate will have a strong background in the full data modeling lifecycle, including designing, implementing, and maintaining complex data models that align with organizational goals and industry standards. This role requires a deep … understanding of data architecture, data modeling methodologies, and experience with real-time data integrations. The successful candidate will collaborate with cross-functional teams to ensure optimal data structures supporting business intelligence, analytics, and operational needs. This role involves creating, assuring, and overseeing the implementation of data models within analytical and real-time streaming domains. What … you'll be doing: Develop conceptual, logical, and physical data models to support data analytics, streaming, and data product implementation. Define and maintain data architecture standards, principles, and best practices. Ensure data models are aligned with business requirements and scalable for future needs. Work closely with business stakeholders, data engineers, data solution architects More ❯

that result in low levels of production issues Awareness of industry best practice and new and upcoming technology trends Full solution architectural understanding across networking and software Experience of data programmes and data technologies, ideally gained within an enterprise scale organisation or within technology or development team or similar. Technical exposure to and/or experience in a … range of technologies and architectural best practice concepts, specifically Data Engineering Design Snowflake expert with hands-on experience of data modelling and best practises MS Azure Data Stack - Data Factory, Data Lake Storage, Azure SQL, Azure ML, Power BI Automation of CICD pipelines across different technologies including Power BI, Snowflake and the Azure Data Stack Data Science, Analytics & Reporting Design Understanding of implementations for Operational (near real time data management and analytics) and MI (‘aged’ data) data modelling and reporting Exposure and passion for new and emerging data technologies and trends Exposure to concepts of Data Governance (e.g. Data Quality, Data Management, Data Lineage More ❯