76 to 100 of 111 Data Lineage Jobs in London

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and shape how data … and risk. This is a hands-on leadership role in a high-trust, high-ownership environment. You’ll lead a squad of talented engineers, architect the future of our data ecosystem, and drive modern, scalable engineering practices across the organisation. What you’ll do Lead and develop a squad of 4–6 data engineers. Own the technical strategy … for the data platform and internal data products. Design scalable, secure, observable data architectures. Work closely with product and business teams to deliver meaningful outcomes. Drive engineering excellence, automation, and standardisation. Mentor and coach engineers, raising the bar across the function. Stay hands-on when needed: you build it, you run it. What you’ll work on More ❯

highly visible, hands-on engineering role with a strong focus on pragmatic, production-ready solutions that drive real business impact. This role and team collaborate closely with the wider Data team (Data Science, Core Data Engineering) and the wider organisation (Technology, Legal, Information Security) to onboard/develop & scale AI applications. As AI & ML Engineer you will … APIs and microservices for AI/ML solutions, ensuring security, scalability, and observability. Implementing CI/CD for ML services, writing infrastructure as code, and monitoring for model/data drift and performance. Establishing robust guardrails for safe AI usage, including prompt security, practical evaluation frameworks, and compliance with privacy regulations. Driving and evangelizing best practices, reusable templates, and … documentation to scale AI/ML delivery across the business. Collaborating with data engineers, data scientists, front & back-end engineers, product managers, legal & infosec colleagues to deliver impactful solutions end-to-end. Who you will work with The AI & ML Engineer Lead and the wider data team. About you The role requires a blend of technical depth More ❯

a few. This role is based in Finland, and can be located at either our Helsinki or Tampere offices, or remotely from the UK. Key Responsibilities Designing and optimizing data solutions in a cloud environment Integrating data pipelines with external services through APIs Enforcing data security measures, including encryption and access controls Designing data solutions adhering … to regulatory requirements (e.g., GDPR, HIPAA)Implementing metadata repositories for tracking data lineage and dependencies Building data solutions leveraging different data ingestion methods and technologies Skills, Knowledge And Expertise Must have: Experience with cloud-based technologies (such as Azure) Proficiency in designing and implementing complex system integrations Experience with Python and .NET Experience in implementing data … Pandas In-depth knowledge of various database system technologies (relational, document, columnar, etc.) Understanding and experience with relational databases and implementation of OLTP and OLAP systems Professional experience in data modeling and database optimisation Nice to have: Experience in implementing version control for data artifacts Expertise in data migration strategies Familiarity with machine learning integration Knowledge and More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes More ❯

and these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience with … Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates with experience … with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes More ❯

corporate landscape is dynamic and the world ahead is full of possibilities! As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Hands-on experience with Apache … Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC Experience with Confluent Platform, Confluent Cloud managed … services, multi-cloud deployments, and Confluent for Kubernetes Knowledge of data mesh architectures, KRaft migration, and modern event streaming patterns Exposure to monitoring tools (Prometheus, Grafana, Splunk) Experience with data lakes, data warehouses, or big data ecosystems High quality awareness Infosys is a global leader in next-generation digital services and consulting. We enable clients in More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing consultancies in … Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a forward-thinking consultancy … that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities Data More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing consultancies in … Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a forward-thinking consultancy … that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities Data More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing consultancies in … Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a forward-thinking consultancy … that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities Data More ❯

Forward Deployed Engineer – London – Up to £100,000 per annum Are you a data-driven professional with a passion for delivering impactful solutions using Palantir Foundry? Do you excel in translating complex data challenges into actionable insights? If so, Morela has an exciting opportunity for you. Morela is proud to partner one of the fasted growing consultancies in … Europe, renowned for their innovative approach to data integration and analytics. As they continue to expand, they're seeking a skilled Forward Deployed Engineer to join their dynamic team. This role is perfect for someone who combines technical expertise with a consultative mindset, aiming to drive value across diverse projects. You'll be part of a forward-thinking consultancy … that operates at the intersection of advanced technology and real-world impact. Serving both public and private sectors, their services encompass strategic advisory, digital transformation, and end-to-end data engineering. As a Forward Deployed Engineer, you'll play a crucial role in designing and implementing data solutions that empower clients to make informed decisions. Core Responsibilities Data More ❯

software/DevOps/MLOps capability to develop, productionise, and scale systematic investment models and sustainability analytics. You will own the end to end research to production lifecycle : automating data operations, building and validating quant models, and integrating them into scalable platforms, while providing timely responses to internal and external client queries. The role is a key contributor to … decay/robustness analysis; implement model risk controls , documentation, and reproducibility. Scale and commercialise proprietary metrics for investment use‐cases and new revenue lines (e.g., indices, APIs/subscriptions, data products). 2) Data Operations & Quality Control (Automation‐First) Work with systematic team and IT to automate ingestion, validation, and monitoring of 30+ multi‐vendor datasets (schema evolution … mapping, entity resolution, referential integrity, SLA oversight). Run impact analysis of data changes on models and reporting; manage deployment pipelines and data lineage/audit trails ; support data procurement and budgeting. 3) Platform Development & Process Management Co-develop with systematic team and IT a scalable data/quant architecture (data pipelines, model services More ❯

Overview: We are seeking a technically proficient Data Analyst to join our IT Department. This role will focus on API design and systems integrations , playing a vital part in enabling data-driven decision-making and ensuring seamless data exchange across internal and external platforms. Key Responsibilities: Design, document, and maintain APIs to facilitate secure and efficient data integration between systems. Analyse and interpret complex datasets to support IT operations and strategic initiatives. Create and maintain data dictionaries , business glossaries , and detailed documentation of data structures and relationships. Define and document data lineage and transformations to ensure transparency and consistency. Collaborate with developers, architects, and business analysts to define integration and reporting requirements. … Contribute to the development of dashboards and reporting tools using Power BI, Azure Foundry, and Fabric . Ensure data quality, compliance, and governance across all integrations. Support automation efforts by embedding APIs into existing workflows. Work closely with vendors to design solutions aligned with architectural standards and best practices. Key Skills & Experience: Proven experience in a Data Analyst More ❯

design, and cloud-native platforms (specifically Microsoft Azure, leveraging services like Azure AI Studio/Foundry, Azure OpenAI, Databricks). Collaborate with C-suite executives, Directors, Business & technology stakeholders, data scientists, and engineering teams to ensure that AI initiatives are scalable, secure, ethically sound, and aligned with Ecolab's core business of water, hygiene, and infection prevention solutions. Key … and multi-agent systems, integrating them with core enterprise systems like SAP, Salesforce, and the ECOLAB3D™ platform. Define and enforce architectural standards and governance frameworks for the agent lifecycle, data lineage, observability, and interoperability. Technology Evaluation and Selection: Evaluate and select AI platforms, tools, and protocols, such as LangChain, AutoGen, or similar frameworks, ensuring they meet scalability, security … development and operations teams through the deployment, integration, and testing of AI solutions. Champion best practices in AIOps, LLMOps, and agile methodologies to ensure smooth delivery and production deployment. Data and Integration: Ensure data readiness for AI initiatives, collaborating with data engineers to design robust data pipelines (leveraging tools like Databricks) that provide timely, accurate, and More ❯

Paxus architecture with 6+ years in enterprise AI solutions • Design end-to-end AI solutions for private equity fund operations and financial automation • Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. • Experience performing data mapping and reconciliation between Intacct and Paxus other financial systems • Understanding of fund accounting concepts … capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). • Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. • Strong documentation and analytical skills – process maps, data lineage, and data dictionary creation. • Proven ability to work with both technical and accounting teams, translating between system data and business meaning. • Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. • Hands-on experience with Azure OpenAI GPT-4/5, embedding models, and Azure cloud services • Strong background in Python, distributed systems, and enterprise architecture • Knowledge in Claude Code for agentic coding and AI-powered development. More ❯

Job Details: Location: London(Hybrid) Required Skills & Experience: 8–12 years of experience in financial systems or fund accounting process analysis. Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. Experience performing data mapping and reconciliation between Intacct and other financial systems (e.g., Investran, Yardi, Paxus, or GL extracts). … Understanding of fund accounting concepts (capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. Strong documentation and analytical skills – process maps, data lineage, and data dictionary creation. Proven ability to work with both technical and accounting teams … translating between system data and business meaning. Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. More ❯

Analyst for one of our customer who has an expertise in:- 812 years of experience in financial systems or fund accounting process analysis. Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. Experience performing data mapping and reconciliation between Intacct and other financial systems (e.g., Investran, Yardi, Paxus, or GL … Understanding of fund accounting concepts (capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. Strong documentation and analytical skills process maps, data lineage, and data dictionary creation. Proven ability to work with both technical and accounting teams … translating between system data and business meaning. Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. Employment type:- Inside IR35 Contract. It would be hybrid working in London, UK. Note:-Only apply if you have valid visa in the EU Region, Sponsorship will not be given. More ❯

for one of our customer who has an expertise in:- 8–12 years of experience in financial systems or fund accounting process analysis. Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. Experience performing data mapping and reconciliation between Intacct and other financial systems (e.g., Investran, Yardi, Paxus, or GL … Understanding of fund accounting concepts (capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. Strong documentation and analytical skills – process maps, data lineage, and data dictionary creation. Proven ability to work with both technical and accounting teams … translating between system data and business meaning. Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. Employment type:- Inside IR35 Contract. It would be hybrid working in London, UK. Note:-Only apply if you have valid visa in the EU Region, Sponsorship will not be given. More ❯

for one of our customer who has an expertise in:- 8–12 years of experience in financial systems or fund accounting process analysis. Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. Experience performing data mapping and reconciliation between Intacct and other financial systems (e.g., Investran, Yardi, Paxus, or GL … Understanding of fund accounting concepts (capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. Strong documentation and analytical skills – process maps, data lineage, and data dictionary creation. Proven ability to work with both technical and accounting teams … translating between system data and business meaning. Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. Employment type:- Inside IR35 Contract. It would be hybrid working in London, UK. Note:-Only apply if you have valid visa in the EU Region, Sponsorship will not be given. More ❯

for one of our customer who has an expertise in:- 8–12 years of experience in financial systems or fund accounting process analysis. Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. Experience performing data mapping and reconciliation between Intacct and other financial systems (e.g., Investran, Yardi, Paxus, or GL … Understanding of fund accounting concepts (capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. Strong documentation and analytical skills – process maps, data lineage, and data dictionary creation. Proven ability to work with both technical and accounting teams … translating between system data and business meaning. Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. Employment type:- Inside IR35 Contract. It would be hybrid working in London, UK. Note:-Only apply if you have valid visa in the EU Region, Sponsorship will not be given. More ❯

for one of our customer who has an expertise in:- 8–12 years of experience in financial systems or fund accounting process analysis. Strong working knowledge of Sage Intacct data structures, APIs, chart of accounts, reporting hierarchies, and journal logic. Experience performing data mapping and reconciliation between Intacct and other financial systems (e.g., Investran, Yardi, Paxus, or GL … Understanding of fund accounting concepts (capital calls, distributions, management fees, unrealized gains/losses, investor-level accounting). Ability to extract and analyze Intacct reports, exports, or API-based data to derive insights. Strong documentation and analytical skills – process maps, data lineage, and data dictionary creation. Proven ability to work with both technical and accounting teams … translating between system data and business meaning. Proficiency in Excel, SQL basics, or BI tools for data analysis and validation preferred. Employment type:- Inside IR35 Contract. It would be hybrid working in London, UK. Note:-Only apply if you have valid visa in the EU Region, Sponsorship will not be given. More ❯

Snowflake Data Engineer, 4 months, Remote, CO7369 A leading software consultancy requires a Snowflake Data Engineer - for the next 4 months - to work on a prestigious client project to deliver an innovative data platform Working remotely and outside of IR35, the Snowflake Data Engineer will: Improve the transparency and traceability of data through well-documented … pipelines and clear data lineage. Ensure seamless data integration and architecture Optimise data processing performance Collaborate with development and data teams to support data-driven features and insights Experience Required: Snowflake expertise Solid data engineering expertise including strong SQL and Python Proficiency in DBT for transformation tasks Experience with Dagster or a similar orchestration … tool Familiarity with Azure So What's Next? If you are an experienced Snowflake-focused Data Engineer and are available for a prompt start; apply now for immediate consideration! Corriculo Ltd acts as an employment agency and an employment business. #GB More ❯

Apache Kafka and the Confluent Platform. You will work closely with clients to understand business requirements, define integration strategies, and guide implementation teams in building scalable, secure, and resilient data streaming ecosystems. Strongly Preferred: • Experience in designing and architecting solutions using Apache Kafka, with hands-on experience in Confluent Kafka • Ability to lead client engagements, translate business requirements into … technical solutions, and guide implementation teams • Deep understanding of Kafka internals, KRaft architecture, and Confluent components • Experience with Confluent Cloud, Stream Governance, Data Lineage, and RBAC • Expertise in stream processing (Apache Flink, Kafka Streams, ksqlDB) and event-driven architecture • Strong proficiency in Java, Python, or Scala • Proven ability to integrate Kafka with enterprise systems (databases, APIs, microservices) • Hands … Kafka, Cloudera Kafka, AWS MSK, etc. • Solid understanding of Kafka architecture and operational management in enterprise environments. • Experience in professional services or implementation consulting for SaaS products, especially involving data integration, streaming, or enterprise architecture Personal Besides the professional qualifications of the candidates we place great importance in addition to various forms personality profile. These include: • High analytical skills More ❯

Apache Kafka and the Confluent Platform. You will work closely with clients to understand business requirements, define integration strategies, and guide implementation teams in building scalable, secure, and resilient data streaming ecosystems. Strongly Preferred: • Experience in designing and architecting solutions using Apache Kafka, with hands-on experience in Confluent Kafka • Ability to lead client engagements, translate business requirements into … technical solutions, and guide implementation teams • Deep understanding of Kafka internals, KRaft architecture, and Confluent components • Experience with Confluent Cloud, Stream Governance, Data Lineage, and RBAC • Expertise in stream processing (Apache Flink, Kafka Streams, ksqlDB) and event-driven architecture • Strong proficiency in Java, Python, or Scala • Proven ability to integrate Kafka with enterprise systems (databases, APIs, microservices) • Hands … Kafka, Cloudera Kafka, AWS MSK, etc. • Solid understanding of Kafka architecture and operational management in enterprise environments. • Experience in professional services or implementation consulting for SaaS products, especially involving data integration, streaming, or enterprise architecture Personal Besides the professional qualifications of the candidates we place great importance in addition to various forms personality profile. These include: • High analytical skills More ❯