51 to 75 of 181 ETL Jobs in London

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

support Pragmatic approach to balancing technical delivery with business needs Desirable Python experience for infrastructure automation and tooling Familiarity with data pipeline infrastructure (supporting ETL workloads, data warehousing) and experience with Snowflake or a comparable cloud data warehouse Experience with data governance and compliance requirements Cloud cost and resource utilisation ...

and web-scraping pipelines. 3. Data engineering & APIs Build and maintain API/MCP integrations to fetch, clean, and aggregate data. Set up small ETL flows to monitor targets and portfolio companies. Use Python, SQL, or whatever you prefer to deliver dashboards or structured outputs. What we’re looking ...

actionable and scalable. \n • Expertise of using Spark, Dremio, Teradata or other SQL technologies. \n • Strong knowledge and experience of using business intelligence, ETL frameworks and visualisation tools such as Tableau. \n • Experience with Python, GitHub, data orchestration tools (Oozie, Airflow) for data wrangling, building data pipelines and building analytical ...

valuation processes, and investor reporting cycles.Demonstrated experience owning platform-level or infrastructure product workstreams with high technical complexity.Familiarity with data architecture concepts: data modeling, ETL pipelines, API design, and event-driven systems.Experience with agile development methodologies; strong proficiency with product management tools (Jira, Confluence, Productboard, or similar).Exceptional analytical, communication ...

QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code: Terraform and Ansible for repeatable, automated provisioning ...

and architectures, Data products and Data Governance principles Solid understanding of the full Software Development Lifecycle (SDLC) as relevant to data management. Understanding of ETL, data manipulation, and data preparation processes. An outstanding problem solver who has an analytical mindset, is inquisitive, and excellent with technology enabling a creative approach ...

regulated environments Ability to translate business requirements into robust technical solutions Experience with cloud data platforms (e.g. Databricks, GCP BigQuery) is desirable Exposure to ETL/ELT pipelines or data integration Familiarity with Agile tools such as Jira, Confluence, MS Teams Strong communication skills and ability to engage both technical ...

team of architects and analysts to optimize large-scale datasets, transforming raw information into strategic assets. Your Impact: Pipeline Engineering: Build and optimize scalable ETL/ELT workflows and data pipelines for structured and semi-structured datasets (exposure to policy/insurance data preferred). Snowflake Innovation: Drive CDC-based ...

with architects, analysts, developers, and business stakeholders to deliver reliable and maintainable data solutions. Key Responsibilities Data Pipeline Development Design, develop, and maintain robust ETL/ELT pipelines using Informatica and cloud-native technologies. Build scalable data ingestion, transformation, and delivery processes that support operational and analytical use cases. Cloud ...

and automation. Define Data Mesh principles, domain ownership models, governance, metadata management, and interoperability standards. Establish integration architecture across Snowflake, Kafka, cloud platforms, APIs, ETL/ELT, and downstream systems. Collaborate with business and engineering teams to enable scalable data products. Required Multiple years in Platform Engineering, Cloud, Integration ...

core of advanced AI systems. Key Responsibilities Design, build and optimise scalable cloud-based data platforms and pipelines within AWS. Develop robust ETL and ELT processes capable of handling high-volume and complex datasets. Design and manage data models, schema structures and data reconciliation processes across multiple source systems. Build ...

scale data processing solutions and deploying into a production environment \n • Proficient in SQL and SQL extensions for analytical queries \n • Solid understanding of ETL/ELT data processing pipelines and design patterns \n • Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation ...

disseminated through publications, industry forums, or social media. Desirable Understanding of data architecture principles , including the design and implementation of robust data models and ETL processes, to support the construction of scalable and efficient data systems. Familiarity with big data tools like DuckDB, Polars or Apache Spark for processing ...

issues, and analyze webpage sources and console logs to troubleshoot effectively. Familiarity with JavaScript is a plus. Understanding of Data Pipelines: Awareness of ETL workflows or data movement between APIs, storage, and compute resources. Problem Solving & Communication Proven ability in navigating complex technical challenges and creating tailored solutions for enterprise ...

solutions that drive decision-making across the organisation. You'll be involved in migrating and modernising existing data workloads into Microsoft Fabric, developing robust ETL/ELT processes, integrating Dynamics 365 and Dataverse data, and ensuring the quality, accuracy, and reliability of data throughout the transformation journey. The role offers … data architecture. Key Responsibilities Design, develop, and maintain data pipelines within Microsoft Fabric Build and manage Lakehouses, Notebooks, and data integration workflows Develop efficient ETL/ELT processes to ingest, transform, and deliver data across the business Support the migration of legacy data platforms into Microsoft Fabric Work closely with ...

into technical proposals Your skills and experience Relevant experience conducting data science or model development in a business setting Demonstrated experience with data integration, ETL/ELT processes, and data quality assurance, especially involving new data source systems Educated to bachelor’s degree level or equivalent qualification/relevant work ...

assess and define where data quality controls should be applied (source systems vs pipelines vs consumption layers) Experience evaluating platform capabilities (data storage, ETL, BI, ML) in terms of performance, scalability and real-time capability Strong understanding of how to assess and enable data readiness for AI use cases, including ...

complex environments Expertise in data architecture frameworks and best practices Experience with Azure/AWS/GCP data platforms Solid background in data warehousing, ETL/ELT, and big data technologies Strong knowledge of data governance, security, and compliance Excellent communication and stakeholder management skills Mandatory Criteria Active SC clearance ...

Data Engineer Hands-on experience with Microsoft Fabric Experience with Azure Strong SQL skills Experience using Python, ideally PySpark Experience building and maintaining ETL or ELT pipelines Experience working directly with stakeholders Ability to gather requirements and translate them into technical solutions Experience with KQL, Synapse or Databricks would ...

data management tools (e.g., Collibra, Alation, Informatica). Strong analytical skills (SQL, Excel; Python is a plus). Understanding of data architecture, lineage, and ETL processes. Soft Skills Excellent stakeholder and communication skills. Ability to drive change across global, matrixed organizations. Strong problem-solving and structured thinking. ...

architecture frameworks and methodologies (e.g. TOGAF, Zachman) Broad knowledge of enterprise data technologies, including lakehouse and medallion architectures, legacy data platforms and data engineering (ETL, ELT, CDC) Experience working within large, complex or highly regulated organisations In return, you can expect a flexible working culture, including: Non-contributory career-average ...

responsible AI controls Good understanding of key Azure services such as Virtual Machines, Active Directory, Automation, and related cloud infrastructure Experience building and supporting ETL and workflow pipelines using Azure Data Factory, Databricks workflows, or similar Experience with containerisation and orchestration tools such as Docker and Kubernetes Experience with version ...

perspective will lie with the Technical Product Owner. Data Platform Ownership Coordinate the delivery and maintenance of:Data Warehouse Management (Snowflake), Batch & Real-Time ETL Pipelines Ensure all data pipelines are reliable, performant, and aligned with defined SLAs. Advocate for data quality, consistency, and documentation across the DE ecosystem. Collaboration ...

including audit trails, confidence scoring, and human‐in‐the‐loop controls. Background in traditional ML or data engineering, including feature pipelines, model training, and ETL, is preferred. MongoDB or other NoSQL database experience is preferred. Prior exposure to insurance domain concepts such as underwriting, claims, and policy administration is preferred. ...