51 to 75 of 559 ETL Jobs in London

unit testing Understanding of CI/CD pipelines to maintain code quality and facilitate deployments Knowledge of Data Engineering fundamentals, including Batch processing and ETL/ELT Basic understanding of various data architectures, such as Lakes and Warehouses Knowledge of data cleansing and transformation within unified, standardised schemas Basic ...

time‐series (TimescaleDB/InfluxDB), and document (MongoDB) stores used by applications Design the data ingestion and movement architecture – real‐time CDC pipelines, batch ETL/ELT patterns, and event‐driven feeds from the NATS messaging layer into Snowflake Define data domain boundaries, ownership, and lineage standards aligned with Project ...

ability to provide credible technical leadership. Experience leading, mentoring or providing technical direction to BI/reporting professionals. Solid understanding of data warehousing, ETL/ELT, semantic modelling and enterprise reporting concepts. Proven experience delivering and supporting business‐critical, enterprise‐level reporting solutions. Ability to manage competing priorities, translate business ...

standardisation : Experience in resolving data quality issues and ensuring data accuracy through cleansing and standardisation techniques. Use of data integration tools : Skilled in using ETL tools for data integration and storage. Ensures data interoperability with other datasets. Collaboration with data professionals : Experience collaborating with other data professionals to improve modelling ...

and with different software solutions (Snowflake, Azure, SQL, Python); Provide the handling of (and where needed training of) Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into … Knowledge of developing dimensional data models from unstructured content and awareness of the advantages and limitations of Star Schema and Snowflake schema designs; Solid ETL development, reporting knowledge based off intricate understanding of business process and measures; Knowledge of Snowflake cloud data warehouse and Azure cloud is preferred; Knowledge ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...

trusted advisor to client stakeholders on data analytics matters Python for data analysis and automation (pandas, numpy, scipy, etc.) Data Engineering Knowledge: Familiarity with ETL processes, data integration tools, and modern data platforms (e.g., Databricks) Communication: Excellent stakeholder management and presentation skills; fluent English (written and verbal) Power BI Expertise ...

Mongo DB with Python and Pyspark Building data warehouse or data lakes with SCVs or in conjunction with CDP platforms Experience of ELT/ETL tools such as Databricks, Azure Data Factory, SSIS, Talend, Informatica and Palantir Managing and motivating teams and individuals Understanding and application of statistical and analytical ...

analytics and AI-driven solutions.ResponsibilitiesLead the architecture, design and build of large-scale data platforms using Azure Databricks and modern cloud technologiesImplement and optimize ETL workflows and streaming pipelines with PySpark and Delta Live Tables following Lakehouse principlesEnhance performance, manage cloud costs and ensure platform reliability for structured streaming workloadsDefine ...

track key metrics (ticket volumes, server utilisation, application performance). Partner with Finance, Sales, and Operations to gather requirements and build self‐service reports (ETL pipelines, dimensional modelling). Coordinate with data architects and data analysts to ensure data accuracy and governance in the enterprise data warehouse. Project & Change Management ...

tierenvironments. Maintaining and updatingthe technical documentation suite in Azure DevOps. To be successful in this role, you’ll: D emonstrate solid experience developing of ETL/ELT ingestion pipelinesto handle data movement, transformation and visualisations from structured andunstructured sources. Have experiencewith the Azure Platform including: DataIngestion: Azure Data Factory ...

experience Production data engineering, including SQL, Python, a modern data platform such as Databricks, Snowflake or Fabric, and orchestration tooling, with practical experience of ETL/ELT, data testing, Git and CI/CD; PySpark or dbt experience is beneficial. Working knowledge of finance data structures, including chart of accounts ...

clients in the context of their business Be responsible for end-to-end delivery of projects across the full lifecycle - Data extraction, transformation, loading (ETL), analysis, visualisation, deployment and client delivery Handle a large amount of structured and unstructured data from a variety of data sources Carry out reactive and ...

enterprise data strategies. Managed and versioned models stored in tools like ERwin. Data Mapping Documents Mapping between source systems and target models, especially for ETL/ELT processes. Mapping between target models and Semantic models. Documentation of naming conventions, modelling standards, and best practices to ensure consistency across the organization ...

remote teams. Strong proficiency in programming languages like Python. Proven experience designing and implementing enterprise data warehouse solutions. Proven expertise in building and optimizing ETL pipelines using tools like SQL, Python and dbt. Experience with AI development tools and platforms (e.g., GPT APIs, Copilot) and AI agent frameworks. Architect, designing ...

experience Production data engineering, including SQL, Python, a modern data platform such as Databricks, Snowflake or Fabric, and orchestration tooling, with practical experience of ETL/ELT, data testing, Git and CI/CD; PySpark or dbt experience is beneficial. Working knowledge of finance data structures, including chart of accounts ...

Modern Data Platform Expertise You're familiar with contemporary data platforms and tools, including data lakes, open table formats such as Parquet and Iceberg, ETL and ELT pipelines, multiple query engines, and BI tools such as Power BI. You're comfortable working across cloud environments including AWS, Azure and ...

spoke, data lakes, data fabrics, lakehouses. Detailed understanding of Databricks eco system. Strong experience of Data reporting solutions from data warehousing (Kimble and Inmon), ETL, reporting tools, and document stores. Exceptional communication skills to explain concepts and solution designs to any stakeholders across the enterprise. Clear formal communication skills ...

platform – Microsoft Fabric, Azure Synapse/Databricks, data lakehouse and warehouse design, migration and modernisation from legacy platforms. Data engineering and integration – ingestion pipelines, ETL/ELT modernisation, master data management, unstructured content preparation (SharePoint, file shares, Teams) for retrieval-augmented AI. Data governance, quality and security – Microsoft Purview, cataloguing ...

with different software solutions (Snowflake, Azure, SQL, Python). Provide the handling of (and where needed training of) Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake. Participate in the Natural Language Processing (NLP) extract of unstructured data into … Knowledge of developing dimensional data models from unstructured content and awareness of the advantages and limitations of Star Schema and Snowflake schema designs. Solid ETL development, reporting knowledge based off intricate understanding of business process and measures. Knowledge of Snowflake cloud data warehouse and Azure cloud is preferred. Knowledge ...

considerations Familiarity with Lakehouse Federation in Azure Databricks — federating queries across external data sources without full ingestion Experience with Azure Data Factory or equivalent ETL/ELT tooling for enterprise source ingestion pipelines Experience with Power BI data modelling and DirectQuery/Import mode considerations for Databricks SQL Warehouse connectivity ...

Snowflake), and develop dashboards with Power BI in an Agile team. You bring 5+ years in data engineering, strong Oracle 19c+ experience, warehousing concepts, ETL/ELT, and cloud familiarity (AWS Redshift/RDS). Bonus familiarity with dbt and CI/CD will help you improve data quality and ...

and code modular data services and APIs that unify campaign, conversion, and audience datasets across 20+ marketing platforms. Build and optimize schemas, transformations, and ETL logic for high‐performance, reusable data workflows. Contribute directly to the DFP codebase (Python, SQL, Spark) — developing pipelines and infrastructure alongside the engineering team. Establish ...