1 to 25 of 230 Remote/Hybrid ETL Jobs in London

data architecture, reporting and governance foundations needed for longer‐term transformation. What You'll Be Doing as a Data Engineer: Design, build and improve ETL and ELT pipelines that support data ingestion, profiling, reconciliation, cleansing and reporting across enterprise source systems. Building data catalogues, data flows, interface views and trusted ...

Tableau, Power BI, Python, Azure, Microsoft Azure, Cloud Data, Data Warehouse, Data Architecture, Data Quality, Data Strategy, AI Strategy, Business Intelligence, BI, Analytics, Reporting, ETL, ELT, Data Integration, Data Modelling, Data Migration, Pipeline Development, Data Platform, Data Infrastructure, Data Engineer London, Data Analyst London, Senior Data Engineer London, Mayfair, London. ...

and collaborate with technical and non-technical stakeholders. Hands‐on expertise with SQL Server, SSIS, and relational databases, including writing complex queries and building ETL processes. Practical experience in network engineering, including network monitoring, troubleshooting, and ensuring secure data transmission. Proficiency with reporting and visualization tools (e.g., Power BI, Tableau ...

patterns Data processing: Apache Spark, SQL and distributed processing technologies Data storage: Delta Lake, Apache Iceberg and open table formats Data pipelines: Enterprise-scale ETL/ELT, batch and streaming patterns Transformation and quality: dbt, Great Expectations and equivalent tooling Orchestration: Apache Airflow and cloud-native orchestration services Event streaming ...

with Snowflake. Proven experience developing data transformations and data models using dbt. An understanding of dimensional modelling and data warehousing principles. Experience working with ETL/ELT processes and modern cloud-based data architectures. Knowledge of data lineage, metadata management and data quality frameworks. Experience using Git and working within ...

and modern enterprise data platforms, including Databricks, Microsoft Fabric or another cloud data platform. Strong understanding of modern data architecture patterns, data modelling and ETL/ELT approaches. Practical experience with Spark, PySpark, Python and SQL and the design of scalable batch and real-time data pipelines. Experience designing appropriate ...

datameshand domain-oriented patterns Data processing:Apache Spark,SQLand distributed processing technologies Data storage:Delta Lake, ApacheIcebergand open table formats Data pipelines:Enterprise-scale ETL/ELT,batchand streaming patterns Transformation and quality:dbt, Great Expectations and equivalent tooling Orchestration:Apache Airflow and cloud-native orchestration services Event streaming:Kafka ...

Data Governance, Data Quality, Metadata Management, and Data Lineage.* Experience designing and implementing Data Warehouses, Data Lakes, and Modern Data Platforms.* Strong understanding of ETL/ELT Architecture and Data Integration Frameworks.* Experience with Cloud Data Platforms such as Azure, AWS, or GCP.* Strong SQL and data analysis skills.* Knowledge ...

shaping the data foundation used for critical decision-making, innovative products, and future-focused services.* Own the design, development, and enhancement of scalable ETL/ELT data pipelines.* Develop data products and data platform components aligned with modern architectural principles.* Structure, integrate, and ensure data quality with a focus ...

query performance tuning Dataform or equivalent transformation frameworks (dbt, etc.), writing SQLX, managing dependencies, and maintaining modular, well‐tested transformation logic Solid understanding of ETL/ELT pipeline design, including incremental loads, idempotency, error handling, and pipeline monitoring Working with event‐driven or streaming data pipelines (Pub/Sub, Kafka ...

business stakeholders to make data-driven decisions that shape the future of our company. Key Responsibilities Design, build, and maintain robust, scalable, and reliable ETL/ELT data pipelines . Develop data models and schemas in our data warehouse to support business analytics and reporting needs. Integrate data from ...

party APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems.Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear, documented lineage and integrated testing to protect against bad data entering datasets ...

APIs, returning complex data from multiple endpoints. Implement processes to retain and refresh this data within business systems. Data Modeling: Using the businesses preferred ETL tools, generate curated datasets from raw input tables. Ensure all datasets have clear, documented lineage and integrated testing to protect against bad data entering datasets ...

e.g. Cloud, Azure, Databricks), and enterprise data and analytics ecosystems, including medallion architectures, data lakehouse designs, master data systems, legacy data warehouses, data engineering (ETL, ELT, CDC) for enterprise scale analytics) Experience with data product thinking, domain-oriented ownership or federated operating models Understanding of data standards and industry models ...

analytics, or related disciplines in a complex, global organisation. Proven delivery of modern cloud‐based data platforms, data lakes or warehouses, integration patterns, ETL/ELT pipelines, semantic models, and analytics solutions. Strong knowledge of the Microsoft data and analytics ecosystem, including Azure data services, SQL, Power BI, and modern ...

practical, curious and commercially-minded approach to problem-solving. Desirable Experience with machine learning and predictive modelling. Experience with Snowflake. Experience working with ETL/data integration tools, ideally Matillion. Experience with cloud data platforms and modern data stacks Experience working with large-scale video, image or other unstructured datasets. ...

Reference Data. Cloud Platforms: Microsoft Azure; AWS; GCP. Modern Data Platforms: Databricks; Microsoft Fabric; PostgreSQL. Data Integration: Azure Data Factory; API-led Integration; Kafka; ETL/ELT; Streaming and Event-Driven Architectures. Architecture & Modelling: TOGAF; DAMA; ArchiMate; Sparx Enterprise Architect. Data Governance: Microsoft Purview; Collibra; Informatica; Security by Design; Data ...

frameworks.* Collaborate with business stakeholders, solution architects, product owners, and engineering teams to translate requirements into effective data solutions.* Define data integration patterns using ETL/ELT, APIs, event-driven architectures, and real-time streaming technologies.* Drive cloud migration and modernization of legacy data platforms.* Support advanced analytics, AI/ ...

and transform diverse data types into standardized, unified schemas Good understanding of serverless, code-driven data transformation pipelines as well as traditional batch-oriented ETL systems. Technologies While mastery of everything is not required, we are seeking Engineers who possess hands‐on experience with one or more of the following ...

industry and understand the complexities of insurance data, systems, and business processes. What You'll Do Design, develop, and maintain scalable data pipelines and ETL/ELT processes. Build and optimise cloud-based data solutions and data platforms. Integrate data from multiple source systems into enterprise data environments. Work closely ...

cleansing, and enrichment Data cleansing and standardisation : Experience resolving data quality issues and ensuring data accuracy. Exposure to data integration tools : Basic experience with ETL tools for data integration. Collaboration with data professionals : Some experience working with other data professionals. Understanding visualisation requirements : Ability to understand visualisation needs and create ...

Duration: 6 months Start: ASAP Location: Hybrid, 2/3 days per week in London Key responsibilities Design, build and optimise scalable ETL/ELT data pipelines. Develop and maintain data solutions using Databricks, Python and SQL. Support the migration of data assets from legacy platforms to modern cloud architectures. ...

time‐series (TimescaleDB/InfluxDB), and document (MongoDB) stores used by applications Design the data ingestion and movement architecture – real‐time CDC pipelines, batch ETL/ELT patterns, and event‐driven feeds from the NATS messaging layer into Snowflake Define data domain boundaries, ownership, and lineage standards aligned with Project ...

and with different software solutions (Snowflake, Azure, SQL, Python); Provide the handling of (and where needed training of) Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into … Knowledge of developing dimensional data models from unstructured content and awareness of the advantages and limitations of Star Schema and Snowflake schema designs; Solid ETL development, reporting knowledge based off intricate understanding of business process and measures; Knowledge of Snowflake cloud data warehouse and Azure cloud is preferred; Knowledge ...

promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will Write ETL (Extract/Transform/Load) processes, designs database systems and, develops tools for real-time and offline analytic processing Troubleshoot software and processes for data ...