1 to 25 of 87 ETL Jobs in London

guidance and support to junior engineers within the team Design, develop, and test robust data pipelines for ingestion, processing, and transformation Implement and maintain ETL/ELT workflows feeding data warehouses, data lakes, or lakehouse platforms Leverage open-source and AWS-native tools to deliver scalable data solutions Apply DevOps ...

that tends to appeal. You will work with Building and maintaining enterprise-grade data pipelines across CRM, HR, Finance, and commercial systems Developing automated ETL/ELT pipelines using modern Azure tools Turning raw data into clean, reliable, analytics- and AI-ready datasets Working closely with data architects, analysts, and ...

deliver robust data solutions that support operational and strategic objectives. This role requires active Security Check (SC) clearance. Key Responsibilities * Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data sources. * Build scalable data ingestion and transformation frameworks using cloud-native and on-premise technologies. * Develop and ...

and AI-driven solutions. This is not a passive learning role, you will be expected to contribute quickly. Role Build and support data pipelines (ETL/ELT) Work with data across Bronze/Silver/Gold layers Transform and model data for reporting and analytics Support development of Power ...

Catalog, Delta Sharing, Pyspark, Spark SQL etc.) Snowflake (data warehousing & data sharing, Iceberg, ) Strong understanding of: Data architecture patterns, industry benchmarking, Data integration patterns (ETL/ELT, streaming, CDC, APIs) Data governance & metadata management Architecture & M&A Experience Proven experience in M&A data integration, platform consolidation, or carve-outs ...

Databricks and Spark Strong understanding of data modelling (3NF, dimensional modelling, star/snowflake schemas, data vault concepts) Experience designing and operating ELT/ETL pipelines Familiarity with data quality frameworks, SLA monitoring and lineage tracking Experience with Snowflake and dbt Proficiency with AWS Experience with version control, CI/ ...

Data Engineer should have: Strong experience designing and building scalable data platforms in Azure. Deep expertise in Azure Data Factory, SQL, and Python for ETL/ELT pipelines Proven ability to lead, mentor, and develop data engineering teams Hands-on experience with data warehousing, modelling, and performance tuning Solid understanding ...

environments is beneficial Experience with MLOps practices and tools (CI/CD pipelines, model monitoring, versioning) Strong understanding of data engineering concepts (ETL pipelines, data lakes, feature engineering) Experience working with large-scale structured and unstructured datasets Knowledge of AI ethics, bias mitigation, and model governance Comfortable working in Agile ...

Understanding: Strong knowledge of distributed processing (e.g. Apache Spark). Familiarity with Hadoop ecosystem components. Working knowledge of SQL and NoSQL technologies. Understanding of ETL/ELT design trade-offs. Awareness of DevOps practices and CI/CD for data platforms. Understanding of how ML/AI workloads integrate into ...

using React and modern JavaScript/TypeScript. Experience designing and building APIs and distributed systems. Solid understanding of data engineering concepts, including data modelling, ETL/ELT pipelines, and performance optimisation. Experience with CI/CD, containerised systems, and modern deployment workflows. Familiarity with working alongside data science teams and ...

and analytics: Design and deploy sophisticated Power BI dashboards, develop predictive models to identify at-risk learners and funding risks, lead data warehousing and ETL processes, and maintain a single trusted version of the College's data. Funding and audit readiness: Ensure the College's BI and reporting capability ...

with a strong background in SQL, Python, and PySpark/Spark. Proficiency in building REST API integrations, with a solid understanding of data modelling, ETL/ELT patterns, and modern data warehousing concepts. Hands-on experience with Microsoft Fabric (or equivalent lakehouse platform), Power BI Direct Lake semantic models, and ...

commodities, trading, or financial markets Experience with derivatives pricing or risk systems Knowledge of Numerix or similar quant/risk platforms Understanding of ETL and data pipeline design Experience working in Agile delivery environments McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

and develop scalable BI solutions, data models, dashboards, and reporting frameworks that turn complex data into clear business insights. Key responsibilities include: Building automated ETL/ELT pipelines and data models Creating dashboards and reports for senior leaders and business users Improving data quality, documentation, and governance Optimising SQL queries ...

with Snowflake, MS SQLServer , DBT , and Azure DevOps (or similar CI/CD). Data Expertise: Solid understanding of data modeling, curation, orchestration, and ETL tools (e.g., Matillion, SNP Glue, Fivetran). Engineering Best Practices: Experience with shell scripting, unit testing, and test-driven development (TDD). Soft Skills: Excellent ...

Engineering function, shaping architectural direction, ensuring engineering excellence, and partnering with Technology, Architecture, and Business teams across the organisation. Tech Stack SQL Oracle Python ETL Background: The bank is migrating from an on-premise Oracle estate to a modern data platform built on cloud and Databricks. This role leads ...

working examples) for: Lead platform modernisation by evaluating, adopting, and migrating to newer, more cost effective Microsoft first capabilities; retire legacy or over engineered ETL approaches and decommission redundant components Promote AI driven development practices (e.g., AI assisted code generation, test creation, documentation, and refactoring) with appropriate guardrails around security ...

excellent communication skills across all channels and levels of recipients including team members, colleagues, clients at all levels including C suite. Experienced hands-on ETL, Snowflake, CI/CD Pipelines, SQL, Data Quality rules and Data-Readiness design and implementation of data platforms Experience in designing and implementing relational data ...

Experience coordinating UAT and strong analytical capability Nice to Have: Basic knowledge of data engineering principles, with prior exposure to data engineering teams (e.g. ETL fundamentals) This is an urgent requirement – please reach out to Adam Akhtar at Opus as soon as possible for further information. ...

Azure Data Lake Drive data quality, governance, and performance Collaborate with global teams in an agile environment What you’ll bring: Strong SQL + ETL/ELT experience Knowledge of Python/T-SQL Exposure to cloud platforms (Azure preferred) Nice to have: Databricks, Spark, CI/CD, big data ...

collaboration and innovation, they invest heavily in their data platform and analytical capability. The Role Design, build, and maintain scalable data models and automated ETL or ELT pipelines within a cloud data warehouse environment. Lead the development of executive-level dashboards and self-serve reporting solutions that balance clarity with ...

strong problem‐solving abilities. Proficiency in SQL with 5+ years of hands‐on experience (complex queries, performance tuning, data modelling). Working knowledge of ETL processes and data flows, including validation, transformation, and loading. High proficiency in Excel for data analysis (formulas, pivot tables, lookups, automation, etc.). Experience working ...

Proven experience designing cloud-native, scalable, secure, and highly available enterprise solutions. Strong knowledge of modern data platforms and technologies including Data Lakes, Lakehouse, ETL/ELT, Kafka, and Spark. Expertise in microservices, APIs, event-driven architectures, integration patterns, and distributed systems design. Good understanding of data governance, cloud security ...

ready, and transition smoothly to BAU operations. Required Skills & Qualifications: Proficiency in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Composer. Familiarity with CI/CD & DevOps practices, including automated testing ...

Multi-Engine Management: Administer a hybrid database environment, ensuring seamless data flow between PostgreSQL (Live Trading) and ClickHouse/Snowflake (Analytics). Data Movement & ETL: Own the reliability of CDC pipelines that stream data from production Postgres instances into the analytical layer. Schema Evolution: Manage schema changes across different engines ...