1 to 25 of 74 ETL Jobs in the City of London

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

technical teams A security-first mindset when designing and implementing solutions Qualifications & Experience Essential Strong version control principles relating to databases Experience with ETL processes (SSIS or Azure Data Factory preferred) High availability and disaster recovery for SQL Server environments Administering, managing, and maintaining large-scale databases Advanced performance tuning ...

and maintaining high-performance data pipelines ingesting structured and unstructured datasets from a variety of internal and external sources. Developing ingestion processes including scrapers, ETL pipelines, crawlers, streaming jobs, and services. Cleaning, transforming, and enriching datasets to ensure high quality and usability across analytics and trading use cases. Designing storage ...

Azure, or GCP) Advanced SQL skills and experience with at least one backend language (Python, Scala, Java, etc.) Hands-on experience with data warehouses, ETL/ELT, and distributed systems A mindset focused on performance, reliability, automation, and scalability Confidence working cross-functionally and owning technical decisions Exposure to large ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

digital platforms is highly advantageous. Technical Skills: Proficiency in Python, SQL, and BI tools such as Tableau or Power BI. Experience with data pipelines, ETL processes, and familiarity with cloud environments is preferred. Business Development & Analytics Tools: Hands-on experience with CRM systems like Salesforce or HubSpot, and marketing analytics ...

enablement across the business. 🌐 What You’ll Do 🏗 Data Platform Architecture & Strategy Define and evolve the data architecture roadmap Design scalable ELT/ETL frameworks using DBT and cloud data warehouses Establish orchestration standards (Dagster or equivalent) Drive decisions across batch, streaming, and real-time pipelines Champion data modelling standards ...

influence on the data roadmap. ______________ Key Responsibilities Data Architecture & Engineering Leadership • Lead the design and implementation of scalable, secure, and robust data pipelines using ETL/ELT frameworks across GCP. • Define and promote best practices for data engineering, modular design, and orchestration • Provide technical leadership, mentoring, and support across … time, and streaming pipelines using tools such as Airflow, ADF, dbt, and GCP-native services (Dataflow, Dataproc, Cloud Composer) • Design and implement scalable GCP ETL pipelines using BigQuery, Dataflow (Apache Beam), Pub/Sub, and Cloud Storage • Monitor, troubleshoot, and optimise pipelines, storage, and query performance Data Governance, Security & Compliance ...

based pricing, client analytics and internal operational metrics What You Need Strong academic background 4 years or more experience across full stack data including ETL, modelling, analytics and predictive systems Strong Python for ETLs and analysis Strong SQL and dbt experience Experience building from scratch in a startup ...

Advanced DAX, Tabular Editor, DAX Studio, Measure Killer Data Modelling & Architecture: Semantic design, Star Schemas, Semantic models Databases & Platforms: Snowflake, Azure Databricks Data Engineering & ETL: ETL processes, DBT, IBM Data Manager DevOps & Governance: GitHub, Version control, CI/CD, License management, Capacity optimisation Background in commodities or energy trading environments ...

Collibra or Collibra Data Quality Strong SQL skills (PL/SQL or T‐SQL) Experience with Oracle and/or SQL Server Understanding of ETL/data integration Advanced MS Office/Excel/Visio Knowledge of Agile , GDPR/CCPA , and compliance standards Strong analytical/problem‐solving mindset ...

Engineering or Analytics Engineering f unctions within a multichannel business. Strong hands-on technical background across modern data platforms (cloud data lakes/warehouses, ETL/ELT, SQL, Python), with the ability to operate strategically at leadership level. Experience designing and delivering scalable, production-grade data pipelines that support ...

operating within retail banking or financial services environments Deep understanding of data warehousing principles and modelling techniques Advanced SQL expertise and practical experience with ETL/ELT processes Experience working within AWS cloud environments A track record of delivering successful Snowflake migration programmes Confidence engaging with business users and translating ...

firm is early in its AI journey. The right candidate will shape architecture, tooling, and standards. What You’ll Actually Do Build scalable ETL/ELT pipelines from loan systems and financial data Structure complex borrower reporting (financial statements, PDFs, credit memos) Design clean datasets for predictive credit risk models ...

with containerisation and orchestration (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices Strong understanding of databases and data pipelines (SQL, NoSQL, ETL systems) Experience working with large-scale datasets ...

platforms supporting large transformation programmes. • Define modern architectures including lakehouse platforms, distributed analytics, and event-driven systems. • Provide oversight of data engineering environments, including ETL/ELT pipelines, orchestration, and DataOps practices. • Ensure platforms are secure, scalable, resilient, and aligned with governance standards. • Lead architecture workshops and governance forums, aligning ...

systems built on .NET (currently .NET 8–10). Building and optimising Kafka-based streaming applications and real-time data flows. Designing and implementing ETL components for large-scale market data ingestion. Ensuring platform reliability and minimal downtime through strong observability and monitoring practices (Grafana environment). Contributing to architectural ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...

driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable data products Manage data … and modern data pipeline design Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability to lead technical workstreams and mentor junior team members A strong alignment with the organisation’s IDEAL values ...

modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices architecture and distributed systems Experience with DevOps practices for AI/ML workflows (MLOps ...

solutions. Required Skills & Experience End-to-end delivery of large-scale data warehouse (DWH) programmes Amazon Redshift, Apache Airflow, dbt, Tableau, OpenMetadata Advanced SQL, ETL, and data modelling BI tools and customer analytics frameworks Senior stakeholder management (CTIO/CxO level) Strong communication and presentation Enterprise-scale delivery PMP/ ...

and C#. Skills and experience required: Strong proficiency in SQL, Python, and C# (including query optimisation and performance tuning). Experience with data modelling, ETL pipelines, and data integration. Proven ability to work directly with stakeholders and data users to understand problems and deliver effective solutions Strong analytical and problem ...

and Redshift. 🔧 What you’ll be doing: • Scaling and optimising ELT pipelines (Python + Airflow) • Enhancing the data warehouse (performance, cost, complexity) • Expanding Reverse ETL and data activation capabilities • Deepening dbt modelling and data quality frameworks • Driving automation, governance and reliability across AWS • Collaborating closely with Product, Design, Marketing & Finance ...

dashboards Modernise systems into cloud-native, API-first architectures Key skills Cloud engineering (Azure, Kubernetes, serverless, DevOps) Python and relational databases (SQL) Data platforms, ETL/ELT, and analytics AI tools and LLM integrations (e.g. GPT, Claude, Gemini) Security, governance, and regulated environment experience Why this team? Work ...

complex procedural logic into scalable, production-ready distributed pipelines for a Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python ...