1 to 25 of 72 ETL Jobs in the City of London

Oversee logical and physical data modelling for Finance and Enterprise data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

technical teams A security-first mindset when designing and implementing solutions Qualifications & Experience Essential Strong version control principles relating to databases Experience with ETL processes (SSIS or Azure Data Factory preferred) High availability and disaster recovery for SQL Server environments Administering, managing, and maintaining large-scale databases Advanced performance tuning ...

documentation, lineage, governance standards. Required Skills/Experience The ideal candidate will have the following: Strong SQL; Snowflake ELT; dbt experience. Python/PySpark, ETL/ELT design. Data Vault 2.0 or dimensional modeling. AWS services (S3, Glue, Lambda, Redshift) or GCP equivalents. Experience with CI/CD for data ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

digital platforms is highly advantageous. Technical Skills: Proficiency in Python, SQL, and BI tools such as Tableau or Power BI. Experience with data pipelines, ETL processes, and familiarity with cloud environments is preferred. Business Development & Analytics Tools: Hands-on experience with CRM systems like Salesforce or HubSpot, and marketing analytics ...

enablement across the business. 🌐 What You’ll Do 🏗 Data Platform Architecture & Strategy Define and evolve the data architecture roadmap Design scalable ELT/ETL frameworks using DBT and cloud data warehouses Establish orchestration standards (Dagster or equivalent) Drive decisions across batch, streaming, and real-time pipelines Champion data modelling standards ...

Bedrock/SageMaker), GCP (Vertex AI); containerization (Docker/Kubernetes) and service meshes. Data & Integration : SQL, NoSQL, data warehousing concepts (fact/dimension, SCD), ETL/ELT, streaming (Kafka/Event Hubs), API design, and secure integration (OAuth2/JWT/RBAC). LLMOps/MLOps & Automation : CI/ ...

Storage, Power BI, Fabric. AI & Machine Learning - generative AI, cognitive services, ML engineering, responsible AI. Modern Data Architecture - lakehouse, data mesh, ELT/ETL, MDM, dimensional modelling. Microsoft Business Applications - Dynamics 365, Power Platform. Delivery & Engineering - DevOps, Agile, CI/CD, governance. ...

operating within retail banking or financial services environments Deep understanding of data warehousing principles and modelling techniques Advanced SQL expertise and practical experience with ETL/ELT processes Experience working within AWS cloud environments A track record of delivering successful Snowflake migration programmes Confidence engaging with business users and translating ...

domains , including policy lifecycle, underwriting, claims, and risk data. Strong proficiency in PySpark, Python, and SQL for large-scale data processing. Extensive experience building ETL/ELT pipelines and scalable data architectures . Hands-on experience with Azure cloud technologies , including: Azure Databricks Azure Data Factory Azure Data Lake Experience ...

Advanced DAX, Tabular Editor, DAX Studio, Measure Killer Data Modelling & Architecture: Semantic design, Star Schemas, Semantic models Databases & Platforms: Snowflake, Azure Databricks Data Engineering & ETL: ETL processes, DBT, IBM Data Manager DevOps & Governance: GitHub, Version control, CI/CD, License management, Capacity optimisation Background in commodities or energy trading environments ...

based pricing, client analytics and internal operational metrics What You Need Strong academic background 4 years or more experience across full stack data including ETL, modelling, analytics and predictive systems Strong Python for ETLs and analysis Strong SQL and dbt experience Experience building from scratch in a startup ...

insight. Tech Stack seeking: Full Stack Developer; Design and Build with C#, JavaScript Library (React.js bonus), API Development, SQL Server/Backend Development including ETL/Integration Azure DevOps (Repos, Pipelines, Boards, Artifacts, Test Plans), CI/CD automation, gated releases, and environment governance Infrastructure-as-Code (Bicep, ARM, Terraform ...

with containerisation and orchestration (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices Strong understanding of databases and data pipelines (SQL, NoSQL, ETL systems) Experience working with large-scale datasets ...

platforms supporting large transformation programmes. • Define modern architectures including lakehouse platforms, distributed analytics, and event-driven systems. • Provide oversight of data engineering environments, including ETL/ELT pipelines, orchestration, and DataOps practices. • Ensure platforms are secure, scalable, resilient, and aligned with governance standards. • Lead architecture workshops and governance forums, aligning ...

delivery of datasets. Document and relay clear updates to users during production events. Technical responsibilities: Ingest, configure and operationalise new datasets. Develop and maintain ETL/ELT data pipelines to feed real time trading and research systems. Implement data quality checks, anomaly detection and monitoring frameworks. Build and maintain high ...

Engineering or Analytics Engineering f unctions within a multichannel business. Strong hands-on technical background across modern data platforms (cloud data lakes/warehouses, ETL/ELT, SQL, Python), with the ability to operate strategically at leadership level. Experience designing and delivering scalable, production-grade data pipelines that support ...

systems built on .NET (currently .NET 8–10). Building and optimising Kafka-based streaming applications and real-time data flows. Designing and implementing ETL components for large-scale market data ingestion. Ensuring platform reliability and minimal downtime through strong observability and monitoring practices (Grafana environment). Contributing to architectural ...

firm is early in its AI journey. The right candidate will shape architecture, tooling, and standards. What You’ll Actually Do Build scalable ETL/ELT pipelines from loan systems and financial data Structure complex borrower reporting (financial statements, PDFs, credit memos) Design clean datasets for predictive credit risk models ...

and Redshift. 🔧 What you’ll be doing: • Scaling and optimising ELT pipelines (Python + Airflow) • Enhancing the data warehouse (performance, cost, complexity) • Expanding Reverse ETL and data activation capabilities • Deepening dbt modelling and data quality frameworks • Driving automation, governance and reliability across AWS • Collaborating closely with Product, Design, Marketing & Finance ...

complex procedural logic into scalable, production-ready distributed pipelines for a Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python ...

automating API's) Experience with SQL querying Previous experience within financial services (asset management highly desirable) WPF experience is a nice to have Any ETL and Data Warehousing testing experience nice to have Firm understanding of agile software engineering practices (I.e 3 amigos) 2 stage process - 1st: 1 hour intro ...

will be a key architect and builder of our modern data platform. You will be responsible for: Pipeline Engineering: Designing and implementing robust, scalable ETL/ELT pipelines to ingest data from a variety of internal and external sources. Infrastructure: Leveraging the full power of Google Cloud Platform to ensure ...

security models). Platform & Integration Lead the design of data flows between ARGUS investment models and Yardi operational and financial systems. Architect APIs, middleware, ETL pipelines, and event-based integrations where appropriate. Ensure consistent master data management across properties, leases, tenants, and financials. Support cloud and SaaS-based architectural approaches ...