1 to 25 of 35 ETL Jobs in the City of London

tuning and optimisation. Solid understanding of data ingestion frameworks and modern integration methodologies. Expertise in data architecture and data modelling principles. Proven experience in ETL/ELT processes and pipeline development. Deep knowledge of Azure cloud services within a data engineering context. Experience implementing and managing CI/CD pipelines ...

technical teams A security-first mindset when designing and implementing solutions Qualifications & Experience Essential Strong version control principles relating to databases Experience with ETL processes (SSIS or Azure Data Factory preferred) High availability and disaster recovery for SQL Server environments Administering, managing, and maintaining large-scale databases Advanced performance tuning ...

Azure, or GCP) Advanced SQL skills and experience with at least one backend language (Python, Scala, Java, etc.) Hands-on experience with data warehouses, ETL/ELT, and distributed systems A mindset focused on performance, reliability, automation, and scalability Confidence working cross-functionally and owning technical decisions Exposure to large ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

digital platforms is highly advantageous. Technical Skills: Proficiency in Python, SQL, and BI tools such as Tableau or Power BI. Experience with data pipelines, ETL processes, and familiarity with cloud environments is preferred. Business Development & Analytics Tools: Hands-on experience with CRM systems like Salesforce or HubSpot, and marketing analytics ...

enablement across the business. 🌐 What You’ll Do 🏗 Data Platform Architecture & Strategy Define and evolve the data architecture roadmap Design scalable ELT/ETL frameworks using DBT and cloud data warehouses Establish orchestration standards (Dagster or equivalent) Drive decisions across batch, streaming, and real-time pipelines Champion data modelling standards ...

including target architecture, data models, security, and governance frameworks. Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL. Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process. Optimize Spark workloads ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

operating within retail banking or financial services environments Deep understanding of data warehousing principles and modelling techniques Advanced SQL expertise and practical experience with ETL/ELT processes Experience working within AWS cloud environments A track record of delivering successful Snowflake migration programmes Confidence engaging with business users and translating ...

driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable data products Manage data … and modern data pipeline design Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability to lead technical workstreams and mentor junior team members A strong alignment with the organisation’s IDEAL values ...

dashboards Modernise systems into cloud-native, API-first architectures Key skills Cloud engineering (Azure, Kubernetes, serverless, DevOps) Python and relational databases (SQL) Data platforms, ETL/ELT, and analytics AI tools and LLM integrations (e.g. GPT, Claude, Gemini) Security, governance, and regulated environment experience Why this team? Work ...

complex procedural logic into scalable, production-ready distributed pipelines for a Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python ...

automating API's) Experience with SQL querying Previous experience within financial services (asset management highly desirable) WPF experience is a nice to have Any ETL and Data Warehousing testing experience nice to have Firm understanding of agile software engineering practices (I.e 3 amigos) 2 stage process - 1st: 1 hour intro ...

data pipelines, including troubleshooting incidents, conducting root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte ...

developing REST APIs or microservices with Spring Boot. Experience containerising applications with Docker. Understanding of relational and NoSQL databases. Familiarity with modern data architectures (ETL/ELT, streaming, event-driven systems). Knowledge of cloud platforms (AWS, Azure, GCP) is a plus. Excellent problem-solving skills and a collaborative mindset. ...

pipelines & cloud deployment (AWS/Azure) Experience working across business requirements/user journeys (BA background beneficial) Strong understanding of data models, MDM, and ETL processes Experience in Agile environments Leadership & Stakeholder Skills Experience managing or mentoring developers and QA teams Strong communication skills with the ability to challenge and ...

with web scraping or crawling systems (relevant to our content monitoring work). Knowledge of NoSQL technologies (MongoDB preferred). Experience with data engineering, ETL processes, or ML-adjacent applications. AWS certifications, or willingness to obtain them. Interest in music, copyright, or the broader creative industries. How to apply Candidates ...

hands-on role building a robust data platform from ingestion through to consumption. Tech Environment: Azure Data Lake Storage Azure Synapse Medallion Architecture ETL/data ingestion pipelines Dimensional modelling Strong governance, security, and error handling Ideal Experience: Azure-based data platform architecture End-to-end data warehouse design and ...

major communication platforms and capture solutions (e.g., Bloomberg, LSEG, ICE, Symphony, whats app, WeCom, Smarsh, Global Relay, Behavox). Experience with communications data structures, ETL/ELT pipelines, and data integrity standards. Strong understanding of CI/CD practices and agile methodologies. Excellent communication and stakeholder-management skills. Desired Understanding ...

stakeholders across multiple teams. Key Responsibilities: Collaborate with engineers across legacy systems to understand available data and its structure. Design queries and scripts to extract, transform, and migrate data into new platforms. Partner with senior data leadership to define cold-storage solutions for regulatory data retention. Work with solution architects … design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with platform and infrastructure teams on security ...

allocation. Key Responsibilities Design, build, and maintain scalable data pipelines to manage and process large datasets from internal and external sources. Architect and optimise ETL/ELT workflows using AWS, SQL, Python, and modern cloud-based technologies. Manage API integrations and automate data ingestion, transformation, and enrichment processes. Improve data … data capabilities. Requirements Strong understanding of data architecture principles, scalable platform design, and data modelling . Proven experience building and maintaining data pipelines and ETL/ELT workflows using modern data stack technologies. 5+ years' experience in data engineering or a similar data-focused role. Strong proficiency in SQL and ...

experience. Previous experience in industry, with a background in similar roles. Proven experience in data architecture and management. Proficiencies in data modeling, data warehousing, ETL processes, and database technologies. Continuous learner that stays abreast with industry knowledge and technology. Other Qualifications: Advanced degree in a relevant field is a plus. ...

Python (ideally FastAPI) 👉 Proven experience building fullstack products end-to-end 👉 Background working on complexed and data heavy products 👉 Exposure to data pipelines/ETL ➕ Nice to have Azure/cloud experience IaC (Terraform/OpenTofu) Experience with AI tools or LLM integrations ...

Azure integrations primarily utilising AIS (Azure Integration Services) including optimising enhancement with the MDM platform and integrating data via ADF albeit in conjunction with ETL developers. Working in an SME/Lead capacity you will: Liaise with other technical teams, vendors and wider business stakeholders Design, config and deploy application ...

standards, ensuring solutions remain secure and audit-ready. Skills & Competencies Expert-level Salesforce data architecture, Flows, Apex, LWC, and OmniStudio. Strong integration expertise (APIs, ETL, asynchronous/event-driven architecture). Proficiency in Salesforce DevOps (Salesforce DX, CI/CD pipelines, 2GP packaging). Skilled in SOQL/SOSL optimisation ...