1 to 25 of 53 ETL Jobs in the City of London

tuning and optimisation. Solid understanding of data ingestion frameworks and modern integration methodologies. Expertise in data architecture and data modelling principles. Proven experience in ETL/ELT processes and pipeline development. Deep knowledge of Azure cloud services within a data engineering context. Experience implementing and managing CI/CD pipelines ...

technical teams A security-first mindset when designing and implementing solutions Qualifications & Experience Essential Strong version control principles relating to databases Experience with ETL processes (SSIS or Azure Data Factory preferred) High availability and disaster recovery for SQL Server environments Administering, managing, and maintaining large-scale databases Advanced performance tuning ...

and maintaining high-performance data pipelines ingesting structured and unstructured datasets from a variety of internal and external sources. Developing ingestion processes including scrapers, ETL pipelines, crawlers, streaming jobs, and services. Cleaning, transforming, and enriching datasets to ensure high quality and usability across analytics and trading use cases. Designing storage ...

patterns. Strong understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. Knowledge of data visualisation good ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

and financial systems. Create management dashboards for global leaders, agency heads and account teams to support proactive decision making. Develop reliable data pipelines and ETL processes to deliver accurate, timely and secure data. Define and deliver a scalable data strategy aligned with growth plans and PE value creation priorities. Recruit ...

digital platforms is highly advantageous. Technical Skills: Proficiency in Python, SQL, and BI tools such as Tableau or Power BI. Experience with data pipelines, ETL processes, and familiarity with cloud environments is preferred. Business Development & Analytics Tools: Hands-on experience with CRM systems like Salesforce or HubSpot, and marketing analytics ...

enablement across the business. 🌐 What You’ll Do 🏗 Data Platform Architecture & Strategy Define and evolve the data architecture roadmap Design scalable ELT/ETL frameworks using DBT and cloud data warehouses Establish orchestration standards (Dagster or equivalent) Drive decisions across batch, streaming, and real-time pipelines Champion data modelling standards ...

with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset that thrives in fast-moving environments Why You’ll Love It Work on meaningful data challenges that directly ...

including target architecture, data models, security, and governance frameworks. Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL. Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process. Optimize Spark workloads ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

operating within retail banking or financial services environments Deep understanding of data warehousing principles and modelling techniques Advanced SQL expertise and practical experience with ETL/ELT processes Experience working within AWS cloud environments A track record of delivering successful Snowflake migration programmes Confidence engaging with business users and translating ...

and ready for business-as-usual handover. Required Skills & Qualifications: Proficient in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong hands-on experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, Composer, and Cloud Run/App Engine. Familiarity with ...

with containerisation and orchestration (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices Strong understanding of databases and data pipelines (SQL, NoSQL, ETL systems) Experience working with large-scale datasets ...

platforms supporting large transformation programmes. • Define modern architectures including lakehouse platforms, distributed analytics, and event-driven systems. • Provide oversight of data engineering environments, including ETL/ELT pipelines, orchestration, and DataOps practices. • Ensure platforms are secure, scalable, resilient, and aligned with governance standards. • Lead architecture workshops and governance forums, aligning ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...

driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable data products Manage data … and modern data pipeline design Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability to lead technical workstreams and mentor junior team members A strong alignment with the organisation’s IDEAL values ...

modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices architecture and distributed systems Experience with DevOps practices for AI/ML workflows (MLOps ...

dashboards Modernise systems into cloud-native, API-first architectures Key skills Cloud engineering (Azure, Kubernetes, serverless, DevOps) Python and relational databases (SQL) Data platforms, ETL/ELT, and analytics AI tools and LLM integrations (e.g. GPT, Claude, Gemini) Security, governance, and regulated environment experience Why this team? Work ...

complex procedural logic into scalable, production-ready distributed pipelines for a Tier-1 financial services environment. Core Responsibilities Engineering Leadership: Design and develop complex ETL/ELT pipelines and Data Marts using PySpark, EMR, and Glue. Legacy Modernisation: Architect the conversion of SAS Base/Macros into modular, testable Python ...

automating API's) Experience with SQL querying Previous experience within financial services (asset management highly desirable) WPF experience is a nice to have Any ETL and Data Warehousing testing experience nice to have Firm understanding of agile software engineering practices (I.e 3 amigos) 2 stage process - 1st: 1 hour intro ...

data pipelines, including troubleshooting incidents, conducting root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte ...

Engineer Strong development skills in Python Advanced SQL skills with experience working on complex datasets Experience with core data engineering tools and technologies (e.g. ETL/ELT pipelines, data warehouses, orchestration tools) Strong understanding of data modelling, data quality, and performance optimisation Desirable Experience Experience with Palantir (Foundry, Gotham) Willingness ...

relational database design & support Strong SQL and query optimisation expertise Hands-on AWS data services experience (RDS, Aurora, DynamoDB, S3 etc.) Experience with modern ETL, replication & cloud migrations Python or similar scripting skills Bonus points for previous experience in Financial Services 🎁 What’s On Offer Salary ...

improve delivery speed, and raise engineering standards Guide and mentor an offshore engineering team What We’re Looking For Strong data warehousing experience (modelling, ETL/ELT, pipelines) Hands-on with Snowflake, SQL and Python Experience in AWS (or similar cloud) Background in insurance or financial services (Lloyd’s ideal ...