1 to 25 of 124 Permanent ETL Jobs in London

data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Architect, implement and oversee high-performing data lakes, data warehouses and ETL/ELT processes Develop scalable, robust data models for enterprise-level reporting within Power BI Serve as a technical authority, advising clients on best-fit data solutions ...

cases across the organisation. Key Responsibilities Design, build, and maintain scalable, secure, and reliable data pipelines (batch and streaming). Develop and optimise ETL/ELT workflows to ensure efficient data ingestion and transformation. Build and maintain data models , feature stores, and data marts to support analytics and AI initiatives. ...

. Desirable: Experience with architecting and implementing data pipelines, data lakes, and data warehousing solutions optimised for GenAI workloads. Strong knowledge of data modelling, ETL processes, SQL, and scripting languages such as Python. Experience with Big Data technologies (e.g., Hadoop, Spark) and data visualisation tools (e.g., Tableau, Power BI). ...

fully remote role. What You Will Be Doing Building and enhancing scalable data pipelines using Azure and Snowflake Developing and improving ETL/ELT processes across batch and micro-batch workloads Working extensively with Azure Data Factory, Azure SQL, Azure Storage and Azure Functions Designing and maintaining data warehouse structures ...

Collaborate across the business, ensuring solutions meet quality and performance expectations. Required Skills Strong Azure expertise (architecture, services, security). Solid data engineering experience (ETL, modelling, warehousing). Hands-on Azure Data Services: Data Factory, Data Lake, Synapse, Azure SQL. Proficient SQL and programming skills (Python/Java/C# ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

Manchester. The Role and Responsibilities You will join the Data and AI team and be responsible for: Designing, building, and maintaining scalable ELT/ETL pipelines in a large-scale AWS environment Improving data warehousing and modelling across curated and analytics layers Enhancing governance, lineage, and data quality across ...

solutions in Databricks. Strong technical expertise in Databricks, including workspace design and configuration. Demonstrable experience implementing the Medallion Architecture for structured data transformation. Advanced ETL/ELT development experience using PySpark, Delta Lake and Databricks SQL. Practical experience with Unity Catalog for governance, metadata management and lineage tracking. Strong knowledge ...

design, dimensional models) and created ADRs. Dimensional modelling (Kimball star schemas), SCD Type 2, MDM (entity resolution, golden records). Batch + incremental ETL/ELT pipelines. File-based integration (CSV/XLS ingestion, error handling). Database replication (SQL Server snapshot/delta strategies). Partitioning strategies (date-based ...

practices Proficiency with cloud platforms (AWS, Azure, GCP) and data technologies such as Snowflake, Databricks, or equivalent Experience with programming/scripting, data integration, ETL pipelines, and orchestration Knowledge of ML/AI frameworks, BI/analytics platforms, and semantic data modelling Strong client-facing skills with the ability ...

Azure, or GCP) Advanced SQL skills and experience with at least one backend language (Python, Scala, Java, etc.) Hands-on experience with data warehouses, ETL/ELT, and distributed systems A mindset focused on performance, reliability, automation, and scalability Confidence working cross-functionally and owning technical decisions Exposure to large ...

and capital allocation decisions. Role Responsibilities * Build and maintain scalable data pipelines, managing large data sets from internal and external sources. * Develop and optimise ETL processes using AWS, SQL, and modern cloud technologies. * Manage API integrations and automate data ingestion and transformation workflows. * Improve infrastructure scalability, performance, and data delivery ...

Your Skills: 16+ years of data/software engineering experience with deep expertise in Spark, Scala, and Python. Strong background in designing large‐scale ETL/ELT workflows and distributed compute optimization. Solid understanding of trade data, counterparty risk, and market/risk processes within banking. Hands-on experience ...

play a pivotal role in shaping the data infrastructure. Your responsibilities will include: Own and evolve our data pipelines -designing, building, and maintaining ETL/ELT workflows that ensure high-quality, reliable data across the platform. Deploy and support production ML systems - from forecasting models to LLM-driven and agentic ...

data function, they offer a place where you can make meaningful technical impact. The Role * Design and maintain end to end ELT and ETL pipelines within a large scale AWS environment. * Build well structured data models and curated layers to support reporting and analytics. * Improve data quality, observability, governance, and ...

Migration, Cloud Data Warehouse. Experience of working with large datasets, knowledge of data manipulation, interrogation, transformation and import procedures. Experience with data loading and ETL/ELT concepts and Big Data tools. Experience with supporting strategic data improvement initiatives. A high level of analytical skills, process automation, problem solving, attention ...

This role requires strong hands-on experience in modern cloud data platforms including Snowflake, DBT and AWS/Azure, alongside expertise in data modelling, ETL/ELT processes and pipeline orchestration. You will also act as a technical mentor within a collaborative and innovative data engineering team. Key Responsibilities Design … develop, optimise and maintain scalable ETL/ELT data pipelines using modern cloud technologies. Monitor, troubleshoot and enhance production data pipelines to ensure performance, reliability and data integrity. Write and optimise complex SQL queries to support high-performance analytics workloads. Implement flexible Data Vault models in Snowflake to support enterprise ...

shape data architecture, influence technical decisions, and contribute to meaningful, data-driven outcomes. Key Responsibilities Design, develop, and maintain scalable data pipelines to extract, transform, and load (ETL) data into cloud-based data platforms, primarily AWS. Create and manage data models that support efficient storage, retrieval, and analysis of data. … automated builds, deployments, and testing. Skills and Experience Strong experience designing and building data pipelines on cloud platforms, particularly AWS. Excellent proficiency in developing ETL processes and data transformation workflows. Strong SQL skills (postgresql) and advanced Python coding capability (essential). Experience working with AWS services such ...

data tools. Good SQL skills; some Python or R is a bonus. Familiarity with Swagger/OpenAPI or Postman . Understanding of data modelling, ETL concepts and system‐to‐system integrations. Comfortable working with both technical teams and business stakeholders. Clear communication and documentation skills. Nice to Have Experience with ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

transitioning from Data Analyst to Data Engineer . Proven expertise in SQL and building complex data models. Strong proficiency in Python for data processing, ETL, and workflow automation. Experience with cloud data platforms (Snowflake experience highly desirable). Exposure to or experience with Terraform or similar infrastructure-as-code tools ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

based pricing, client analytics and internal operational metrics What You Need Strong academic background 4 years or more experience across full stack data including ETL, modelling, analytics and predictive systems Strong Python for ETLs and analysis Strong SQL and dbt experience Experience building from scratch in a startup ...

data architecture, ideally in customer-centric domains such as CRM, CDP, or marketing analytics. Strong knowledge of cloud platforms (Azure, GCP), data warehousing, and ETL tools. Proficiency in SQL, Python, and data modelling techniques. Experience with customer data platforms (e.g., Salesforce CDP, Redpoint), MDM, and real-time data processing. Understanding ...

path to production Worked with one or more cloud platforms and services ( AWS, Azure, GCP ) Extensive hands-on experience with modern data technologies, ETL tools (e.g. Kafka, Flink, DBT etc.) , data storage (e.g. Snowflake, Redshift, etc.) and also IaC ( e.g. Terraform, CloudFormation ) Software development experience with one or more languages ...