1 to 25 of 113 Permanent ETL Jobs in London

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

data platforms using Azure, AWS, or exceptional on-premise design expertise. At least 5 years in data engineering or business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data ...

other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. Knowledge of querying API systems. Experience building and optimising ETL pipelines using Databricks. Strong problem-solving skills and attention to detail. Understanding of data governance and data quality principles. A degree in computer science, engineering ...

and take ownership of the roadmap for the ongoing development and enhancement of the Data Platform. Design, implement, and oversee scalable data pipelines and ETL/ELT processes within MS Fabric, leveraging expertise in Azure Data Factory, Databricks, and other Azure services. Advocate for engineering best practices and ensure long ...

reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

maintain end‐to‐end web applications —from intuitive front‐end interfaces to robust back‐end servers and APIs. Build and optimise data platforms and ETL/ELT pipelines supporting analytics and AI‐driven applications. Prepare and structure data for dashboards, reporting, and machine learning solutions. Collaborate with consultants, data scientists ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality ...

scheduled r-training pipelines. Data Management and Preprocessing: Collect, clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control ...

seeking an experienced Databricks Data Engineer to design, develop, and manage scalable data pipelines using Azure technologies. Responsibilities: The role involves building robust ETL solutions Processing large volumes of data Collaborating closely with business and technical teams to support analytics and reporting requirements. Experience needed: Hands-on experience with Azure ...

production experience with DBT (mandatory). Advanced SQL and strong Python programming skills. Experience with Git, CI/CD, and DevOps practices. Familiarity with ETL/ELT tools and cloud platforms (AWS, Azure). Knowledge of Snowflake features such as Snowpipe, streams, tasks, and query optimisation. Preferred Qualifications Snowflake certifications ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

Salary: £50K -£60K per annum Location: London -Hybrid - three days WFO Experience: 5+ Years Key Responsibilities Design, develop, and maintain robust ETL/ELT data pipelines using Python and PySpark Build and optimize data models and schemas for analytics and reporting Work extensively with Amazon Redshift for data warehousing, performance ...

Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices ...

across structured and unstructured data Set and uphold engineering standards, including documentation, architecture diagrams, and Architecture Decision Records Design and build scalable, fault tolerant ETL and ELT pipelines with clear trade offs around latency, freshness, and cost Remain hands on, building and maintaining core pipelines, schemas, and services in production ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

combining multiple technologies. Data Engineering & Pipeline Development - Strong skills in building data pipelines for AI/automation solutions including data extraction, transformation, and loading (ETL). Experience with SQL databases (SQL Server), data validation, cleansing workflows, scheduling tools (Azure Data Factory), and ensuring data quality for machine learning applications. Machine ...

collaborate with a global team to create scalable data architectures optimised for AI/ML, source and prepare high-quality data, and implement robust ETL processes. You should be comfortable working independently while driving improvements in engineering standards and best practices. As a senior member of the team, you will ...

Strong SQL skills and experience working with large, complex datasets. Proficiency in Python for data processing, pipeline development, and automation. Experience building and maintaining ETL/ELT pipelines in a production environment. Exposure to cloud-based data platforms (AWS, GCP, Azure, or similar). Familiarity with data orchestration tools (e.g. ...

and end-to-end scenarios Validate financial calculations, transaction flows, compliance logic, and reporting across multiple platforms Perform end-to-end data validation across ETL pipelines, databases, and reporting layers Develop, maintain, and enhance test automation scripts using Python and PyTest Support API testing using tools such as Postman and ...

chance to build reliable data pipelines that support analytics, advertising, and digital products used at scale. What you'll do: Build and maintain ETL/ELT pipelines using Python and SQL Orchestrate workflows with Airflow Work with cloud data platforms (AWS/GCP, BigQuery/Redshift) Improve data quality, monitoring ...