1 to 25 of 156 ETL Jobs in London

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please ...

Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain ETL/ELT processes to support business reporting, analytics, and machine learning. Optimise data architectures for performance, reliability, and cost efficiency in cloud environments. Collaborate with ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high ...

recommending improvements to architecture practices. Technical Skills & Experience Must-have: Extensive experience designing and implementing enterprise-scale data architectures Proficiency in data integration and ETL processes. Advanced skills in SQL, Python, or equivalent programming languages. Strong knowledge of data governance, data security, and compliance frameworks. Expertise in Master & Reference Data ...

data platforms using Azure, AWS, or exceptional on-premise design expertise. At least 5 years in data engineering or business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data ...

other data engineering development tools. Experience with metadata driven pipelines and SQL serverless data warehouses. Knowledge of querying API systems. Experience building and optimising ETL pipelines using Databricks. Strong problem-solving skills and attention to detail. Understanding of data governance and data quality principles. A degree in computer science, engineering ...

and take ownership of the roadmap for the ongoing development and enhancement of the Data Platform. Design, implement, and oversee scalable data pipelines and ETL/ELT processes within MS Fabric, leveraging expertise in Azure Data Factory, Databricks, and other Azure services. Advocate for engineering best practices and ensure long ...

reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect ...

reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory, Databricks, and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect ...

secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

maintain end‐to‐end web applications —from intuitive front‐end interfaces to robust back‐end servers and APIs. Build and optimise data platforms and ETL/ELT pipelines supporting analytics and AI‐driven applications. Prepare and structure data for dashboards, reporting, and machine learning solutions. Collaborate with consultants, data scientists ...

enterprise data models , master data management (MDM), and data governance frameworks , ensuring regulatory compliance and data consistency. Build, optimise, and maintain data pipelines and ETL processes , improving reliability, performance, and data quality. Drive continuous improvement by monitoring tool usage, recommending new technologies, and helping shape the roadmap for future enhancements ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality ...

scheduled r-training pipelines. Data Management and Preprocessing: Collect, clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control ...

seeking an experienced Databricks Data Engineer to design, develop, and manage scalable data pipelines using Azure technologies. Responsibilities: The role involves building robust ETL solutions Processing large volumes of data Collaborating closely with business and technical teams to support analytics and reporting requirements. Experience needed: Hands-on experience with Azure ...

production experience with DBT (mandatory). Advanced SQL and strong Python programming skills. Experience with Git, CI/CD, and DevOps practices. Familiarity with ETL/ELT tools and cloud platforms (AWS, Azure). Knowledge of Snowflake features such as Snowpipe, streams, tasks, and query optimisation. Preferred Qualifications Snowflake certifications ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

Salary: £50K -£60K per annum Location: London -Hybrid - three days WFO Experience: 5+ Years Key Responsibilities Design, develop, and maintain robust ETL/ELT data pipelines using Python and PySpark Build and optimize data models and schemas for analytics and reporting Work extensively with Amazon Redshift for data warehousing, performance ...

Strong programming skills in Python (pandas, NumPy, scikit-learn) and SQL. Experience in data science , machine learning, and predictive modelling. Background in data engineering (ETL pipelines, streaming tech like Kafka). Familiarity with cloud platforms (AWS, Azure, GCP). Excellent communication skills for technical and non-technical stakeholders. Exposure ...

Data Engineering roles Advanced-level Python for data applications and high proficiency in SQL (query tuning, complex joins) Hands-on experience designing and deploying ETL/ELT pipelines using Google Cloud Dataflow (Apache Beam) or similar tools Proficiency in data architecture, data modeling, and scalable storage design Solid engineering practices ...