1 to 25 of 162 ETL Jobs in London

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

technical audiences A proactive, growth-oriented mindset, passionate about improving data accessibility and scalability Responsibility: Data Engineering & Pipeline Development: Design, build, and maintain ETL/ELT data pipelines to consolidate and transform customer success data from multiple international sources. Collaborate with Data Engineering and Platform teams to optimize data ingestion ...

Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Experience working with Apache Spark and large-scale data processing For a full consultation on this exciting new role, please ...

Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark and large-scale data processing For a full consultation ...

reporting, and advanced data use cases. Key Responsibilities Design, develop, and optimize end-to-end data pipelines using Azure services Build and maintain scalable ETL/ELT workflows using Azure Databricks (PySpark/SQL) Develop and manage data warehouses and analytics solutions using Azure Synapse Analytics Ingest data from multiple ...

Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain ETL/ELT processes to support business reporting, analytics, and machine learning. Optimise data architectures for performance, reliability, and cost efficiency in cloud environments. Collaborate with ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ELT pipelines using Azure tools (Fabric, Databricks, Synapse, Data Factory) Building data lakes with medallion architecture Migrating legacy on-prem data systems ...

data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business. Key Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high ...

developing data products such as data warehouses, data models, reports, and business applications. Knowledge of data lakes and cloud data warehousing solutions. Expertise in ETL/ELT development using tools like Azure Data Factory. Ability to write ETL (extract, transform, load) scripts and code to ensure optimal performance. Understanding ...

and speaking for communicating requirements and development tasks/issues Hands-on experience with lake houses, dataflows, pipelines, and semantic models Ability to build ETL workflows Familiarity with time-series data, market feeds, transactional records, and risk metrics Familiarity with Git, DevOps pipelines, and automated deployment Strong communication skills with ...

recommending improvements to architecture practices. Technical Skills & Experience Must-have: Extensive experience designing and implementing enterprise-scale data architectures Proficiency in data integration and ETL processes. Advanced skills in SQL, Python, or equivalent programming languages. Strong knowledge of data governance, data security, and compliance frameworks. Expertise in Master & Reference Data ...

data platforms using Azure, AWS, or exceptional on-premise design expertise. At least 5 years in data engineering or business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data ...

and take ownership of the roadmap for the ongoing development and enhancement of the Data Platform. Design, implement, and oversee scalable data pipelines and ETL/ELT processes within MS Fabric, leveraging expertise in Azure Data Factory, Databricks, and other Azure services. Advocate for engineering best practices and ensure long ...

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

reliable, performant, and secure. Key Responsibilities Platform Development & Maintenance Design and implement data pipelines using Azure Data Factory , Databricks , and related Azure services. Build ETL/ELT processes to transform raw data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect ...

secure data pipelines on the Azure platform. Develop and deploy data ingestion processes using Azure Data Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with ...

responsible for: Building and managing data pipelines using Azure Synapse, Data Factory, Databricks, or Microsoft Fabric Designing and maintaining data lakes, data warehouses, and ETL/ELT processes Developing scalable data models for reporting in Power BI Work closely with stakeholders to understand the needs of their individual business and ...

data governance. •Solid understanding of Insurance domain concepts (Specialized Insurance, London Market, Regulatory Data). •Excellent communication and stakeholder management skills. Preferred •Experience with ETL tools and data integration processes. •Familiarity with data warehousing concepts and cloud data platforms. •Exposure to Fivetran, SSIS, or Snowflake advanced features. Personal Besides ...

similar for reporting and visualization. Version Control & Automation: CI/CD pipelines, and automated testing frameworks. Data Management: Strong understanding of data modelling, ETL/ELT processes, and governance standards. A relevant degree in finance, economics, mathematics, or a related field. Strong proficiency in financial modelling and analytical tools. Experience ...

production experience with dbt (mandatory). Advanced SQL and strong Python programming skills. Experience with Git, CI/CD, and DevOps practices. Familiarity with ETL/ELT tools and cloud platforms (AWS, Azure). Knowledge of Snowflake features such as Snowpipe, streams, tasks, and query optimisation. Preferred Qualifications Snowflake certifications ...

strong reputation for excellence in analytics and data-driven decision-making. Description Senior Data Engineer Develop and maintain robust and scalable data pipelines and ETL processes. Optimise data workflows and ensure efficient data storage solutions. Collaborate with analytics and engineering teams to meet business objectives. Ensure data integrity and implement ...

and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality ...

scheduled r-training pipelines. Data Management and Preprocessing: Collect, clean and preprocess large datasets to facilitate analysis and model training. Implement data pipelines and ETL processes to ensure data availability and quality. Software Development: Write clean, efficient and scalable code in Python. Utilize CI/CD practices for version control ...

Strong programming skills in Python (pandas, NumPy, scikit-learn) and SQL. Experience in data science , machine learning, and predictive modelling. Background in data engineering (ETL pipelines, streaming tech like Kafka). Familiarity with cloud platforms (AWS, Azure, GCP). Excellent communication skills for technical and non-technical stakeholders. Exposure ...