1 to 25 of 173 ETL Jobs in London

Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data modelling, and delivering analytics-ready datasets. Ability to implement approaches that improve delivery reliability: data quality checks, monitoring, and operational feedback ...

Factory and Databricks Experience building dashboards and reports using Power BI or Tableau Solid understanding of data modelling and data structures Experience working with ETL/ELT processes Proficiency in Python or R for data analysis Strong analytical and problem-solving skills Ability to work with stakeholders and translate business ...

ingestion pipelines into appropriate data technologies such as Snowflake from internal systems (policy admin, claims, finance) and external data sources. Build orchestrated ELT/ETL processes using modern tooling and best practice engineering patterns. Implement incremental refresh, schema evolution management, and data validation tests. Ensure data availability aligned to business ...

high data quality and reliability across platforms. Must have worked in the telecommunications domain. Key Responsibilities Design, develop, and maintain robust data pipelines and ETL processes Build and optimise data models to support reporting and analytics requirements Develop and enhance dashboards and reports using Power BI Write efficient and scalable ...

Programming/Query Strong expertise in SQL for data transformation and performance optimization Python (preferred) for automation and data engineering tasks. Data Engineering Enterprise ETL/ELT pipeline architecture Data warehousing and enterprise data modelling Dimensional modelling (Star Schema, Snowflake Schema) Data pipeline scalability and reliability design. AI/Data ...

Kimball, Data Vault) Experience exposing Delta Lakehouse to Power BI or Tableau Skilled in Python, Scala or SQL for data engineering Experience building scalable ETL pipelines (Workflows, Delta Live Tables) Hands-on experience with Azure, AWS or GCP (storage, compute, networking) Knowledge of Databricks security: RBAC, IAM, encryption Excellent analytical ...

tuning and optimisation. Solid understanding of data ingestion frameworks and modern integration methodologies. Expertise in data architecture and data modelling principles. Proven experience in ETL/ELT processes and pipeline development. Deep knowledge of Azure cloud services within a data engineering context. Experience implementing and managing CI/CD pipelines ...

innovation. They're investing in data to support smarter decision-making as they continue to scale. Description Databricks experience essential Design, build, and maintain ETL/ELT data pipelines supporting People Analytics use cases. Develop scalable models and schemas to integrate data from HRIS, ATS, learning platforms, engagement tools, and ...

end.* Strong background in Lakehouse Architecture, including structured and unstructured data.* Expertise in Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience ...

and maintaining high-performance data pipelines ingesting structured and unstructured datasets from a variety of internal and external sources. Developing ingestion processes including scrapers, ETL pipelines, crawlers, streaming jobs, and services. Cleaning, transforming, and enriching datasets to ensure high quality and usability across analytics and trading use cases. Designing storage ...

teams o Experience operating within agile delivery environments Data & Integration Expertise o Strong understanding of integration design patterns (REST APIs, message queues, eventdriven integration, ETL, batch processing). o Experience working with master data domains (Party, Facility, Instrument, Product, Country, Sector, Ratings). Technology & Platform Knowledge o Hands-on architectural ...

collaborative environment where data is seen as a strategic asset and where new ideas are encouraged. The Role • Develop and maintain scalable ELT and ETL pipelines using Azure Data Factory and Databricks. • Build and optimise transformation logic in Databricks using Python, SQL and Spark. • Model datasets across Bronze, Silver and ...

PostgreSQL-based data platformLead the shift away from Databricks and spreadsheet-dependent reportingCreate dimensional data models covering investments, pricing, performance and related domainsDevelop reliable ETL/ELT processes in PythonImplement data quality, reconciliation and validation controlsOptimise database performance for analytical and reporting workloadsEnsure compliance with FCA and TPR regulatory guidelinesSet ...

Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and its Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the role In addition to the core technology listed above, this role will involve: Designing and implementing ...

. The right person will be comfortable sitting between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access ...

and Experience You will bring • Strong commercial experience using Power BI, including report development, DAX and data modelling • Strong SQL skills • Experience working with ETL processes and data pipelines • Experience working across the full BI lifecycle and delivering complex BI solutions • Ability to work with senior stakeholders and translate business ...

data function, they offer a place where you can make meaningful technical impact. The Role * Design and maintain end to end ELT and ETL pipelines within a large scale AWS environment. * Build well structured data models and curated layers to support reporting and analytics. * Improve data quality, observability, governance, and ...

reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design and implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure ...

patterns. Strong understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. Knowledge of data visualisation good ...

excited by solving complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant ...

Microsoft Azure platform. This role involves delivering reliable, high-performance data pipelines that support analytics and business operations. Key Responsibilities: Design and develop ETL/ELT pipelines within Azure Build scalable solutions for data ingestion, transformation, and integration Ensure data quality, reliability, and performance Collaborate with cross-functional teams ...

contributing to the successful delivery of end-to-end data engineering projects. Responsibilities Design, build and deliver data solutions using Databricks Develop and optimise ETL/ELT data pipelines using Spark, Python and SQL Build and maintain data lakes and data warehousing solutions Collaborate with stakeholders to deliver scalable and ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

and financial systems. Create management dashboards for global leaders, agency heads and account teams to support proactive decision making. Develop reliable data pipelines and ETL processes to deliver accurate, timely and secure data. Define and deliver a scalable data strategy aligned with growth plans and PE value creation priorities. Recruit ...