1 to 25 of 75 ETL Jobs in Central London

Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data modelling, and delivering analytics-ready datasets. Ability to implement approaches that improve delivery reliability: data quality checks, monitoring, and operational feedback ...

and maintaining high-performance data pipelines ingesting structured and unstructured datasets from a variety of internal and external sources. Developing ingestion processes including scrapers, ETL pipelines, crawlers, streaming jobs, and services. Cleaning, transforming, and enriching datasets to ensure high quality and usability across analytics and trading use cases. Designing storage ...

evolution of the data architecture within the Microsoft ecosystem. Key Requirements Strong hands-on experience with Azure Synapse (ESSENTIAL) Experience building and maintaining ETL/ELT pipelines Strong skills in reverse engineering data pipelines, schemas, and legacy processes Solid programming skills in PySpark, Python, and SQL Experience with Azure Data ...

tuning and optimisation. Solid understanding of data ingestion frameworks and modern integration methodologies. Expertise in data architecture and data modelling principles. Proven experience in ETL/ELT processes and pipeline development. Deep knowledge of Azure cloud services within a data engineering context. Experience implementing and managing CI/CD pipelines ...

collaborative environment where data is seen as a strategic asset and where new ideas are encouraged. The Role • Develop and maintain scalable ELT and ETL pipelines using Azure Data Factory and Databricks. • Build and optimise transformation logic in Databricks using Python, SQL and Spark. • Model datasets across Bronze, Silver and ...

Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and its Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the role In addition to the core technology listed above, this role will involve: Designing and implementing ...

patterns. Strong understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. Knowledge of data visualisation good ...

Looking For 2+ years’ experience with Power BI (Desktop & Service) Strong DAX, Power Query (M), and SQL skills Experience with data modelling and ETL processes Exposure to Azure or broader Microsoft stack Strong communication skills and stakeholder management Financial services experience is a plus 📍 Location: London (Hybrid - 4 days onsite ...

enablement across the business. 🌐 What You’ll Do 🏗 Data Platform Architecture & Strategy Define and evolve the data architecture roadmap Design scalable ELT/ETL frameworks using DBT and cloud data warehouses Establish orchestration standards (Dagster or equivalent) Drive decisions across batch, streaming, and real-time pipelines Champion data modelling standards ...

experience in python scripting. • Exposed to python packages such as NumPy, pandas, polars beautiful soup, Selenium, Requests etc. • Experience in building native python ETL pipelines for scraping/processing. • Good to have experience in processing big data. • Proficient in SQL programming, Postgres SQL. Spark knowledge is a good to have ...

. The right person will be comfortable sitting between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access ...

practices. Key Responsibilities Design and maintain scalable data architectures across Snowflake and Databricks Lead schema design, dimensional modelling, and SQL performance optimisation Build robust ETL/ELT pipelines Develop resilient API ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing ...

and financial systems. Create management dashboards for global leaders, agency heads and account teams to support proactive decision making. Develop reliable data pipelines and ETL processes to deliver accurate, timely and secure data. Define and deliver a scalable data strategy aligned with growth plans and PE value creation priorities. Recruit ...

need to thrive? A degree in IT, Computer Science, Maths or a related discipline, with 3+ years experience across BI, data warehousing, data management, ETL and database technologies Strong hands-on experience building and optimising data pipelines using Python, SQL, Apache Spark, and Microsoft SSIS Proven ability to design, deliver ...

with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset that thrives in fast-moving environments Why You’ll Love It Work on meaningful data challenges that directly ...

stakeholders across the business. Skills & Experience Required Strong proficiency in Python (Pandas, NumPy; ML frameworks beneficial). Experience building automated data workflows , pipelines, or ETL processes. Exposure to machine learning, AI, or advanced analytics (time‐series, anomaly detection, forecasting, NLP etc.). Solid understanding of data quality, validation, and structured ...

Platform (ADF, ADLS, Synapse) Be hands-on in development, debugging, optimization, and production support of data pipelines Work with or extend existing/proprietary ETL frameworks (e.g., Mar's Simpel or similar) and improve performance and reliability Implement data modeling, transformation, and orchestration patterns aligned with best practices Apply data ...

with containerisation and orchestration (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices Strong understanding of databases and data pipelines (SQL, NoSQL, ETL systems) Experience working with large-scale datasets ...

including target architecture, data models, security, and governance frameworks. Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL. Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process. Optimize Spark workloads ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

operating within retail banking or financial services environments Deep understanding of data warehousing principles and modelling techniques Advanced SQL expertise and practical experience with ETL/ELT processes Experience working within AWS cloud environments A track record of delivering successful Snowflake migration programmes Confidence engaging with business users and translating ...

and ready for business-as-usual handover. Required Skills & Qualifications: Proficient in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong hands-on experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, Composer, and Cloud Run/App Engine. Familiarity with ...

share best practice across the team What you’ll bring Strong SQL skills and a solid understanding of data modelling Experience building and maintaining ETL/ELT pipelines Familiarity with cloud platforms (BigQuery, Snowflake, Redshift or similar) Working knowledge of Python (or similar) Experience with BI tools (Power BI, Looker ...

including governance of KPIs/metrics to prevent drift. Expert understanding of data integration and pipeline architecture, with strong technical knowledge of ELT/ETL tooling and MPP, columnar, cloud‐native databases (ideally Snowflake). Strong experience defining Solution Architecture patterns for analytics and ML solutions that consume data products ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...