1 to 25 of 62 ETL Jobs in the City of London

Global 2000 across 34 countries and 5 continents including North America, South America, Europe, Asia, Australia, and Middle East. About the Role: Job Title – ETL Developer Location – London, Paddington, UK Mode of Work – Hybrid (3 Days Onsite Per Week) Type of Hiring – Permanent Job Summary: Seeking a Senior Specialist with … domain to ensure robust data integration and validation Skills Mandatory Skills : ETL Concepts Job Description: Design and implement ETL processes to efficiently extract transform and load data Collaborate with data engineers and analysts to understand data requirements and maintain data integrity Develop and maintain data testing frameworks to validate ETL ...

Understanding of Direct Lake semantic modelling design considerations (model creation, table choices, and enforcing access rules). Proven experience with ingestion and transformation patterns (ETL/ELT concepts), data modelling, and delivering analytics-ready datasets. Ability to implement approaches that improve delivery reliability: data quality checks, monitoring, and operational feedback ...

tuning and optimisation. Solid understanding of data ingestion frameworks and modern integration methodologies. Expertise in data architecture and data modelling principles. Proven experience in ETL/ELT processes and pipeline development. Deep knowledge of Azure cloud services within a data engineering context. Experience implementing and managing CI/CD pipelines ...

and maintaining high-performance data pipelines ingesting structured and unstructured datasets from a variety of internal and external sources. Developing ingestion processes including scrapers, ETL pipelines, crawlers, streaming jobs, and services. Cleaning, transforming, and enriching datasets to ensure high quality and usability across analytics and trading use cases. Designing storage ...

collaborative environment where data is seen as a strategic asset and where new ideas are encouraged. The Role • Develop and maintain scalable ELT and ETL pipelines using Azure Data Factory and Databricks. • Build and optimise transformation logic in Databricks using Python, SQL and Spark. • Model datasets across Bronze, Silver and ...

Revit, Revit API, pyRevit, Rhino, Grasshopper, IES VE (and its Python API), BIM data standards (IFC, COBie) Cloud & Infrastructure: AWS/Azure, Git, Ansible Extract, Transform and Load (ETL) Responsibilities Key responsibilities of the role In addition to the core technology listed above, this role will involve: Designing and implementing ...

. The right person will be comfortable sitting between data engineering and security/IAM teams . What youll be doing Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks and SQL Server Develop and support data models, reporting layers and curated datasets for IAM/access ...

reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design and implementation at scale; orchestration with Airflow, Prefect, or equivalent; reliability-first mindset including backfill, retry, and exactly-once semantics * Azure ...

patterns. Strong understanding of methodologies and principles of data science and MLOps, including model development, validation, and lifecycle management. Experience in data pipeline design, ETL/ELT processes, and data integration approaches and appreciation of trade-offs associated with specific use-cases and architectural choices. Knowledge of data visualisation good ...

and financial systems. Create management dashboards for global leaders, agency heads and account teams to support proactive decision making. Develop reliable data pipelines and ETL processes to deliver accurate, timely and secure data. Define and deliver a scalable data strategy aligned with growth plans and PE value creation priorities. Recruit ...

with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity, and a mindset that thrives in fast-moving environments Why You’ll Love It Work on meaningful data challenges that directly ...

Snowflake) Data sourced from transactional, operational, and product systems Mix of open-source, cloud, and internal tooling Required Experience Strong experience in data modelling, ETL/ELT, and building scalable data pipelines Advanced SQL skills and deep understanding of data warehousing principles Experience working with large-scale datasets Hands ...

Platform (ADF, ADLS, Synapse) Be hands-on in development, debugging, optimization, and production support of data pipelines Work with or extend existing/proprietary ETL frameworks (e.g., Mar's Simpel or similar) and improve performance and reliability Implement data modeling, transformation, and orchestration patterns aligned with best practices Apply data ...

skills/knowledge/experience: Data Architecture — Data lake/Medallion Architecture design (structured, curated, consumption zones) Data Platforms - AWS/Athena or Snowflake ETL/Integration — Experience in building integrations with Salesforce, using Python to build data transformation pipelines. Delivery Tooling — Sprint management via JIRA Asset management domain awareness ...

including target architecture, data models, security, and governance frameworks. Analyze existing Foundry pipelines, datasets, and ontologies, and redesign them into scalable Databricks (Delta Lake) ETL/ELT workflows using PySpark and SQL. Implement validation frameworks to ensure complete data accuracy, consistency, and lineage throughout the migration process. Optimize Spark workloads ...

organisation through training and internal champions Ensuring GDPR compliance and robust data security controls throughout Essential Experience: Solid, hands-on understanding of data warehousing, ETL/ELT processes, data modelling and Medallion architecture Experience managing vendors delivering hosted or managed data warehouse solutions Ability to design and implement governance frameworks ...

and ready for business-as-usual handover. Required Skills & Qualifications: Proficient in Python, Scala, and SQL. Extensive experience in data modelling and ELT/ETL processes. Strong hands-on experience with Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, Composer, and Cloud Run/App Engine. Familiarity with ...

backend Python, REST APIs and microservices You have a good knowledge of AWS including Amazon RedShift You have experience with PostgreSQL, DBT, data pipelines, ETL, data modelling, LLMs and agentic programming You have a good understanding of event driven systems You're comfortable working with complex, data rich environments and ...

Extras: Understands financial processes such as P2P, R2R, and O2C, and how to use relevant data markers from these processes to link datasets, develop ETL pipelines and identify transactions of potential concern Has an understanding of advanced data science techniques such as machine learning, natural language processing and statistical analysis. ...

driven transformation across critical UK industries. Core Responsibilities Design, build, and optimise data pipelines using Azure Data Factory, Synapse, and Databricks Develop and maintain ETL/ELT workflows to ensure high data quality and reliability Collaborate with analysts and AI engineers to deliver robust and reusable data products Manage data … and modern data pipeline design Hands-on experience within Microsoft’s Azure ecosystem, with an interest in emerging technologies such as Fabric, AI-enhanced ETL, and real-time data streaming Proven ability to lead technical workstreams and mentor junior team members A strong alignment with the organisation’s IDEAL values ...

modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices architecture and distributed systems Experience with DevOps practices for AI/ML workflows (MLOps ...

and security standards. Skills Required: Previous experience in a data role. Experience with data visualization tools (e.g., Tableau, Power BI, Looker). Knowledge of ETL processes and data warehousing concepts. Strong analytical and problem-solving skills. Strong presentation skills, both written and verbal; able to describe complex technical problems ...

based applications and scalable data pipelines. Debug, develop, and optimize Spark jobs primarily using Scala. Build, operate, monitor, and troubleshoot Hadoop clusters. Develop robust ETL workflows using Spark, Hive, and Pig. Create and manage data ingestion pipelines using Sqoop, Flume, or Kafka. Optimize MapReduce jobs and efficiently manage HDFS storage. ...

data pipelines, including troubleshooting incidents, conducting root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte ...

Engineer Strong development skills in Python Advanced SQL skills with experience working on complex datasets Experience with core data engineering tools and technologies (e.g. ETL/ELT pipelines, data warehouses, orchestration tools) Strong understanding of data modelling, data quality, and performance optimisation Desirable Experience Experience with Palantir (Foundry, Gotham) Willingness ...