226 to 250 of 633 ETL Jobs in London

built-in Python libraries, as well as third-party packages Experience leading design of large-scale, efficient and performant analytics workflows, including ETL, orchestration, and distributed compute, using industry-standard libraries such as Pandas, Polars, and Dask. Experience with both SQL and NoSQL database platforms, as well as OLAP and ...

Claude Code**, **GitHub Copilot**, or similar coding assistants as part of the software development lifecycle.* Experience designing, building, and operating data pipelines and ETL/ELT workflows using Databricks, dbt, and Apache Airflow.**Preferred Skills & Experience*** Experience with frameworks like ReactJS, Angular, or Vue.js to build interactive and responsive user ...

prototype and troubleshoot) Experience designing solutions for enterprise systems: PSA, CRM, ERP, HRMS, financial systems, data platforms Familiarity with data modeling, ETL processes, data migration strategies, and enterprise data flows Comfortable using modern AI tools (Claude, Cursor, MCPs) to accelerate problem-solving, build prototypes, and enhance delivery productivity Bonus: Experience ...

using Azure Databricks , Azure Data Factory , and Azure SQL Database . Optimise Databricks environments for performance, cost, and security. Develop and maintain data integration , ETL/ELT processes, and data quality frameworks. Translate business requirements into data models, ensuring consistency and accuracy across data layers. Work with stakeholders to deliver … integration environments. 8–10 years’ experience in data engineering and integration , ideally in enterprise‐scale environments. Hands‐on experience with Spark (PySpark/SparkSQL) , ETL/ELT design, and data pipeline orchestration . Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with ...

using Azure Databricks , Azure Data Factory and Azure SQL Database . Optimise Databricks environments for performance, cost and security. Develop and maintain data integration , ETL/ELT processes and data quality frameworks. Translate retail business requirements into data models, ensuring consistency and accuracy across data layers. Partner with business and … integration environments. 8-10 years' experience in data engineering and integration, ideally in enterprise-scale environments. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large ...

medallion, dimensional and domain-oriented designs. Data Integration & Engineering - Design ingestion and integration patterns across batch, streaming and change data capture (CDC). Define ETL/ELT, transformation and orchestration approaches suited to the customer's scale, skills and operating model. Data Storage & Management - Design the logical storage layer, including … oriented approaches, and of designing semantic layers for consistent business definitions. Experience designing ingestion and integration patterns, including batch, streaming, change data capture (CDC), ETL/ELT and orchestration. A good understanding of relational and non-relational databases, open table formats (e.g. Delta Lake, Apache Iceberg), and data storage and ...

users and tooling. The role is 100% remote. Key Responsibilities Design, develop, and implement data pipelines and ETL processes to ingest, transform, and load data into the data platform. Collaborate with the Lead Architect and Cloud Engineer to ensure the seamless integration of data services within the cloud infrastructure. Develop … with Azure data services. Strong understanding of data modeling concepts and relational and non-relational databases. Proficiency in SQL and experience with data integration and ETL tools (e.g., Azure Data Factory, Azure Databricks). Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). ...

Apache Spark, Delta Lake, or equivalent (Hadoop, Kafka, Flink)Experience leading technical customer conversations — discovery, whiteboarding, architecture reviewsFamiliarity with one or more: data engineering (ETL/ELT, medallion architecture, streaming), data science/ML (model training, MLOps), or SQL analyticsStrong presentation and demo skills — you will build and present ...

transformation, and loading processes. Support data migration activities, including loading financial data, moving configuration between tenants, and aligning with business processes and security. Develop ETL processes and data transformation logic to improve and normalise financial data. Validate and reconcile data loaded into Workday, ensuring consistency with legacy systems and financial ...

Analytics in London is seeking an AWS Data Engineer to join our hybrid team. You will design, build and optimise scalable data pipelines and ETL/ELT processes, using Python, SQL and Spark to manage large consumer datasets. You will collaborate with analytics and data science teams, apply AWS data ...

data pipeline technologies, Experience with data processing frameworks such as Apache Airflow, Apache Flink or Google Dataflow, with a practical understanding of ETL pipeline design and the ability to diagnose issues across data transformation and scheduling workflows. Demonstrable CI/CD experience — building, maintaining and improving pipelines using tools such ...

science, machine learning, and business analytics Practical experience in coding languages eg. Python, R, Scala, etc.; (Python preferred) Proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies e.g. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings ...

and incrementality testing directly in stakeholders' hands, working closely with engineers and marketing. Work with Data Engineering to build scalable pipelines and evolve our ETL as the modeling stack grows (e.g. adopting Databricks). What you need to succeed: An AI mindset: you use AI to work faster, automate where ...

complex environments. Key Responsibilities Lead the design and implementation of scalable data architectures on the Databricks Lakehouse platform. Oversee the development of efficient ETL/ELT pipelines using PySpark, SQL, and Delta Lake. Mentor and guide junior data engineers, promoting best practices in code quality, CI/CD, and performance ...

rules. Build interactive dashboards, reports and data visualisations. Develop allocation models, calculations and workflow processes. Integrate BOARD with ERP and other enterprise systems using ETL and data integration tools. Support data migration, testing and deployment activities. Deliver user training and provide post-go-live support. Recommend improvements to planning processes ...

including database development and stored proceduresStrong SQL skills, including query and performance tuningStrong hands-on Python development skillsProven experience designing, building and maintaining ETL processesGood working knowledge of Unix/Linux and shell scriptingExperience in automated testing of applications and data processesClean coding skillsExcellent problem-solving skillsFamiliarity with agile practices ...

including database development and stored proceduresStrong SQL skills, including query and performance tuningStrong hands-on Python development skillsProven experience designing, building and maintaining ETL processesGood working knowledge of Unix/Linux and shell scriptingExperience in automated testing of applications and data processesClean coding skillsExcellent problem-solving skillsFamiliarity with agile practices ...

core data warehouse. Define end-to-end data architecture, including ingestion, transformation, storage, governance, and reporting. Lead migration of Legacy data warehouses and ETL workloads to GCP and BigQuery. Design optimized BigQuery schemas, partitioning, clustering, and performance tuning strategies. Develop data pipelines using Cloud Dataflow, Dataproc, Cloud Composer, Cloud Functions ...

optimise them for future use and accessibility. Requirements Proven experience in Data Engineering or a similar analytical role. Strong understanding of data modelling, ETL processes, and data warehousing. Ability to work closely with subject matter experts to gather and interpret data requirements. Excellent problem-solving skills and attention to detail. ...

including schema design, performance optimisation and scalability Experience supporting operational, analytical or historical reporting workloads Understanding of cloud-native data technologies, data orchestration and ETL processes Awareness of data governance, metadata management, data quality, data lineage and the responsible use of AI-assisted tooling Positive and collaborative approach, with ...

data platform initiatives Data & Technology Awarenesso Solid understanding of modern data architectures, including cloud data warehouses (e.g. Snowflake)o Familiarity with data engineering concepts (ETL/ELT, pipelines, APIs, data modelling)o Ability to engage effectively with architects and engineers without needing to be hands-ono Strong understanding ...

warehouse and the data quality framework. Keep the warehouse up to date and exceeding data quality targets Monitor, investigate and resolve issues with the ETL and reporting processes Oversee the execution of scheduled analyses, reporting and model processes and automate repeat tasks using available SQL & BI tools Log work requests ...

filters, and drill-through functionality. Ensure consistency of data across source systems, data warehouse, and reports. Perform report reconciliation and data accuracy checks. Validate ETL processes and data transformations. Verify data movement from source systems to reporting layers. Execute database and SQL-based validation tests. Identify data quality issues and ...

platform. Experience is helpful, but not essential:* **Languages:** Python, SQL, Terragrunt, JavaScript* **Cloud:** AWS (primary), some GCP* **Warehouse & Storage:** Snowflake, S3/Parquet* **Data & ETL:** dbt, Fivetran* **Platform & Infra:** Kubernetes, Kafka, RabbitMQ, Argo, GitHub Actions, HashiCorp Vault* **Observability:** Datadog, Grafana* **Dashboarding:** Preset* **Other**: Claude### **What we’re looking for**Strong ...

Strategy Test Automation and Continuous Testing Testing Center of Excellence (TCoE) Agile, DevOps, and CI/CD Program and Portfolio Management Data Warehouse and ETL Testing Performance Engineering Cloud Migration Validation Generative AI and Agentic AI Executive Stakeholder Management Business Consulting and Digital Transformation Key Deliverables Enterprise Quality Engineering Roadmaps ...