101 to 125 of 146 ETL Jobs in London

Energy/Gas), who is technically well versed in systematic trading development, and analysis data-sets (time series, market-data). Stack: Python, AWS, ETL, Airflow The team has a flat structure, where developers are interfaced with PMs and traders, to ensure the software systems created are bespoke. ...

Proven experience as a Data Architect/Data Solutions Architect Strong GCP experience , particularly BigQuery Deep understanding of data mesh, data warehousing, and ETL/ELT Experience with MPP databases and large-scale data platforms Strong grasp of data governance, security, and GDPR Confident communicator who can influence engineers and ...

ensure reliable, secure, and efficient data infrastructure for the organisation. What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation … improvement of data processes and tooling across the organisation Experience required: Proven experience in data engineering and building scalable data solutions Strong experience with ETL processes , data modelling, and data warehousing Proficiency in Python and SQL Expertise in relational (SQL) and NoSQL database technologies Hands-on experience with AWS Solid ...

PySpark experience. SAS to Pyspark migration experience Proven ability to write production-ready PySpark code. Strong understanding of data and data warehousing concepts, including: ETL/ELT, Data models, Dimensions and facts, Data marts, SCDs Spark Performance & Optimisation Strong knowledge of Spark execution concepts, including partitioning, optimisation, and performance tuning. … legacy SAS code. Data Engineering & Testing Ability to understand end-to-end data flows, integrations, orchestration, and CDC. Experience writing and executing data and ETL test cases. Ability to build unit tests, comparative testing, and validate data pipelines. Engineering Practices Proficiency in Git-based workflows, branching strategies, pull requests, and ...

leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs and modernising legacy ETL processes. You'll help design and build a new on-prem data platform aligned to the metals strategy while developing and maintaining scalable data pipelines … development. Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines. Delivered streaming pipelines and real-time data processing solutions. Experience replacing legacy ETL tools (e.g., Informatica) with modern data engineering pipelines and platform builds. Proven background working within financial services environments. What you'll get in return Flexible ...

with the implementation of London Market Insurance Policy Administration Systems (PAS) or migrations from legacy platforms onto a new PAS. - Data experience, to include ETL processes, using tools such as SQL or similar. - Process mapping and requirements gathering. - Excellent stakeholder management. - As is and to be analysis and documentation. - Experience ...

with the implementation of London Market Insurance Policy Administration Systems (PAS) or migrations from legacy platforms onto a new PAS. - Data experience, to include ETL processes, using tools such as SQL or similar. - Process mapping and requirements gathering. - Excellent stakeholder management. - As is and to be analysis and documentation. - Experience ...

programme focused on consolidating multiple payment and card-processing systems into a unified global ecosystem. The successful candidate will bring expertise in system migrations, ETL/data transformation pipelines, and cross-functional collaboration click apply for full job details ...

find the best team to suit your skillset/interests but you could be working on: • Some of the world’s most performant ETL pipelines that deal with billions of data points every second • Software solutions/products with scale, reliability and latency considerations in mind • R&D work ...

best team to suit your skillset/interests but you could be working on UI for: • Some of the world’s most performant ETL pipelines that deal with billions of data points every second • Software solutions/products with scale, reliability and latency considerations in mind • Machine Learning Infrastructure and ...

coordinate and manage own workload support project delivery. Basic understanding of reporting and audit functions, including viewing activity logs and document histories. Familiarity with ETL tools like FME and GIS integrations. Excellent communication and engagement skills Minimum Qualifications Needed for Role Degree in BIM/Design/Architecture/Civil ...

programme focused on consolidating multiple payment and card-processing systems into a unified global ecosystem. The successful candidate will bring expertise in system migrations, ETL/data transformation pipelines, and cross-functional collaboration. You will work with engineering, product, operations, compliance, and partner teams to define and govern architecture that … migration and consolidation of regional card-processing and payments platforms into a modern, unified global environment. Design and own large-scale data migration and ETL processes, including data mapping, transformation logic, orchestration, validation, lineage, and implementation. Translate complex business requirements into: Data models and data flow diagrams Sequence diagrams Migration ...

complex organisation. Experience with Oracle DBMS. Experience with SQL Server DBMS Microsoft Azure, Microsoft Fabric and Dataverse. Develop and maintain robust data pipelines and ETL workflows. Design and optimise relational and non-relational databases. Implement scalable data storage, orchestration frameworks and master data management processes. Ensure data quality, integrity, security … advise on best practice tools and standards. Identify and introduce emerging technologies to enhance organisational data capability. About You Proven experience in data engineering, ETL development and database optimisation. Strong understanding of data modelling, governance and regulatory compliance. Experience working in complex organisational environments. Strong analytical skills with the ability ...

models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting cloud-based data platforms across AWS, Azure, and/or GCP Embedding data governance, metadata management, and master data … Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/or GCP) Knowledge of ETL/ELT , data integration, and streaming architectures Solid understanding of data governance, metadata, and master data management Excellent communication skills, able to engage technical and ...

Support ongoing and planned data migration projects from SQL-based systems to Snowflake, including troubleshooting and environment support. Perform data extraction, transformation, and loading (ETL) processes from Avaloq using approved tools and interfaces. Manage, maintain, and optimize datasets in Snowflake, ensuring accuracy, performance, and alignment with governance standards. Assist … . Strong proficiency with Snowflake, including: Data Modelling, Snowflake roles, warehouses and tasks, working with the Snowflake Data Marketplace, Performance Tuning and Knowledge of ETL/ELT pipelines and data integration tools (e.g., Informatica, Matillion, DBT, Airflow). Experience with APIs, stored procedures, and automation scripts is a plus. Strong ...

EDGE, and Lineage Harvester, ensuring consistent ingestion of metadata, schemas, and lineage from multiple data sources. Perform connectivity and prerequisite validation with Application teams, ETL teams, and DBAs, including driver installation, credential management, network/firewall requirements and technical onboarding for new data sources. Investigate and resolve incidents related ...

design of innovative solutions using Palantir software, ensuring scalability and long-term impact. Engineer Data at Scale: Build, optimise, and maintain complex pipelines and ETL processes powering mission-critical decision models. Strategic Workflows: Develop enterprise-grade workflows and decision-support tools that reshape operations across industries. AI Leadership: Guide … with proven expertise in Python, SQL, and TypeScript. Ideally experience with Palantir technologies (Foundry, Gotham, or similar platforms). Advanced knowledge of data engineering, ETL pipelines, and workflow design at enterprise scale. Track record of leading teams, mentoring engineers, and delivering complex projects in client-facing environments. Passion ...

Microsoft Fabric, Azure Databricks, Synapse, Data Factory, SQL Server and more Lead the delivery of cloud migrations, modern data lakes, and end-to-end ETL/ELT pipelines Own resource planning, scheduling, and team availability Work closely with Pre-Sales, Commercial, and Project Management to scope work effectively … experience Strong background in Data Engineering or Data Warehousing Solid experience across Microsoft Fabric, Databricks, Synapse, Data Factory, etc. Excellent SQL & Python skills for ETL/ELT and data transformation Knowledge of lakehouse architecture and large-scale datasets A collaborative style and the ability to build an engaged, inclusive team ...

Responsibilities Analyse legacy system data structures and define detailed data mapping rules aligned with the target ERP data model. Design, develop, and execute ETL workflows for data extraction, transformation, and loading activities. Plan and conduct trial migrations, validate outputs, and reconcile migrated data against source systems. Lead data cleansing and … Skills & Experience Proven experience delivering ERP data migration projects (e.g., SAP, Oracle, Microsoft Dynamics, or similar platforms). Strong hands-on expertise with ETL tools, SQL, and advanced data transformation techniques. Demonstrated experience in data mapping, data quality improvement, de-duplication, and archival processes. Familiarity with integration platforms such ...

models. Key Responsibilities Design & Solve: Break down client problem sets and design innovative solutions using Palantir software. Engineer Data: Build and maintain pipelines and ETL processes to power decision-making models. Create Workflows: Develop operational workflows and decision-support tools that transform enterprise operations. Apply AI: Collaborate with colleagues … Engineer with proven expertise in Python, SQL, and TypeScript. Experience with Palantir technologies: Foundry, Gotham, or similar platforms (preferred) Strong understanding of data engineering, ETL pipelines, and workflow design. Passion for AI, machine learning, and emerging technologies. Excellent problem-solving, collaboration, and communication skills. Curiosity, adaptability, and a drive ...

Strong hands-on experience as a Snowflake Developer Solid SQL skills and experience with complex data transformations Experience with cloud platform - Azure Familiarity with ETL/ELT tools Strong understanding of data warehousing concepts and dimensional modelling Responsibilities Design, develop, and maintain data pipelines and data models in Snowflake Implement …/ETL processes using Snowflake and associated tools Optimise performance, cost, and scalability of Snowflake workloads Work closely with data engineers, analysts, and stakeholders to deliver high-quality data solutions Ensure best practices around security, governance, and data quality Support existing Snowflake environments and troubleshoot issues as needed Desirable Experience ...

Venture) Information Management Team (IM), where your responsibilities will include ensuring systems integration, designing data modelling processes, and developing algorithms and predictive models to extract the data required by the project. You will also collaborate with teams across the project to support data analysis and share insights. Candidates need … checks. Use FME to support information sharing and provide basic training on FME to project teams. Ensure project team members receive essential instruction on ETL tools (FME). Drive digital transformation by identifying and implementing process and workflow efficiency improvements. Support the integration of project systems with internal and client ...

from onboarding new datasets through to reliability, monitoring and data quality in production. In this role, you’ll: 🔧 Build, streamline and improve ETL/data pipelines (prototype → production) 📈 Ingest and normalise high-velocity time-series datasets from multiple external sources ⚙️ Work heavily in Python with a modern stack including DuckDB … days in the office ⚡ Start ASAP – Interviewing now What my client is looking for: Strong Python + SQL fundamentals (data engineering/ETL/pipeline ownership) Hands-on experience with DuckDB and/or Polars (DuckDB especially valuable) Experience operating pipelines in production (monitoring, backfills, incident/RCA mindset, data ...

heart. Your work will include: Leading the adoption of Databricks and building a modern Lakehouse architecture. Designing and implementing AWS-native ETL pipelines using S3, Glue, Athena, Step Functions. Building scalable, ACID-compliant datasets using Apache Iceberg. Running cost-efficiency initiatives across Redshift and broader AWS services. Consolidating fragmented environments … lead position Strong expertise across AWS Hands-on experience with Databricks, PySpark, and Lakehouse patterns Strong Python and SQL engineering ability Experience implementing scalable ETL/ELT pipelines Background in data modelling and building analytics-ready datasets Understanding of security best practices and compliance-driven architecture Ability to influence, mentor ...

working for a consultancy, with the end client being a utilities company. Your new role You will be responsible for monitoring, maintaining and supporting ETL processes, pipelines and data warehouse environments. What you'll need to succeed Extensive experience with ETL, data pipelines, and data warehouse production environments Strong expertise … troubleshooting ETL/ELT processes using Matillion, Informatica, ODI or SSIS Experience with Snowflake SQL programming and debugging skills with relational and cloud databases Nice to have: Finance domain knowledge SAP Systems and Database experience PowerBI or Tableau What you'll get in return You will be based ...