126 to 150 of 173 ETL Jobs in London

complex organisation. Experience with Oracle DBMS. Experience with SQL Server DBMS Microsoft Azure, Microsoft Fabric and Dataverse. Develop and maintain robust data pipelines and ETL workflows. Design and optimise relational and non-relational databases. Implement scalable data storage, orchestration frameworks and master data management processes. Ensure data quality, integrity, security … advise on best practice tools and standards. Identify and introduce emerging technologies to enhance organisational data capability. About You Proven experience in data engineering, ETL development and database optimisation. Strong understanding of data modelling, governance and regulatory compliance. Experience working in complex organisational environments. Strong analytical skills with the ability ...

engineering delivery of a modern Microsoft data platform, centred on Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, Notebooks). Building, optimising and maintaining ELT/ETL pipelines across Fabric, Azure Data Factory and Databricks. Delivering high-quality datasets across the medallion architecture (Bronze/Silver/Gold). Developing scalable models … with Azure Databricks and Delta Lake engineering. Solid working knowledge of the Microsoft data stack: Azure Data Factory, ADLS Gen2, Synapse, Azure SQL. Strong ETL/ELT experience using modern cloud data tools. Proven ability to build and optimise Power BI datasets, semantic models, and performance tuning. Good understanding ...

and ensuring data quality across our scalable Big Data platforms. Key Responsibilities Data Pipeline Development: Assist in the design, construction, and maintenance of robust ETL/ELT pipelines to integrate data from various sources into our data warehouse or data lake. Data Transformation with Python: Write, optimize, and maintain production … and performing performance tuning. Big Data Concepts Foundational understanding of Big Data architecture (Data Lakes, Data Warehouses) and distributed processing concepts (e.g., MapReduce). ETL/ELT Basic knowledge of ETL principles and data modeling (star schema, snowflake schema). Version Control Practical experience with Git (branching, merging, pull requests ...

Power BI dashboards, ensuring insights are visually compelling, intuitive, and aligned to business needs. Work closely with the Data Architecture Lead to ensure Alteryx ETL workflows produce models optimised for dashboard creation. Provide input on data model structure, required fields, and logic to support visualisation needs. Apply best practices … development experience with proven visual design skills. Ability to translate reporting needs into data model requirements. Strong understanding of data structures, relational models, and ETL concepts. Ability to work collaboratively with Data Architecture/ETL resources. Advanced Excel and strong analytical capability. Strong communication and stakeholder engagement skills. Desirable Experience ...

Design and build integration pipelines (Real Time + batch) using SnapLogic Develop ETL/data workflows and API integrations across systems (ERP, CRM, SaaS) Work with Snap Packs , pipelines, and Snaplex environments Implement error handling, monitoring, and performance optimisation Collaborate with business and tech teams to translate requirements into solutions ...

EDGE, and Lineage Harvester, ensuring consistent ingestion of metadata, schemas, and lineage from multiple data sources. Perform connectivity and prerequisite validation with Application teams, ETL teams, and DBAs, including driver installation, credential management, network/firewall requirements and technical onboarding for new data sources. Investigate and resolve incidents related ...

Azure Data Engineer (Contract – Day Rate) - Mid-Level | Azure | Data Lakehouse | ETL Location: Central London Day Rate: £375 - 425 per day (Outside IR35) Working Patterns: Hybrid, London Interviews: 2 stage processOpus are supporting a global insurance organisation seeking an Azure Data Engineering contractor to join its core IT function … reporting into the agile delivery team. Act as a replacement within the existing data engineering function Focus on incoming data design, Azure optimisation, and ETL best practice Work closely with senior engineers while contributing independent technical thought and challenge Key Responsibilities: Design, build and maintain ETL pipelines in Azure ...

technical stakeholders across multiple timezones, with the ability to lead and take ownership of your decisions. Tech stack will likely use Snowflake, Azure Databricks, ETL using DBT and IBM Data Manager so knowledge of these data platforms, data engineering and ETL processes will be helpful. Any previous experience ...

plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will … deliver modern cloud-based transformation for clients across a range of sectors. In this role, you will design and build data pipelines, develop ETL/ELT processes, and create innovative data solutions using the latest cloud technologies and frameworks across AWS. Some responsibilities include: Build data pipelines to ingest, process ...

junior engineers ________________________________________ Key Responsibilities: • Break down complex client problem sets and design innovative solutions using Palantir technologies • Build and maintain robust data pipelines and ETL processes • Develop operational workflows and decision-support tools that transform client operations • Collaborate with colleagues to implement AI and machine learning models • Apply strong software … Proven experience as a Full Stack Data Engineer or similar engineering role • Strong skills in Python, SQL, and TypeScript • Solid understanding of data engineering, ETL pipelines, and workflow orchestration • Interest in AI, machine learning, and emerging technologies • Strong communication skills and a collaborative, consulting mindset • Curiosity, adaptability, and a desire ...

unified, scalable HR data platform. The core data model has already been designed. The next phase focuses on: Building logical data layers Developing scalable ETL pipelines Delivering a centralised HR data product Enabling Power BI reporting and improved organisational insight This is a highly hands-on engineering role with significant … influence over architectural decisions and delivery pace. What You'll Be Doing Core Responsibilities Designing and developing ETL pipelines within Snowflake Working at the logical data modelling layer Challenging and supporting existing data architecture Collaborating with architects, data engineers, and insight teams Ownership & Leadership Driving delivery of the HR data ...

team development and platform strategy. Key Responsibilities Lead and develop a team of data engineers Own the design and delivery of scalable data pipelines (ETL/ELT) Drive improvements in data platform tooling, orchestration and CI/CD Define and enforce engineering standards and best practices Collaborate with architecture … modern cloud data platform Key Requirements Proven experience in a Lead/Senior Data Engineering role Strong handson experience with Snowflake Expertise in ETL/ELT and orchestration tools (e.g. Airflow, dbt, Matillion) Strong SQL and Python skills Experience building scalable data platforms in cloud environments Previous experience leading ...

Data Factory, ADLS, Synapse, and Databricks (Spark & Delta Lake). Lead data modelling initiatives including star schema and lakehouse patterns. Architect end-to-end ETL/ELT pipelines and integration strategies. Ensure solutions meet NHS standards (FHIR/HL7), patient data sensitivity, and governance requirements. Provide architectural leadership … Databricks (Spark, Delta Lake). Proficient in Python and SQL. Proven track record designing end-to-end data pipelines and architectures. Deep understanding of ETL/ELT design and data modelling (star schema/lakehouse). Knowledge of ML workflows (basic to intermediate). ...

Design and implement data governance solutions using the Collibra platform (DIP/CDQ) . Liaise with cross-functional teams including Data Office, Application Teams, ETL Teams, DBAs and other project teams to ensure data source prerequisites are met and configured. Enable effective data lineage and metadata management within the Collibra … skills (eg PL/SQL or T-SQL). Experience working with Oracle and/or SQL Server . Experience with data integration and ETL processes . Strong understanding of data management concepts and data modelling techniques . Experience working in Agile delivery environments . Excellent communication skills with ...

deploy services on their own servers, so a strong production/ops mindset is important. In this role, you’ll: Build, streamline and improve ETL/data pipelines (prototype → production) Ingest and normalise high-velocity, time-series datasets from multiple external sources Work heavily in Python with a modern columnar … office Start ASAP – interviewing now What my client is looking for: 5–7+ years hands-on data engineering experience Strong Python + SQL fundamentals (ETL, pipelines, data modelling, performance) Hands-on experience with Polars and Parquet/Arrow/PyArrow Proven ability to operate pipelines in production (monitoring, backfills, data ...

rail network. The Role As a Data Engineer, you'll be part of a collaborative technical team, working across the data lifecycle: from designing ETL pipelines and integrating real-time data streams, to developing APIs and backend systems that deliver rail data securely and reliably. You'll work closely with … Contribute to internal learning sessions, tech talks, and shared documentation. The Candidate You might be a good fit if you have experience with: • Building ETL/ELT pipelines using tools like Kafka, dbt, or custom frameworks. • Working with structured and unstructured data at scale. • Backend development in Python (or similar ...

Venture) Information Management Team (IM), where your responsibilities will include ensuring systems integration, designing data modelling processes, and developing algorithms and predictive models to extract the data required by the project. You will also collaborate with teams across the project to support data analysis and share insights. Candidates need … checks. Use FME to support information sharing and provide basic training on FME to project teams. Ensure project team members receive essential instruction on ETL tools (FME). Drive digital transformation by identifying and implementing process and workflow efficiency improvements. Support the integration of project systems with internal and client ...

building and optimising data pipelines within highly controlled, high impact programmes. You will work across modern data ecosystems, integrating large scale datasets, developing robust ETL processes and enabling the deployment of AI and machine learning solutions into operational settings. The work is technically challenging, often requiring creative problem solving … willingness to work within secure UK environments • Strong Data Engineering background with solid programming skills in Python and SQL • Proven experience designing and building ETL pipelines and data workflows at scale • Experience working across cloud and on prem data platforms • Exposure to machine learning or AI driven systems within production ...

Insurance sector. This role sits at the intersection of business and technology, driving the successful delivery of data-driven solutions, including modern data platforms, ETL pipelines, and business intelligence reporting. Key Responsibilities Collect and formalize business requirements for the implementation of Data & Analytics projects with ETL and Data Visualization tools … Business Analyst within the Insurance industry Strong understanding of the insurance lifecycle (policy, underwriting, claims, etc.) Proven experience working on Data & Analytics projects (ETL, reporting, dashboards) 5+ years of experience in Project Management/PMO, including planning and tracking delivery Solid SQL skills for data analysis and validation Experience working ...

delivering insights that drive customer retention and revenue growth. Design and develop interactive dashboards to track retention and revenue performance Build and maintain scalable ETL pipelines to support data integration and reporting Use SQL (essential) and Python (desirable) for data extraction, manipulation and automation Support A/B testing and … must be able to write complex queries from scratch) Proven experience building dashboards using Tableau, Qlik Sense or similar tools Experience designing and maintaining ETL/data pipelines Strong stakeholder engagement and communication skills Ability to simplify complex data for non-technical audiences Desirable: Experience with Python for data analysis ...

ownership of high-impact backlog items Develop and enforce data engineering standards, frameworks, and best practices Design and optimise scalable data pipelines aligned to ETL principles and business objectives Collaborate closely with Product and Delivery teams to deliver high-value solutions Champion the adoption and evolution of a modern cloud … cloud-based data platforms (preferably Azure) Strong background in end-to-end data solution design and data warehousing principles Hands-on experience with ETL tools (e.g. Databricks) and data processing frameworks Advanced proficiency in Python, SQL, and Spark Ability to navigate and deliver complex engineering challenges with confidence What Sets ...

ongoing analytical work (risk modelling, anomaly detection), but the primary focus is on ML system structure and scalability . Technical Environment * High-volume ETL/ELT pipelines (multi-source ingestion: SAP, APIs, email, flat files) * Client-specific models built on shared base models (micro-model architecture) * Feedback-driven learning loops … Experience auditing and improving existing ML setups * Strong MLOps experience (model versioning, monitoring, CI/CD) * Experience working with data pipelines (ETL/ELT, Spark or similar) * Comfortable working with messy, real-world data and complex business logic * Experience in small, fast-moving teams (startup, scaleup, or consulting) * Strong communication ...

Maintain legal entity hierarchies, system configurations, access controls, and user permissions. Partner with accounting teams to resolve D365 issues and ensure smooth daily operations. Extract data and perform ETL tasks; manage integrations and data flows between systems. Gather and document business requirements for new functionality, modules, and localisation. Lead testing ...

someone who enjoys being personally embedded in the system and has strong experience across Analytical Workspace, stored procedures, data manipulation, reporting, and data integration (ETL & Datasources). A background in consolidation processes is advantageous but not essential. Role Overview As the technical owner and lead developer of the Tagetik platform … Hands-On) Serve as the hands-on technical lead for Tagetik, responsible for system build and configuration Design, build, and maintain Analytical Workspace models, ETL processes, validations, and reports Develop and optimise solutions, models, calculations, and transformation logic Perform advanced data manipulation, validation, and reconciliation across Tagetik modules Troubleshoot performance ...

site (London) What You'll Do: * Design and build intuitive, interactive dashboards focused on retention and revenue-driving activities * Develop and maintain scalable ETL processes to support data integration * Leverage SQL and Python to analyze data and automate workflows * Support A/B testing initiatives by analyzing experiments and establishing … consistency through strong QA practices What You Bring: * Strong proficiency in SQL and experience with Tableau, QlikSense, or similar tools * Hands-on experience with ETL processes and data pipelines * Solid understanding of A/B testing and experimentation analysis * 3+ years working with call center data and related KPIs * 3+ ...