151 to 175 of 181 ETL Jobs in London

seeking an experienced Senior Data Engineer with strong expertise in Informatica PowerCentre, Oracle, and UNIX shell scripting to support critical data warehouse and ETL migration initiatives. The role will focus on migrating legacy SAS-based ETL processes to Informatica, ensuring efficient, scalable, and high-quality data integration within a complex … closely with internal requirements where Informatica PowerCentre (v10.6 preferred), Oracle, UNIX scripting, and SAS migration exposure are essential. Key Responsibilities Design, develop, and maintain ETL pipelines using Informatica PowerCentre (preferably version 10.6) Lead and support migration of SAS-based ETL workflows to Informatica within a Data Warehouse environment Develop and ...

PowerShell , SFTP , and WinSCP.Support and enhance internal tools and services developed in VB.NET , including debugging and minor code adjustments where necessary. Oversee and optimise ETL workflows , including those built using SSIS , ensuring data accuracy, reliability, and timely delivery. Create and maintain scripts to automate routine tasks, improve operational efficiency, and ...

company products, all potential applications, and effective communication skills. 3+ years in pre‐sales environment for a software vendor in the iPaaS, API management, ETL, ESB or similar space. Excellent written and presentation skills and the ability to consult and empathize with customers. Strong hands‐on relational database skills, SaaS ...

plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will … deliver modern cloud-based transformation for clients across a range of sectors. In this role, you will design and build data pipelines, develop ETL/ELT processes, and create innovative data solutions using the latest cloud technologies and frameworks across AWS. Some responsibilities include: Build data pipelines to ingest, process ...

timely and start execution. Validate financial calculations, transaction flows, compliance logic, and reporting across various platforms. This includes end-to-end data validation across ETL pipelines, databases, and reporting layers Validate performance of system via performance and load testing leveraging tools for the purpose Develop and maintain test automation scripts … tools and automation frameworks, performance and load testing tools, defect reporting and management tools Skilled in writing SQL queries to validate data across databases, ETL pipelines, and reporting layers Experience working with Microsoft Fabric workspace and notebooks. Experience validating data in relational and non-relational databases including CosmosDB. Experience validating ...

member of the team Compensation: OTE £90,000 Location: Hybrid/client-site as required Technology environment: AWS, Databricks, lakehouse architecture, complex relational databases, ETL/CDC pipelines About Transform Together Transform Together is a digital transformation consultancy helping organisations deliver business and technology change. We work with clients … remediation patterns. Define data quality dashboards, exception reporting and data health metrics. Ensure validation outputs can support audit, regulatory assurance and operational sign-off. ETL, CDC and Engineering Collaboration Work with Data Engineers to define ingestion requirements from complex relational databases, operational platforms and structured client files. Produce clear source ...

initiatives.Key Responsibilities* Deliver reporting, analytics and BI solutions for commercial lending teams * Build and enhance Tableau dashboards, reports and management information * Use SQL to extract, analyse and interpret business data * Partner with stakeholders to define reporting requirements and KPIs * Support data and reporting initiatives across change and transformation projects * Generate … skills * Ability to translate data into meaningful business insights * Strong stakeholder management and communication skillsDesirable* Power BI experience * Exposure to data warehousing concepts and ETL processes * Experience working in Agile environmentsNo sponsorship available.Get in touch for more details - McGregor Boyall is an equal opportunity employer and do not discriminate ...

between heavy-duty data engineering and core Python enterprise development. You will take technical ownership of designing, optimizing, and scaling native Python ETL pipelines and robust data processing frameworks. Given the nature of the trading floor, this role demands someone who thrives under agility, coordinates seamlessly across global time zones … Technical Leadership: Serve as the subject matter expert for Python development, championing best practices for automation, scraping, data processing, and integration workflows. Data Manipulation: Extract and process complex datasets using data-centric libraries (Pandas, NumPy, Polars) and scraping/parsing tools (BeautifulSoup, Selenium, Requests, pdfplumber). Database & Cloud Management: Architect ...

specifications and user stories. Analyse and document data flows, data lineage and data mappings. Define API specifications and system integrations. Work with developers on ETL processes, data transformations and data warehouse solutions. Support data modelling and ensure data is delivered effectively from multiple source systems to reporting and end users. … Technical Data Business Analyst or Systems Analyst. Proven background working on enterprise data platforms. Strong knowledge of: Data flows & lineage API integrations ETL processes Data modelling & data warehousing Data mapping Cloud platform experience (AWS and/or Snowflake preferred). Experience with reporting tools such as Power BI. Strong analytical ...

doing Leading, mentoring and growing a team of Data Engineers Designing and building scalable data pipelines and cloud based data platforms Developing robust ETL and ELT solutions using Python and SQL Defining engineering standards, data models and best practice Driving CI/CD, automation and modern engineering practices Collaborating with … quality and delivery What you'll bring Strong experience with Python and SQL Expertise building modern data platforms on Azure, AWS or GCP Strong ETL and ELT engineering experience Data modelling and data warehousing expertise CI/CD, Git and engineering best practice Previous experience leading, mentoring or developing engineers ...

Lloyd’s Market Insurer. This is a pivotal role sitting at the intersection of financial data integrity and cloud transformation. You will own the ETL pipeline that underpins monthly, quarterly and year-end close cycles, while simultaneously driving a strategic migration from legacy on-premise infrastructure to a modern, cloud … native data platform. Key Responsibilities Managing and monitoring the ETL pipeline to ensure timely and accurate financial reporting. Acting as the technical point of contact during the Monthly, Quarterly and Year-end Close process. Design and build scalable ETL workflows using Azure Data Factory and Databricks, replacing legacy SSIS pipelines. ...

members, the role contributes to building data pipelines, reports, and dashboards to support informed business decision-making. Key Accountabilities: Support development of data warehouses, ETL processes, and BI solutions. Develop and maintain reports and dashboards. Perform basic data analysis and identify trends. Assist in data validation and quality assurance. Collaborate … and analytical skills. Job Skills: Exposure to BI tools such as Power BI or Tableau. Working knowledge of SQL and relational databases. Exposure to ETL concepts and techniques. Strong analytical and problem-solving skills. Good communication skills. NRC is an Equal Opportunity Employer. We welcome applications from all qualified candidates ...

leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage Infrastructure as Code (IaC) using Terraform Work within established CI/CD pipelines to enable … Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements Active SC Clearance (must be valid ...

Required Skills Hands-on experience with Quantexa platform/Decision Intelligence Strong in Apache Spark/PySpark Proficiency in Python/Scala Experience in ETL, Data Engineering, Data Warehousing Knowledge of entity resolution, graph analytics, link analysis Experience working with large datasets (Big Data ecosystem – Hive/HDFS) Detailed … Description Design and develop solutions using Quantexa Decision Intelligence Platform Build data ingestion, transformation, and ETL pipelines using Spark/PySpark Work on entity resolution, network analytics, and graph-based data models Integrate multiple structured/unstructured data sources for analytics use cases Ensure data quality, validation, and governance standards ...

commercial performance metrics, and content derived from tens of thousands of expert interviews. The role gives you the mandate to find new ways to extract value from that data, with the freedom to experiment and the expectation to ship. \n Key Responsibilities: \n \n Design and build PoC solutions with … clear 'ship-or-kill' decision framework, defining evaluation criteria upfront so success is measurable, not just qualitative. \nBuild extraction, transformation, and loading (ETL/ELT) pipelines to create net-new datasets for analytical or ML use, including feature engineering pipelines for model training and downstream reporting.Apply supervised and unsupervised ...

commercial performance metrics, and content derived from tens of thousands of expert interviews. The role gives you the mandate to find new ways to extract value from that data, with the freedom to experiment and the expectation to ship. \n Key Responsibilities: \n \n Design and build PoC solutions with … clear 'ship-or-kill' decision framework, defining evaluation criteria upfront so success is measurable, not just qualitative. \nBuild extraction, transformation, and loading (ETL/ELT) pipelines to create net-new datasets for analytical or ML use, including feature engineering pipelines for model training and downstream reporting.Apply supervised and unsupervised ...

team development and platform strategy. Key Responsibilities Lead and develop a team of data engineers Own the design and delivery of scalable data pipelines (ETL/ELT) Drive improvements in data platform tooling, orchestration and CI/CD Define and enforce engineering standards and best practices Collaborate with architecture … modern cloud data platform Key Requirements Proven experience in a Lead/Senior Data Engineering role Strong handson experience with Snowflake Expertise in ETL/ELT and orchestration tools (e.g. Airflow, dbt, Matillion) Strong SQL and Python skills Experience building scalable data platforms in cloud environments Previous experience leading ...

metadata. Analyse source systems to understand data structures, assess data quality, evaluate data lineage, and perform impact analysis for proposed changes. Validate data models, ETL/ELT pipelines, and warehouse structures against business requirements through testing and User Acceptance Testing (UAT). Partner with business stakeholders, BI developers, data engineers … Agile environments, including user story creation, backlog refinement, sprint planning, and UAT support. Experience with cloud‐based data platforms, particularly Snowflake. Understanding of ETL/ELT frameworks and tools such as dbt and Apache Airflow. Knowledge of data governance, metadata management, and data lineage concepts. Experience supporting Business Intelligence and ...

implement and maintain data pipelines allowing data to be pulled from systems using a combination of SQL and APIs to a centralised warehouse using Extract Transformation and Load (ETL) processes enabling data analysis across the team. To create, maintain and produce reports that meet the needs of regulatory inspection and … and automating performance reporting wherever possible. Designing and implementing Power BI models from various data sources to create a centralised dashboard. Designing and implementing ETL pipelines to support with self-service reporting (Power BI) and enabling larger data sets to be analysed by the performance team. Produce usable technical documentation ...

Extensive experience working with Oracle databases (SQL & PL/SQL) Proficiency in UNIX/Linux shell scripting Proven experience working in Data Warehouse/ETL environments Experience in data integration, transformation, and performance tuning Strong understanding of ETL frameworks, data pipelines, and batch processing Desirable Skills Working knowledge … especially in ETL context) Experience in migrating SAS workloads to Informatica ETLs Familiarity with data modelling (dimensional modelling/star schema) Exposure to scheduling tools (e.g., Control-M, Autosys) Understanding of data governance and data quality frameworks ...

Product Development expertise and experience. Proficiency in English language and ability to communicate technical topics in a simple way to a non-technical audience. Extract, Transform, Load (ETL) tool experience (preferred but not required) You have experience with Topline Revenue Forecast modeling (preferred but not required) Skills & Other Qualities Strong ...

stakeholders receive accurate, timely, and actionable information. This is an exciting opportunity for a reporting and data analytics professional with experience of Data Lakes, ETL processes, and the Microsoft Power Platform to join a high-performing team and influence project outcomes through data-led decision making. What … data through reports, dashboards, graphs, and visualisations. Work with IT and Digital teams to improve data availability and accessibility through Data Lake environments. Utilise ETL processes and Databricks to prepare data for reporting and analytics solutions. Own the quality, consistency, and visual standards of reporting outputs across the project. Implement ...

APIs, microservices, and distributed systems Solid understanding of CI/CD pipelines and DevOps methodologies Experience working in Agile environments Exposure to Data Platforms, ETL pipelines, analytics, or data-driven products would be beneficial Excellent communication and stakeholder management skills Tech Stack Python Flask, Django, FastAPI AWS CI/… Tooling Docker & Kubernetes (desirable) Data Platforms & ETL Pipelines Location Hybrid – Hounslow, West London 2 days per week onsite Flexible hybrid working model Why Join? Competitive salary and comprehensive benefits package Private medical insurance Opportunity to lead a talented and growing engineering team Modern cloud-first technology environment Strong engineering culture ...

pipelines and orchestration tooling. Develop database schemas and data models. Integrate and enrich data from multiple sources, ensuring quality and consistency. Design and implement ETL processes (e.g. using NiFi). Write clean, secure, test-driven code that is reusable by default. Maintain and enhance data ingestion and storage architectures. Investigate … into epics and stories. Implement appropriate data security controls. Monitor, maintain and optimise data platforms to ensure performance and reliability. Skills and Experience Required: ETL development using Python or similar languages Apache Spark, NiFi, or Kafka Relational (PostgreSQL, MySQL) and NoSQL (MongoDB, Cassandra) databases AWS and cloud-based data services ...

data migration into Dynamics 365 for Finance. This role involves working closely with data leads, functional consultants, and architects to design and execute efficient ETL processes, ensuring a smooth transition from legacy systems with an emphasis on accuracy and scalability. Responsibilities Design and build ETL processes and migration solutions. Extract … data leads, functional consultants, and architects. Support cutover, deployment, and post go-live hypercare. Document processes, scripts, and migration runbooks. Requirements Proven experience in ETL and data migration engineering. Exposure to Dynamics 365 for Finance & Operations. Strong knowledge of SQL and data modelling. Experience with integration tools such as Azure ...