326 to 350 of 401 ETL Jobs in the UK

seeking an experienced Senior Data Engineer with strong expertise in Informatica PowerCentre, Oracle, and UNIX shell scripting to support critical data warehouse and ETL migration initiatives. The role will focus on migrating legacy SAS-based ETL processes to Informatica, ensuring efficient, scalable, and high-quality data integration within a complex … closely with internal requirements where Informatica PowerCentre (v10.6 preferred), Oracle, UNIX scripting, and SAS migration exposure are essential. Key Responsibilities Design, develop, and maintain ETL pipelines using Informatica PowerCentre (preferably version 10.6) Lead and support migration of SAS-based ETL workflows to Informatica within a Data Warehouse environment Develop and ...

and build full-stack Python applications, including FastAPI APIs, and to deploy containerized services on Kubernetes. You will work with PostgreSQL and Snowflake, develop ETL pipelines with Argo Workflows, and collaborate with data scientists and product managers across marketing and advertising projects. You will contribute to evolving technology stacks, gain ...

Server environment with SSRS reporting, pulling data from multiple third-party platforms across every service area in the business. We build and maintain ETL pipelines using SSIS, Power Automate, PowerShell and batch scripts, develop and maintain a large library of stored procedures, and deliver self-service reporting to stakeholders across ...

plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data Storage, and DevOps methodologies Role Overview: This role sits within our client’s rapidly growing Cloud Data Platforms team, part of the Insights and Data Global Practice. You will … deliver modern cloud-based transformation for clients across a range of sectors. In this role, you will design and build data pipelines, develop ETL/ELT processes, and create innovative data solutions using the latest cloud technologies and frameworks across AWS. Some responsibilities include: Build data pipelines to ingest, process ...

days per month onsite in Coventry , and offers the potential to become a permanent position following the initial contract. Key Responsibilities Develop and maintain ETL pipelines using Microsoft Azure technologies. Support the delivery and maintenance of a central Azure data platform. Design and develop SQL database solutions. Build and enhance … requirements. Produce technical documentation and support best practice across the Data Engineering function. Essential Skills Commercial experience as a Data Engineer, Junior Data Engineer, ETL Developer or SQL Developer. Strong SQL/T-SQL skills. MS Fabric Experience with Azure Data Factory (ADF). Azure Synapse experience. ETL development experience ...

become a permanent member of the team Location: Hybrid/client-site as required Technology environment: AWS, Databricks, Lakehouse architecture, complex relational databases, ETL/CDC pipelines About Transform Together Transform Together is a digital transformation consultancy helping organisations deliver business and technology change. We work with clients to bridge … remediation patterns. Define data quality dashboards, exception reporting and data health metrics. Ensure validation outputs can support audit, regulatory assurance and operational sign-off. ETL, CDC and Engineering Collaboration Work with Data Engineers to define ingestion requirements from complex relational databases, operational platforms and structured client files. Produce clear source ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

working when possible Must hold active Enhanced DV Clearance (West) Competitive Salary DOE - 6% bonus, 25 days holiday, clearance bonus Experience in Data Pipelines, ETL processing, Data Integration, Apache, SQL/NoSQL Who Are We? Our client is a trusted and growing supplier to the National Security sector, delivering mission … utilising distributed computing techniques to handle large-scale, real-time, and unstructured data. Responsibilities include: Design and develop data pipelines, including ingestion, orchestration, and ETL processing (e.g., NiFi). Ensure data consistency, quality, and security across all processes. Create and maintain database schemas and data models. Integrate and enrich data ...

data solutions using modern AWS technologies. You must have active SC clearance for this role. Key responsibilities Design, develop and maintain data pipelines and ETL processes Build scalable data migration and transformation solutions Ensure data quality, validation and integrity throughout the migration process Work with cloud technologies to deliver secure … and stakeholders to deliver successful project outcomes Support testing, deployment and ongoing optimisation Skills & experience We're looking for experience with: Python and SQL ETL/data migration and transformation AWS cloud services Data modelling, validation and quality assurance Relational databases and large-scale datasets Strong analytical and problem-solving ...

catalogue content, metadata and governance artefacts Evaluating migration feasibility from legacy catalogue platforms Designing metadata mappings, transformation rules and migration approaches Building and optimising ETL/ELT pipelines Integrating data from multiple source systems and APIs Working closely with Business Analysts, Data Architects and technical teams to deliver migration outcomes … Experience Proven experience as a Data Engineer within large-scale data transformation or migration programmes Strong experience with data catalogue platforms, particularly Informatica Excellent ETL/ELT development experience Strong SQL and Python skills Experience with metadata management, data governance and data modelling Experience integrating APIs and multiple data sources ...

doing Leading, mentoring and growing a team of Data Engineers Designing and building scalable data pipelines and cloud based data platforms Developing robust ETL and ELT solutions using Python and SQL Defining engineering standards, data models and best practice Driving CI/CD, automation and modern engineering practices Collaborating with … quality and delivery What you'll bring Strong experience with Python and SQL Expertise building modern data platforms on Azure, AWS or GCP Strong ETL and ELT engineering experience Data modelling and data warehousing expertise CI/CD, Git and engineering best practice Previous experience leading, mentoring or developing engineers ...

Data Engineer who enjoys solving complex challenges, working with modern cloud technologies and contributing to business-critical projects. Key Responsibilities Design, develop and maintain ETL processes, data pipelines and data integration solutions Support the development and optimisation of cloud-based data platforms using cloud technologies Build and maintain scalable data … multiple systems and platforms Skills & Experience Proven experience working as a Data Engineer or within a Data & Analytics environment Strong experience building and supporting ETL processes and data pipelines Knowledge of cloud-based data platforms Advanced SQL skills with experience querying, transforming and manipulating large datasets Experience with Python ...

using a mixture of, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies (SQL Server, PL/SQL, T-SQL, SQL Server Management Studio - SSIS), ETL, Integration Platforms, Agile and Frontend Development (JavaScript/jQuery, React, Blazor) and Software Testing. This is a hands-on role, so you MUST … Software Engineer, .NET, C#, ASP.NET Core, ASP.NET, Blazor, Database Technologies, SQL Server, PL/SQL, T-SQL, SQL Server Management Studio, SSIS, Power BI, ETL, Integration Platforms, Agile, Frontend Development, JavaScript, jQuery, React, Blazor, Software Testing, AWS, Azure, Cloud, CI/CD, DevOps, Software Architecture, Design Patterns. The role comes ...

design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across … similar message brokers for asynchronous processing. Practical experience with cloud services, preferably Microsoft Azure and/or GCP. Demonstrated expertise in designing and implementing ETL pipelines and background processes. Strong understanding of system architecture principles – microservices, event‐driven design, and API gateways. Soft Skills Strong team player with excellent collaboration ...

Lloyd’s Market Insurer. This is a pivotal role sitting at the intersection of financial data integrity and cloud transformation. You will own the ETL pipeline that underpins monthly, quarterly and year-end close cycles, while simultaneously driving a strategic migration from legacy on-premise infrastructure to a modern, cloud … native data platform. Key Responsibilities Managing and monitoring the ETL pipeline to ensure timely and accurate financial reporting. Acting as the technical point of contact during the Monthly, Quarterly and Year-end Close process. Design and build scalable ETL workflows using Azure Data Factory and Databricks, replacing legacy SSIS pipelines. ...

maintain scalable data processing systems Develop and manage data pipelines to transform raw data into usable insights Support and enhance data warehouse architectures and ETL processes Collaborate with technical and non-technical stakeholders to deliver data solutions Monitor and optimise data performance and reliability Maintain and improve API integrations across … systems and architecture Skills & Experience Experience in a Data Engineer or similar role Strong SQL skills and proficiency in Python Experience with data modelling, ETL processes and data warehousing Exposure to cloud platforms Strong problem-solving skills and attention to detail Excellent communication and collaboration abilities What's On Offer ...

members, the role contributes to building data pipelines, reports, and dashboards to support informed business decision-making. Key Accountabilities: Support development of data warehouses, ETL processes, and BI solutions. Develop and maintain reports and dashboards. Perform basic data analysis and identify trends. Assist in data validation and quality assurance. Collaborate … and analytical skills. Job Skills: Exposure to BI tools such as Power BI or Tableau. Working knowledge of SQL and relational databases. Exposure to ETL concepts and techniques. Strong analytical and problem-solving skills. Good communication skills. NRC is an Equal Opportunity Employer. We welcome applications from all qualified candidates ...

leveraging modern AWS and data engineering technologies. Key Responsibilities Design, build, and optimise scalable cloud-based data pipelines on AWS Develop and maintain robust ETL processes to support complex data integration requirements Implement and manage Infrastructure as Code (IaC) using Terraform Work within established CI/CD pipelines to enable … Terraform) Experience working with GitLab and implementing CI/CD pipelines Practical experience building data pipelines in AWS (e.g. EMR, PySpark) Solid understanding of ETL tooling (e.g. Informatica or similar) Strong background in data processing and transformation Proficiency in Python and PySpark Essential Requirements Active SC Clearance (must be valid ...

dashboards that support operational decision making across the business. Tech Stack & Environment Microsoft Data Platform Microsoft Fabric Power BI Lakehouse Architecture Semantic Models Dataflows & ETL Data Modelling Data Integration SaaS platform integrations API connectivity Data ingestion & transformation Data quality and governance Reporting & Analytics Interactive dashboards Operational reporting KPI development Self … reporting Performance optimisation What You'll Be Doing Review and optimise an existing Microsoft Fabric and Lakehouse environment Assess current data models, semantic models, ETL processes and reporting architecture Recommend improvements around performance, scalability, governance and security Integrate data from multiple business systems and APIs Design and develop operational reports ...

Required Skills Hands-on experience with Quantexa platform/Decision Intelligence Strong in Apache Spark/PySpark Proficiency in Python/Scala Experience in ETL, Data Engineering, Data Warehousing Knowledge of entity resolution, graph analytics, link analysis Experience working with large datasets (Big Data ecosystem – Hive/HDFS) Detailed … Description Design and develop solutions using Quantexa Decision Intelligence Platform Build data ingestion, transformation, and ETL pipelines using Spark/PySpark Work on entity resolution, network analytics, and graph-based data models Integrate multiple structured/unstructured data sources for analytics use cases Ensure data quality, validation, and governance standards ...

interactive Power BI dashboards, including data modelling and DAX calculations Gather and analyse business requirements, translating them into scalable technical solutions Build and maintain ETL processes and system integrations Support testing, deployment and continuous improvement activities across systems and applications SQL Developer Requirements Proven experience with SQL Server database development … and optimisation Hands-on experience with Microsoft Power Platform Strong knowledge of Power BI, SSRS and reporting solutions Understanding of data modelling, ETL processes and performance tuning Exposure to Microsoft Azure cloud technologies Strong analytical and problem-solving skills Excellent communication skills with the ability to engage technical and ...

interactive Power BI dashboards, including data modelling and DAX calculations Gather and analyse business requirements, translating them into scalable technical solutions Build and maintain ETL processes and system integrations Support testing, deployment and continuous improvement activities across systems and applications SQL Developer Requirements Proven experience with SQL Server database development … and optimisation Hands-on experience with Microsoft Power Platform Strong knowledge of Power BI, SSRS and reporting solutions Understanding of data modelling, ETL processes and performance tuning Exposure to Microsoft Azure cloud technologies Strong analytical and problem-solving skills Excellent communication skills with the ability to engage technical and ...

team development and platform strategy. Key Responsibilities Lead and develop a team of data engineers Own the design and delivery of scalable data pipelines (ETL/ELT) Drive improvements in data platform tooling, orchestration and CI/CD Define and enforce engineering standards and best practices Collaborate with architecture … modern cloud data platform Key Requirements Proven experience in a Lead/Senior Data Engineering role Strong handson experience with Snowflake Expertise in ETL/ELT and orchestration tools (e.g. Airflow, dbt, Matillion) Strong SQL and Python skills Experience building scalable data platforms in cloud environments Previous experience leading ...