351 to 375 of 1,152 ETL Jobs in the UK

Senior AI Platform Architect - Infra, MLOps & Governance

Location
Greater London, England, United Kingdom
QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code: Terraform and Ansible for repeatable, automated provisioning ...

Data Engineer-contract

Hiring Organisation
Cyberteam
Location
Sheffield, Yorkshire, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Up to £450 per day
Duration: until 07/05/2027 Location: Sheffield, hybrid 60% office 40% home You will design and implement robust ETL/ELT pipelines, develop data models for management information (MI) reporting, and create dashboards that provide actionable insights for operational, risk, and compliance stakeholders. Key Responsibilities · Design, build, and … maintain scalable ETL/ELT pipelines to ingest and process log and event data from AI platform components. · Develop and optimize data models for aggregation, reporting, and analytics to support MI and governance requirements. · Collaborate with platform, DevOps, and security teams to ensure comprehensive data capture for monitoring and controls. ...

Data Engineer

Location
Sheffield, England, United Kingdom
building and maintaining the monitoring, controls, and observability capabilities for the HSBC Productivity Suite. This role will focus on designing and implementing robust ETL/ELT pipelines, developing data models for management information (MI) reporting, and creating dashboards that provide actionable insights for operational, risk, and compliance stakeholders. Responsibilities Design … build, and maintain scalable ETL/ELT pipelines to ingest and process log and event data from AI platform components. Develop and optimize data models for aggregation, reporting, and analytics to support MI and governance requirements. Collaborate with platform, DevOps, and security teams to ensure comprehensive data capture for monitoring ...

Data Engineer

Location
Belfast City District, Northern Ireland, United Kingdom
deliver reliable, secure and high-quality data solutions that make a meaningful business impact. You will bring strong technical expertise across data architecture, ETL processes and cloud platforms, alongside a collaborative approach and a genuine drive to improve how data is structured, accessed and used. MAIN RESPONSIBILITIES You will design … build and maintain robust ETL and ELT pipelines that provide reliable, high-quality data across the organisation. You will create scalable ingestion processes that bring together structured and unstructured data from multiple sources. You will develop and maintain modern data warehouses and data lakes that support reporting, analytics and data ...

Senior Data & AI Platform Engineer

Location
Manchester, England, United Kingdom
across APIs, files, events and operational stores; establish robust orchestration, monitoring, alerting, data-quality checks and incident response. Use AI and automation to accelerate ETL/ELT development, data mapping, documentation, testing, report generation, monitoring and data-quality management. Design high-quality Power BI semantic models, DAX measures and reusable … leadership, finance, commercial, product, marketing, payments and support reporting. Support CRM and operational data integrations, including outbound data feeds, identity mapping, schema mapping, reverse-ETL patterns and monitoring. Create reliable ingestion and modelling patterns for acquired businesses, so future integrations are repeatable, auditable and faster to execute. Set data-engineering ...

Data Engineer

Hiring Organisation
Anson Mccade
Location
Belfast, Northern Ireland, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
£60,000
company's data capabilities, improve existing processes and help turn complex datasets into meaningful business insights. Key Responsibilities Design, develop and maintain robust ETL/ELT data pipelines. Build data ingestion processes across multiple structured and unstructured sources. Develop and maintain data warehouses and data lakes. Optimise database performance, storage … Skills & Experience At least 4 years' experience in data engineering or a related role. Strong SQL and Python skills. Experience building and managing ETL/ELT pipelines. Experience with cloud platforms such as Azure, AWS or GCP. Knowledge of relational and non-relational databases. Understanding of data warehousing and dimensional ...

Data Engineer

Location
Aberdeen City, Scotland, United Kingdom
large‐scale data transformation initiatives. Key Responsibilities Data Engineering Develop and maintain data pipelines using Microsoft Fabric and Azure technologies. Build and optimise ETL/ELT processes. Support data lakehouse, warehouse and semantic model environments. Monitor, troubleshoot and improve data workflows. Contribute to data quality, governance and platform standards. 2. … activities. Skills & Experience Essential 5+ years' experience in Data Engineering, Business Intelligence, Analytics or a related field. Microsoft Fabric Strong SQL skills. Experience developing ETL/ELT processes. Understanding of data modelling and relational databases. Experience working with Power BI. Knowledge of cloud‐based data platforms. Strong analytical, problem‐solving ...

Data Engineer

Hiring Organisation
Peterson
Location
Aberdeen, Aberdeen City, City of Aberdeen, United Kingdom
Employment Type
Permanent
large-scale data transformation initiatives. Key Responsibilities Data Engineering Develop and maintain data pipelines using Microsoft Fabric and Azure technologies. Build and optimise ETL/ELT processes. Support data lakehouse, warehouse and semantic model environments. Monitor, troubleshoot and improve data workflows. Contribute to data quality, governance and platform standards. Business … activities. Skills & Experience Essential 5+ years' experience in Data Engineering, Business Intelligence, Analytics or a related field. Microsoft Fabric Strong SQL skills. Experience developing ETL/ELT processes. Understanding of data modelling and relational databases. Experience working with Power BI. Knowledge of cloud-based data platforms. Strong analytical, problem-solving ...

Senior Data Engineer

Hiring Organisation
Sellick Partnership
Location
Greater Manchester, United Kingdom
Employment Type
Permanent
Salary
£47000 - £57000/annum
Engineer will include * Designing, developing and maintaining enterprise-scale data pipelines using Microsoft Fabric, Azure Synapse Analytics and associated Microsoft technologies * Building and optimising ETL and ELT processes to support reporting, analytics, business intelligence and AI initiatives * Designing and maintaining modern data architectures including Data Lakes, Lakehouses, Data Warehouses and … data solutions using Microsoft Fabric and Azure Synapse Analytics * Advanced SQL development skills, including query optimisation and performance tuning * Experience designing and developing complex ETL and ELT processes * Strong understanding of data warehousing, data lake and Lakehouse architectures * Experience with data modelling techniques including dimensional modelling and star schemas * Experience ...

Senior Financial Automation Analyst - FTC

Location
Newcastle upon Tyne, England, United Kingdom
qualifications:• Bachelor’s degree in computer science or other equivalent qualification.• Proven experience (4+ years) of working with varied and complex data sets, building ETL (extract transform load) processes using scripting language (such as SQL, Python) and use of tools incl. Alteryx.• Previous experience with Low Code technologies (such … problems through technology.Experience with technologies such as Microsoft Power Platform, Alteryx, SQL, Python, Dataverse or SharePoint is important, alongside a good understanding of databases, ETL processes and application development. You'll also bring strong project management, problem-solving and communication skills, with the confidence to facilitate workshops, training and stakeholder ...

Senior Associate, Payroll Integration, London/Manchester/Glasgow/Newcastle

Location
Greater London, England, United Kingdom
using one or more Cloud platforms such as Microsoft Azure, AWS, Google Cloud is a plus Familiarity with automation and data technologies (e.g. RPA, ETL tools, visual analytics) Please note we are hiring in the following locations: London Manchester Glasgow What we offer you At EY, we’ll develop ...

Data Engineer - Databricks

Location
Bristol, England, United Kingdom
platform. Key Responsibilities Design, develop, and maintain data products using Databricks and associated Azure technologies. Build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple enterprise systems. Develop data transformations using PySpark, Spark SQL, SQL, and Python. Create and maintain curated datasets that support business intelligence … lineage, and support materials. Qualifications Minimum 2years' experience delivering data engineering or business intelligence solutions. Strong proven commercial experience with Databricks. Strong experience developing ETL/ELT pipelines and data integration solutions. Experience using Apache Spark, PySpark, and Spark SQL. Strong SQL development and optimisation skills. Experience working with large ...

Data Engineer – Python & Azure Databricks Expert

Location
Warwick, England, United Kingdom
seeks a Data Engineer to design, build, and optimize scalable data pipelines and modern data platforms using Python and Azure Databricks. The role involves ETL/ELT workflows, data integration from diverse sources, data quality and governance, collaboration with data scientists and analysts, and supporting CI/CD deployment ...

Senior Manager - Analytics Delivery - Technology Consulting - Belfast - IOI

Location
Belfast City District, Northern Ireland, United Kingdom
and visualisation: PowerBI, Tableau, Qlik Programming languages: SQL, Python, R Experience in any aspects of the data analytics lifecycle, for example: Data Manipulation and ETL Data Analysis & Visualization Applying machine learning statistical analysis and other advanced analytics techniques to key business issues faced by our clients that can transform and ...

Machine Learning Engineer · London, United Kingdom

Location
Greater London, England, United Kingdom
with Azure DevOps or similar CI/CD/CT pipelines for deploying AI/ML solutions Strong understanding of data engineering principles and ETL pipelines Proficiency in programming languages such as Python, R, Java, C# Familiarity with cloud-based data storage technologies like Azure Data Lake and Azure ...

Lead Software Engineer - Solution & Data Architecture - B2B SaaS Fintech

Location
Greater London, England, United Kingdom
distributed or microservices platform and lived with the consequences. Strong data modelling and SQL skills, plus experience designing data ingestion, transformation or ETL pipelines. You've dealt with data you couldn't trust. Enough Python to design and review it. Our metrics, analytics and AI services are written ...

Compliance Data Analyst

Location
Portsmouth, England, United Kingdom
relevant HND or degree (Data Science/Computer Science/Information Management/Engineering). Experience with variety of data sources. Basic understanding or ETL process’s Basic understanding of BI technologies, preferably with Power BI. Basic knowledge of SQL/TSQL Ideally, knowledge or experience of statistical methodologies and ...

Data Science Manager

Hiring Organisation
Hackajob Ltd
Location
South West London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
machine learning, and business analytics Practical experience in coding languages eg. Python, R, Scala, etc.(Python preferred) Strong proficiency in database technologies eg. SQL, ETL, No-SQL, DW, and Big Data technologies eg. pySpark, Hive, etc. Experienced working with structured and also unstructured data eg. Text, PDFs, jpgs, call recordings ...

Forward Deployed Engineer

Location
Greater London, England, United Kingdom
/CD in GitLab (or equivalent); infrastructure-as-code (e.g. Terraform); observability and monitoring stacks.* Solid understanding of database systems, SQL, data modelling, ETL pipelines, REST/gRPC APIs and microservices architecture; identity and access management with OIDC/SAML and Azure Entra ID.* Experience with LLMs, RAG systems, prompt ...

Data Warehouse Architect: On-Prem to Cloud Power BI

Location
United Kingdom
reports into Power BI via an Azure gateway, enabling analytics across client estates. The role is hybrid in the United Kingdom, requiring strong SQL, ETL and Microsoft stack skills, with potential future cloud migration and collaboration with the product/BI leads. #J-18808-Ljbffr ...

Staff Data Scientist - Paid Marketing Optimization

Location
Greater London, England, United Kingdom
seeds, remarketing audiences and exclusion lists. Work closely with the Data Engineering and Applied AI team on scalable data pipelines, the evolution of our ETL processes, and the adoption of new tools and frameworks. What you need to succeed: Python, SQL and a distributed framework like Spark; we use Databricks. ...

Test Automation Analyst

Location
United Kingdom
integration, regression, API and end-to-end testing. Develop and maintain automated testing solutions. Validate data across banking, lending, cards and AML systems. Perform ETL, database and data reconciliation testing. Test AWS-based data pipelines and large-scale data processing solutions. Investigate defects and support root-cause analysis. Work closely ...

Software Engineer - Java

Hiring Organisation
Spencer Rose
Location
Manchester, United Kingdom
Employment Type
Contract
Contract Rate
£380 - £400/day Inside IR35
Azure, ideally including GKE. Knowledge of Docker, Kubernetes, Helm, Jenkins, IAM and API gateways such as Apigee. Experience with Python, Pytest, API automation and ETL testing. Strong understanding of TDD, BDD, shift-left testing, unit, integration and regression testing. Familiarity with security and performance testing, and observability tools such ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
Deep familiarity with AWS and cloud-native data architectures Strong Python and SQL skills, with solid software engineering fundamentals Experience designing and maintaining scalable ETL/ELT pipelines, data lakes or modern lakehouse architectures Understanding of distributed data processing, streaming architectures and data pipeline optimisation Someone who enjoys ...

Business Intelligence Specialist

Location
Greater London, England, United Kingdom
equivalent combination of experience with 2-5 years experience in delivering business intelligence solutions Intermediate experience with Microsoft Power BI including data modeling, ETL, and authoring DAX for querying and calculations Strong working knowledge of: Power BI, Power Query, DAX, SQL, and best practices in data visualization Knowledge of Software ...