401 to 425 of 1,152 ETL Jobs in the UK

ML Data & Platform Engineer

Location
United Kingdom
data engineering foundation Hands-on experience with containerisation and orchestration (Docker, Kubernetes), and working with a major cloud provider Experience building data pipelines and ETL/ELT processes at scale, including web scraping or automated data collection A solid understanding of the ML lifecycle, from data through to model training ...

Forward Deployed Engineer, Manager -London

Location
Greater London, England, United Kingdom
workflows. Experience designing or implementing AI‐powered workflows involving MCP, APIs, LLM applications, prompt engineering, retrieval or RAG systems, or workflow orchestration. Experience with ETL or ELT workflows, schema mapping, validation scripts, and large‐scale content or data migration tooling. Experience partnering with product and engineering teams to influence roadmaps ...

Python Engineer, Financial Data Platform & Integrations

Location
Cardiff, Wales, United Kingdom
degradation when a provider slows down or goes dark Build the pipelines that land provider data in Cardiff's systems, including Snowflake, using serverless ETL on AWS (Glue, Athena, Step Functions, S3 data lakes), supporting both batch and near-real-time ingestion Do the data modeling and schema mapping that ...

Technical Lead

Location
Greater London, England, United Kingdom
/BST). DESIRABLE Telephony experience: Twilio, Vonage, LiveKit, SIP/PSTN, IVR design or call centre infrastructure. Experience with data pipelines, ETL or real-time data streaming (Kafka, RabbitMQ). Familiarity with AI operations (MLOps), model evaluation frameworks and A/B testing. Advanced experience with Azure Kubernetes Service ...

Research & Development Summer Internship 2027

Location
Reading, England, United Kingdom
following (the candidate is not expected to be knowledgeable in every area): Python (Pandas, NumPy), SQL & data modeling, Data wrangling and ETL, Data visualization (Power BI/Tableau), Machine Learning fundamental, API integration, Generative AI & prompt engineering, AI application development, Workflow automation, Web application development (Streamlit/React/Flask ...

EPR Data Migration Lead

Location
Sutton-in-Ashfield, England, United Kingdom
report writing and presentation skills. Attention to detail and commitment to data quality. SQL querying and data analysis skills. Experience using data migration and ETL tools Advanced Excel and reporting skills. Personal Attributes Highly organised and methodical. Strong attention to detail. Collaborative and team-focused. Resilient and able to work ...

Software Development Engineer III

Location
Greater London, England, United Kingdom
Claude Code**, **GitHub Copilot**, or similar coding assistants as part of the software development lifecycle.* Experience designing, building, and operating data pipelines and ETL/ELT workflows using Databricks, dbt, and Apache Airflow.**Preferred Skills & Experience*** Experience with frameworks like ReactJS, Angular, or Vue.js to build interactive and responsive user ...

Customer Engagement Manager

Location
Greater London, England, United Kingdom
prototype and troubleshoot) Experience designing solutions for enterprise systems: PSA, CRM, ERP, HRMS, financial systems, data platforms Familiarity with data modeling, ETL processes, data migration strategies, and enterprise data flows Comfortable using modern AI tools (Claude, Cursor, MCPs) to accelerate problem-solving, build prototypes, and enhance delivery productivity Bonus: Experience ...

Data Engineer

Location
City of Edinburgh, Scotland, United Kingdom
professional experience in data engineering, software engineering, or a related field.* Strong expertise in database architecture, design, and management.* Proven experience developing and maintaining ETL/ELT pipelines and scalable data workflows.* Strong proficiency in Python and SQL, or other relevant programming languages.* Experience with CI/CD pipelines, automation ...

Senior Data Engineer, Fabric & Analytics (Remote)

Location
Sheffield, England, United Kingdom
Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, andPowerBIto build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data. Develop andmaintainsophisticated data models, employing dimensional modelling … Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or evenon-premiseSpark clusters, usingPySparkor Spark SQL to manage and process large datasets. Expertisein Building ETL and ELT Pipelines:You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions ...

Senior Data Engineer, Fabric & Analytics (Remote)

Location
Greater London, England, United Kingdom
Microsoft Fabric, Azure Data Factory, Azure Synapse, Databricks, andPowerBIto build robust, scalable, and future-proof end-to-end data solutions. Design and implement efficient ETL and ELT pipelines, ensuring seamless integration and transformation of data from various sources to deliver clean, reliable data. Develop andmaintainsophisticated data models, employing dimensional modelling … Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or evenon-premiseSpark clusters, usingPySparkor Spark SQL to manage and process large datasets. Expertisein Building ETL and ELT Pipelines:You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions ...

Senior Data & Integrations Engineer – People & Finance

Location
Woking, England, United Kingdom
accurate and trusted datasets. Translate business and technical requirements into scalable integration designs, covering data mappings, transformation logic, scheduling, security, error handling and reconciliation. Extract, transform and exchange data through SQL, APIs, web services, file‐based interfaces and approved integration tools. Assess the upstream and downstream impact of changes … Good SQL skills for data extraction, transformation and troubleshooting. A practical understanding of APIs, REST, SOAP, JSON, XML, SFTP, web services, authentication methods and ETL/ELT patterns. Exposure to data modelling and preparing datasets for reporting environments, ideally Power BI. The ability to build and maintain data pipelines and ...

Data Engineer - 12 month FTC

Location
Greater London, England, United Kingdom
data products using Azure Databricks, Azure Data Factory, Python, PySpark and SQL. You will work with modern data architectures, including medallion architecture, data modelling, ETL/ELT and Unity Catalog, ensuring data is secure, governed, reliable and accessible. Working closely with architects, analysts and other technical teams, you will drive … organisation. Key skills and experience: Strong experience with Azure Databricks and Azure Data Factory. Proficiency in Python, PySpark and SQL. Experience in data modelling, ETL/ELT and modern data architectures. Knowledge of Power BI or similar reporting tools. Understanding of CI/CD, DevOps and automated testing. Knowledge ...

Data Engineer

Location
Lisburn, Northern Ireland, United Kingdom
infrastructure. About you Commercial experience in Data Engineering or a closely related role Strong SQL skills and experience with Python Experience developing and maintaining ETL/ELT pipelines Knowledge of data modelling, data warehousing and data integration Experience with cloud platforms such as Azure or AWS Exposure to technologies such … Microsoft Fabric or cloud-based analytics platforms would be advantageous. What you'll do Design, develop and maintain robust data pipelines Build and optimise ETL/ELT processes to support business requirements Integrate data from multiple sources and systems Develop and maintain cloud-based data platforms and warehouses Improve data ...

AWS Data Engineer – Power BI

Location
Lancashire, England, United Kingdom
DevOps, and business intelligence, ensuring reliable data pipelines and high-quality Power BI reporting. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT processes . Build and manage data solutions using native AWS services . Develop and maintain Power BI dashboards, reports, semantic models, and datasets … Strong hands-on Power BI experience. Strong hands-on experience with native AWS services . Experience in Data Engineering/DataOps . Experience building ETL/ELT data pipelines . Experience with data modelling and data warehousing. Experience with CI/CD and DevOps practices . Experience with Git and ...

Senior Data Engineer

Hiring Organisation
Reed Technology
Location
Manchester, United Kingdom
Employment Type
Permanent
Salary
£50000 - £57650/annum
Design, develop and maintain scalable data pipelines, integrations and data solutions using Microsoft Fabric, Azure Synapse Analytics and related Microsoft technologies. * Build and optimise ETL and ELT processes. * Design and maintain data lake, Lakehouse, data warehouse and semantic model architectures. * Develop robust integrations between cloud-based and on-premise systems … enterprise data solutions using Microsoft Fabric, Azure Synapse Analytics and Microsoft cloud technologies. Advanced SQL skills with experience designing, developing and optimising data pipelines, ETL/ELT processes and large-scale data solutions. Strong understanding of data warehouse, data lake and Lakehouse architectures, including data modelling techniques such as star ...

Senior Data Engineer

Hiring Organisation
Reed Technology
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, On-site
Salary
£57,650
Design, develop and maintain scalable data pipelines, integrations and data solutions using Microsoft Fabric, Azure Synapse Analytics and related Microsoft technologies. * Build and optimise ETL and ELT processes. * Design and maintain data lake, Lakehouse, data warehouse and semantic model architectures. * Develop robust integrations between cloud-based and on-premise systems … enterprise data solutions using Microsoft Fabric, Azure Synapse Analytics and Microsoft cloud technologies. Advanced SQL skills with experience designing, developing and optimising data pipelines, ETL/ELT processes and large-scale data solutions. Strong understanding of data warehouse, data lake and Lakehouse architectures, including data modelling techniques such as star ...

Databricks Data Engineer

Hiring Organisation
EXL Service
Location
Leeds, Yorkshire, United Kingdom
Employment Type
Permanent Contract, Hybrid
using Azure Databricks , Azure Data Factory and Azure SQL Database . Optimise Databricks environments for performance, cost and security. Develop and maintain data integration , ETL/ELT processes and data quality frameworks. Translate retail business requirements into data models, ensuring consistency and accuracy across data layers. Partner with business and … scale environments. Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse and Azure Data Lake. Hands-on experience with Spark (PySpark/SparkSQL), ETL/ELT design and data pipeline orchestration. Strong data modelling skills (Dimensional, ODS, Data Vault) and experience with data warehousing concepts. Experience working with large ...

Data Engineer

Location
Southampton, England, United Kingdom
build, so client and firm data stay separateMove existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric, redesigning legacy ETL and ELT processes along the wayUse version control, CI/CD, automated testing and monitoring to keep your pipelines reliable, and fix root causes when issues … Factory, Lakehouse, Warehouse and Notebooks) or Databricks, working proficiency in Python, PySpark and SQL for data engineering, an understanding of data modelling, warehousing and ETL/ELT principles, working knowledge of Power BI and version control (for example Git/DevOps), awareness of good practice in data governance, security and ...

Data Engineer

Location
Chilworth Old Village, England, United Kingdom
build, so client and firm data stay separate Move existing Azure Data Factory, Azure Data Lake and SQL Server solutions into Fabric, redesigning legacy ETL and ELT processes along the way Use version control, CI/CD, automated testing and monitoring to keep your pipelines reliable, and fix root causes … Factory, Lakehouse, Warehouse and Notebooks) or Databricks, working proficiency in Python, PySpark and SQL for data engineering, an understanding of data modelling, warehousing and ETL/ELT principles, working knowledge of Power BI and version control (for example Git/DevOps), awareness of good practice in data governance, security and ...

Senior Solution Architect, Data & AI

Location
City Of London, England, United Kingdom
medallion, dimensional and domain-oriented designs. Data Integration & Engineering - Design ingestion and integration patterns across batch, streaming and change data capture (CDC). Define ETL/ELT, transformation and orchestration approaches suited to the customer's scale, skills and operating model. Data Storage & Management - Design the logical storage layer, including … oriented approaches, and of designing semantic layers for consistent business definitions. Experience designing ingestion and integration patterns, including batch, streaming, change data capture (CDC), ETL/ELT and orchestration. A good understanding of relational and non-relational databases, open table formats (e.g. Delta Lake, Apache Iceberg), and data storage and ...

Senior Data Engineer

Hiring Organisation
Anson Mccade
Location
Central London, South East, United Kingdom
Employment Type
Permanent Contract, Hybrid
Responsibilities As a Senior Data Engineer, the successful candidate will: Design, build, improve and maintain data pipelines and ETL processes to extract, transform and load data. Develop and deploy high-quality data engineering components using software engineering and DataOps best practices. Work closely with clients and business stakeholders to understand … requirements include: Strong programming skills in Python, SQL or similar programming languages. Extensive experience with AWS Experience building, maintaining and optimising data pipelines and ETL processes. Understanding of data engineering principles, data management and data modelling. Experience with data orchestration and the development of reliable data workflows. Experience establishing ...

Python Developer (Data Applications and AI Engineering)

Location
Greater London, England, United Kingdom
work independently, manage your own priorities and deliver to agreed timelines Clear, concise communication and confidence building relationships with business stakeholders Nice to have ETL or ELT pipeline design, including orchestration with Dagster and transformation with dbt Snowflake Cortex, including Agents, Search and LLM integration Experience building AI powered applications ...

Data Engineer (SC Eligible/ SC Cleared)

Location
Newcastle upon Tyne, England, United Kingdom
flexible, work without compromising on interesting, meaningful projects. Key responsibilities Design, build and maintain scalable data pipelines (ETL/ELT) to collect, transform and load data from a range of sources. Develop and manage data storage solutions, including data warehouses and data lakes. Ensure data quality, accuracy and consistency through … skills and experience with relational databases such as PostgreSQL, SQL Server or Oracle. Programming experience in Python (or Scala or Java). Experience building ETL/ELT pipelines. Experience with cloud data platforms such as AWS or Azure (for example, S3, Glue, Redshift, Azure Data Factory or Synapse). Understanding ...

Senior Quality Engineer

Location
Milton Keynes, England, United Kingdom
Responsibilities Practical experience in back‐end automated testing using C# (minimum 5+ years’ experience). Hands on testing experience using MS Azure technologies (ETL, Microservices, Messaging and Service Bus technology). Experience of automating front‐end applications with Typescript/Playwright. Solid understanding of .Net with practical experience using .Net ...