1 to 25 of 176 Permanent ETL Jobs in South Wales

services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯

services. Knowledge of using PySpark in notebooks for data analysis and manipulation. Strong proficiency with SQL and data modelling. Experience with modern ELT/ETL tools within the Microsoft ecosystem. Solid understanding of data lake and lakehouse architectures. Hands-on experience with Power BI for data integration and visualisation. Familiarity More ❯

Data Engineer - FinTech Company - Newcastle (Tech Stack: Data Engineer, Databricks, Python, Azure, Power BI, AWS QuickSight, AWS, TSQL, ETL, Agile Methodologies) I’m working with a leading Software House in the FinTech industry, based in Newcastle, who are looking to hire a talented Data Engineer . This is a fantastic More ❯

Databricks, SQL Database, Data Factory, and T-SQL. In-depth understanding of London Market insurance data and Actuarial/Finance business processes. Experience with ETL processes, data modelling, and dimensional modelling techniques. Proficient with Azure DevOps, CI/CD, GIT, and deployment strategies. Proven track record in delivering cloud-based More ❯

Databricks, SQL Database, Data Factory, and T-SQL. In-depth understanding of London Market insurance data and Actuarial/Finance business processes. Experience with ETL processes, data modelling, and dimensional modelling techniques. Proficient with Azure DevOps, CI/CD, GIT, and deployment strategies. Proven track record in delivering cloud-based More ❯

IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse More ❯

IF YOU ARE Experienced with Python/PySpark Proficient working with Databricks Lakehouse architecture and principles Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse More ❯

collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE A technology professional focused on Data Warehouses, ETL, and BI solutions development Experienced in eliciting business requirements to address the customer’s data visualization needs Ready to dive into a customer's subject More ❯

collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others. IF YOU ARE A technology professional focused on Data Warehouses, ETL, and BI solutions development Experienced in eliciting business requirements to address the customer’s data visualization needs Ready to dive into a customer's subject More ❯

reporting. Strong programming skills in Python, with experience in data processing libraries like Pandas and NumPy. Experience with data pipeline development, data warehousing, and ETL processes. Strong analytical and problem-solving skills, with attention to detail and ability to work in a fast-paced environment. Excellent communication and collaboration skills. More ❯

reporting. Strong programming skills in Python, with experience in data processing libraries like Pandas and NumPy. Experience with data pipeline development, data warehousing, and ETL processes. Strong analytical and problem-solving skills, with attention to detail and ability to work in a fast-paced environment. Excellent communication and collaboration skills. More ❯

core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or Power BI. Excellent communication skills, with the More ❯

core GCP data services such as BigQuery, Composer, Dataform, Dataproc, and Pub/Sub. Strong programming skills in PySpark, Python, and SQL. Proficiency in ETL processes, data mining, and data storage principles. Experience with BI and data visualisation tools, such as Looker or Power BI. Excellent communication skills, with the More ❯

a full cloud migration. 🔧 Key Responsibilities Manage and enhance cloud-based data infrastructure (Azure) across multiple international markets Own the development and performance of ETL pipelines, ensuring integrity and consistency Lead the migration of legacy environments into Azure Cloud Maintain and synchronise Dev, Test, and Production environments using DevOps principles More ❯

of DevOps, CI/CD, and modern software development practices. Solid experience with Python (especially data and machine learning libraries). Experience working with ETL platforms and cloud-based data engineering tools (AWS, Azure, or OCI). Excellent communication skills and a solutions-focused mindset. Desirable experience includes: AWS or More ❯

Fabric , and/or Azure Synapse Analytics Hands-on experience with Python and working with APIs and SFTP data connectors Knowledge of data modelling , ETL pipelines , and data governance principles Demonstrable experience in stakeholder engagement , especially with senior leaders and cross-functional teams Ability to work independently and manage multiple More ❯

Fabric , and/or Azure Synapse Analytics Hands-on experience with Python and working with APIs and SFTP data connectors Knowledge of data modelling , ETL pipelines , and data governance principles Demonstrable experience in stakeholder engagement , especially with senior leaders and cross-functional teams Ability to work independently and manage multiple More ❯

in the business Programming experience in Python Experience writing, troubleshooting, and debugging advanced SQL queries Outstanding analytical and problem-solving skills Experience working with ETL/ELT, and reporting and analytics tools Skills and experience we’d love you to have... But if not? We’ll help you get there More ❯

in the business Programming experience in Python Experience writing, troubleshooting, and debugging advanced SQL queries Outstanding analytical and problem-solving skills Experience working with ETL/ELT, and reporting and analytics tools Skills and experience we’d love you to have... But if not? We’ll help you get there More ❯

SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong knowledge of data security, governance frameworks, and NHS interoperability standards (FHIR, HL7). Familiarity with More ❯

SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong knowledge of data security, governance frameworks, and NHS interoperability standards (FHIR, HL7). Familiarity with More ❯

and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist in gathering, documenting, and managing data engineering requirements and workflows. Contribute to the development … reviews of designs, prototypes, and other work products to ensure requirements are met. Skills & Experience: Essential: Basic understanding of data engineering concepts, such as ETL processes, data pipelines, and data quality management. Hands-on experience with SQL (e.g., writing queries, basic database management). Familiarity with data tools and platforms More ❯

and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency and reliability. Project & Improvement: Assist in gathering, documenting, and managing data engineering requirements and workflows. Contribute to the development … reviews of designs, prototypes, and other work products to ensure requirements are met. Skills & Experience: Essential: Basic understanding of data engineering concepts, such as ETL processes, data pipelines, and data quality management. Hands-on experience with SQL (e.g., writing queries, basic database management). Familiarity with data tools and platforms More ❯

On a daily basis your varied role will include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and More ❯

On a daily basis your varied role will include, but will not be limited to: Design, build, and optimize high-performance data pipelines and ETL workflows using tools like Azure Synapse, Azure Databricks or Microsoft Fabric. Implement scalable solutions to ingest, store, and transform vast datasets, ensuring data availability and More ❯