1 to 25 of 45 ETL Jobs in South Wales

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

principles are followed throughout. In this role, you will be responsible for: Designing and delivering end‐to‐end data solutions Building and maintaining scalable ETL pipelines and cloud‐based data platforms using Microsoft Azure technologies. Leading workshops, capturing requirements and communicating confidently with both technical and non‐technical stakeholders. Creating ...

principles are followed throughout. In this role, you will be responsible for: Designing and delivering end‐to‐end data solutions Building and maintaining scalable ETL pipelines and cloud‐based data platforms using Microsoft Azure technologies. Leading workshops, capturing requirements and communicating confidently with both technical and non‐technical stakeholders. Creating ...

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance. Key Responsibilities Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks. Develop and maintain data models, transformations, and integrations across multiple systems. Collaborate with client teams to deliver high ...

best practises, including data security, data quality and data lineage. Other requirements include: Comfortable working in Microsoft Stack (Fabric, Azure, Power BI) Knowledge of ETL processes, semantic layers and tools like DBT Proficiency in Python for data manipulation and automation Ability to challenge assumptions and educate senior staff on data ...

best practises, including data security, data quality and data lineage. Other requirements include: Comfortable working in Microsoft Stack (Fabric, Azure, Power BI) Knowledge of ETL processes, semantic layers and tools like DBT Proficiency in Python for data manipulation and automation Ability to challenge assumptions and educate senior staff on data ...

Terraform, AWS CodePipeline), and integration with databases such as SQL Server, PostgreSQL, Oracle, Redshift, and Synapse Strong hands-on background in building and optimising ETL/ELT pipelines using modern tooling and best practices Proficiency in reporting tools such as Power BI, Tableau, and QlikView Let's connect for more ...

Terraform, AWS CodePipeline), and integration with databases such as SQL Server, PostgreSQL, Oracle, Redshift, and Synapse Strong hands-on background in building and optimising ETL/ELT pipelines using modern tooling and best practices Proficiency in reporting tools such as Power BI, Tableau, and QlikView Let's connect for more ...

Doing Designing and building a greenfield data architecture from scratch Creating scalable data pipelines for large, text-heavy and unstructured datasets Building ETL/ELT workflows that produce AI-ready datasets Implementing dataset versioning, reproducibility and data lifecycle management Supporting AI teams with training, validation and test data splits Embedding ...

Doing Designing and building a greenfield data architecture from scratch Creating scalable data pipelines for large, text-heavy and unstructured datasets Building ETL/ELT workflows that produce AI-ready datasets Implementing dataset versioning, reproducibility and data lifecycle management Supporting AI teams with training, validation and test data splits Embedding ...

conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets, and performance optimisation approaches Ensure data governance, security, privacy, and quality standards are embedded from day one Confidently challenge vendors ...

conscience of the programme - reviewing architecture, data models, pipelines, and design decisions Support development of data pipelines, Fabric workloads, and Power BI integration Validate ETL/ELT processes, migrated datasets, and performance optimisation approaches Ensure data governance, security, privacy, and quality standards are embedded from day one Confidently challenge vendors ...

frameworks (TensorFlow, PyTorch, scikit-learn, etc.) - DevOps practices, CI/CD, IaC, Docker, Kubernetes - Version control (Git) and collaborative development tools - Data engineering and ETL workflows - Monitoring/logging tools (Prometheus, Grafana, ELK, etc.) - Cloud platforms (AWS, Azure, Google Cloud) with focus on Google Cloud - Strong analytical, problem-solving, communication ...

deliver and maintain robust data solutions. Support data modelling and warehousing activities using best practices in schema design and data governance. Contribute to ETL/ELT development, testing, and automation using tools such as Python, SQL, Airflow, or Azure Data Factory. Collaborate closely with analysts, scientists, and architects to ensure … Clearance (or 5+ years UK residency. Desirable Skills & Exposure Familiarity with data lakes, warehouses, or streaming architectures (e.g. Databricks, Spark, Kafka). Experience with ETL tools, orchestration frameworks, or automation pipelines. Understanding of version control and CI/CD (e.g. GitHub, Azure DevOps). Awareness of data governance, lineage, and ...

handover and audit readiness. • Experience working in government, defence, or highly regulated industries with knowledge of relevant standards. • Experience with additional data processing and ETL tools like Apache Kafka, Spark, or Hadoop. • Familiarity with containerization and orchestration tools such as Docker and Kubernetes. • Experience with monitoring and alerting tools such ...

Oracle Analytics Cloud (OAC dashboards, DV, RPD/semantic modelling). Experience with Autonomous Data Warehouse (ADW) and Oracle Fusion data structures. Data modelling, ETL/ELT, SQL tuning and general analytics engineering skillset. Proven ability to collaborate with AI teams, data scientists or ML engineers in shared workloads. ...

Data Analyst or similar role. Demonstrate the design of dashboards, reports and data visualisation methods. Be familiar with relational databases, data warehousing, and ETL processes. Experience in translating the business needs into analytical solutions. Practical experience with AI/ML frameworks Fantastic communicator and team player capable of influencing adoption ...

Asset Management software. Proficient in handling multiple data formats: XML, JSON, CSV, EDI, XLSX. Strong communication and collaboration skills; fluent in English. Familiarity with ETL or data integration platforms (e.g., DataStage, Palantir). Experience with mapping documentation tools or standards (Excel-based mapping docs, BPMN, UML). Proficiency ...

part of a team that ensures our data infrastructure is robust, efficient, and continuously evolving. Key responsibilities include: Designing, developing, and maintaining ETL processes Writing and optimising complex queries for data extraction and transformation Supporting BAU data operations and ensuring consistent data delivery Creating and managing reports Developing analytical models ...

modeling tools (e.g., Erwin, Visio, Lucidchart) to create and maintain models that reflect business and technical requirements. Data Engineering & Pipelines Build, optimize, and maintain ETL/ELT pipelines for both structured and unstructured data. Implement scalable and efficient data warehousing solutions on relational and NoSQL platforms. Analytics & Reporting Develop and … relational and NoSQL databases such as Oracle, Sybase, PostgreSQL, SQL Server, MongoDB. Familiarity with big data platforms (e.g., Hadoop, Snowflake). Prior experience with ETL tools or as a SQL developer. Proficiency in Python for data engineering and Tableau for reporting and dashboards. Exposure to cloud platforms like AWS, Azure ...

modeling tools (e.g., Erwin, Visio, Lucidchart) to create and maintain models that reflect business and technical requirements. Data Engineering & Pipelines Build, optimize, and maintain ETL/ELT pipelines for both structured and unstructured data. Implement scalable and efficient data warehousing solutions on relational and NoSQL platforms. Analytics & Reporting Develop and … relational and NoSQL databases such as Oracle, Sybase, PostgreSQL, SQL Server, MongoDB. Familiarity with big data platforms (e.g., Hadoop, Snowflake). Prior experience with ETL tools or as a SQL developer. Proficiency in Python for data engineering and Tableau for reporting and dashboards. Exposure to cloud platforms like AWS, Azure ...

Integration architecture Event-driven architecture patterns (distributed design patterns more generally is an advantage) API design, management, and governance Extensive experience improving and optimising ETL processes, presumably using IPaaS tooling Data architecture Data modelling, cataloguing, and associated governance Data lakes, distributed storage Metadata management Cloud & Platform Architecture Proficient ...

Integration architecture Event-driven architecture patterns (distributed design patterns more generally is an advantage) API design, management, and governance Extensive experience improving and optimising ETL processes, presumably using IPaaS tooling Data architecture Data modelling, cataloguing, and associated governance Data lakes, distributed storage Metadata management Cloud & Platform Architecture Proficient ...

Server, MySQL) to support scalable data architectures. Leverage BI tools like Power BI and Tableau for data visualisation and reporting. Collaborate on ETL and data engineering tasks, ensuring efficient data transformations with SQL, Excel, and DevOps tools. Support teams in utilizing JIRA, Visual Studio, and Office Suite for project management … experience with Databricks, Azure, Data Factory, Synapse, and ADLS. Experience with R & Shiny Proficient with BI/data analytics tools (Power BI, Tableau) and ETL/data engineering. Advanced SQL skills, with experience in SQL Server and MySQL. Familiar with DevOps practices and project management tools like JIRA and Visual ...