18 of 18 Permanent Data Pipeline Jobs in Wales

Data Engineer | Hybrid | Pontypridd IntaPeople are proud and excited to be appointed to recruit an experienced Data Engineer for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data/IT function in this newly created position. You will … be joining the data team as one of the first employees in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and … management capability, lacks data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data processing, meeting the organisation’s More ❯

Data Engineer – Cardiff/Hybrid – £40,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that’s continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they’re offering an excellent opportunity for a Data Engineer to make a real impact. We’re looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You’ll play a key role in ensuring data is accurate, accessible, and high-quality — driving data-led decision making at every level. What you’ll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with More ❯

Data Engineer - Cardiff/Hybrid - £45,000 - £50,000 + benefits Yolk Recruitment are excited to be working with a global technology business that's continuing to expand its data capability and invest in modern cloud solutions. Known for their collaborative culture and commitment to innovation, they're offering an excellent opportunity for a Data Engineer to make a real impact. We're looking for a Data Engineer to help design, build, and maintain scalable data pipelines and systems that power analytics and business intelligence across the organisation. You'll play a key role in ensuring data is accurate, accessible, and high-quality - driving data-led decision making at every level. What you'll be doing: Design, build, and maintain scalable data pipelines and ETL processes to support analytics and operations. Develop and optimise data models and storage solutions for performance and reliability. Ensure data quality, integrity, and security throughout the data lifecycle. Collaborate with More ❯

Senior Data Engineer – Cardiff/Hybrid – £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They’re looking for a Senior Data Engineer to help shape the next generation of their data platform — leading technical design … mentoring others, and driving best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you’ll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best … practices for data engineering, including coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data More ❯

Senior Data Engineer - Cardiff/Hybrid - £65,000 - £75,000 + benefits Yolk Recruitment are proud to be supporting a leading global business investing heavily in its data and analytics capabilities. They're looking for a Senior Data Engineer to help shape the next generation of their data platform - leading technical design … mentoring others, and driving best practice. This is a great opportunity for an experienced data professional who enjoys solving complex challenges, optimising large-scale systems, and influencing strategy within a collaborative, forward-thinking team. What you'll be doing: Lead the design and implementation of scalable, high-performance data architectures and pipelines. Define and enforce best … practices for data engineering, including coding standards, testing, and documentation. Mentor and guide engineers, fostering collaboration and technical excellence. Translate complex business requirements into reliable, well-structured data solutions. Optimise data workflows for performance, reliability, and cost efficiency. Drive adoption of modern data tools and technologies across the organisation. Ensure robust data More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

our work is meaningful and rewarding, often varied, sometimes complex but always rich with opportunities to learn, grow and improve both as a team and individually. We use data to help our customers make better decisions and take the same evidence led approach to our own development. We’re a UK based, veteran owned data analytics … sites across Europe (and occasionally further afield) to ensure we stay close to those we serve. Our ideal candidate is comfortable working across the stack, from designing backend data pipelines to building clean, user-friendly front ends. You’ll collaborate with data scientists, product managers, and other engineers to build systems that enable insight, automation, and … intelligent data-driven decision-making at scale. Your main responsibilities will be to: •Design, develop, and maintain full-stack web applications with a focus on data pipelines, analytics dashboards, and reporting tools. •Build scalable RESTful APIs and backend services using modern frameworks and languages (e.g. Python, Node.js, C++). •Develop clean, responsive front-end interfaces using More ❯

Senior Data & ML Engineer ?? Cardiff/London ?? £90,000 - £100,000 DOE What You'll Do: Take the lead on building and scaling large-scale web scraping and data ingestion systems that form the core of an AI-driven product suite used by major enterprise clients. From crawling hundreds of dynamic sources to powering downstream LLM … features, your work will be the foundation of everything the platform delivers. You'll own projects end-to-end - designing data pipelines, integrating with vector databases, and deploying intelligent features using Retrieval-Augmented Generation (RAG) and fine-tuned LLMs. What You'll Bring: Deep hands-on experience with web scraping tools and frameworks (Scrapy, Playwright, Puppeteer, etc.) 5+ … Strong Python skills and comfort working across complex ingestion workflows Experience managing NoSQL and vector databases at scale (MongoDB, Weaviate, Pinecone, etc.) Solid understanding of modern data pipeline tools (Airflow, Prefect, Dagster) Practical experience with LLM development, embeddings, and RAG architectures Familiarity with distributed systems and cloud platforms (AWS, GCP, or Azure) Self-motivated and capable of More ❯

Job Title : Lead Data & Machine Learning Architect Location : Yate (On-Site 2 Days Per Week) Salary : Up to £60,000 (Depending on Experience) Overview of Business: This is a chance to join a team who are creating an Energy Management Solutions to minimise energy cost & increase higher returns from energy assets. We are seeking a highly skilled Lead … Data & Machine Learning Architect to design and lead the development of robust data and machine learning systems. You will take ownership of the data architecture, drive the development and deployment of machine learning models, and contribute to the strategic use of data across the organisation. Key Responsibilities: Data Architecture Schema … Model Ownership: Design, implement, and maintain logical and physical data models, primarily using PostgreSQL. Data Integration: Build and manage robust data pipelines to ingest, clean, and unify data from APIs, sensors, and other external sources, using tools like Dagster. System Design: Select appropriate storage and processing technologies tailored to system needs. Governance More ❯

solving, and hands-on contribution. The role involves Re-architecting an AWS environment that has grown inconsistently, addressing security, governance, and scalability. Designing and implementing distributed systems and data pipelines, with a focus on reliability and resilience. Working directly on code and infrastructure as code (around 50% of your time). Running proofs of concept to evaluate approaches … as Node.js, C#, or Java (currently use serverless architecture using Node.js and React). Understand SQL at a solid level, with broader experience across NoSQL and data pipeline design. Have experience with distributed systems or progressive web applications. Think carefully about problems, explore alternatives, and can explain the reasoning behind their choices. This role may suit someone … currently working as Lead Developer/Senior Software Engineer Lead DevOps Engineer Solutions Architect with hands-on coding experience Senior Data Engineer with strong AWS expertise Technical Lead in a small-to-medium software team It would particularly fit someone who enjoys combining practical engineering with higher-level architectural thinking, and who wants the space to solve technical More ❯

solving, and hands-on contribution. The role involves Re-architecting an AWS environment that has grown inconsistently, addressing security, governance, and scalability. Designing and implementing distributed systems and data pipelines, with a focus on reliability and resilience. Working directly on code and infrastructure as code (around 50% of your time). Running proofs of concept to evaluate approaches … as Node.js, C#, or Java (currently use serverless architecture using Node.js and React). Understand SQL at a solid level, with broader experience across NoSQL and data pipeline design. Have experience with distributed systems or progressive web applications. Think carefully about problems, explore alternatives, and can explain the reasoning behind their choices. This role may suit someone … currently working as Lead Developer/Senior Software Engineer Lead DevOps Engineer Solutions Architect with hands-on coding experience Senior Data Engineer with strong AWS expertise Technical Lead in a small-to-medium software team It would particularly fit someone who enjoys combining practical engineering with higher-level architectural thinking, and who wants the space to solve technical More ❯

We are currently looking for a Senior Systems Engineer to join the Data Cloud team in our Cardiff Bay office. You will need to have demonstrable experience in Python and AWS cloud services. Creditsafe Privately owned and independently minded, Creditsafe operates with the singular vision of powering business decisions. We do this by delivering valuable intelligence on customers … a revolutionary dream to make business information accessible to all. Twenty-five years later, we’ve not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened new avenues of data intelligence for businesses with machine learning, AI and connected data. From … risk management through to opportunity identification, our industry-leading solutions, power decisions for companies by turning their data into actionable insights that help them become stronger, grow faster and thrive. The Team This opportunity is to join a team of highly technically skilled engineers, who are enhancing Creditsafe’s data offerings with high throughput and scalability More ❯

Shape the Future with AI — Start Your Career Here Are you fascinated by artificial intelligence, machine learning, and data-driven innovation? Are you excited by the potential of AI to solve real-world problems and build smarter systems? We’re looking for an ambitious and curious Graduate AI Analyst/Engineer to join our AI & Data … recent graduate who wants to kickstart their career by working on real AI projects, learning from experts, and gaining hands-on experience with modern AI tools, models, and data pipelines. Whether you studied Computer Science, Engineering, Maths, Data Science, or a related field, if you have a passion for AI and a hunger to learn — we … want to hear from you. What You’ll Be Doing You’ll work with experienced AI engineers and data scientists to: Build & Train Models : Support the development and training of machine learning and deep learning models using tools like Python, TensorFlow, PyTorch, or Scikit-learn. Explore & Prepare Data : Help clean, transform, and analyse large datasets for More ❯

Data & Insight Manager - Ecommerce Job Title: Data & Insight Manager Salary Range: £60,000 - £75,000 + discretionary bonus Location: Cardiff Area, Wales (Hybrid - 2 days/week in office) (With some potential flexibility) Our client is a global consumer brand with nearly a century of heritage and a reputation for innovation. Following a recent acquisition by … team and high-growth ambitions, this is a rare chance to join at a foundational stage, helping professionalise a business that's scaling fast across international markets. The Data & Insight Manager will be the first dedicated analytics hire in the business — owning everything from technical setup to commercial storytelling. You'll work cross-functionally across eCommerce, marketing, and … operations to unlock the value of data and drive critical decision-making. This is a hands-on, high-impact role for someone who thrives on solving problems, building from scratch, and creating business value through data. Essential Skills: Strong SQL and experience with BI tools (e.g. Looker, Tableau, Data Studio) Proven experience building and maintaining data More ❯

this role, you will be responsible for: Delivering strategic advisory, engineering delivery, and enablement services to Government and commercial clients. Solve user problems by drawing source and captured data into a single foundational data model and building operational workflows that materially change the decisions made Work closely with clients, to tailor products and services Design solutions … for client problem sets based on their descriptions and by exploration of the data landscape Assist in the design, development, and maintenance of data pipelines and ETL processes to build data and action models to address the workflow needs Build and edit operational workflows, including front ends and decision-support toolsets, inclusive of native … company with strong ideals and ambitions. You will work closely with teams of experienced and early talent engineers on a variety of projects, gaining hands-on experience in data management, analysis, and AI technologies, on profound and important problems. This represents an excellent opportunity to secure a permanent role with a growing and dynamic organisation. More ❯

Overview VP of AI/ML/Data - UK (Hybrid role with offices in South Wales & London). Highly Competitive (circa £100,000 - £150,000) + Bonus + Equity. What You'll Do Step into a senior leadership role with a mission to drive innovation across an AI-powered SaaS platform. As VP of AI, you'll shape … just experimentation-so your impact will be visible, measurable, and far-reaching. You'll also play a key role in modernising and streamlining the platform's AI and data infrastructure, championing MLOps best practices, and aligning technical delivery with strategic goals. What You'll Bring Significant experience leading AI/ML teams in fast-paced, SaaS-driven environments … Proven ability to deliver AI capabilities in production, including model training, deployment, monitoring, and lifecycle management Strong technical background across machine learning, data pipelines, and cloud platforms (e.g. Snowflake, Databricks, Azure) Exceptional communication and influencing skills, with the ability to align executive stakeholders around AI strategy A pragmatic, delivery-focused mindset and passion for scalable, secure, and privacy More ❯

table creation, SAS Studio V and SAS RTENG to build the SA registration network, SAS Viya 3.5 tools for risk assessment of new SA registrations. The POC leveraged data from 20 different sources, most of which were already housed in the Minerva Oracle database. Previously, some data had to be transferred manually. However, the automated file … transfers described in this Solution Design Document (SDD) will now move that data to the SAS platform using approved Enterprise Architecture (EA) integration patterns, with the initial phase, targeted for delivery in April 2026. This role will form part of a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS … implement automation test strategies and plans for SAS Viya 4 applications, for UI based Visual Analytics (VA) and Intelligent Decisioning (ID), as well as for integration testing of data pipelines. Develop and maintain test scripts using appropriate automation frameworks (e.g., Selenium, PyTest, JUnit) and integrate them into CI/CD pipelines. Confirm the test data strategy More ❯

table creation, SAS Studio V and SAS RTENG to build the SA registration network, SAS Viya 3.5 tools for risk assessment of new SA registrations. The POC leveraged data from 20 different sources, most of which were already housed in the Minerva Oracle database. Previously, some data had to be transferred manually. However, the automated file … transfers described in this Solution Design Document (SDD) will now move that data to the SAS platform using approved Enterprise Architecture (EA) integration patterns, with the initial phase, targeted for delivery in April 2026. This role will form part of a new scrum team within Minerva Platform to develop and deliver the Ingestion and Risking within the SAS … implement automation test strategies and plans for SAS Viya 4 applications, for UI based Visual Analytics (VA) and Intelligent Decisioning (ID), as well as for integration testing of data pipelines. Develop and maintain test scripts using appropriate automation frameworks (e.g., Selenium, PyTest, JUnit) and integrate them into CI/CD pipelines. Confirm the test data strategy More ❯