1 to 25 of 56 Data Pipeline Jobs in Wales

About Our Client Leading Transportation organisation Job Description Leading Transportation organisation are seeking to hire a Head of Data & Data Engineering in this newly created role. You will lead a team of developers and analysts to provide a robust data platform on their journey … to self-serve information, providing insight and analysis with the sole purpose of providing excellent service to customers. Outside of Data Engineering you will fulfil a broad remit across Data Architecture, Data Security and Data Quality Management. Dimensions of the role: Deliver … technologies, including Azure data warehouses, data lakes, and data governance tools. Knowledge of optimising data pipelines, pipeline architectures and integrated datasets. Demonstrable knowledge of working with and understanding data architecture principles and best practice. Experience of procuring and implementing More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

the ease of use - they have introduced several industry-first products and maintain a strong focus on research and development. As a Junior Data Engineer, you will play a crucial role in developing the data infrastructure that supports the analytics and operational functions of our business … enterprise. Role & Responsibilities: Data Infrastructure & Support: Provide first-line support for data engineering tasks, such as managing and monitoring data pipelines, resolving issues, and ensuring data integrity. Work with both structured and unstructured datasets to design and implement data models … -related errors. Collaborate with business stakeholders to identify data requirements and deliver sustainable solutions. Monitor and troubleshoot data pipeline issues to maintain data integrity and accuracy. Assist in the development, maintenance, and optimization of ETL (Extract, Transform, Load) processes for efficiency More ❯

Data Engineer My client is in search of a Data Engineer who will concentrate on data warehousing and business intelligence for the organisation. The role involves utilising tools such as Azure Data Factory, Power BI, Fabric, SSRS Reporting, and data cubes. Key Responsibilities Oversee Azure Data Factory, Data Lake, and Data Warehouse SQL environments Work with business and technical teams to gather and document data requirements Design, implement, update, and support data pipelines in Azure Data Factory (ADF) Maintain data warehouse dimensional model and develop data marts Develop standards and processes to optimize cost and service delivery Provide ongoing support, debug issues, and perform root cause analysis Enforce data management governance processes and standards Experience : Hands-on experience More ❯

Data Engineer - Hybrid working My client is in search of a Data Engineer who will concentrate on data warehousing and business intelligence for the organisation. The role involves utilising tools such as Azure Data Factory, Power BI, Fabric, SSRS Reporting, and data cubes. Key Responsibilities Oversee Azure Data Factory, Data Lake, and Data Warehouse SQL environments Work with business and technical teams to gather and document data requirements Design, implement, update, and support data pipelines in Azure Data Factory (ADF) Maintain data warehouse dimensional model and develop data marts Develop standards and processes to optimize cost and service delivery Provide ongoing support, debug issues, and perform root cause analysis Enforce data management governance processes and standards Experience: Hands-on experience More ❯

Social network you want to login/join with: Senior Azure Data Engineer - Remote, newport, wales col-narrow-left Client: Location: newport, wales, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 7 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description … Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use, adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior More ❯

Role: Senior Data Engineer and Data Manager Salary: £45,974 to £54,430 Location: Cardiff (hybrid) The Opportunity Yolk Recruitment are excited to be working with an innovation-driven civil service organisation as they journey through some incredible projects whilst prioritising forward thinking and excellent digital … practices. Role Overview: This is chance to work in an organisation that uses data extensively to directly inform its work. As a key part of the data team, you will be supporting the organisation in that evidence based decision-making and working with colleagues who value … ensure integration projects account for data governance, quality, and versioning. Document all integrations and maintain up-to-date records. Data Pipeline Development & Management Build and maintain data pipelines for ingestion from internal and external sources. Automate data processes to support scalable More ❯

We are seeking a talented and experienced Data Platform Product Lead to join our team. This is an exciting role focusing data warehousing and business intelligence for the firm and external clients. You will be joining our data and architecture team whose mission is … to re-imagine how we manage and extract value from our data. You will be a hands-on data engineer with experience in Azure Data Factory, PowerBI, Fabric, legacy SSRS reporting and data cubes. Your expertise and ability to implement best practices in a … newly established team and fast changing data environment will be essential in driving the success of the team. Key Responsibilities Overall management of Azure Data Factory, Data Lake, and Data Warehouse SQL environments. Work with business and technical teams to elicit and More ❯

Data Engineer – Data Engineering Team We’re looking for a Data Engineer to join our growing Data Engineering team at Creditsafe. You'll play a key role in building data pipelines and supporting faster, more informed decision-making for both … give you the flexibility you need to do your best work. Your Team You’ll join one of four delivery teams within our Data Engineering department. Together, we support over 1,000 data pipelines and manage data services across our centralised data warehouse. These services provide the "business-ready" data that powers our products. We work in an Agile environment using modern tools and technologies including AWS, Glue, Step Functions, Athena, PySpark, SQL, and Python. Our processes are metadata-driven to ensure scalable, consistent, and reliable data More ❯

Social network you want to login/join with: We are currently looking a Data Engineer, to join the Data Engineering team in Cardiff. You will be expected to attend the office 50% of the working week, to align with our hybrid working policy. WHO ARE … a company where careers are made and where talent meet its true potential. JOB PROFILE You will be working closely with the product, data analysts and data engineering, building specific systems facilitating the extraction and transformation of Creditsafe data. The role will define and build data … such as continuous integration and test driven development to enable the rapid delivery of working code. Design and build metadata driven data pipeline using Python and SQL in accordance with guidelines set by the Data Architect Ship medium to large features independently using industry standard More ❯

You will be responsible for advising clients, designing and implementing technical solutions, and supporting post-implementation phases. The role involves hands-on configuration, data integration and migration, and stakeholder engagement to ensure the success of technology projects across diverse client environments. As a Technical Consultant at RTBSS, you … procedures, and advanced queries. Object-Oriented Programming: Can write scripts in an object-oriented programming (OOP) language, ideally C#. Expertise in ETL and Data Warehousing: Comprehensive understanding of ETL tools and techniques, data warehousing concepts, and best practices. Strong Analytical and Problem-Solving Skills: Proven ability … Provide training to client users, supporting them post-go-live to maximise solution impact. SQL Development and Data Engineering Data Pipeline Design: Implement advanced ETL pipelines that support client data transformation needs across various systems. Systems Integration: Ensure seamless data connectivity More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in … a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution … software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and More ❯

Social network you want to login/join with: ZONTAL is revolutionizing data management and digital transformation for the life sciences industry. Our cutting-edge platform enables seamless data integration, standardization, and accessibility—empowering scientists and organizations to drive innovation, enhance compliance, and accelerate breakthroughs in … a subject matter expert in the ZONTAL Platform and its customer use-cases. Analyze business requirements for customer-facing projects, with emphasis on data flows and data formats as they feed into & out of the ZONTAL Platform. Create functional and design specifications for the proposed solution … software, such as Scientific Data Management Systems (SDMS) or Laboratory Information Management Systems (LIMS). Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and data parsing. Familiarity with cloud service models, SaaS infrastructure, and related SDLC. Familiarity with containerization and More ❯

people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service. We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our … optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic … and enjoy. Methods was acquired by the Alten Group in early 2022. Requirements On-site, Full time. We are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across More ❯

people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service. We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our … optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic … and enjoy. Methods was acquired by the Alten Group in early 2022. Requirements On-site, Full time. We are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

our award-winning team at Sparta Global. About This Role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, newport col-narrow-left Client: Bytes Software Services Location: newport, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job … collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, cardiff col-narrow-left Client: Bytes Software Services Location: cardiff, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job … collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just … grasp of Azure Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, newport col-narrow-left Client: Data Science Talent Location: newport, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col … wide Job Description: Head of Data Engineering & Governance Investment & Wealth Management Hybrid (3 days at home with 2 days traveling in the UK) £120k - £140k basic (DOE) + bonus (10-25%) and benefits (pension, life insurance, healthcare, holidays, & more). “Money makes the world go round,” they say. … on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, cardiff col-narrow-left Client: Data Science Talent Location: cardiff, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col … wide Job Description: Head of Data Engineering & Governance Investment & Wealth Management Hybrid (3 days at home with 2 days traveling in the UK) £120k - £140k basic (DOE) + bonus (10-25%) and benefits (pension, life insurance, healthcare, holidays, & more). “Money makes the world go round,” they say. … on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance More ❯

from our state-of-the-art UK headquarters in Wrexham, and our US office in Atlanta. The role: We’re seeking a skilled Data Engineer to support key business initiatives throughout 2025. This contract role is ideal for someone who thrives on designing and optimizing data pipelines from the ground up. Reporting to the Head of Data Engineering, the position offers a hybrid working model with our office based in Wrexham, North Wales. You’ll work across multiple teams, systems, and products—so being self-directed and collaborative is essential. The successful … candidate will play a key role in delivering robust, scalable, and maintainable data solutions that empower the business with reliable insights and streamlined processes. Key responsibilities: Develop and maintain scalable data pipelines to support required data integrations for all business areas Design data More ❯

Lead Data Scientist (Equity Only) - 1% Job Description: As a Lead Data Scientist at Luupli, you will leverage AWS analytics services to analyze data, collaborate with cross-functional teams, and develop data-driven solutions to support our social media app for diverse … creators. Responsibilities include developing data analysis strategies, building data pipelines, applying machine learning techniques, creating dashboards, and optimizing data architecture. Responsibilities: Understand business objectives and define analytics goals. Develop strategies using AWS services like Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes. Apply statistical and machine learning techniques for analysis. Create dashboards and KPIs for decision-making. Conduct exploratory data analysis to identify trends. Collaborate on data architecture and governance in AWS. Requirements: Bachelor's or master's in Computer Science, Statistics More ❯

Staff Software Engineer - Data Department: Engineering Employment Type: Full Time Location: Cardiff Description is the UK's first comparison platform for car insurance. We've been helping customers since 2002 by empowering them to make better decisions around insurance and financial services. Our mission is simple: take away … Autonomy: Authority over technical strategy, decisions and implementation approach, so you can deliver using practices that align with your preferred ways of working. Data Driven: Utilise rich logs, metrics, and data to monitor and improve system performance & reliability. Culture: Enhancing a diverse engineering culture by taking … around the business to build relationships and act as a multiplier. What we look for in you Understand, assess and effectively apply modern data architectures (dimensional model, data mesh, data lake). Experience in applying and using data observability methods effectively. Experience More ❯

work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: ? Lead the Future of Data | Lead Data Engineer | Bristol (Hybrid) £65,000 – £80,000 + Excellent Benefits | Hybrid Are you an experienced Data Engineer ready … to step into a strategic, hands-on leadership role? We're working with a purpose-driven organisation that’s reshaping how data supports environmental and regulatory innovation — and they need a Data Engineering Lead to help deliver their next-generation data platform. This is … led business based in the heart of Bristol. You’ll play a pivotal role in shaping and delivering a brand-new cloud-native data platform — the backbone of digital tools that serve major UK brands and internal teams alike. What you’ll be doing: Lead the design and More ❯