18 of 18 Permanent Data Pipeline Jobs in South Wales

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform.You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

advisers and their clients by combining our innovative proprietary technology with exceptional customer service. As we scale, we are growing our multi-disciplinary Data, Analytics&AI function to unlock the full potential of our data assets. About the Role This is a high-impact hands … leadership role with the opportunity to design and build Fundment's data and analytics infrastructure from the ground up. Reporting to our Head of Data&Analytics, you will create the data foundations that allow us to deliver data-driven insights, automated systems ...

About the role The Analytics Capabilities team is responsible for developing and managing data products that drive intelligent experiences, decisions and actions across the Tesco ecosystem. We work in close partnership with business and technology teams across Stores, Finance, People, Customer, Commercial to enable the seamless build, consumption … integration and expansion of Data & AI capabilities. This is a fantastic opportunity to join our team and play a leading role in defining, building and launching new type of data products that have a real impact on Tesco business & colleagues. This is a hybrid role with ...

description Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing data platforms and services that are high-quality, cost-efficient, and tailored to clients' needs. They develop, operate, and maintain these services. They make sure they provide … maximum value to data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior Data Engineer, you may play one or more roles according to our clients' needs. The role is very hands-on and you'll support as a senior contributor ...

Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven … business, where you'd drive the Data function playing a key role optimising the acquisition & retention of users. Your work will serve millions of users a month, process thousands of requests a day, and enable hundreds of integrations with partners. Salary to £100k + 10% Bonus, pension ...

Role: Senior Data Platform Architect (Contract) Duration: 6 months+ IR35: Inside Start: January Location: Remote (occasional on-site as required) Overview A large organisation is maturing its modern cloud-based data platform built on Snowflake and Azure. They have strong leadership, product ownership, and capable data … Azure DevOps/GitHub Actions) Azure Data Services (ADF, Functions, Key Vault, Event Hub, etc.) ELT patterns and data pipeline orchestration Strong understanding of platform security, RBAC/ABAC, governance-enabling patterns, and data quality foundations. Broad experience across integration, platform automation, pipelines ...

Ready to shape the future of data? Matillion is the intelligent data integration platform. We're changing how the world works with data – and we need driven, curious people who think big and move fast. We built the Data Productivity Cloud … supercharge data productivity, and now we're shaping the future of data engineering with Maia – our AI-powered virtual data engineers that help teams design, build, and manage data pipelines at unmatched speed. Join #TeamGreen, where the mission comes first, collaboration drives ...

experts to design and deliver secure, scalable, and resilient systems for enterprise and government clients. We work across multiple domains - from data privacy and cloud security to AI assurance - ensuring that every solution meets the highest standards of compliance, reliability, and trust. We are now inviting a Security … Architect to join our UK-based team, contributing to large-scale digital transformation programmes that handle sensitive personal and medical data, integrating AI responsibly and securely across hybrid environments. IF YOU ARE An experienced Security Architect or Security Lead with 8+ years of experience designing secure systems ...

Machine Learning Ops Engineer, you will play a key role in building and implementing features that empower lodging customers to make data-driven pricing decisions. Some of these features will use simple heuristic data, while others will leverage advanced machine learning techniques to optimize revenue strategies. … development to production. You'll be instrumental in establishing robust MLOps practices and rigorous testing processes across the entire ML lifecycle. From structuring data pipelines to implementing and validating ML models, you'll own the end-to-end development of our revenue management application—ensuring hotels have ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

role: Joining the Reporting product line, you would work as a member of a highly focused team. This team specialises in Java-based data engineering, designing and delivering large-scale ETL workflows on a lake house platform. You'll be working with modern big data technologies … move, transform, and optimise data for high-performance analytics and regulatory reporting. The environment encourages autonomy, problem-solving, and system-level thinking. If you're passionate about clean, well-tested, performant code and enjoy working on complex data pipelines at scale, you'll thrive here. Tech ...

Spain Role Purpose: We are looking for an experienced DevOps Engineer to support the implementation, optimisation, and management of our cloud infrastructure and data pipelines. This role requires strong expertise in AWS services and DevOps best practices, with a focus on automation, security, scalability, and reliability. You will … responsible for building and maintaining Infrastructure as Code (IaC) with Terraform, deploying containerized applications using Kubernetes and Docker, and ensuring seamless integration of data ingestion processes. As a key member of our existing DevOps team, you will collaborate with development, data, and operations teams ...

Build the ML systems that power market leaders Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data … Machine Learning Engineer, you will own end-to-end ML systems that power our core product. You'll design and operate scalable ML data pipelines and agentic workflows, ship production-ready LLM and model-driven features, and help guide how new research and techniques make it into production. ...

Ship production ML and agentic AI powering market leaders worldwide Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs … about complex, ambiguous modeling and production challenges 3. Work Sample: Solve a real Boam-style ML/AI challenge that shows your modeling approach, pipeline thinking, and execution muscle 4. Founder/Leadership Conversation: Candid discussion with our founder and Head of Engineering on ambition, values, ownership ...

top. We're working with a fintech scale-up building the next generation of intelligent financial products, automated decisioning, predictive insights, real-time data layers, and genuinely smart user experiences powered by applied AI. They're looking for a Product Manager who isn't scared of the unknown. … Turning ML capabilities (Python, TensorFlow, PyTorch) into real customer value Working closely with engineering teams using TypeScript, Node.js, React, and Next.js Partnering with data teams working across AWS, Kafka, Spark, and modern data pipelines Shaping products built on secure, scalable fintech architecture (Event-driven, microservices, serverless ...

leading global investment bank. You'll work on business-critical regulatory reporting platforms, helping modernise legacy systems and build strategic, cloud-based data solutions used across the firm. You'll be part of a collaborative Agile squad focused on Java services, Spark data pipelines, and cloud … What You'll Do Design, build, and enhance software applications supporting regulatory and financial reporting Develop Java-based backend services and Spark-driven data pipelines Contribute to the modernisation of platforms toward cloud-native architectures Work with large, complex datasets in an Agile delivery environment Support CI/ ...

leading global investment bank. You'll work on business-critical regulatory reporting platforms, helping modernise legacy systems and build strategic, cloud-based data solutions used across the firm. You'll be part of a collaborative Agile squad focused on Java services, Spark data pipelines, and cloud … What You'll Do Design, build, and enhance software applications supporting regulatory and financial reporting Develop Java-based backend services and Spark-driven data pipelines Contribute to the modernisation of platforms toward cloud-native architectures Work with large, complex datasets in an Agile delivery environment Support CI/ ...