11 of 11 Permanent Data Pipeline Jobs in Cardiff

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform.You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

About the role The Analytics Capabilities team is responsible for developing and managing data products that drive intelligent experiences, decisions and actions across the Tesco ecosystem. We work in close partnership with business and technology teams across Stores, Finance, People, Customer, Commercial to enable the seamless build, consumption … integration and expansion of Data & AI capabilities. This is a fantastic opportunity to join our team and play a leading role in defining, building and launching new type of data products that have a real impact on Tesco business & colleagues. This is a hybrid role with ...

Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven … business, where you'd drive the Data function playing a key role optimising the acquisition & retention of users. Your work will serve millions of users a month, process thousands of requests a day, and enable hundreds of integrations with partners. Salary to £100k + 10% Bonus, pension ...

Role: Senior Data Platform Architect (Contract) Duration: 6 months+ IR35: Inside Start: January Location: Remote (occasional on-site as required) Overview A large organisation is maturing its modern cloud-based data platform built on Snowflake and Azure. They have strong leadership, product ownership, and capable data … Azure DevOps/GitHub Actions) Azure Data Services (ADF, Functions, Key Vault, Event Hub, etc.) ELT patterns and data pipeline orchestration Strong understanding of platform security, RBAC/ABAC, governance-enabling patterns, and data quality foundations. Broad experience across integration, platform automation, pipelines ...

Ready to shape the future of data? Matillion is the intelligent data integration platform. We're changing how the world works with data – and we need driven, curious people who think big and move fast. We built the Data Productivity Cloud … supercharge data productivity, and now we're shaping the future of data engineering with Maia – our AI-powered virtual data engineers that help teams design, build, and manage data pipelines at unmatched speed. Join #TeamGreen, where the mission comes first, collaboration drives ...

experts to design and deliver secure, scalable, and resilient systems for enterprise and government clients. We work across multiple domains - from data privacy and cloud security to AI assurance - ensuring that every solution meets the highest standards of compliance, reliability, and trust. We are now inviting a Security … Architect to join our UK-based team, contributing to large-scale digital transformation programmes that handle sensitive personal and medical data, integrating AI responsibly and securely across hybrid environments. IF YOU ARE An experienced Security Architect or Security Lead with 8+ years of experience designing secure systems ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible click apply for full job details ...

Build the ML systems that power market leaders Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data … Machine Learning Engineer, you will own end-to-end ML systems that power our core product. You'll design and operate scalable ML data pipelines and agentic workflows, ship production-ready LLM and model-driven features, and help guide how new research and techniques make it into production. ...

leading global investment bank. You'll work on business-critical regulatory reporting platforms, helping modernise legacy systems and build strategic, cloud-based data solutions used across the firm. You'll be part of a collaborative Agile squad focused on Java services, Spark data pipelines, and cloud … What You'll Do Design, build, and enhance software applications supporting regulatory and financial reporting Develop Java-based backend services and Spark-driven data pipelines Contribute to the modernisation of platforms toward cloud-native architectures Work with large, complex datasets in an Agile delivery environment Support CI/ ...