13 of 13 Data Pipeline Jobs in Cardiff

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

flow across the organisation. Build efficient, fault-tolerant, and highly available data ingestion processes. Monitor and improve data pipeline performance and scalability for low-latency and high-throughput. Work closely with cross-functional teams, including software engineers, data scientists, and business … similar language. Proficiency in database technologies (SQL, NoSQL, time-series databases) and data modelling. Strong understanding of data pipeline orchestration tools (e.g., Apache Airflow, Kubernetes). You thrive when working as part of a team Comfortable in a fast-paced environment Have excellent written ...

Lead Data Engineer Lead Data Engineer required to join my Client's Technology Team and contribute to their Group Architecture Board in building the next generation of their eCommerce data platform.You will play a pivotal role in designing and maintaining a modern, cloud-based … develop robust data models, ETL/ELT processes, and data marts that support complex analytics and operational use cases. Pipeline Optimization: Maintain and optimize data pipelines and warehouse environments to ensure top-tier performance, reliability, and scalability. Cross-Functional Collaboration: Effectively collaborate with ...

About the role The Analytics Capabilities team is responsible for developing and managing data products that drive intelligent experiences, decisions and actions across the Tesco ecosystem. We work in close partnership with business and technology teams across Stores, Finance, People, Customer, Commercial to enable the seamless build, consumption … integration and expansion of Data & AI capabilities. This is a fantastic opportunity to join our team and play a leading role in defining, building and launching new type of data products that have a real impact on Tesco business & colleagues. This is a hybrid role with ...

seeking a highly experienced DevOps Engineer with a strong background in Google Cloud Platform (GCP) and a proven track record in delivering complex data analytics projects for clients. In this full-time, permanent role, you will be responsible for designing, implementing, and managing the infrastructure and deployment processes … infrastructures tailored to each client's unique project requirements, ensuring high performance, availability, and security. Work closely with client stakeholders, full-stack developers, data engineers, and data scientists to define and execute efficient data ingestion, processing, and storage solutions that meet project deliverables. Implement ...

Want to drive a top brand's Data team with 1m+ users? If you love Python, implementing robust data pipelines & driving best Data practices, you may be interested in a Staff Data Engineer role I have with a highly successful Tech driven … business, where you'd drive the Data function playing a key role optimising the acquisition & retention of users. Your work will serve millions of users a month, process thousands of requests a day, and enable hundreds of integrations with partners. Salary to £100k + 10% Bonus, pension ...

Role: Senior Data Platform Architect (Contract) Duration: 6 months+ IR35: Inside Start: January Location: Remote (occasional on-site as required) Overview A large organisation is maturing its modern cloud-based data platform built on Snowflake and Azure. They have strong leadership, product ownership, and capable data … Azure DevOps/GitHub Actions) Azure Data Services (ADF, Functions, Key Vault, Event Hub, etc.) ELT patterns and data pipeline orchestration Strong understanding of platform security, RBAC/ABAC, governance-enabling patterns, and data quality foundations. Broad experience across integration, platform automation, pipelines ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

impact on its customers, employees, and communities. The Role At Veeva Link, we're building the intelligence layer for Life Sciences, creating connected data applications that accelerate drug development and significantly improve patient outcomes. Our core belief: combining the highest quality data with state … designs. We leverage a modern tech stack to deliver inherently reliable applications, and a great user experience. Our work spans two critical areas: Data-Driven Insights We develop sophisticated applications that map and understand global scientific and medical expertise, providing high-impact insights and AI-generated intelligence. Engineers ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible click apply for full job details ...

Build the ML systems that power market leaders Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data … Machine Learning Engineer, you will own end-to-end ML systems that power our core product. You'll design and operate scalable ML data pipelines and agentic workflows, ship production-ready LLM and model-driven features, and help guide how new research and techniques make it into production. ...

Ship production ML and agentic AI powering market leaders worldwide Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs … about complex, ambiguous modeling and production challenges 3. Work Sample: Solve a real Boam-style ML/AI challenge that shows your modeling approach, pipeline thinking, and execution muscle 4. Founder/Leadership Conversation: Candid discussion with our founder and Head of Engineering on ambition, values, ownership ...

leading global investment bank. You'll work on business-critical regulatory reporting platforms, helping modernise legacy systems and build strategic, cloud-based data solutions used across the firm. You'll be part of a collaborative Agile squad focused on Java services, Spark data pipelines, and cloud … What You'll Do Design, build, and enhance software applications supporting regulatory and financial reporting Develop Java-based backend services and Spark-driven data pipelines Contribute to the modernisation of platforms toward cloud-native architectures Work with large, complex datasets in an Agile delivery environment Support CI/ ...