1 to 25 of 27 Data Pipeline Jobs in South Wales

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … data management practices, including governance, metadata standards, and quality controls. Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

This role is fully remote in UK, with full work authorization already in effect. No Visa sponsorship is available. Job Description In a data-driven and AI-oriented environment, you will be responsible for the design, industrialization, and optimization of inter-application data pipelines. You will … Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … technologies to transform data capabilities. About the Role The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring ...

Data Engineer Salary: Up to £60,000 I am working with a leading Microsoft partner that are currently recruiting for a Data Engineer to join their growing team. This organisation is driving digital transformation for a wide range of businesses across the UK, specialising in delivering … that improve efficiency, enable self-sufficiency and accelerate growth. With a strong focus on scalable analytics and advanced business intelligence, they are modernising data platforms to deliver future-ready solutions. This is a chance to join a genuinely people-focused, high-performing consultancy where you play a trusted ...

Senior Data Engineer | Remote (UK or Europe) A leading prop trading firm is hiring a Senior Data Engineer to take ownership of their trading and market data infrastructure. Operating globally with connectivity to dozens of exchanges, the firm executes millions of trades daily with … checks Create tools and APIs for data access Collaborate with traders and developers on data needs Ensure 24/7 pipeline reliability What We're Looking For Strong Python and SQL Experience with trading/market data in production Proven work on real ...

Senior Data Engineer | Remote (UK or Europe) A leading prop trading firm is hiring a Senior Data Engineer to take ownership of their trading and market data infrastructure. Operating globally with connectivity to dozens of exchanges, the firm executes millions of trades daily with … checks Create tools and APIs for data access Collaborate with traders and developers on data needs Ensure 24/7 pipeline reliability What We're Looking For Strong Python and SQL Experience with trading/market data in production Proven work on real ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … weeks) using Agile methods (Scrum or Kanban) with regular demos and retrospectives. Build and lead cross-functional squads including Product Owner, Data Scientists, ML Engineers, Integration Engineers, Solution Architect, and domain experts from Admissions, Registry and Student Services. Design experiments, test hypotheses, and iterate quickly, ensuring human ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … weeks) using Agile methods (Scrum or Kanban) with regular demos and retrospectives. Build and lead cross-functional squads including Product Owner, Data Scientists, ML Engineers, Integration Engineers, Solution Architect, and domain experts from Admissions, Registry and Student Services. Design experiments, test hypotheses, and iterate quickly, ensuring human ...

cloud platforms (AWS, Azure, or GCP). Experience mentoring junior developers or leading small development teams. Familiarity with AI/ML frameworks, data pipelines, or integrating large language models/APIs. Strong problem-solving skills and the ability to translate complex requirements into scalable solutions. Excellent communication skills ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

roadmap, combining leadership of architecture and engineering practice with hands-on development of prototypes and production features. You'll partner with Product, Data, and Platform Engineering to design and integrate AI-driven capabilities such as voice/chatbots, natural-language analytics, and predictive models. This role balances strategic … feasibility studies for emerging AI technologies. Collaborate with Product Management to scope AI features and align them with business goals. Partner with Data Engineering to operationalize models, manage training data, and implement monitoring and retraining pipelines. Work closely with Development, DevOps, and QA teams to ensure ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

model capabilities and protocols. Leadership & Collaboration - Collaborate on UI/UX integration, code reviews, architecture and roadmap decisions, and cross-functional work with data science, product, and commercial teams. Data Engineering - Design and maintain efficient data pipelines, ensuring smooth data flow between ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

Data Scientist | Fully Remote | Health and Wellbeing We're hiring an Data Scientist to help build and ship ML and LLM features in a regulated environment with sensitive data. You'll work with engineering to move models from idea to production. Tech Stack: Python, scikit-learn … Python for data science and ML Practical experience with LLM frameworks (e.g. LangChain) Familiar with Spark/Kafka and End-to-end pipeline experience Databricks, MLflow, Docker, Kubernetes Clear communication with technical and non-technical stakeholders If you are interested apply below or email me directly mmatysik ...

robust engineering, governance, and scalability. Responsibilities Design, build, and deploy machine learning models into production within a Financial Services environment Collaborate closely with Data Scientists, Software Engineers, Risk, and Product teams Build and maintain end-to-end ML pipelines (training, validation, inference, monitoring) Ensure models meet requirements around … skills and hands-on experience with ML libraries (TensorFlow, PyTorch, scikit-learn) Experience deploying and supporting ML models in production Solid understanding of data pipelines, versioning, testing, and software engineering best practices Experience working with cloud platforms (AWS, GCP, or Azure) Nice to Have Experience with fraud, risk ...

robust engineering, governance, and scalability. Responsibilities Design, build, and deploy machine learning models into production within a Financial Services environment Collaborate closely with Data Scientists, Software Engineers, Risk, and Product teams Build and maintain end-to-end ML pipelines (training, validation, inference, monitoring) Ensure models meet requirements around … skills and hands-on experience with ML libraries (TensorFlow, PyTorch, scikit-learn) Experience deploying and supporting ML models in production Solid understanding of data pipelines, versioning, testing, and software engineering best practices Experience working with cloud platforms (AWS, GCP, or Azure) Nice to Have Experience with fraud, risk ...

leverage artificial intelligence to drive smarter decisions. Their mission: to make enterprise AI accessible, actionable, and transformative, helping companies unlock insights from complex data in real-time. They're looking for a Founding AI Engineer to join the team, helping shape the product, technology, and AI strategy from … leadership team. What You'll Do: Design, build, and deploy AI/ML models powering the core platform. Create scalable AI infrastructure, data pipelines, and deployment workflows. Collaborate with product and engineering to turn business problems into AI solutions. Experiment with the latest AI techniques to innovate ...

leverage artificial intelligence to drive smarter decisions. Their mission: to make enterprise AI accessible, actionable, and transformative, helping companies unlock insights from complex data in real-time. They're looking for a Founding AI Engineer to join the team, helping shape the product, technology, and AI strategy from … leadership team. What You'll Do: Design, build, and deploy AI/ML models powering the core platform. Create scalable AI infrastructure, data pipelines, and deployment workflows. Collaborate with product and engineering to turn business problems into AI solutions. Experiment with the latest AI techniques to innovate ...

endpoints Learning and applying best practices around code quality and system design Contributing to reliable, regular releases Developing your understanding of cloud, data pipelines, and distributed systems Seeing your work support real reductions in methane emissions What We're Looking For We're looking for someone with … preferred, others considered) Familiarity with version control, CI/CD, and automated testing Good communication skills and a collaborative mindset Desirable: Interest in data-heavy, geospatial, or analytics-driven systems Some exposure to containers or microservices Curiosity about energy, infrastructure, or environmental data Motivation to grow ...

growth, scaling the platform, and building a high-performing engineering team. About the Role You will take full ownership of the platform architecture, data pipelines, integrations, and multi-tenant SaaS infrastructure. This is a highly visible, strategic role where you will work closely with the founder and early … customers, ensuring the platform is scalable, secure, reliable, and enterprise-ready. Key Responsibilities Own the full platform architecture, including ingestion, scoring, data stores, APIs, and dashboards. Lead AI/ML-powered enrichment and scoring systems. Build and scale microservices, event-driven pipelines, and automated intelligence workflows. Harden cloud ...

growth, scaling the platform, and building a high-performing engineering team. About the Role You will take full ownership of the platform architecture, data pipelines, integrations, and multi-tenant SaaS infrastructure. This is a highly visible, strategic role where you will work closely with the founder and early … customers, ensuring the platform is scalable, secure, reliable, and enterprise-ready. Key Responsibilities Own the full platform architecture, including ingestion, scoring, data stores, APIs, and dashboards. Lead AI/ML-powered enrichment and scoring systems. Build and scale microservices, event-driven pipelines, and automated intelligence workflows. Harden cloud ...