15 of 15 Data Pipeline Jobs in Scotland

View our cookie policy .Junior Engineer (Data) page is loaded Junior Engineer (Data)locations: Edinburghtime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: October 6, 2025 (29 days left to apply)job requisition id: R Job Description At Aberdeen, our ambition is to be the UK's leading Wealth & Investments group.Strengthening talent and … where we have both strength and scale to capitalise on the key themes shaping the market, through either public markets or alternative asset classes. About the Department The Data Platform team plays a pivotal role in bridging the gap between business and data by utilising a Data Mesh architecture operating model to help move … domain teams to own and operate their data. Develop and maintain the centralized data cloud infrastructure using Snowflake, DBT, and Microsoft Azure, and automate data pipeline workflows, providing easy integration with data analytics and BI platforms like Power BI. Work with the Data Governance teams to help enforce data More ❯

Purpose of the Role: To design, build, and maintain the systems that collect, process, and analyse data - including pipelines, data warehouses, and data lakes - ensuring data is accurate, accessible, and secure. Key Responsibilities: Develop, maintain, and optimise scalable data pipelines and data storage solutions. Design and implement data warehousing and data lake architectures. Ensure robust data governance, security, and compliance across all systems. Collaborate with cross-functional teams to gather requirements and deliver solutions that support business objectives. Apply machine learning and data mining techniques where appropriate to add value. Support change and transformation initiatives by providing reliable data systems. Identify risks, implement controls, and follow secure coding practices. Provide strategic input on data architecture, technology adoption, and best practices. Skills & Competencies: Strong knowledge of database structures, data modelling, and data engineering practices. Proficiency in requirements analysis, problem-solving, and strategic thinking. Ability to work collaboratively with technical and non-technical More ❯

constituent of the FTSE 100 index of the London Stock Exchange. The Position Our roster has an opening with your name on it! We are seeking a Staff Data Engineer to lead the technical design and implementation of our most critical data infrastructure and products. In this senior-level individual contributor role, you'll be responsible … for designing scalable systems, setting data architecture standards, and solving complex technical challenges that power analytics, data science, and business function use cases across the company. You will collaborate closely with engineers, product managers, and business stakeholders to architect data solutions that are performant, reliable, and built with a long-term, customer-centric mindset. … batch & streaming data pipelines and architectures that support enterprise-wide data needs Define standards for data modeling, data product design, and pipeline orchestration using modern tools and cloud-native technologies Collaborate with cross-functional stakeholders to translate business and analytical requirements into end-to-end data solutions Drive Engineering More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯

Role Title: Lead Data Engineer Location: Glasgow Duration: 31/12/2026 Work Setup: 2-3 days onsite Rate: £400 per day - PAYE via Umbrella Only Role Description: Join us as a Lead Data Engineer. This role will focus on building pipelines for accounts, event streaming in real time. Your role will be to lead … our teams, setting standards, reviewing code, and reviewing what our colleagues build. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions. You will lead one of … our data engineering teams, setting technical standards, reviewing code, and ensuring high-quality delivery across projects. Key Responsibilities Design, build and maintain scalable data architectures and pipelines. Implement and manage data warehouses and data lakes, ensuring data security, durability and accessibility. Develop data processing and analysis algorithms to … handle complex, large-scale datasets. Collaborate with data scientists to support machine learning model deployment. Lead and mentor a team of data engineers, setting coding standards and driving best practices. Partner with senior stakeholders to align data solutions with business strategy. Manage risk and ensure compliance with governance and control frameworks. Contribute to strategic More ❯

every decision wemake and action we take, guiding us to deliver impact how and where it mattersmost . Connect to your opportunity We're looking for a skilled Data Lake Reporting Assistant Manager to join our team and play a key role in developing and maintaining our data lake reporting environment. You'll work closely with … experienced data analysts and engineers to deliver impactful reports that help us understand our business better. Key responsibilities include: Collaborate closely with senior data analysts and engineers, contributing to the development and implementation of our reporting strategy. Learn and apply industry best practices for data warehousing, reporting, and visualization. Data Lake Reporting … Environment: Become proficient in navigating and understanding data lake architecture. Assist in implementing data quality checks and validation processes to ensure accurate and reliable reporting. Work alongside data engineers to understand and optimize data pipelines for reporting needs. Translate business requirements into technical specifications for reports and dashboards, working with senior team More ❯

Senior Data Engineer Edinburgh 3 days per week on-site 6 months (likely extension) £550 - £615 per day outside IR35 Primus is partnering with a leading Financial Services client who are embarking on a greenfield data transformation programme. Their current processes offer limited digital customer interaction, and the vision is to modernise these processes by: Building … a modern data platform in Databricks Creating a single customer view across the organisation. Enabling new client-facing digital services through real-time and batch data pipelines. You will join a growing team of engineers and architects, with strong autonomy and ownership. This is a high-value greenfield initiative for the business, directly impacting customer experience … and long-term data strategy. Key Responsibilities: Design and build scalable data pipelines and transformation logic in Databricks Implement and maintain Delta Lake physical models and relational data models. Contribute to design and coding standards, working closely with architects. Develop and maintain Python packages and libraries to support engineering work. Build and run automated More ❯

Senior Data Engineer ESM Contract: 6 months Rate: £500 £550 per day (inside IR35) Location: Glasgow (3 days onsite per week) Start date: ASAP Our client, a large global consultancy, is seeking a Senior Data Engineer to join a Enterprise Systems Management (ESM) team on a contract basis. ESM plays a critical role in developing and … agile squads and contributing to technology solutions that support more than 10,000 developers and production engineers worldwide. Key Responsibilities: Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management. Build and support self-service portals, incident/change management, and capacity management tools. Develop event management solutions, including monitoring, log-collection, correlation, and … large-scale distributed systems. Collaborate with cross-functional teams to design scalable and reliable ETL processes using Python and Databricks. Develop and deploy ETL jobs, extracting and transforming data from multiple sources. Take ownership of the full engineering lifecycle: data extraction, cleansing, transformation, and loading. Create and manage data pipelines with robust error handling More ❯

using FastAPI and integrate with external systems. Deploy scalable AI systems using AWS (Lambda, S3, SQS, EKS/ECS), CDK , and modern DevOps practices. Collaborate on infrastructure and data pipelines using SQLAlchemy, Boto3, Pandas, and Airflow . Contribute to real-time AI services , model versioning, and advanced fine-tuning (LoRA, QLoRA, etc.). AI Engineer requirements: Solid Python More ❯

OCR Leveraging frameworks like Hugging Face Transformers , PyTorch , YOLO , OpenCV , and Pillow Designing and deploying AI services via FastAPI , AWS Lambda , EKS/ECS , and S3 Creating scalable data pipelines with Pandas , NumPy , SQLAlchemy , and Airflow Supporting real-time model inference, edge deployments, and API integrations Working closely with a technical lead in a service-based and serverless More ❯

integration strategies across partner systems and data platforms. Ensure systems meet AML, KYC, and sanctions compliance standards. Provide leadership on upgrades, API integrations, and data pipeline enhancements. Mentor engineering teams and support vendor evaluations. Qualifications 10+ years of experience with compliance screening technologies (FIRCO, Prime Compliance Manager, Quantexa). Strong cloud expertise (Azure preferred) and … hybrid deployment knowledge. Proficiency in programming/scripting for integration and automation. Experience with DataBricks, Snowflake, or similar data platforms. Deep understanding of financial services compliance requirements. Preferred Advanced degree in Computer Science, Engineering, or related field. Cloud architecture certifications (Azure preferred). Background in regulatory reporting, API management, or performance tuning. More ❯

services such as Logic Apps, Function Apps, Service Bus, Event Grid, and Event Hub. Collaborate with architects to define patterns for event-driven and API-based integrations. Develop data pipelines and orchestrations using Azure Data Factory and Abinitio to support batch and near-Real Time data integration scenarios. Implement automated deployment and testing of More ❯

Role Title: Lead Data Engineer (Hybrid 2-3 days onsite) Location: Glasgow Duration: Until 31/12/2026 Day Rate: £382.50 Inside IR35 Role Description Join us as a Lead Data Engineer . You will focus on designing and building data pipelines, including real-time event streaming solutions click apply for full job More ❯