25 of 25 Data Pipeline Jobs in Scotland

Security cleared Data Architect PROJECT DESCRIPTION The Data Architect is responsible for designing, creating, deploying, and managing an organization’s data architecture. This role ensures that data across systems is accurate, accessible, secure, and supports business objectives. As a Data Architect, you will have extensive experience in development of data intensive systems. This should include working with customers to derive requirements and design solutions to meet their needs. The successful applicant will be expected to have seen a project through from inception to delivery. To succeed ...

Role: Data Architect Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Rate: £550 - £650 per day Security Clearance: Active SC Clearance required Project Description We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise-scale … data architectures within a secure environment. You will be responsible for ensuring data across systems is accurate, accessible, secure, and aligned to business and technical objectives. The role requires extensive experience delivering data-intensive systems end-to-end, from initial requirements capture through architecture ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data Engineer role focused on designing and delivering modern data platforms using Microsoft technologies. As a Senior Data Engineer , you will work across a varied client base, taking ownership of data solutions from initial scoping through to build and delivery. The Role – Senior ...

pipelines using Python and distributed data processing frameworks. Develop and support multi-tenant data processing systems and data pipeline architecture. Integrate data platforms with cloud services including storage, messaging, monitoring, and security tools. Monitor data quality, performance, and reliability … engineering best practices. Experience working within a cloud environment, ideally Azure (ADF, Storage, Service Bus, Monitor). Solid understanding of data pipeline orchestration, data validation patterns, and ELT/ETL processes. Background in containerisation, CI/CD, and DevOps practices. If youre ready ...

Role: Data Engineer Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Security Clearance: Active SC Clearance required Rate: £500 - £600 per day - inside IR35 Project Description We are seeking an experienced Data Engineer to design, build, deploy, and maintain robust data platforms and pipelines within a secure environment. You will be responsible for the end-to-end data engineering lifecycle, transforming raw data into high-quality, consumable datasets that support analytics, reporting, and advanced modelling. You will own and optimise the data operations ...

Data Architect Edinburgh 6-Month contract Paying up to 69p/h (Inside IR35) Please note - due to the nature of the work, you will need to hold or be eligible to obtain a high level of UK Security clearance - please only apply if suitable Key Responsibilities: Design … implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define data management standards, policies, and best practices. Work with data engineers to design and optimize ...

Azure Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Azure Data Engineer. This role sits within a growing Data practice delivering Azure … based data platforms for a wide range of clients. The Azure Data Engineer will focus on building modern, scalable data solutions using Microsoft Fabric and the wider Azure data stack, working closely with customers throughout the full delivery lifecycle. This ...

Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality, lineage, governance, and documentation across production systems. Collaborate cross-functionally with … analytics, product, and platform teams. Support CI/CD automation for data pipeline deployment. Contribute to reusable frameworks and engineering best practices within the team. Essential experience Candidates must have prior, hands-on experience working with at least one of the following APM platforms : Power Factors Bazefield ...

Data Business Analyst - Global Markets & Securities Services Location: Edinburgh (Hybrid - 2 days per week onsite)Rate: £685 per day via Umbrella Contract: Initial 6 months The Role We're supporting our financial services clients Global Markets & Securities Services function with the hire of a hands-on Data Business Analyst to join a small, collaborative delivery pod. This is a practical, data-driven role You'll work directly with traders, business management, and data scientists, getting into the data to analyse, interpret, and improve how it's used across markets ...

Data Engineer - Inside IR35 - Glasgow - Private Sector - Hybrid Day Rate - up to £675 Duration - 6 months Harvey Nash's Client are looking to bring in a contract Data Engineer, You will be responsible for designing, building, managing, and optimizing data pipelines and the data model used by Data Scientists and Traders. Working closely with Data Management teams on governance and security as well as business stakeholders around projects and IT teams to deliver these data pipelines and models effectively into production. This role will focus ...

Spec: . Data Engineer Candidates needs to travel to Europe once in a month (European country) Duration: Initially 6 months Data Engineer MRO AI Solutions Role Purpose The Data Engineer/Data Analyst will design, build, and maintain robust data … scale across all OpCos. This role demands consultancy-level technical depth combined with strong delivery discipline. Key Responsibilities : • Discover, connect to, and process data from various sources: relational databases, flat files (CSV, YML, XLS), etc • Identify and remediate data quality/completeness issues • Challenge data ...

Data Lead Glasgow based No visa support provided Lead the data platform. Own the insight. Set the direction. My client is hiring a Data Lead to own their end-to-end data and analytics capability - from Azure-based data engineering … This is a senior role for someone who combines deep technical credibility with the ability to set strategy, lead teams, and influence how data is used across the business. What you'll be doing Owning the data and analytics strategy , aligned to business goals Leading ...

Data Engineer Glasgow - required onsite for occasional meetings and workshops only 6 Month Contract £550 - £675/day inside IR35 Lorien's Utilities client are currently recruiting for 2 x Data Engineers to join on a 6 month initial contract, inside IR35. As part of your … role you will: Architect, create, improve, and operationalise integrated and reusable data pipelines, tools and processes. Measuring performance, efficiency and robustness of data provision and best practice process approaches. Deliver commercial value through working with key business stakeholders, IT experts and subject-matter experts and high ...

Data Business Analyst Location: Edinburgh/Hybrid - CANDIDATE MUST BE LOCATED CLOSE TO EDINBURGH Contract Length: 6 months Competitive Rate of Pay About the Role We are seeking a skilled and analytical Data Business Analyst to join HSBC. The work and output will directly enable … drive new data pipelines to create AI/ML powered insights and signals for the Markets & Securities business.This role is pivotal in bridging the gap between business needs and data-driven solutions. You will analyse complex datasets, identify trends, and collaborate with a wide range ...

Data Architect We are currently partnered with a a UK-based financial services organisation providing banking and insurance products to millions of customers nationwide. The business has a strong heritage in retail-focused financial services, with a clear purpose of making money management simpler, more accessible, and better … across multiple customer channels and product domains, ensuring consistency, quality, and alignment with enterprise standards. Define and deliver end-to-end digital, application, data, and security architectures, including the design and integration of AWS-based data lakes and data pipelines to support data ...

Contract Data Business Analyst – Edinburgh (2 days onsite) – 6 month initial contract – Inside IR35 (Umbrella) Meraki Talent’s global financial client are looking for a Data Business Analyst on an initial 6-month contract to bridge the gap between business needs and data driven … solutions. You will have responsibility for analysing complex data sets, identifying trends, and collaborate with senior stakeholders to unlock revenue growth opportunities and also remediate gaps with respect to model risk policy requirements on data documentation and quality control. This will directly enable and drive ...

sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Candidates must hold active SC clearance. Key Responsibilities: Design, develop, deploy, and support data infrastructure, pipelines, and architecture Implement reliable, scalable, and tested solutions to automate data ingestion Develop systems to manage batch processing and real ...

Data Engineer - Fixed Incomes £60,000 - £80,000 Remote (within UK) Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial data solutions. This is an exciting opportunity to join … collaborative and forward-thinking engineering team working on a cutting-edge data platform for financial datasets. Youll help shape how complex market data is processed, structured, and made accessible for analytics, research, and insight generation. What youll be doing: Designing and maintaining data pipelines ...

ideal candidate will have deep experience with CloudFormation, SageMaker, Glue, Lambda, Spark, and Python, along with solid understanding of machine learning concepts, data pipelines, model monitoring, and production deployment. Key Responsibilities Design, automate, and maintain scalable ML infrastructure using AWS CloudFormation and AWS-native services. Build, deploy … manage ML models on Amazon SageMaker (training, tuning, hosting, endpoints, pipelines). Develop and optimize distributed data processing workflows using Apache Spark, AWS Glue, and related ETL frameworks. Build serverless automation and integration logic using AWS Lambda and Python-based microservices. Implement MLOps best practices across ...

Reed Technology is working with a company based in Auchterarder , currently seeking to hire a Data Platform Engineer on a 12-month contract (Outside IR35). The position combines technical engineering with platform oversight. Responsibilities include constructing and operating data pipelines and models, facilitating secure … self-service analytics, and implementing the operational frameworks and automation required for a scalable, trustworthy platform. Key Responsibilities: Drive the delivery of the data strategy by improving engineering practices and ensuring the business can rely on clean, trustworthy data. Lead by example with hands-on development, building ...

Data Engineer - AWS/Glue - £425 outside IR35 - Edinburgh Exalto consulting are currently recruiting for a contract Data Engineer, this is mostly remote, 1 day a month in Edinburgh, this is outside IR35 paying £425 per day. Key responsibilities Design, build and maintain data pipelines on AWS Develop and manage ETL processes using AWS Glue Work with structured and semi-structured data to support analytics and reporting Collaborate with engineers, analysts and stakeholders across the business Skills & experience Strong experience as a Data Engineer Hands-on AWS experience ...

Data Engineer Edinburgh Hybrid 2 days onsite Im on the lookout for an experienced Data Engineer who can help build and scale a robust, multi-tenant data platform. This role focuses on designing, building, and maintaining reliable data pipelines using Python ...

Title: AWS Site Reliability Engineer (Data Platform) Role Summary We are looking for an AWS Site Reliability Engineer (SRE) to support and scale a cloud-native data platform built on AWS, Snowflake, and Databricks . The role focuses on driving reliability through automation, disaster recovery …/CD. Lead resiliency and disaster recovery planning , including regular DR drills, failure testing, and recovery validation across AWS and data platform components. Define, implement, and manage SLIs, SLOs, and SLAs for critical data pipelines and platform services; use error budgets to guide reliability improvements. Build ...

integration with Zero Trust. Harden AKS clusters and cloud-native apps through role-based access control (RBAC), secrets management, and runtime protection. Secure data pipelines and models in AI workloads, implementing guardrails for model integrity and prompt injection defence. Cloud & Network Security Engineer secure access and posture … automation. Strategic, yet pragmatic: balances best practice with business context. Proactive, communicative, and passionate about elevating security posture through innovation. MS Engineer & MS Data Scientist Associate Ability to exercise independent judgment and act on it. Benefits for our U.K. teams include: The choice to work flexibly from home ...

innovation, focused on tackling the most challenging aspects of AI. You will work closely with product, engineering and data teams to turn cutting-edge machine learning and AI research into scalable, production-ready solutions. This is a superb opportunity with a forward-thinking and expansive client, with candidates … diverse backgrounds. Key Responsibilities: Design and implement AI systems using LLMs and agent-based architectures for production use. Build and maintain scalable data pipelines and model training workflows Build autonomous or semi-autonomous agents that can reason, plan, and take actions Evaluate, iterate, and improve AI system performance ...