101 to 125 of 127 Data Pipeline Jobs in Scotland

Intune, ensuring device compliance and integration with Zero Trust. Harden AKS clusters and cloud-native apps through role-based access control (RBAC), secrets management, and runtime protection. Secure data pipelines and models in AI workloads, implementing guardrails for model integrity and prompt injection defence. Cloud & Network Security Engineer secure access and posture for Cisco Meraki infrastructure and Umbrella … problems through systems thinking and automation. Strategic, yet pragmatic: balances best practice with business context. Proactive, communicative, and passionate about elevating security posture through innovation. MS Engineer & MS Data Scientist Associate Ability to exercise independent judgment and act on it. Benefits for our U.K. teams include: The choice to work flexibly from home and the office, in line More ❯

take advantage of our ongoing learning opportunities and award-winning training, to help you achieve the job and career you want. About the role We are seeking two Data Developers to join the Customer and Colleague Engagement Centres (CCECs), Insight and Data Development team. In this role, you will design and execute data development … have meaningful management information to drive our business plans and enhance experiences for both customers and colleagues. This is an essential role that involves creating scalable and efficient data pipelines, implementing data models, and integrating diverse data sources to enable the business to extract valuable insights and make data-driven decisions. This … position is currently based at our UK CCEC in Dundee. We are looking for individuals with strong programming skills, expertise in data modelling and ELT processes, experience with database management, excellent analytics and communication abilities, and a keen attention to detail. You will be responsible for Assisting in the development, automation, and maintenance of management information for the More ❯

for the Technical Business Analyst role at Barclays Join us as a Technical Business Analyst at Barclays where you will help shape the future of banking by implementing data quality processes and procedures, ensuring that data is reliable and trustworthy, then extracting actionable insights from it to help the organisation improve its operation, and optimise resources. … To be successful as a Technical Business Analyst, you should have: Knowledge of data architecture, data infrastructure, or data products – Ability to understand and work within data ecosystems, supporting the development, management, or optimisation of data-driven solutions. Experience in a change management – Involvement in delivering or supporting organisational change … transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills. This role is based in Glasgow. Purpose of the role To implement data quality process and procedures, ensuring that data is reliable and trustworthy, then extract actionable insights from it to help the organisation improve its operation, and optimise resources. More ❯

Your role will include: Understanding core heating system and physics concepts underpinning our modelling. The design, development and maintenance of our core platform services, including APIs, workflows and data pipelines. Supporting front end teams with integrating UI products with our APIs and services. Supporting product owners in refining requirements by providing technical insight. Supporting existing applications in production. More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Social network you want to login/join with: We are seeking an experienced Principal Data Engineer to lead a team in developing and maintaining robust, scalable data pipelines, bridging on-premises and cloud environments, and delivering real-time analytics systems. This role requires deep expertise in data engineering and streaming technologies, combined with … to drive the team towards achieving business objectives. You will collaborate with cross-functional teams including architecture, product, and software engineering to ensure the delivery of high-quality data solutions aligned with company goals. Requirements: 5+ years of hands-on experience in data engineering, including expertise in Python, Scala, or Java. Deep understanding of Apache Kafka … as PostgreSQL, MySQL, MSSQL. Familiarity with analytical databases. Familiarity with both cloud solutions (AWS preferably) and on-premises environments as part of cost-optimization efforts. Knowledge of additional data tools and frameworks such as Flink, Redis, RabbitMQ, Superset, Cube.js, Minio, and Grafana (optional but beneficial). Strong leadership and mentoring skills, with the ability to guide a team More ❯

Data Engineer - Remote - £65,000 My client, a growing, high-impact consultancy is looking for a hands-on Data Engineer to join its expert team. Working across a mix of exciting, high-profile clients in various different sectors. You will join their expanding team to build robust platforms and create intelligent solutions. If you thrive in … fast-paced environments, enjoy variety in your work, and want to build meaningful data products using Snowflake, dbt, Python, and SQL, this role is for you. Requirements: Experience designing and building scalable data pipelines using Snowflake, dbt, and Python Proven experience as a Data Engineer or Analytics Engineer Great knowledge of Snowflake SQL optimization … and warehouse design experience Strong Python skills for scripting, orchestration, and data manipulation Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and More ❯

Data Engineer - Remote - £65,000 My client, a growing, high-impact consultancy is looking for a hands-on Data Engineer to join its expert team. Working across a mix of exciting, high-profile clients in various different sectors. You will join their expanding team to build robust platforms and create intelligent solutions. If you thrive in … fast-paced environments, enjoy variety in your work, and want to build meaningful data products using Snowflake, dbt, Python, and SQL, this role is for you. Requirements: Experience designing and building scalable data pipelines using Snowflake, dbt, and Python Proven experience as a Data Engineer or Analytics Engineer Great knowledge of Snowflake SQL optimization … and warehouse design experience Strong Python skills for scripting, orchestration, and data manipulation Please Note: This is a permanent role for UK residents only. This role does not offer Sponsorship. You must have the right to work in the UK with no restrictions. Some of our roles may be subject to successful background checks including a DBS and More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

now to be part of our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety of roles including but not … limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the data is organized and available for further analysis and investigation. Working with others is key, you could be working with other engineers, developers More ❯

Join us as a Technical Business Analyst at Barclays, where you will help shape the future of banking by implementing data quality processes and procedures, ensuring that data is reliable and trustworthy. You will then extract actionable insights from it to help the organization improve its operations and optimize resources. To be successful as a Technical … Business Analyst, you should have: Knowledge of data architecture, data infrastructure, or data products – Ability to understand and work within data ecosystems, supporting the development, management, or optimization of data-driven solutions. Experience in change management – Involvement in delivering or supporting organizational change, with a focus on stakeholder engagement, implementation … and transformation, business acumen, strategic thinking, digital and technology, as well as job-specific technical skills. This role is based in Glasgow. Purpose of the role To implement data quality processes and procedures, ensuring data is reliable and trustworthy, then extract actionable insights to help the organization improve its operations and optimize resources. Accountabilities Investigation and More ❯

looking for a Legal AI Engineer who’s passionate about building intelligent systems at the intersection of law and machine learning. You’ll work closely with legal experts, data scientists, and product managers to develop AI features that tackle real legal challenges through the use of agentic GenAI. As Legal AI Engineer you will: Design and implement AI … data. Collaborate with legal SMEs to translate domain knowledge into scalable machine learning solutions. Continuously evaluate model performance, ensuring accuracy, fairness, and compliance. Help shape the data pipeline and MLOps practices for handling sensitive legal content securely. Required Experience: Solid experience with Python and ML/NLP libraries (e.g., spaCy, Hugging Face, TensorFlow/PyTorch). Experience More ❯

Vacancy for Senior Data Engineer at National Records of Scotland Vacancy for Senior Data Engineer at National Records of Scotland 30 July 2021 Edinburgh Full-Time Overview National Records of Scotland (NRS) is a Non-Ministerial Department of the Scottish Government, supporting the Registrar General for Scotland and the Keeper of the Records for Scotland. Both … Scotland. Alongside this NRS are delivering an ongoing programme of technology modernisations and improvements aligned with the Scottish Governments Digital, Cloud and Green IT Strategies. As a Senior Data Engineer you will be part of the data team at NRS offices in Corstorphine, Edinburgh, working collaboratively across NRS teams on a variety of projects. You will … implement data pipelines and the full lifecycle of data, delivering high quality digital services. Able to execute a wide range of Dba Microsoft SQL Server and SSIS skills and demonstrate knowledge of open source tools such as R or Python. Provide clear communications to both technical and non-technical stakeholders Investigate problems and opportunities in existing More ❯

Specialist to join their team in Glasgow on a contract basis. Key Responsibilities Integrate PowerOn with other enterprise systems such as GIS, OMS, AMI, and SAP Develop APIs, data pipelines, and middleware Customise PowerOn configuration to align with business workflows Perform system testing and provide user acceptance support Job Requirements Experience in working within a data centre environment Strong understanding of data integration techniques and tools Proficiency in developing APIs and data pipelines Knowledge of PowerOn system configuration and customisation Ability to perform thorough system testing and user acceptance support Excellent problem-solving skills and attention to detail Strong communication and collaboration abilities Experience in the Defence & Security sector is More ❯

permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a … strategic thinking, and strong project management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring seamless integration into customer environments … reinforce business impact Contribute to case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers Knowledge of APIs & software development More ❯

permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a … strategic thinking, and strong project management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring seamless integration into customer environments … reinforce business impact Contribute to case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers Knowledge of APIs & software development More ❯

permit required: Yes col-narrow-right Job Views: 4 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Actian is transforming how enterprises discover, understand, and govern their data assets through our innovative data catalog and intelligence platform. Our customers rely on us to provide a seamless and scalable experience, and we’re looking for a … strategic thinking, and strong project management skills to ensure customers see long-term success with Actian solutions. Responsibilities: Technical Implementation & Onboarding Lead technical onboarding process for new Zeenea Data Intelligence Platform customers Develop and execute customer implementation plans ensuring smooth deployment and adoption Manage the technical setup, configuration, and deployment of Zeenea, ensuring seamless integration into customer environments … reinforce business impact Contribute to case studies showcasing innovative metadata implementations Skills and Expertise: 5+ years in technical implementation, consulting, professional services, or customer success in a SaaS, data management, or cloud-based environment Excellent ability to translate customer needs into actionable technical requirements Experience managing multiple concurrent implementation projects with enterprise customers Knowledge of APIs & software development More ❯

/SOAP APIs for functionality, security, reliability. Test mobile app quality on Android/iOS using Appium, XCUITest, TestFairy. Data/ETL Testing Ensure data pipeline accuracy and validation. Work with SQL, Informatica, Talend, SSIS, Snowflake. Test models for accuracy, bias, performance, and ethical AI compliance. Senior Level: Associate Employment Type: Full-time Job Functions More ❯

SOAP APIs for functionality, security, and reliability. Focus on mobile app quality across Android/iOS devices. Manual and automated testing with tools like Appium , XCUITest , TestFairy . Data/ETL Testing Ensure accurate data flow, transformation, and validation in data pipelines. Work with SQL, Informatica , Talend , SSIS , Snowflake . Test models for accuracy More ❯

Kraken Robotics is currently recruiting a Hydrographic Data Processor join our Mount Pearl, Newfoundland or Aberdeen, Scotland Office. Full-Time – Permanent | Job Reference: KRSI-2025-023 We are seeking aHydrographic Data Processor for the processing of field data and the production of charts and/or maps from data acquired using Kraken … of navigation, hydrographic, bathymetry and all other survey data sets acquired. This includes the following data sets: SAS data, Multibeam data, Pipeline & Cable inspection/installation data sets, Positioning data sets, SeaVision data sets, etc. QC/QA computations using raw and processed data QC/QA survey data received from field for completeness and quality Ensure the integrity of project data sets including the incorporation of data sets from third party’s such as-built data sets Ensure processing logs are up to date and record offsets used during processing. Review of survey More ❯

Social network you want to login/join with: Legal Data Analyst & Researcher, glasgow col-narrow-left Client: The Sponsor Legal Intelligence Platform Location: glasgow, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Legal Data Analyst & Researcher (Part-Time … Sponsor The Sponsor is a legal intelligence platform designed to provide law firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is backed by industry relevant investors … and is in the early stages of product deployment. Our mission is to modernise legal intelligence with data transparency, intuitive design, and actionable insights. As we prepare to go to market, we’re looking for a part-time Legal Data Analyst & Researcher to support the accuracy and growth of our database, contribute to our proprietary rankings More ❯

Social network you want to login/join with: Legal Data Analyst & Researcher, edinburgh col-narrow-left Client: The Sponsor Legal Intelligence Platform Location: edinburgh, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Legal Data Analyst & Researcher (Part-Time … Sponsor The Sponsor is a legal intelligence platform designed to provide law firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is backed by industry relevant investors … and is in the early stages of product deployment. Our mission is to modernise legal intelligence with data transparency, intuitive design, and actionable insights. As we prepare to go to market, we’re looking for a part-time Legal Data Analyst & Researcher to support the accuracy and growth of our database, contribute to our proprietary rankings More ❯

Legal Intelligence Platform Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Legal Data Analyst & Researcher (Part-Time, Remote) Location: Initially Remote moving to in-house Job Type: Part-Time (with potential to transition into Full-Time post-launch) Start Date: Mid-late … Sponsor The Sponsor is a legal intelligence platform designed to provide law firms, professionals, and business leaders with a comprehensive view of the legal industry. Through curated deal data, AI-generated firm rankings, and editorially enriched insights, we help users stay ahead of the legal market. Currently in pre-launch, The Sponsor is backed by industry relevant investors … and is in the early stages of product deployment. Our mission is to modernise legal intelligence with data transparency, intuitive design, and actionable insights. As we prepare to go to market, we’re looking for a part-time Legal Data Analyst & Researcher to support the accuracy and growth of our database, contribute to our proprietary rankings More ❯

Engineer (FastAPI, GCP, Kubernetes) Remote (UK-based) | £500–£600day | Outside IR35 | 3 months+ We’re supporting a legal-tech platform that helps litigation teams collect and process Slack data; they’re in the middle of a major re-platform. They’ve inherited a mess, made big moves toward Kubernetes (away from GCP serverless), and now need a contract … engineer to help rebuild a core part of the system by the end of the year. You’ll be coming in at a critical point, working on Slack data ingestion pipelines and helping build out production-grade services on a new Kubernetes-based setup. The Stack: Python & FastAPI (non-negotiable) GCP (Pub/Sub, Cloud Run) Kubernetes (mainly … Kubernetes Able to work independently - this isn’t a greenfield, it’s a rescue mission Bonus if you’ve dealt with Slack/Jira/Confluence integrations or data pipelines More ❯

Specialist to join their team in Glasgow on a contract basis. Key Responsibilities: Integrate PowerOn with other enterprise systems such as GIS, OMS, AMI, and SAP Develop APIs, data pipelines, and middleware Customise PowerOn configuration to align with business workflows Perform system testing and provide user acceptance support Job Requirements: Experience in working within a data centre environment Strong understanding of data integration techniques and tools Proficiency in developing APIs and data pipelines Knowledge of PowerOn system configuration and customisation Ability to perform thorough system testing and user acceptance support Excellent problem-solving skills and attention to detail Strong communication and collaboration abilities Experience in the Defence & Security sector is More ❯