18 of 18 Data Pipeline Jobs in Scotland

Content Link Select how often (in days) to receive an alert: Create Alert Competitive salary UK/Glasgow: hybrid working model (2-3 days on site) At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees are key factors in our company's growth, market … within a dynamically evolving technical stack. Collaborate seamlessly across diverse technical stacks, including Databricks, Snowflake, etc. Developing various components in Python as part of a unified data pipeline framework. Contributing towards the establishment of best practices for the optimal and efficient usage of data across various on-prem and cloud platforms. Assisting with the testing … and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling. Monitoring the performance of queries and data loads and perform tuning as necessary. Providing assistance and guidance during QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

Octopus Investments and Octopus Money. Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and secure data capabilities. … This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the team's growth, and help shape our overall data strategy. On a typical … day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product managers and engineering leaders to define priorities and align data initiatives with business goals. Provide technical guidance and architectural oversight across the data More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UK's role in the … Directorate (IDD) is responsible for delivering the Foreign Secretary's ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

Head of Enterprise Data Engineering - FCDO - G6 London, Milton Keynes or East Kilbride - You will be required to work from this location in line with FCDO policies on Hybrid Working (minimum 60% in the office). About the job Job summary The Foreign, Commonwealth & Development Office pursues our national interests and projects the UKs role in the world. … Digital Directorate (IDD) is responsible for delivering the Foreign Secretarys ambition to make the FCDO the most technologically integrated and innovative foreign ministry globally. This means harnessing digital, data, technology, IT security and information management to support the FCDO and UK Government partners on our platform to deliver our diplomatic, development and consular aims. All while keeping our … to global network management, from supporting staff in using the latest Microsoft toolsets, to creating corporate applications, harnessing AI and much more in line with the FCDO Digital, Data and Technology (DDaT) Strategy. The Directorate is made up of a wide range of talented staff and experts including specialist, contractors, home civil servants and diplomats who have served More ❯

constituent of the FTSE 100 index of the London Stock Exchange. The Position Our roster has an opening with your name on it! We are seeking a Staff Data Engineer to lead the technical design and implementation of our most critical data infrastructure and products. In this senior-level individual contributor role, you'll be responsible … for designing scalable systems, setting data architecture standards, and solving complex technical challenges that power analytics, data science, and business function use cases across the company. You will collaborate closely with engineers, product managers, and business stakeholders to architect data solutions that are performant, reliable, and built with a long-term, customer-centric mindset. … batch & streaming data pipelines and architectures that support enterprise-wide data needs Define standards for data modeling, data product design, and pipeline orchestration using modern tools and cloud-native technologies Collaborate with cross-functional stakeholders to translate business and analytical requirements into end-to-end data solutions Establish and More ❯

JOB TITLE: Senior Data Engineer SALARY: £70,929 - £78,810 LOCATION: Edinburgh, Manchester, Leeds or Bristol HOURS: Full time WORKING PATTERN: Hybrid, 40% (or two days) in an office site About this opportunity At Lloyds Banking Group, we're moving to the next stages of our digital transformation, and it's our job within the Chief Security Office … CSO) to ensure that we keep our customers, colleagues and assets safe from threat. The CSO's Security Data Services lab does this by using data to build security insights by working collaboratively with our Data Management and Analytics teams. This is an exciting opportunity for a Senior Data Engineer to join … the Security Data Services lab to collaborate with the Data Operations, Software Engineers, Data Scientists, and Business SMEs to design, develop, integrate and test Data Product features on the product roadmaps to meet customer needs. What you'll do Engineer Data Products that are stable, scalable, performant, accessible, testable and More ❯

benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The Role We are recruiting for the position of a Lead Data Engineer in SSE's Group Data and Analytics team. This team acts as a Centre for Enablement (CfE) for the SSE organisation and are involved in a … variety of activities: practical project development work, advising on best practice, investigation into new capabilities and other activities that further data driven solutions across SSE. You Will - Act as a subject matter expert in the data engineering/data solutions space as a key member of the CfE. - Understand business requirements and discuss with … stakeholders a recommended solution approach. Work in an inclusive manner with team members in terms of architecture and design of a solution. - Lead, mentor and advise the CfE data solutions team in their work. - Lead and undertake practical work as well as provide advice and guidance to business units in SSE. This will mainly relate to data More ❯

Are you ready to take your data engineering skills to the next level? We are looking for a talented Data Engineer to join our innovative team and work closely with our Data Lead to implement a cutting-edge Business Intelligence (BI) platform. This is your chance to make a significant impact on our company … s reporting and analytics capabilities! About the Role As a Data Engineer, you will play a crucial role in transforming our organisation into a data-driven enterprise. Your primary responsibilities will include data ingestion from diverse source systems, development of data pipelines through both ETL tools and programming languages such as Python. … You'll ensure that this data is structured, optimised, and accessible for our Power BI developers and business analysts, empowering them to turn data into actionable insights. Key Responsibilities Develop and optimise ETL processes to ensure data is readily available and useful. Create dynamic scripts for the ingestion of data with clear More ❯

Vacancy for Research Data Engineers at NPL 6 July 2021 Locations: Glasgow & Teddington NPL is the UK's National Measurement Institute, providing measurement expertise that underpins UK prosperity and quality of life. We are a world-leading research facility, bringing together scientists and engineers from various fields to help save lives, protect the environment, and support global trade … and innovation. We are investing in Data Science to address scientific challenges in Advanced Manufacturing, Energy & Environment, and Life Sciences & Health, aligned with our organizational growth and transformation plans. The Data Science team at NPL is expanding, and we are seeking motivated candidates at all levels, from early career to experienced scientists, data engineers … partners in academia and industry, you will help advance research by creating optimal data infrastructures across various projects. You will work across the entire data pipeline, from configuring data sources to integrating analytical tools. Responsibilities include developing data architectures, protocols, and software tools to promote the FAIR principles (Findable, Accessible, Interoperable More ❯

i am recruiting for a Data Engineer to work in Glasgow 3 days a week, 2 days remote. The role falls inside IR35 so you will have to work through an umbrella company. Banking/Financial Services experience is required. You will have a number of years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects. Experience in data development and solutions in highly complex data environments with large data volumes. SQL/PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis. Experience developing data pipelines and data warehousing solutions using Python and … libraries such as Pandas, NumPy, PySpark, etc. You will be able to develop solutions in a hybrid data environment (on-Prem and Cloud). Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files etc More ❯

Lead Data Architect £67,000 - 76,000 GBP Hybrid WORKING Location: Glasgow, Scotland - United Kingdom Type: Permanent Lead Data Architect Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £67,000 - £76,000 (non-London)/Up to £83,000 (London) + Benefits A respected … digital consultancy is hiring a Lead Data Architect to join its growing Data Engineering practice. Known for delivering modern, human-centred services across public and private sectors, this organisation supports clients through meaningful transformation by combining data, design, and engineering. This role is ideal for experienced architects who enjoy shaping cloud-native data platforms, working in multidisciplinary teams, and embedding data governance and architectural rigour across complex service ecosystems. The Role: As a Lead Data Architect, you'll play a key role in designing scalable, secure, and accessible data platforms that enable insight-driven decision-making. You'll work closely with engineering teams and client More ❯

Senior Azure Data Engineer £57,000 - 64,000 GBP Hybrid WORKING Location: Glasgow, Scotland - United Kingdom Type: Permanent Senior Azure Data Engineer Locations: Leeds, Manchester, Birmingham, Bristol, Glasgow, or London (Hybrid - up to 2 days on-site per week, remainder remote) Salary: £57,000 - £64,000 (non-London)/Up to £70,000 (London) + Benefits … A respected digital consultancy is hiring a Senior Azure Data Engineer to join its growing Managed Services team. Known for supporting mission-critical services across government, health, and the private sector, this organisation builds and operates data platforms that are scalable, secure, and high-performing. You'll be part of a collaborative environment where modern engineering … practices and user-first thinking are at the heart of delivery. This role is ideal for experienced Data Engineers with a strong Azure background who enjoy variety, technical challenges, and building long-term value for clients. The Role: As a Senior Azure Data Engineer, you'll work across multiple client environments-enhancing pipelines, resolving performance issues More ❯

Eden Scott is recruiting a Senior Data Engineer for Amici to develop a cutting-edge platform. As the business looks to the future, we are now seeking an experienced Senior Data Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology … stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you'll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using … Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory More ❯

Job Title: Senior IICS Developer/Data Integration Lead Location: Edinburgh (Hybrid - 3 days onsite/week) Contract Type: Contract Duration: Specify if known - e.g., 6 months, extendable Job Summary: We are seeking an experienced and highly skilled Senior IICS Developer/Data Integration Lead to join our team in Edinburgh. The ideal candidate will have … strong understanding of Agile development methodologies and demonstrated team leadership capabilities . The role involves working closely with business and technical stakeholders to design, develop, and implement robust data integration solutions. Key Responsibilities: Design and develop scalable data integration solutions using Informatica IICS . Write, optimize, and manage complex SQL queries and stored procedures in PostgreSQL … . Collaborate with cross-functional teams in an Agile environment to deliver high-quality data solutions. Lead and mentor a team of developers, ensuring best practices are followed. Participate in sprint planning, backlog grooming, and daily stand-ups. Troubleshoot and resolve technical issues in the ETL/data integration pipelines. Ensure data quality, governance More ❯

for taking calculated risk, demonstrate a high level of original thinking and intellectual curiosity. Role and Responsibilities: Design, develop, and maintain performant, scalable backend infrastructure for real-time data processing and analysis using Golang/rust Build and optimize low-latency data pipelines that can handle large volumes of data in real-time Develop … and implement algorithms and data structures for efficient data storage and retrieval Collaborate with data scientists and traders to integrate machine learning models and trading strategies into the backend infrastructure Ensure data privacy, security, and regulatory compliance Monitor and analyze system performance to identify potential issues and optimize overall performance Work with … training materials Requirements: Bachelor's degree in Computer Science or related field 3+ years of experience in software development with Golang/Rust/Python Strong understanding of data structures, algorithms, and design patterns Experience working with quant trading or crypto data is highly desirable Solid experience designing and building scalable backend systems for real-time More ❯

and our employee exit rate is astonishingly low. Join us on our journey Let's create something awesome, together, today. About the role and team: As a Lead Data Engineer, you'll play a hands-on technical leadership role in our Data Practice. You'll be instrumental in shaping how we deliver data engineering … engagements, working closely with client stakeholders, internal teams and fellow consultants. You'll bring strong technical expertise, mentorship, and a practical approach to building scalable and value-driven data platforms. What you'll be doing: Leading the design and implementation of robust, cloud-native data platforms Architecting and optimising data pipelines and data models for performance and scalability Championing best practices across data engineering, including testing, automation, and documentation Mentoring junior engineers and guiding technical delivery across projects Working directly with client stakeholders to define goals, shape roadmaps and deliver real business impact Driving innovation through continuous improvement and staying ahead of industry trends We'd love to talk More ❯

Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable insight to lead the transition to a sustainable future. That's why we cover the entire supply chain with unparalleled breadth and … committed - we put customers at the heart of our decisions Future Focused - we accelerate change Curious - we turn knowledge into action Job Description We are looking for a Data Engineer who can leverage Python to build new data pipelines. Your role will sit within an Agile team developing backend data pipelines and processes, aligned … to our data roadmap for delivering new features for Wood Mackenzie's flagship product offering, Lens. You will work alongside other Data Engineers, business SMEs, product and data owners to ensure Wood Mackenzie delivers a world-class experience for its customers - helping them change the way we power our planet. Main Responsibilities As part More ❯