1 to 25 of 37 Data Pipeline Jobs in Scotland

as well as optimising data flow and collection for other teams. Using their experience in data architecture, ETL processes and pipeline management to support the building, testing and maintenance of data architecture. Job Details - Data Engineer (12-month FTC) Salary - circa … Experience building and deploying machine learning models in production Strong proficiency in object-oriented languages and scripting languages Strong proficiency in data pipeline and workflow management tools Strong project management and organisational skills Excellent problem-solving, communication, and organisational skills Proven ability to work independently and with … performance indicators Develop and deliver insightful analytics for the assigned department to inform key business decisions Create and maintain an optimal data pipeline architecture Assemble large, complex data sets that meet functional/non-functional business requirements Identify, design, and implement internal process improvements: automating More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Enterprise Data Architect Permanent Edinburgh/Glasgow/Wilmslow Hybrid 50% home/office based A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the … execution of the Data Transformation roadmap. The expectations: Accountable for the delivery of the Enterprise Data Architecture and directing detailed Data Architecture for major transformation programmes Key contributor to the data architecture target state including maintaining key architectural viewpoints (Data More ❯

is diverse and equitable, building a culture of collaboration and inclusion. Position Overview Ithaca Energy is accepting applications for the position of Senior Data Engineer located in our Aberdeen Office. Reporting to the Analytics and Integration Lead, the Senior Data Engineer will play a pivotal role in shaping the future of the company's data analytics capabilities. Responsibilities Provision of pipeline engineering support across all development projects within the company's portfolio. Supporting Data Platform Program: Collaborate with cross-functional teams to maintain … and enhance our modern data platform, leveraging expertise in Synapse and data engineering techniques. Stay up to date with innovation: Understand best practices in data engineering, application of emerging technologies, and stay current with developments in the data space. Analyse, Model and More ❯

Build and maintain the configuration of the data stack within the DevOps framework. • Develop data objects and write code in and around the data stack. • Interact with upstream and downstream systems and API for data ingestion and egestion. • Build ETL pipelines and … data framework for monitoring the pipeline. • Ensure performance, quality, and consistency in the data and processes. • Champion good data design practices and promote data quality. • Collaborate and contribute with data architecture, DBA's, and other team members. • Review use cases … data demand, envision future demands to develop data services to support Business needs. • Explore new ways of improving data utilization/consumption, discovery, and lineage. • Develop and champion data principles and define/lead efforts for adoption. • Develop tools and functions for More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … to define and deliver technical solutions that support business goals and enhance decision-making on a global scale. The role: As a Martech Data Engineer, you will play a crucial role in implementing and deploying the client's Martech stack. You'll work closely with their marketing, analytics … -driven insights. Key Responsibilities: Martech Architecture: Develop and manage a scalable data architecture using Azure and Snowflake. Data Pipeline Management: Implement and maintain data ingestion and integration from platforms like HubSpot and Shopify. Client Collaboration: Work within the client project team More ❯

Job Title: Data Engineer Location: Glasgow ( Hybrid 2 days on-site) Salary: £40,000 – 50,000 D.O.E About the Company: Our client, a prominent manufacturing firm based in Glasgow, is committed to innovation and excellence in their field. They are currently seeking a skilled Data Engineer … to join their team and help drive data-driven decision-making processes to enhance their manufacturing operations. Job Description: As a Data Engineer, you will be instrumental in designing, developing, and maintaining the data infrastructure. You will work closely with data analysts … data pipelines. Integrate data from multiple sources into a unified data warehouse. Monitor and troubleshoot data pipeline performance. Implement data quality checks and validation processes. Collaborate with data analysts to support their data needs. Maintain More ❯

Summer Internship – Data Engineering (Beginner to Intermediate Levels Welcome) Duration: 3 Months | Remote | Flexible Start Hiring Partner: HIRIST – IT Recruitment Partner Client: Reputed IT Company (Name confidential) Interested in building the backbone that powers modern data systems? Whether you’re just starting out or have some … experience with data pipelines — this internship gives you real-world exposure to how data is collected, processed, and delivered at scale. HIRIST is hiring Data Engineering Interns for a reputed IT client, where you’ll work alongside data engineers solving practical data … flow, storage, and processing • Good logical thinking and attention to detail ⸻ 🌟 Nice-to-Have (But Not Required) : • Experience with data pipeline tools like Apache Airflow, DBT, or Kafka • Knowledge of cloud data services (AWS S3/Glue/Redshift, GCP BigQuery, Azure Data More ❯

Check out the Seccl website for the latest on our products and our mission to shape the future of investments. The role The Data Squad engineering manager's purpose is to lead and empower a high-performing team of data engineers to deliver scalable, reliable, and … secure data capabilities. This role is central to enabling internal and external data products, supporting business insights, and developing a modern data platform. The role will work closely with Product, Engineering, and Data Operations to align delivery with business outcomes, support the … team's growth, and help shape our overall data strategy. On a typical day you will Guide and mentor, a team of data engineers, fostering their professional growth and ensuring high performance.Setting clear, measurable goals with regular performance reviews, development plans, and recognition. Collaborate with product More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time … reporting, and managing data from mergers and acquisitions. At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills More ❯

Data Scientist - University of Edinburgh Visa Sponsorship Available The University of Edinburgh is looking to recruit a highly motivated Data Scientist to join a pioneering new team within the School of Informatics, focused on AI-driven solutions using advanced biological data modalities. This is … a unique opportunity to grow your technical skills in a world-leading research environment, working on projects at the cutting edge of data science and artificial intelligence. Applicants should hold a degree in a relevant field such as mathematics, data science, artificial intelligence, statistics, or biomedical … to drive meaningful results and insights from complex datasets. This role offers a chance to be part of an ambitious, interdisciplinary team, applying data analysis to real-world biological challenges with the potential to impact science, health, and innovation. Visa sponsorship is available, making this a fantastic opportunity More ❯

time: 35 hours per week Fixed term: 24 months 2 vacancies The School of Informatics, University of Edinburgh invites applications for two Biomedical Data Scientists to support our newly established Biomedical Data Intelligence Hub. The Opportunity: The Biomedical Data Intelligence Hub will support our … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role, you will develop data solutions as part of a team of Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. Projects will typically involve implementation of statistical models, data analysis pipelines, or deep More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

Full-time: 35 hours per week Fixed term: 24 months The School of Informatics, University of Edinburgh invites applications for a Senior Biomedical Data Scientist to support our newly established Biomedical Data Intelligence Hub . The Opportunity: The Biomedical Data Intelligence Hub will support … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role you will lead the development of data solutions as part of a team of … Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. A key responsibility will be to help manage, coordinate, and prioritise Hub activities and More ❯

and towards a sustainable future for the world. We're looking for a highly skilled AI Developer with expertise in .NET, C#, Python, Data Science, and Data Engineering. This role requires hands-on experience in AI solution integration, API development, data processing, and cloud … based data pipelines. A deep understanding of Microsoft's Semantic Kernel and enterprise-grade AI-powered application development is essential. The ideal candidate thrives in a collaborative environment, demonstrating strong problem-solving, communication, and teamwork skills to drive innovation and deliver cutting-edge AI solutions. Why Aggreko? Here … are some of the perks and rewards. Work on cutting-edge AI and data-driven applications. Be part of an innovative and collaborative new team. Gain continuous learning and career growth opportunities. Competitive compensation and benefits package. What you'll do: AI & Software Development: Design and maintain AI More ❯

Data Engineer (Azure) - Outside IR35 - 3 Months+ - Remote/Glasgow We're currently looking for an experienced Data Engineer to join a Glasgow-based organisation going through a significant transformation. As the organisation looks to mature their data capabilities, this role will be pivotal … in building out their data infrastructure, specifically focusing on designing and developing scalable data pipelines. The data to be ingested will vary; however, a focus will be placed initially on the company's analytics platforms and the company's CRM, so experience here would … be advantageous. Desired Skills Designing and building robust data pipelines for scalable data processing Developing and maintaining ETL workflows to support analytics and reporting Hands-on with Azure ecosystem: Data Factory, Databricks, and Synapse Analytics Experience working with data warehousing solutions and More ❯

Senior Data Scientist at University of Edinburgh Sponsorship Available The University of Edinburgh is seeking a talented and experienced Senior Data Scientist to join its prestigious School of Informatics. This is an exciting opportunity for a data science professional to advance their career, contributing … to groundbreaking research at the intersection of AI and biological data. Candidates should have proven experience in a data science role, with strong skills in managing, structuring, visualising, and analysing data, as well as developing statistical or machine learning tools. The ideal applicant will have hands … role is ideal for someone looking to develop leadership skills within a newly established team focused on AI solutions using cutting-edge biological data modalities. As part of a leading research institution, the successful candidate will contribute to innovative interdisciplinary work that advances scientific discovery. Visa sponsorship is More ❯

Job Title: Data Engineer Location: Aberdeen (Hybrid 3 days on-site) Salary: £55,000 – 65,000 About Us: Join a dynamic and innovative team at one of the top oil and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability … in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and optimising data processes. Key Responsibilities … Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems More ❯

Job Title: Data Engineer Location: Aberdeen (Hybrid 3 days on-site) Salary: £55,000 – 65,000 About Us: Join a dynamic and innovative team at one of the top oil and gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability … in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and optimising data processes. Key Responsibilities … Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems More ❯

to make our business better and to help clients realize the objectives they desire. At BlackRock, there is a rich problem space for data scientists and engineers across all areas of the business including investments, sales, marketing, operations, product, UX, etc. and the potential to have large scale … impact. In 2018, BlackRock accelerated innovation and technology again with additional investment in artificial intelligence and data science and all the potential they represent. AI Labs was formed to act as a central hub with a firm-wide remit to solve strategic business challenges for the firm by … bringing to bear our expertise in data science, machine learning, generative AI, optimization, stochastic control and statistics. Our mission is to combine human and machine intelligence to revolutionize asset management. The team is led by Dr. Rachel Schutt. Our solutions drive towards commercial impact in the form of More ❯

on technical innovation, strategic racing, and continuous improvement both on and off the track. We are looking for a passionate and technically capable Data Engineer to join our engineering group to help drive performance through data. Position Overview As a Data Engineer, you will play a … key role in acquiring, managing, and analyzing large volumes of motorsport and telemetry data to provide actionable insights that enhance car performance, reliability, and race strategy. Working closely with race engineers, performance analysts, and the broader technical team, you’ll support data systems during race weekends … and continuously improve processes through automation and advanced analytics. Key Responsibilities Develop, maintain, and optimize data pipelines for telemetry, video, and sensor data from Supercars. Build and manage databases and data storage systems for performance analysis. Support live data acquisition and processing More ❯