1 to 25 of 61 Data Pipeline Jobs in Scotland

as well as optimising data flow and collection for other teams. Using their experience in data architecture, ETL processes and pipeline management to support the building, testing and maintenance of data architecture. Job Details - Data Engineer (12-month FTC) Salary - circa … Experience building and deploying machine learning models in production Strong proficiency in object-oriented languages and scripting languages Strong proficiency in data pipeline and workflow management tools Strong project management and organisational skills Excellent problem-solving, communication, and organisational skills Proven ability to work independently and with … performance indicators Develop and deliver insightful analytics for the assigned department to inform key business decisions Create and maintain an optimal data pipeline architecture Assemble large, complex data sets that meet functional/non-functional business requirements Identify, design, and implement internal process improvements: automating More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Enterprise Data Architect Permanent Edinburgh/Glasgow/Wilmslow Hybrid 50% home/office based A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the … execution of the Data Transformation roadmap. The expectations: Accountable for the delivery of the Enterprise Data Architecture and directing detailed Data Architecture for major transformation programmes Key contributor to the data architecture target state including maintaining key architectural viewpoints (Data More ❯

Description The Data Quality Engineer plays a crucial role in ensuring the integrity, accuracy, and reliability of our organization's data assets. This position combines technical expertise with strong collaborative skills to implement and maintain data quality standards across the enterprise. Location:Belfast (Hybrid … days per week in office) Key Responsibilities Data Quality Framework: Develop and implement a comprehensive data quality framework, including defining data quality metrics, setting up data quality checks, and automating quality monitoring SLA and Data Contract Enforcement: Work with domain … data owners and DPOs to ensure adherence to SLAs and data contracts, and monitor data quality against these agreements Data Analysis: Conduct in-depth data analysis to identify data quality issues, anomalies, and inconsistencies Data Validation More ❯

Description The Data Quality Engineer plays a crucial role in ensuring the integrity, accuracy, and reliability of our organization's data assets. This position combines technical expertise with strong collaborative skills to implement and maintain data quality standards across the enterprise. Location:Belfast (Hybrid … days per week in office) Key Responsibilities Data Quality Framework: Develop and implement a comprehensive data quality framework, including defining data quality metrics, setting up data quality checks, and automating quality monitoring SLA and Data Contract Enforcement: Work with domain … data owners and DPOs to ensure adherence to SLAs and data contracts, and monitor data quality against these agreements Data Analysis: Conduct in-depth data analysis to identify data quality issues, anomalies, and inconsistencies Data Validation More ❯

Description The Data Quality Engineer plays a crucial role in ensuring the integrity, accuracy, and reliability of our organization's data assets. This position combines technical expertise with strong collaborative skills to implement and maintain data quality standards across the enterprise. Location:Belfast (Hybrid … days per week in office) Key Responsibilities Data Quality Framework: Develop and implement a comprehensive data quality framework, including defining data quality metrics, setting up data quality checks, and automating quality monitoring SLA and Data Contract Enforcement: Work with domain … data owners and DPOs to ensure adherence to SLAs and data contracts, and monitor data quality against these agreements Data Analysis: Conduct in-depth data analysis to identify data quality issues, anomalies, and inconsistencies Data Validation More ❯

Build and maintain the configuration of the data stack within the DevOps framework. • Develop data objects and write code in and around the data stack. • Interact with upstream and downstream systems and API for data ingestion and egestion. • Build ETL pipelines and … data framework for monitoring the pipeline. • Ensure performance, quality, and consistency in the data and processes. • Champion good data design practices and promote data quality. • Collaborate and contribute with data architecture, DBA's, and other team members. • Review use cases … data demand, envision future demands to develop data services to support Business needs. • Explore new ways of improving data utilization/consumption, discovery, and lineage. • Develop and champion data principles and define/lead efforts for adoption. • Develop tools and functions for More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … to define and deliver technical solutions that support business goals and enhance decision-making on a global scale. The role: As a Martech Data Engineer, you will play a crucial role in implementing and deploying the client's Martech stack. You'll work closely with their marketing, analytics … -driven insights. Key Responsibilities: Martech Architecture: Develop and manage a scalable data architecture using Azure and Snowflake. Data Pipeline Management: Implement and maintain data ingestion and integration from platforms like HubSpot and Shopify. Client Collaboration: Work within the client project team More ❯

with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities. They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and … scheme Cutting-edge projects using AWS and other modern technologies What are we looking for? Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing … with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools More ❯

with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities. They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and … scheme Cutting-edge projects using AWS and other modern technologies What are we looking for? Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing … with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools More ❯

with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities. They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and … scheme Cutting-edge projects using AWS and other modern technologies What are we looking for? Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing … with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools More ❯

with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities. They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and … scheme Cutting-edge projects using AWS and other modern technologies What are we looking for? Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing … with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time … reporting, and managing data from mergers and acquisitions. At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills More ❯

Data Scientist - University of Edinburgh Visa Sponsorship Available The University of Edinburgh is looking to recruit a highly motivated Data Scientist to join a pioneering new team within the School of Informatics, focused on AI-driven solutions using advanced biological data modalities. This is … a unique opportunity to grow your technical skills in a world-leading research environment, working on projects at the cutting edge of data science and artificial intelligence. Applicants should hold a degree in a relevant field such as mathematics, data science, artificial intelligence, statistics, or biomedical … to drive meaningful results and insights from complex datasets. This role offers a chance to be part of an ambitious, interdisciplinary team, applying data analysis to real-world biological challenges with the potential to impact science, health, and innovation. Visa sponsorship is available, making this a fantastic opportunity More ❯

time: 35 hours per week Fixed term: 24 months 2 vacancies The School of Informatics, University of Edinburgh invites applications for two Biomedical Data Scientists to support our newly established Biomedical Data Intelligence Hub. The Opportunity: The Biomedical Data Intelligence Hub will support our … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role, you will develop data solutions as part of a team of Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. Projects will typically involve implementation of statistical models, data analysis pipelines, or deep More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

Senior Data Engineer (AWS or Azure) - Hybrid - Belfast Professional Services | VANRATH Exclusive VANRATH is pleased to be recruiting on behalf of a leading professional services organisation based in Belfast for the role of Senior Data Engineer. This is a fantastic opportunity to join a forward-thinking … company that is investing heavily in its data capabilities and digital transformation. The Role: As a Senior Data Engineer, you will play a pivotal role in shaping and scaling the organisation's data infrastructure. Working closely with cross-functional teams, you will be responsible … for designing, building, and maintaining scalable data pipelines and storage solutions, leveraging cloud technologies such as AWS or Azure. Key Responsibilities: Design and implement robust, scalable data solutions to support analytics and reporting functions. Build and maintain efficient ETL/ELT processes and data More ❯

Senior Data Engineer (AWS or Azure) - Hybrid - Belfast Professional Services | VANRATH Exclusive VANRATH is pleased to be recruiting on behalf of a leading professional services organisation based in Belfast for the role of Senior Data Engineer. This is a fantastic opportunity to join a forward-thinking … company that is investing heavily in its data capabilities and digital transformation. The Role: As a Senior Data Engineer, you will play a pivotal role in shaping and scaling the organisation's data infrastructure. Working closely with cross-functional teams, you will be responsible … for designing, building, and maintaining scalable data pipelines and storage solutions, leveraging cloud technologies such as AWS or Azure. Key Responsibilities: Design and implement robust, scalable data solutions to support analytics and reporting functions. Build and maintain efficient ETL/ELT processes and data More ❯

Senior Data Engineer (AWS or Azure) - Hybrid - Belfast Professional Services | VANRATH Exclusive VANRATH is pleased to be recruiting on behalf of a leading professional services organisation based in Belfast for the role of Senior Data Engineer. This is a fantastic opportunity to join a forward-thinking … company that is investing heavily in its data capabilities and digital transformation. The Role: As a Senior Data Engineer, you will play a pivotal role in shaping and scaling the organisation's data infrastructure. Working closely with cross-functional teams, you will be responsible … for designing, building, and maintaining scalable data pipelines and storage solutions, leveraging cloud technologies such as AWS or Azure. Key Responsibilities: Design and implement robust, scalable data solutions to support analytics and reporting functions. Build and maintain efficient ETL/ELT processes and data More ❯

Full-time: 35 hours per week Fixed term: 24 months The School of Informatics, University of Edinburgh invites applications for a Senior Biomedical Data Scientist to support our newly established Biomedical Data Intelligence Hub . The Opportunity: The Biomedical Data Intelligence Hub will support … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role you will lead the development of data solutions as part of a team of … Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. A key responsibility will be to help manage, coordinate, and prioritise Hub activities and More ❯

Azure Data Architect Location: Northern Ireland (Hybrid) Building Teams OCHO Were working with a fast-growing SaaS company scaling out its data capabilities. They're solving real-world operational challenges for global customers with smart, cloud-first softwareand they need an Azure Data Architect … to help shape the next phase of their data infrastructure. This is a hybrid role based in Northern Ireland, suited to someone who enjoys working across integration design, cloud data architecture, and stakeholder collaboration. The Role As Azure Data Architect, youll be the bridge … between technical architecture and business needsdesigning and implementing scalable, secure, and efficient data solutions using Microsoft Azure. Youll work closely with cross-functional teams (Product, Implementation, Innovation) and customers to ensure seamless data integrations and robust infrastructure design. You'll also take ownership of data More ❯