25 of 25 Data Pipeline Jobs in Edinburgh

as well as optimising data flow and collection for other teams. Using their experience in data architecture, ETL processes and pipeline management to support the building, testing and maintenance of data architecture. Job Details - Data Engineer (12-month FTC) Salary - circa … Experience building and deploying machine learning models in production Strong proficiency in object-oriented languages and scripting languages Strong proficiency in data pipeline and workflow management tools Strong project management and organisational skills Excellent problem-solving, communication, and organisational skills Proven ability to work independently and with … performance indicators Develop and deliver insightful analytics for the assigned department to inform key business decisions Create and maintain an optimal data pipeline architecture Assemble large, complex data sets that meet functional/non-functional business requirements Identify, design, and implement internal process improvements: automating More ❯

Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group's risk appetite. Role Overview Royal London is … models using data modelling tools (Idera ER/Studio or similar). Data engineering/data pipeline experience, with hands on experience on integration tools such as Azure Databricks Notebooks, Azure Data Factory or PySpark. Python extremely beneficial. About More ❯

Enterprise Data Architect Permanent Edinburgh/Glasgow/Wilmslow Hybrid 50% home/office based A fantastic opportunity to join a growing Group Data & Analytics Office. As the Enterprise Data Architect you will be responsible for enhancing the effectiveness of how data is used across this FS organisation. You will provide Data Strategy, Data Management and Analytics capabilities. This person will play a critical leadership role responsible for bringing best practice in data architecture and emerging data technology trends to support the … execution of the Data Transformation roadmap. The expectations: Accountable for the delivery of the Enterprise Data Architecture and directing detailed Data Architecture for major transformation programmes Key contributor to the data architecture target state including maintaining key architectural viewpoints (Data More ❯

Description The Data Quality Engineer plays a crucial role in ensuring the integrity, accuracy, and reliability of our organization's data assets. This position combines technical expertise with strong collaborative skills to implement and maintain data quality standards across the enterprise. Location:Belfast (Hybrid … days per week in office) Key Responsibilities Data Quality Framework: Develop and implement a comprehensive data quality framework, including defining data quality metrics, setting up data quality checks, and automating quality monitoring SLA and Data Contract Enforcement: Work with domain … data owners and DPOs to ensure adherence to SLAs and data contracts, and monitor data quality against these agreements Data Analysis: Conduct in-depth data analysis to identify data quality issues, anomalies, and inconsistencies Data Validation More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … to define and deliver technical solutions that support business goals and enhance decision-making on a global scale. The role: As a Martech Data Engineer, you will play a crucial role in implementing and deploying the client's Martech stack. You'll work closely with their marketing, analytics … -driven insights. Key Responsibilities: Martech Architecture: Develop and manage a scalable data architecture using Azure and Snowflake. Data Pipeline Management: Implement and maintain data ingestion and integration from platforms like HubSpot and Shopify. Client Collaboration: Work within the client project team More ❯

with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities. They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and … scheme Cutting-edge projects using AWS and other modern technologies What are we looking for? Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing … with a diverse and growing capability and they are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. There are a variety of different tools More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time … reporting, and managing data from mergers and acquisitions. At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills More ❯

Data Scientist - University of Edinburgh Visa Sponsorship Available The University of Edinburgh is looking to recruit a highly motivated Data Scientist to join a pioneering new team within the School of Informatics, focused on AI-driven solutions using advanced biological data modalities. This is … a unique opportunity to grow your technical skills in a world-leading research environment, working on projects at the cutting edge of data science and artificial intelligence. Applicants should hold a degree in a relevant field such as mathematics, data science, artificial intelligence, statistics, or biomedical … to drive meaningful results and insights from complex datasets. This role offers a chance to be part of an ambitious, interdisciplinary team, applying data analysis to real-world biological challenges with the potential to impact science, health, and innovation. Visa sponsorship is available, making this a fantastic opportunity More ❯

time: 35 hours per week Fixed term: 24 months 2 vacancies The School of Informatics, University of Edinburgh invites applications for two Biomedical Data Scientists to support our newly established Biomedical Data Intelligence Hub. The Opportunity: The Biomedical Data Intelligence Hub will support our … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role, you will develop data solutions as part of a team of Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. Projects will typically involve implementation of statistical models, data analysis pipelines, or deep More ❯

our award-winning team at Sparta Global. About this role You'll become versatile in a wide array of tools across topics covering data focused coding, data visualisation, Cloud Services, Big Data and Machine learning. You will be equipped to work within a variety … of roles including but not limited to; Data Engineer, Data Analyst, Data Scientist, Information Engineer. You'll be designing, building, maintaining, and troubleshooting the data pipelines that enable organizations to store, process, and analyse their data, and ensuring the data is reliable through testing and debugging. Looking for efficiencies and optimising the data pipelines for scalability and performance will be a focus. You'll be handling and working with large sets of structured and unstructured data and will be responsible for ensuring that the More ❯

is expected to report to Concord, NC on a full-time basis. The Role We are seeking a highly skilled and motivated Senior Data Processing Engineer to join the Aero Innovation team within the Motorsports Aerodynamic Department. Your primary responsibility will be to develop complex data pipelines and data-processing systems that enhance the productivity and capabilities of our aerodynamics development activities for both motorsport and high-performance production vehicles. As a member of our multi-disciplinary team, you will be at the forefront of designing, developing, and optimizing state-of-the … with our partners and ultimately help shape the future of motorsports. What You’ll Do Architect, design, build, and maintain scalable and efficient data pipelines to process and transform large volumes of structured and unstructured data from multiple sources. Work with data engineers and More ❯

Senior Data Engineer (AWS or Azure) - Hybrid - Belfast Professional Services | VANRATH Exclusive VANRATH is pleased to be recruiting on behalf of a leading professional services organisation based in Belfast for the role of Senior Data Engineer. This is a fantastic opportunity to join a forward-thinking … company that is investing heavily in its data capabilities and digital transformation. The Role: As a Senior Data Engineer, you will play a pivotal role in shaping and scaling the organisation's data infrastructure. Working closely with cross-functional teams, you will be responsible … for designing, building, and maintaining scalable data pipelines and storage solutions, leveraging cloud technologies such as AWS or Azure. Key Responsibilities: Design and implement robust, scalable data solutions to support analytics and reporting functions. Build and maintain efficient ETL/ELT processes and data More ❯

Full-time: 35 hours per week Fixed term: 24 months The School of Informatics, University of Edinburgh invites applications for a Senior Biomedical Data Scientist to support our newly established Biomedical Data Intelligence Hub . The Opportunity: The Biomedical Data Intelligence Hub will support … biotechnology, drug discovery, medical imaging, and signal processing. The Hub is designed to augment and catalyse the Centre's ongoing projects with advanced data science skills and compute capabilities. In this role you will lead the development of data solutions as part of a team of … Data Scientists and a Software Engineer using a combination of AI, Machine Learning, and other data science techniques, with dedicated access to our new GPU server with state-of-the-art compute. A key responsibility will be to help manage, coordinate, and prioritise Hub activities and More ❯

Azure Data Architect Location: Northern Ireland (Hybrid) Building Teams OCHO Were working with a fast-growing SaaS company scaling out its data capabilities. They're solving real-world operational challenges for global customers with smart, cloud-first softwareand they need an Azure Data Architect … to help shape the next phase of their data infrastructure. This is a hybrid role based in Northern Ireland, suited to someone who enjoys working across integration design, cloud data architecture, and stakeholder collaboration. The Role As Azure Data Architect, youll be the bridge … between technical architecture and business needsdesigning and implementing scalable, secure, and efficient data solutions using Microsoft Azure. Youll work closely with cross-functional teams (Product, Implementation, Innovation) and customers to ensure seamless data integrations and robust infrastructure design. You'll also take ownership of data More ❯

Azure Data Architect Location: Northern Ireland (Hybrid) OCHO - Building Teams We're working with a fast growing SaaS company scaling out its data capabilities. They're solving real world operational challenges for global customers with smart, cloud first software , and they need an Azure Data Architect to help shape the next phase of their data infrastructure. This is a hybrid role based in Northern Ireland, suited to someone who enjoys working across integration design, cloud data architecture, and stakeholder collaboration. The Role As Azure Data Architect, you … ll be the bridge between technical architecture and business needs designing and implementing scalable, secure, and efficient data solutions using Microsoft Azure. You'll work closely with cross functional teams (Product, Implementation, Innovation) and customers to ensure seamless data integration's and robust infrastructure design. You More ❯

Role: Data Engineer Work Type & Location: Belfast (Hybrid flexibility available) Role Type: Permanent Start Date: ASAP Anson McCade are a leading recruitment … and transformation consultancy, working with an innovative and forward-thinking client in the data and cloud technology space. With a robust project pipeline across multiple sectors, were seeking a Data Engineer to join a growing Belfast-based team, supporting high-impact data-driven … solutions and cutting-edge cloud architecture. We are looking for a technically sharp, motivated, and collaborative Data Engineer with AWS experience and a passion for building reliable, scalable data infrastructure. This is an exciting opportunity to get involved with a highly capable team working on greenfield More ❯

Enso Recruitment are proud to be working exclusively with one of NI's leading software houses on the search for a Senior Data Engineer to join their team. The Data Engineer will be part of a local team in NI, responsible for improving and optimizing data architecture and pipelines. The ideal candidate will have experience building and optimizing data pipelines and enjoy creating data solutions from the ground up. The role involves supporting developers, database architects, data analysts, and data scientists, ensuring that data delivery is consistent and efficient across projects. The Data Engineer will also manage daily tasks related to implementing new services and supporting existing ones. Our client is looking for driven, passionate individuals who work well in distributed teams. While the skills listed below are preferred, the More ❯

Senior Data Scientist at University of Edinburgh Sponsorship Available The University of Edinburgh is seeking a talented and experienced Senior Data Scientist to join its prestigious School of Informatics. This is an exciting opportunity for a data science professional to advance their career, contributing … to groundbreaking research at the intersection of AI and biological data. Candidates should have proven experience in a data science role, with strong skills in managing, structuring, visualising, and analysing data, as well as developing statistical or machine learning tools. The ideal applicant will have hands … role is ideal for someone looking to develop leadership skills within a newly established team focused on AI solutions using cutting-edge biological data modalities. As part of a leading research institution, the successful candidate will contribute to innovative interdisciplinary work that advances scientific discovery. Visa sponsorship is More ❯

the already impressive Belfast team. Role Description: Facilitating the extraction of value from information assets by collaborating with domain experts and integrating innovative data analytics solutions into existing service lines. Leading diverse teams with varied skillsets utilizing different Data and Analytics technologies. Adapting leadership style to … broader society. Championing operational efficiency improvements and consistently driving projects to completion with high-quality results. Contributing to the development of the broader Data & Analytics team's future by building the brand, attending relevant events, collaborating with internal teams, and producing thought leadership. Actively establishing, maintaining, and strengthening … expectations, deliver quality projects on time, etc. Ability to communicate technical information to non-technical colleagues and clients. Proven work experience as a Data Architect. Experience in gathering and analysing system requirements. Proven cloud data architecture experience (Azure/AWS). Deep understanding of both relational More ❯

to make our business better and to help clients realize the objectives they desire. At BlackRock, there is a rich problem space for data scientists and engineers across all areas of the business including investments, sales, marketing, operations, product, UX, etc. and the potential to have large scale … impact. In 2018, BlackRock accelerated innovation and technology again with additional investment in artificial intelligence and data science and all the potential they represent. AI Labs was formed to act as a central hub with a firm-wide remit to solve strategic business challenges for the firm by … bringing to bear our expertise in data science, machine learning, generative AI, optimization, stochastic control and statistics. Our mission is to combine human and machine intelligence to revolutionize asset management. The team is led by Dr. Rachel Schutt. Our solutions drive towards commercial impact in the form of More ❯

Overview of Role A leading technology solutions provider is seeking a Senior Data Solution Architect due to rapid growth in their data and AI business. The selected candidate will join an existing team of data and BI professionals, providing strategic consultancy, advisory, and governance … of complex, impactful solutions for various clients in the private and public sectors. Key Responsibilities Strategic Consultancy: Provide advisory and governance on complex data solutions. Development Leadership: Lead technical teams, manage design and development of data solutions. Stakeholder Communication: Articulate the value of data to both business and technical stakeholders. Performance Management: Optimise performance and cost, manage testing for data pipelines and reports. Qualifications and Skills Experience: 7+ years in data roles, with expertise in Microsoft (Azure) technologies. Leadership: Experience leading technical teams in data-intensive More ❯

Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable insight to lead the transition to a sustainable future. That's why … the heart of our decisions Future Focused - we accelerate change Curious - we turn knowledge into action Job Description We are looking for a Data Analyst to join Wood Mackenzie's Power and Renewables Data team. This role will focus on the analysis, programmatic acquisition, and preparation … of data for delivery to our customers and research teams. Wood Mackenzie produces research and data that the energy industry relies on to understand and navigate the energy transition. Examples of products that you will contribute to include: Power supply and demand long-term outlooks Power More ❯

a strong background in MLOps principles, cloud technologies (AWS), and a passion for building robust and efficient systems. You will collaborate closely with data scientists, engineers, and product teams to deliver high-quality ML solutions that directly impact our business. The mission of the Data Science … practices Cloud Infrastructure Management: Manage and optimize our AWS cloud infrastructure for machine learning, ensuring cost-effectiveness, security, and high availability CI/CD Pipeline Development: Develop and maintain robust CI/CD pipelines for continuous integration and deployment of ML models and related infrastructure Monitoring and Observability: Build … systems for our ML infrastructure and models, leveraging tools like DataDog to ensure system health and performance Collaboration and Mentorship: Collaborate effectively with data scientists, engineers, and other stakeholders. Provide guidance and support to junior team members Performance Optimization: Continuously optimize ML model performance, data pipelines More ❯

strategic thinking, customer-centric service design, and agile engineering practices to accelerate innovation in a tech-driven world. Why consider joining our Digital & Data community? ?? Join our Digital & Data team working alongside product, design and a wide range of other experts and cross-disciplinary teams to … we are often hiring for similar roles which your background might be better suited to. Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Pythn, Scala, Spark, SQL. Perform tasks such as writing scripts … extracting data using APIs, writing SQL queries etc. Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks. You'll be comfortable designing and building for the AWS cloud and More ❯

locations and plan the routes for delivery. Drivers use these systems to navigate to the delivery locations. Our mission is to vend geospatial data (e.g. maps, traffic, addresses, and locations/geocodes) that is detailed and fresh through an intuitive experience that enables every driver - independent of tenure … locations with business and transportation mode awareness. The technical domain is multi-faceted. We build low-latency, highly-available services, we build big data processing pipelines to refresh or produce new data, we train ML models, and we run science experiments. We also build solutions for … and engineering best practices. A day in the life - Collaborate with engineering and science teams on building state-of-the-art scalable, big data pipelines, ML training and inference solutions, high-availability services with low latencies. - Analyze nuanced metrics to understand system behavior and innovate on solutions to More ❯