1 to 25 of 41 Remote Data Pipeline Jobs in Scotland

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it More ❯

Join to apply for the Lead Data Engineer role at Motability Operations Ltd 4 days ago Be among the first 25 applicants Join to apply for the Lead Data Engineer role at Motability Operations Ltd Continuing Defleet’s data led journey and recognising the importance the Data & Analytics team performs in this … regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on … large change projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently You’ll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

to help clients realize the objectives they desire. BlackRock manages ~$10+ trillion in assets on behalf of investors worldwide. As such, there is a rich problem space for data scientists and engineers across all areas of the business including investments, sales, marketing, operations, product, UX, etc. and the potential to have large scale impact. In 2018 BlackRock accelerated … innovation and technology again with additional investment in artificial intelligence and data science and all the potential they represent. The AI Labs was formed to act as a central hub with a firm-wide remit to solve strategic business challenges for the firm by bringing to bear our expertise in machine learning, artificial intelligence, data science … a history of demonstrating machine learning at BlackRock to create alpha, the goal was to apply these same techniques throughout the business. The team has grown to 75+ data scientists and engineers. Working collaboratively, the team is multi-disciplinary with the following skills and capabilities: machine learning, optimization, statistical modeling, signal detection, natural language processing, data More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions … a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science … projects to tight deadlines Ability to work unsupervised and to manage a varied workload efficiently Minimum criteria You'll need all of these. Solid understanding of data pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI More ❯

the first 25 applicants Get AI-powered advice on this job and more exclusive features. Direct message the job poster from SR2 | Socially Responsible Recruitment | Certified B Corporation Data Engineering Recruitment Consultant @ SR2 | Certified B Corporation Lead Data Engineer Lead Data Engineer Salary: £85,000–£90,000 +Up to 10% Bonus + 15% Non … Contributory Pension Location: Hybrid working (3 days P/W On-Site) |Edinburgh Level: Lead We’re looking for a Lead Data Engineer to play a key role in expanding our client's data-driven capabilities and driving the evolution of our enterprise data ecosystem. This is a strategic, hands-on position where you … create real business impact. You’re proactive, hands-on, and comfortable working across both technical and business domains. Key technical skills: Strong SQL and ELT/data pipeline development experience Expertise in Data Warehouse & Data Lake design (including Star Schema, Snowflake Schema, Data Vault) Hands-on experience with enterprise databases: Oracle More ❯

Job Description: Your Impact As a Software Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the data operations infrastructure, manage and optimise performance, reliability, and scalability of the system to meeting growing demands on ingestion … and processing pipelines. To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. Key areas of responsibility. Orchestration ingestion and storage of raw data into structured or unstructured solutions. … Design, Develop, Deploy and Support data infrastructure, pipelines and architecture. Implement reliable, scalable, and tested solutions to automate data ingestion. Development of systems to manage batch processing and real-time streaming of data Evaluate business needs and objectives. Facilitate pipelines, which prepare data for prescriptive and predictive modelling. Working with domain teams More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving their delivery in a secure manner in compliance with Data … The team is primarily Azure focused but other Cloud technologies such as Oracle and Amazon Web Services (AWS) are used in FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load {ETL} and Extract Load and Transform {ELT}) in the Azure cloud platforms. You will work with structured and unstructured data, data lakes, data warehouses to service operational and analytical business needs. Job description The successful candidates will: Work collaboratively with Enterprise Data Colleagues to develop pipelines and data product that aligns with data architecture and engineering best practice. Develop data assets and products that assist Power Business Intelligence (BI More ❯

the Scottish market Full-time · Permanent · Remote/Hybrid (Glasgow-based office) A leading SaaS business at the forefront of digital transformation is seeking an experienced Senior Engineer - Data to join its growing data team. As the company scales its next-generation platform, data is central to delivering fast, accurate, and intelligent user experiences. … This is a fantastic opportunity to play a key role in shaping a modern data and search infrastructure using cutting-edge technologies. About the Role You’ll be part of an agile, cross-functional team building a powerful data platform and intelligent search engine. Working with technologies like Apache Lucene, Solr, and Elasticsearch, you'll contribute … and development of scalable systems, with opportunities to explore machine learning, AI-driven categorisation models, and vector search. What You’ll Be Doing Design and build high-performance data pipelines and search capabilities. Develop solutions using Apache Lucene, Solr, or Elasticsearch. Implement scalable, test-driven code in Java and Python. Work collaboratively with Business Analysts, Data More ❯

its expanding technology team. You’ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a Senior Java Developer, you’ll … be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write clean, maintainable, and well-tested code following Agile and TDD practices Contribute to both backend … services (Java) and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code reviews, pair programming, and mentoring team members Support More ❯

Lead Data Engineer Salary: £85,000–£90,000 + Up to 10% Bonus + 15% Non - Contributory Pension Location: Hybrid working (3 days P/W On-Site) | Edinburgh Level: Lead We’re looking for a Lead Data Engineer to play a key role in expanding our client's data-driven capabilities and driving … the evolution of our enterprise data ecosystem. This is a strategic, hands-on position where you’ll lead the design and delivery of large-scale data solutions that power critical business decisions. You'll work with a high-performing Data & Analytics team on mission-critical systems across Data Warehousing, Data … create real business impact. You’re proactive, hands-on, and comfortable working across both technical and business domains. ✅ Key technical skills: Strong SQL and ELT/data pipeline development experience Expertise in Data Warehouse & Data Lake design (including Star Schema, Snowflake Schema, Data Vault) Hands-on experience with enterprise databases: Oracle More ❯

employee exit rate is astonishingly low. Join us on our journey... Let’s create something awesome, together, today. About the role and team: We’re looking for a Data Engineer to join our growing Data Practice. You’ll work as part of a multidisciplinary team … delivering data solutions for some of the UK’s best-known brands. You’ll have a hand in everything from data ingestion and transformation to pipeline automation and data platform optimisation – always with a strong focus on quality, scalability, and value. What you'll be doing: Designing, building and maintaining robust, cloud-native … deliver value-focused data solutions We'd love to talk to you if: You’ve got solid experience working with Python, SQL, Spar and data pipeline tools such as dbt or Airflow You’re comfortable working across cloud platforms – especially AWS (Glue, Lambda, Athena), Azure (Data Factory, Synapse), or GCP (Dataflow, BigQuery, Cloud More ❯

Senior Data Engineer/Data Analytics Engineer - Full Remote Working from anywhere in the UK SQL+Python+ETL+ Apache Airflow Our client is a global leading and fast growing high tech company: -Over 6,500 employees across 20+ offices; -300 Million+ active users on some of the platforms they developed; -Cutting edge AR and VR technologies, 3D printing … etc. They are looking for a senior Data Engineer to join their FinTech team! You will develop scalable data pipelines, ensure data quality, and support business decision-making with high-quality datasets. -Work across technology stack: SQL, Python, ETL, Big Query, Spark, Hadoop, Git, Apache Airflow, Data Architecture, Data Warehousing … Design and develop scalable ETL pipelines to automate data processes and optimize delivery -Implement and manage data warehousing solutions, ensuring data integrity through rigorous testing and validation -Lead, plan and execute workflow migration and data orchestration using Apache Airflow -Focus on data engineering and data analytics Requirements More ❯

Data Engineering Manager/Edinburgh/Microsoft Gold Partner Data Engineering Manager/Edinburgh/Microsoft Gold Partner Direct message the job poster from Opus Recruitment Solutions Recruitment Consultant | Microsoft Dynamics - CRM/CE at Opus Recruitment Are you a passionate Data Engineering Manager ready to unlock the power of data? Our … client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end-to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For: Proven Data Engineering experience (5+ years). Consultancy experience is a must. Leadership and multi-project More ❯

Senior Engineer - Data – Leading SaaS Business Full-time · Permanent · Remote/Hybrid (Glasgow-based office) A leading SaaS business at the forefront of digital transformation is seeking an experienced Senior Engineer - Data to join its growing data team. As the company scales its next-generation platform, data is central to delivering fast … accurate, and intelligent user experiences. This is a fantastic opportunity to play a key role in shaping a modern data and search infrastructure using cutting-edge technologies. About the Role You’ll be part of an agile, cross-functional team building a powerful data platform and intelligent search engine. Working with technologies like Apache Lucene, Solr … and development of scalable systems, with opportunities to explore machine learning, AI-driven categorisation models, and vector search. What You’ll Be Doing Design and build high-performance data pipelines and search capabilities. Develop solutions using Apache Lucene, Solr, or Elasticsearch. Implement scalable, test-driven code in Java and Python. Work collaboratively with Business Analysts, Data More ❯

technology for insight and efficiency to make our business better and to help clients realize the objectives they desire. At BlackRock, there is a rich problem space for data scientists and engineers across all areas of the business including investments, sales, marketing, operations, product, UX, etc. and the potential to have large scale impact. In 2018, BlackRock accelerated … innovation and technology again with additional investment in artificial intelligence and data science and all the potential they represent. AI Labs was formed to act as a central hub with a firm-wide remit to solve strategic business challenges for the firm by bringing to bear our expertise in data science, machine learning, generative AI, optimization … a history of demonstrating machine learning at BlackRock to create alpha, the goal is to apply these same techniques throughout the business. The team has grown to 30+ data scientists and data engineers. Working collaboratively, the team is multi-disciplinary with the following skills and capabilities: machine learning, statistical modeling, signal detection, natural language processing, data More ❯

With a focus on applied machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration through to deployment and monitoring. … Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI/ML functionality within broader product development efforts. Technical Leadership Define best practices for MLOps … of others through coaching, peer programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Contribute to internal documentation and knowledge sharing resources. Refine and More ❯

With a focus on applied machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration through to deployment and monitoring. … Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI/ML functionality within broader product development efforts. Technical Leadership Define best practices for MLOps … of others through coaching, peer programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Contribute to internal documentation and knowledge sharing resources. Refine and More ❯

its expanding technology team. You’ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a Senior Java Developer, you’ll … be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write clean, maintainable, and well-tested code following Agile and TDD practices Contribute to both backend … services (Java) and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code reviews, pair programming, and mentoring team members Support More ❯

We’re Hiring: Lead AI and Data Engineer 📍 Edinburgh (Hybrid) | 💰 £60,000–£68,000 Are you passionate about AI, data engineering , and building systems that actually make an impact ? We’re looking for a strategic and hands-on leader to shape the way our organisation leverages data and AI—from predictive models that drive … your chance to take the lead in a high-impact role where innovation, automation , and engineering excellence come together. 🚀 What You’ll Be Doing ✅ Design and deliver scalable data architecture , pipelines, and semantic models ✅ Build and deploy production-grade AI solutions (predictive & generative) ✅ Champion automation-first engineering and modern DataOps/MLOps practices ✅ Lead the development of AI … data products tied to measurable business outcomes ✅ Manage, mentor, and grow a high-performing data engineering team ✅ Work cross-functionally with architects, analysts, data scientists, and IT ✅ Use tools like Azure AI, Power BI , and open-source frameworks ✅ Stay ahead of the curve with GenAI and cloud advancements 🧠 What You Bring Strong background in More ❯

Job Title: Data Engineer Location: Edinburgh, UK About Us: Join one of the leading utilities companies in Edinburgh, driving innovation through data! We are looking for a skilled Data Engineer to support our data infrastructure and empower our teams with reliable and efficient data solutions. If you’re passionate about … building robust data pipelines and transforming raw data into valuable insights, we want you on our team! Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data analysts and stakeholders to understand data requirements. Ensure data integrity, security, and compliance with industry standards. … Optimize data architectures for performance and scalability. Monitor and maintain data systems to ensure high availability. Key Requirements: Proven experience as a Data Engineer or similar role. Proficiency in SQL, Python, or other data processing languages. Experience with cloud platforms (e.g., Azure, AWS, or Google Cloud). Knowledge of data More ❯

day ago Be among the first 25 applicants Direct message the job poster from Amici Procurement Solutions Experienced Tech Recruiter with extensive experience in the Scottish market Senior Data Software Engineer – Java, Python & Search | Amici GLASGOW (HYBRID, 1 DAY PER WEEK IN OFFICE) Eden Scott is delighted to be retained by Amici to recruit an experienced Senior Data … at the heart of the biotech industry. With significant business growth and an ambitious technology roadmap ahead, we’re seeking a skilled engineer with strong Java, Python, and data expertise to join the team and shape the future of Amici’s MyAmici platform. Why Join Us? At Amici, you’ll work on projects that truly matter—developing innovative … their mission to make life-changing discoveries. You'll be part of an agile and highly collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With search being a core focus for the next generation of our platform, this is an exciting opportunity to explore vector search, machine learning, and More ❯

and our employee exit rate is astonishingly low. Join us on our journey... Let's create something awesome, together, today. About the role and team: As a Lead Data Engineer, you'll play a hands-on technical leadership role in our Data Practice. You'll be instrumental in shaping how we deliver data engineering … engagements, working closely with client stakeholders, internal teams and fellow consultants. You'll bring strong technical expertise, mentorship, and a practical approach to building scalable and value-driven data platforms. What you'll be doing: Leading the design and implementation of robust, cloud-native data platforms Architecting and optimising data pipelines and data models for performance and scalability Championing best practices across data engineering, including testing, automation, and documentation Mentoring junior engineers and guiding technical delivery across projects Working directly with client stakeholders to define goals, shape roadmaps and deliver real business impact Driving innovation through continuous improvement and staying ahead of industry trends We'd love to talk More ❯

optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … and familiarity with ML frameworks. Extensive experience with AWS services (e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerisation and orchestration tools (Docker, Kubernetes). Knowledge of data engineering concepts (e.g., ETL, data pipelines). Please note that this role is hybrid, based out of Dundee, Scotland. Flexible arrangements are on offer, but we can More ❯

team; as we scale up and drive digital and financial inclusion across our markets. As a Senior Analytics & MLOps Platform Engineer, you will be designing, deploying and managing data and machine learning infrastructure to make it easy for data scientists to experiment, train, serve and monitor batch and online machine learning models in production. About Role … Our mission is to improve the ability of Product, Operations and Data Science teams in M-KOPA to make data driven decisions and automate them using machine learning. You will be designing and implementing architectures to streamline exploration, training, deployment and monitoring of machine learning models. Building and maintain CI/CD pipelines to deploy machine … sets to ensure reproducibility, traceability, and compliance with best practices. Using Azure and infrastructure-as-code tools (e.g., Azure Bicep, Terraform) you will automate and manage infrastructure for data pipelines, machine learning model training, and serving. Additionally, you will establish infrastructure and engineering patterns to feature engineering and reuse across suite of models. Developing workflows for model validation More ❯

its expanding technology team. You’ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a Senior Java Developer, you’ll … be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write clean, maintainable, and well-tested code following Agile and TDD practices Contribute to both backend … services (Java) and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code reviews, pair programming, and mentoring team members Support More ❯