51 to 75 of 127 Data Pipeline Jobs in Scotland

Social network you want to login/join with: London, Manchester, Birmingham Locations Available Looking for your next challenge in Data Engineering ? We’re seeking talented professionals to help businesses unlock the power of their data using cutting-edge technologies. ? Are you passionate about Azure-based data solutions ? ? Do you have expertise in SQL … Python, and modern data platforms ? ? Want to work on high-impact projects with leading organizations? ? What You’ll Do: Design and deliver data solutions using Fabric, Azure Data Factory, and Synapse Work with SQL, Python, Spark, Kafka, Snowflake , and more Apply best practices in Data Architecture, Governance, and Engineering Collaborate with clients … of a supportive, high-performing team ? What We’re Looking For: ️ Strong data engineering experience in Azure ️ Hands-on expertise in SQL, Python , and data pipeline development ️ Familiarity with Agile, DevOps, Git, APIs, and Cloud Data Platforms ️ A team player with problem-solving skills and a consulting mindset ? Bonus: DP-203 or Fabric More ❯

Social network you want to login/join with: London, Manchester, Birmingham Locations Available Looking for your next challenge in Data Engineering ? We’re seeking talented professionals to help businesses unlock the power of their data using cutting-edge technologies. ? Are you passionate about Azure-based data solutions ? ? Do you have expertise in SQL … Python, and modern data platforms ? ? Want to work on high-impact projects with leading organizations? ? What You’ll Do: Design and deliver data solutions using Fabric, Azure Data Factory, and Synapse Work with SQL, Python, Spark, Kafka, Snowflake , and more Apply best practices in Data Architecture, Governance, and Engineering Collaborate with clients … of a supportive, high-performing team ? What We’re Looking For: ️ Strong data engineering experience in Azure ️ Hands-on expertise in SQL, Python , and data pipeline development ️ Familiarity with Agile, DevOps, Git, APIs, and Cloud Data Platforms ️ A team player with problem-solving skills and a consulting mindset ? Bonus: DP-203 or Fabric More ❯

gas firms in Aberdeen. We are committed to leveraging cutting-edge technology to drive efficiency and sustainability in the energy sector. Job Description: We are seeking a skilled Data Engineer to join our team. The ideal candidate will have a strong background in data management, analytics, and engineering, with a passion for solving complex problems and … optimising data processes. Key Responsibilities: Design, develop, and maintain data pipelines and architectures. Collaborate with cross-functional teams to understand data requirements and deliver solutions. Implement data integration and transformation processes. Ensure data quality and integrity across various platforms. Optimize data storage and retrieval systems for performance and … scalability. Develop and maintain documentation for data processes and systems. Qualifications: Bachelor's degree in Computer Science, Engineering, or related field. Proven experience as a Data Engineer or in a similar role. Proficiency in SQL, Python, and data warehousing solutions. Experience with cloud platforms such as AWS, Azure, or Google Cloud. Strong problem-solving More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

Senior Engineer for Data As the business looks to the future, we are now seeking an experienced Senior Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With … an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you’ll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. … Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory, Batch Services, Azure SQL. Contribute to DevOps practices, code reviews, and system optimizations. Current projects More ❯

tech. The new MLOps team will be responsible for the seamless deployment, monitoring, and maintenance of machine learning models in production. Acting as the critical link between the data science and R&D teams, this team will ensure that ML models transition smoothly from development to production, maintaining high availability, scalability, and performance. Key responsibilities include: Managing and … optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerization and orchestration tools (Docker, Kubernetes). Experience with version control systems and CI/CD pipelines. Knowledge of data engineering concepts (e.g., ETL, data pipelines). Ability to troubleshoot complex production systems. Strong communication and collaboration skills. #J-18808-Ljbffr More ❯

optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerization and orchestration tools (Docker, Kubernetes). Experience with version control systems and CI/CD pipelines. Knowledge of data engineering concepts (e.g., ETL, data pipelines). Ability to troubleshoot complex production systems.. If you have the skills and desire for this, then please email your CV More ❯

tech. The new MLOps team will be responsible for the seamless deployment, monitoring, and maintenance of machine learning models in production. Acting as the critical link between the data science and R&D teams, this team will ensure that ML models transition smoothly from development to production, maintaining high availability, scalability, and performance. Key responsibilities include: Managing and … optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerization and orchestration tools (Docker, Kubernetes). Experience with version control systems and CI/CD pipelines. Knowledge of data engineering concepts (e.g., ETL, data pipelines). Ability to troubleshoot complex production systems. Strong communication and collaboration skills. More ❯

tech. The new MLOps team will be responsible for the seamless deployment, monitoring, and maintenance of machine learning models in production. Acting as the critical link between the data science and R&D teams, this team will ensure that ML models transition smoothly from development to production, maintaining high availability, scalability, and performance. Key responsibilities include: Managing and … optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerization and orchestration tools (Docker, Kubernetes). Experience with version control systems and CI/CD pipelines. Knowledge of data engineering concepts (e.g., ETL, data pipelines). Ability to troubleshoot complex production systems. Strong communication and collaboration skills. #J-18808-Ljbffr More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

As the business looks to the future, we are now seeking an experienced Senior Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search … machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you’ll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code … using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory, Batch Services, Azure SQL. Contribute to DevOps practices, code reviews, and system optimizations. Current projects you’ll be involved in: Good More ❯

Blend is an award-winning pure play data consultancy who help people do data right through project delivery across strategy and consulting, data science and BI, and data engineering. As a trusted Data & AI partner we co-create value with clients across a wide variety of industries. Our company has … to implementing a BI dashboard to help swimmers win more medals – nothing we do is designed to be left on the shelf. Job Description Life as a Lead Data Engineer at Blend We are looking for someone who is excited by the idea leading a data engineering squad to develop best in class analytical infrastructures and … resource utilization, training, mentoring, and recruitment. Stakeholder engagement by preparing and present data-driven solutions to stakeholders, translating complex technical concepts into actionable insights. Data pipeline ownership by designing, develop, deploy, and maintain scalable, reliable, and efficient data pipelines. Domain expertise by keeping up to date on emerging trends and advancements within data More ❯

Wood Mackenzie is the global data and analytics business for the renewables, energy, and natural resources industries. Enhanced by technology. Enriched by human intelligence. In an ever-changing world, companies and governments need reliable and actionable insight to lead the transition to a sustainable future. That's why we cover the entire supply chain with unparalleled breadth and … action Key responsibilities Ownership of Enterprise Master Datasets (EMD) Liaise with SMEs and conduct research to build and provide business knowledge for the EMD owned Collaborate with segment data owners to understand: Value of creating an EMD Content and structure requirements of EMD Understanding of existing data sources and systems Design data models for … EMD Define tasks and groom backlog for EMDM Data Stewards to prepare data to populate EMD Collaborate with Data Engineers to design data pipelines, storage, and surfacing of data Define business logic to be included in data pipelines and surfacing of data Use influencing and project More ❯

Social network you want to login/join with: Location: Remote (UK-based) with occasional client site visits This position sits within the Solution Consulting function of a data-focused consultancy, supporting the delivery of data projects across a range of strategic clients. The role involves working both remotely and on-site to lead analysis efforts … and engage with business stakeholders to define and document data-driven requirements. Key Responsibilities: - Lead business and data analysis activities across multiple clients. - Gather, analyse, and document requirements for data pipelines, system migrations, and reporting needs. - Work closely with both client stakeholders and internal engineering teams to ensure accurate and actionable specifications. - Facilitate workshops … and discovery sessions to identify business and data requirements. - Support the development and curation of business glossaries and manage associated processes. - Maintain up-to-date specifications and advocate for solutions that drive client value. Key Experience & Skills: - 5+ years in a business/data analyst role, ideally in a consultancy or commercial setting. - Strong analytical, problem More ❯

day ago Be among the first 25 applicants Direct message the job poster from Amici Procurement Solutions Experienced Tech Recruiter with extensive experience in the Scottish market Senior Data Software Engineer – Java, Python & Search | Amici GLASGOW (HYBRID, 1 DAY PER WEEK IN OFFICE) Eden Scott is delighted to be retained by Amici to recruit an experienced Senior Data … at the heart of the biotech industry. With significant business growth and an ambitious technology roadmap ahead, we’re seeking a skilled engineer with strong Java, Python, and data expertise to join the team and shape the future of Amici’s MyAmici platform. Why Join Us? At Amici, you’ll work on projects that truly matter—developing innovative … their mission to make life-changing discoveries. You'll be part of an agile and highly collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With search being a core focus for the next generation of our platform, this is an exciting opportunity to explore vector search, machine learning, and More ❯

and our employee exit rate is astonishingly low. Join us on our journey... Let's create something awesome, together, today. About the role and team: As a Lead Data Engineer, you'll play a hands-on technical leadership role in our Data Practice. You'll be instrumental in shaping how we deliver data engineering … engagements, working closely with client stakeholders, internal teams and fellow consultants. You'll bring strong technical expertise, mentorship, and a practical approach to building scalable and value-driven data platforms. What you'll be doing: Leading the design and implementation of robust, cloud-native data platforms Architecting and optimising data pipelines and data models for performance and scalability Championing best practices across data engineering, including testing, automation, and documentation Mentoring junior engineers and guiding technical delivery across projects Working directly with client stakeholders to define goals, shape roadmaps and deliver real business impact Driving innovation through continuous improvement and staying ahead of industry trends We'd love to talk More ❯

optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … and familiarity with ML frameworks. Extensive experience with AWS services (e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerization and orchestration tools (Docker, Kubernetes). Knowledge of data engineering concepts (e.g., ETL, data pipelines). Please note we can only consider candidates who can commit to at least one day per week in Dundee. Bright More ❯

optimising existing ML model deployments to ensure reliability and efficiency. Continuously improving the architecture, processes, and tools used for model deployment, monitoring, and lifecycle management. Collaborating closely with data scientists to understand and implement model requirements. Partnering with R&D teams to align technical strategies and integrate ML solutions into broader systems. Implementing robust CI/CD pipelines … and familiarity with ML frameworks. Extensive experience with AWS services (e.g., SageMaker, ECS, Lambda) and cloud environments. Proficiency with containerisation and orchestration tools (Docker, Kubernetes). Knowledge of data engineering concepts (e.g., ETL, data pipelines). Please note that this role is hybrid, based out of Dundee, Scotland. Flexible arrangements are on offer, but we can More ❯

team; as we scale up and drive digital and financial inclusion across our markets. As a Senior Analytics & MLOps Platform Engineer, you will be designing, deploying and managing data and machine learning infrastructure to make it easy for data scientists to experiment, train, serve and monitor batch and online machine learning models in production. About Role … Our mission is to improve the ability of Product, Operations and Data Science teams in M-KOPA to make data driven decisions and automate them using machine learning. You will be designing and implementing architectures to streamline exploration, training, deployment and monitoring of machine learning models. Building and maintain CI/CD pipelines to deploy machine … sets to ensure reproducibility, traceability, and compliance with best practices. Using Azure and infrastructure-as-code tools (e.g., Azure Bicep, Terraform) you will automate and manage infrastructure for data pipelines, machine learning model training, and serving. Additionally, you will establish infrastructure and engineering patterns to feature engineering and reuse across suite of models. Developing workflows for model validation More ❯

its expanding technology team. You’ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a Senior Java Developer, you’ll … be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write clean, maintainable, and well-tested code following Agile and TDD practices Contribute to both backend … services (Java) and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code reviews, pair programming, and mentoring team members Support More ❯

Social network you want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations … keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of daily data operations. You’ll work closely with … both technical colleagues and stakeholders across the business to support reliable, well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries More ❯

Social network you want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations … keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of daily data operations. You’ll work closely with … both technical colleagues and stakeholders across the business to support reliable, well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries More ❯