1 to 25 of 38 Data Pipeline Jobs in Glasgow

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools Identify and resolve data quality and pipeline performance issues to ensure stability and integrity Contribute to the design and deployment of data lakes, warehouses, and streaming architectures Participate in mentoring and upskilling junior team More ❯

Lead Data Scientist (Equity Only) - 1% Location: Glasgow, United Kingdom Job Category: Other EU work permit required: Yes Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 Job Description: About Luupli Luupli is a social media app 'in-development', which aims to provide opportunities for diverse creators from marginalized communities. It will highlight their work and offer access to … social media opportunities. Job Description: As a Lead Data Scientist, you will leverage AWS analytics services to analyze data, collaborate with cross-functional teams, and develop data-driven solutions to support business growth. Responsibilities: Work with teams to understand objectives and define analytics goals. Develop data analysis strategies using AWS services like … Amazon Redshift, Athena, EMR, and QuickSight. Design data pipelines and ETL processes for data extraction and transformation. Apply statistical and machine learning techniques for predictive analysis, clustering, and pattern recognition. Develop KPIs and dashboards using Amazon QuickSight for decision-making. Perform exploratory data analysis to identify trends and insights. Collaborate on data More ❯

Join to apply for the Python Data Engineer III- Machine Learning role at Latinx in AI (LXAI) 2 days ago Be among the first 25 applicants Join to apply for the Python Data Engineer III- Machine Learning role at Latinx in AI (LXAI) Get AI-powered advice on this job and more exclusive features. J Python … Data Engineer III- Machine Learning JPMorganChase Full-time On-site Glasgow, United Kingdom Technology Description Be part of a dynamic team where your distinctive skills will contribute to a winning culture and team. As a Data Engineer III at JPMorgan Chase within the Developer Platforms and Insights team, you serve as a seasoned member of an … agile team to design and deliver trusted data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. You are responsible for developing, testing, and maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives. Job Responsibilities Design, develop, and deploy More ❯

motivated AI Full Stack Developer with a strong foundation in cybersecurity operations and artificial intelligence technologies. The ideal candidate will have deep technical expertise in AI/ML, data science, and programming, alongside a solid understanding of cyber threat detection and defensive operations frameworks. You will be instrumental in designing and implementing full-stack AI-driven solutions to … full-stack development tools and frameworks. · Collaborate with cybersecurity teams to build and enhance detection and mitigation systems based on frameworks like MITRE ATT&CK. · Develop and maintain data pipelines, APIs, dashboards, and visualization tools to support AI model insights. · Write clean, well-documented, and secure code using Python, C C#, or R. · Leverage libraries such as TensorFlow … AI services in cloud-native environments. · Familiarity with containerization (Docker, Kubernetes) and DevOps pipelines. · Exposure to security operations center (SOC) tools and SIEM platforms. · Experience working with big data platforms such as Spark, Hadoop, or Elastic Stack. #J-18808-Ljbffr More ❯

the Scottish market Full-time · Permanent · Remote/Hybrid (Glasgow-based office) A leading SaaS business at the forefront of digital transformation is seeking an experienced Senior Engineer - Data to join its growing data team. As the company scales its next-generation platform, data is central to delivering fast, accurate, and intelligent user experiences. … This is a fantastic opportunity to play a key role in shaping a modern data and search infrastructure using cutting-edge technologies. About the Role You’ll be part of an agile, cross-functional team building a powerful data platform and intelligent search engine. Working with technologies like Apache Lucene, Solr, and Elasticsearch, you'll contribute … and development of scalable systems, with opportunities to explore machine learning, AI-driven categorisation models, and vector search. What You’ll Be Doing Design and build high-performance data pipelines and search capabilities. Develop solutions using Apache Lucene, Solr, or Elasticsearch. Implement scalable, test-driven code in Java and Python. Work collaboratively with Business Analysts, Data More ❯

its expanding technology team. You’ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a Senior Java Developer, you’ll … be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write clean, maintainable, and well-tested code following Agile and TDD practices Contribute to both backend … services (Java) and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code reviews, pair programming, and mentoring team members Support More ❯

Senior Engineer - Data – Leading SaaS Business Full-time · Permanent · Remote/Hybrid (Glasgow-based office) A leading SaaS business at the forefront of digital transformation is seeking an experienced Senior Engineer - Data to join its growing data team. As the company scales its next-generation platform, data is central to delivering fast … accurate, and intelligent user experiences. This is a fantastic opportunity to play a key role in shaping a modern data and search infrastructure using cutting-edge technologies. About the Role You’ll be part of an agile, cross-functional team building a powerful data platform and intelligent search engine. Working with technologies like Apache Lucene, Solr … and development of scalable systems, with opportunities to explore machine learning, AI-driven categorisation models, and vector search. What You’ll Be Doing Design and build high-performance data pipelines and search capabilities. Develop solutions using Apache Lucene, Solr, or Elasticsearch. Implement scalable, test-driven code in Java and Python. Work collaboratively with Business Analysts, Data More ❯

Social network you want to login/join with: Python Data Software Engineer II, Glasgow col-narrow-left Client: Location: Glasgow, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Reference: 884ff738a8ca Job Views: 5 Posted: 17.06.2025 Expiry Date: 01.08.2025 col-wide Job Description: We have an exciting and rewarding opportunity within the … Client Onboarding & Know Your Customer technology group, to help implement our next generation data strategy and take your software engineering career to the next level. As a member of our Software Engineering Group, you will dive head-first into creating innovative solutions that advance businesses and careers. You’ll join an inspiring and curious team of technologists dedicated … documentation for complex applications while being accountable for ensuring design constraints are met by software code development. Gathers, analyses, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems. Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to More ❯

Social network you want to login/join with: Head of Data Engineering & Governance, glasgow col-narrow-left Client: Data Science Talent Location: glasgow, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 04.06.2025 Expiry Date: 19.07.2025 col-wide Job Description: Head of Data Engineering & Governance … client began to focus solely on wealth management. But now? This company – a trusted name in the UK financial services sector – fully recognise this. They understand that embracing data and AI is what will continue to position them at the forefront of the UK’s investment management sector. This isn’t a dalliance with data. It’s a … debate about the direction, fighting for investment or dragging people with you. Now, following a recent acquisition, they’re ready to embark on the next phase – transforming the data and harnessing its power. And that’s where you come in. Where you fit in As one of three new leaders in the newly established Group Data More ❯

With a focus on applied machine learning, generative AI, and cloud-native tools, this is an opportunity to shape the future of the product and how they use data to solve real-world challenges. What You'll Be Doing: AI/ML Project Ownership Lead the delivery of machine learning initiatives from exploration through to deployment and monitoring. … Own the full development cycle for ML systems — including architecture, data pipelines, model training, and production deployment. Cross-functional Collaboration Work closely with Product, Engineering, and DevOps teams to embed intelligent features into our platform. Ensure smooth end-to-end integration of AI/ML functionality within broader product development efforts. Technical Leadership Define best practices for MLOps … of others through coaching, peer programming, and technical reviews. Share learnings and help foster a culture of innovation and experimentation. Problem Solving at Scale Tackle challenges related to data quality, interpretability, bias, and reliability. Build processes and infrastructure that make AI/ML workflows efficient, robust, and repeatable. Contribute to internal documentation and knowledge sharing resources. Refine and More ❯

its expanding technology team. You’ll contribute to the ongoing development of a next-generation platform, with a strong focus on high-performance search capabilities and large-scale data processing. This is a fantastic opportunity to work on impactful technology in a forward-thinking, data-driven environment. Your Role As a Senior Java Developer, you’ll … be instrumental in building and evolving a resilient data platform that underpins key SaaS offerings. You’ll work closely with engineers, designers, and product teams to deliver scalable, performant solutions that help end users derive real value from complex data. Key Responsibilities Write clean, maintainable, and well-tested code following Agile and TDD practices Contribute to both backend … services (Java) and modern front-end frameworks (React/TypeScript) Develop and fine-tune search functionality using technologies like Lucene, Solr, or OpenSearch Collaborate with Data Engineers to design and deliver data pipelines Leverage cloud platforms (AWS, Azure, or GCP) for scalable and resilient processing Participate in code reviews, pair programming, and mentoring team members Support More ❯

recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: We’re looking for an experienced Azure Data & AI Engineer with a strong focus on advanced analytics, machine learning, and applied AI - particularly Generative AI. This role will suit a technically capable professional who combines real-world … Vault), and telemetry via Application Insights or Log Analytics. KEY RESPONSIBILITIES: Have 5+ years of technical consulting or a similar chronology of demonstrable success in coding and deploying Data and AI models onto Azure environments. At least one year using Azure Fabric Create scalable and reliable data pipelines for data processing, transformation, and storage. … Establish and enforce data governance policies and be ‘hands-on’ in exploratory data analysis to identify and measure quality gaps that are a block to Data and Ai implementation. Implement robust security measures to protect sensitive data within Azure environments. Integrate AI and machine learning models into data pipelines and More ❯

Senior Engineer for Data As the business looks to the future, we are now seeking an experienced Senior Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With … an opportunity to explore vector search, machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you’ll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. … Write high-quality, test-driven code using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory, Batch Services, Azure SQL. Contribute to DevOps practices, code reviews, and system optimizations. Current projects More ❯

experienced and highly motivated Lead Machine Learning Engineer to drive the development, deployment, and optimization of machine learning solutions. As a technical leader, you will collaborate closely with data scientists, software engineers, and product managers to bring cutting-edge ML models into production at scale. You'll play a key role in shaping the AI strategy and mentoring … machine learning team. Responsibilities: Lead the end-to-end development of machine learning models, from prototyping to production deployment. Architect scalable ML pipelines and infrastructure. Work closely with data scientists to transition research models into robust production systems. Collaborate with engineering teams to integrate ML models into applications and services. Manage and mentor a team of machine learning … and data engineers. Establish best practices for model development, evaluation, monitoring, and retraining. Design experiments, analyze results, and iterate rapidly to improve model performance. Stay current with the latest research and developments in machine learning and AI. Define and enforce ML model governance, versioning, and documentation standards. Required Skills & Qualifications: Bachelor's or Master’s degree in Computer More ❯

As the business looks to the future, we are now seeking an experienced Senior Engineer for our data team. This is a permanent, full-time position. You'll work in an agile, collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With an opportunity to explore vector search … machine learning, and large-scale data processing using Apache Lucene, Solr, or Elasticsearch. What you’ll be doing: Design, build, and optimize a high-performance data platform and search solution. Develop robust search capabilities using Apache Lucene, Solr, or Elasticsearch. Engineer scalable data pipelines in Java or Python. Write high-quality, test-driven code … using Agile methodologies. Collaborate with Business Analysts, Data Engineers, and UI Developers. Work across the full stack, from React/TypeScript front-end to Java-based search services. Leverage cloud technologies like Azure Data Factory, Batch Services, Azure SQL. Contribute to DevOps practices, code reviews, and system optimizations. Current projects you’ll be involved in: Good More ❯

day ago Be among the first 25 applicants Direct message the job poster from Amici Procurement Solutions Experienced Tech Recruiter with extensive experience in the Scottish market Senior Data Software Engineer – Java, Python & Search | Amici GLASGOW (HYBRID, 1 DAY PER WEEK IN OFFICE) Eden Scott is delighted to be retained by Amici to recruit an experienced Senior Data … at the heart of the biotech industry. With significant business growth and an ambitious technology roadmap ahead, we’re seeking a skilled engineer with strong Java, Python, and data expertise to join the team and shape the future of Amici’s MyAmici platform. Why Join Us? At Amici, you’ll work on projects that truly matter—developing innovative … their mission to make life-changing discoveries. You'll be part of an agile and highly collaborative environment, leveraging modern technology stacks to build and optimize a powerful data platform and search engine. With search being a core focus for the next generation of our platform, this is an exciting opportunity to explore vector search, machine learning, and More ❯

Social network you want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations … keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of daily data operations. You’ll work closely with … both technical colleagues and stakeholders across the business to support reliable, well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries More ❯

Social network you want to login/join with: Data & AI Solutions Deployment Architect, glasgow col-narrow-left Client: Bytes Software Services Location: glasgow, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 31.05.2025 Expiry Date: 15.07.2025 col-wide Job Description: Bytes is a top provider of premium IT solutions … foster a culture of innovation, collaboration, recognition and inclusivity and offer a wide range of benefits to support staff wellbeing. Your Future Starts Here PURPOSE OF JOB: The Data & AI Solutions Deployment Architect will be instrumental in architecting and deploying Azure Data & AI Solutions. A solid, technical, ‘hands-on’ (not just the theory) grasp of Azure … Fabric is essential as we navigate clients through all of the infrastructure, coding, and product development lifecycle challenges around successful Data and AI implementation and deployment. This customer-centric position involves delivering projects, conducting workshops and physically working on client’s environments via Python, and C#. This role would suit an experienced Data platform engineer or More ❯

Social network you want to login/join with: Senior Backend Engineer (Platform Experience & Data Warehousing teams) ??? Location: UK, Ireland, Poland, Lithuania, Spain, Portugal, Finland ? numi are proud to have partnered with a front runner in data integration technology providing fantastic experience for their clients (who are some of the biggest names in the space)! We … are looking for experienced Senior Backend Engineers (PHP) to join either our Platform Experience or Data Warehousing teams. The Platform Experience team focuses on optimizing end-to-end platform journeys and building impactful customer experiences. They are currently developing a data visualization tool (dashboards) and build features primarily from scratch. The Data Warehousing team … is responsible for data storage and transfer solutions, helping users streamline data transfers to data warehouses/datalakes and improving internal storage. This involves scaling, refactoring, and enhancing a complex data transfer system handling large data volumes. As a Senior Backend Engineer, you will play a key role in the More ❯

We are seeking a talented Data Scientist to join our team, dedicated to driving commercial value from data science across the Corporate Bank. In this role, you will have the opportunity to leverage machine learning techniques and advanced analytics to extract valuable insights and create tangible business impact. We embrace a design-led thinking approach that … with business stakeholders and a fail-fast mindset. This position offers the chance to work with extensive datasets that span billions of rows, applying state-of-the-art data science techniques to unlock millions in business value. To be successful as a Data Scientist, you should have experience with: Commercial or academic experience in developing machine … learning models (e.g., clustering, classification, regression, NLP). Comfortable working in Python and using key data science packages. Working knowledge of SQL. Ability to articulate technical findings in business terms and demonstrate value to stakeholders. Some other highly valued skills include: Understanding of code best practice including Git. Familiarity with AWS data science services, including SageMaker. More ❯

CI/CD pipelines to automate deployment processes. Monitor system performance and troubleshoot issues using CloudWatch and other observability tools. Manage and optimise Kafka clusters for real-time data streaming. Oversee and maintain containerized workloads using EKS (Kubernetes on AWS) . Support data infrastructure, including Amazon Redshift for analytics and storage. Implement security best practices and … fixes and provide Level 2 technical support. Build tools to reduce the occurrence of errors and improve customer experience. Develop software to integrate with internal back-end systems (data). Perform root cause analysis of production errors and resolve technical issues. Develop scripts to automate visualisation (management tools such as Sentry and Grafana). Design procedures for system … best practices. Experience with version control systems such as Git . Ability to troubleshoot complex system issues in a production environment. Nice to Have Knowledge of data pipeline and event-driven architectures. Experience with serverless computing (AWS Lambda, Fargate). Familiarity with compliance and security frameworks (ISO 27001, SOC2, etc.). Experience working in an Agile/ More ❯

Social network you want to login/join with: AI Connect are partnering with a boutique, data enabled organisation to deliver high-impact machine learning projects. We're looking for Senior Data Science contractors who can hit the ground running and build production-ready solutions using Python. Role responsibilities/experience required: • Lead the development of … data science solutions • Scope technical tasks and shape project deliverables with stakeholders • Build and optimise traditional machine learning models • Perform complex data wrangling, cleansing, and enrichment • Design and evaluate models with a focus on robustness and interpretability • Develop scalable data pipelines and work with large datasets • Collaborate closely with engineering and product to embed … solutions into workflows • Strong experience in applied Data Science and machine learning • Track record of delivering commercial ML solutions • Ability to scope work independently and drive delivery • Bonus: cloud experience (Azure) If you have the required skills and experience, then please apply for more details #J-18808-Ljbffr More ❯

Join us as a Data and Software Engineer at Barclays where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unapparelled customer experiences. This role will leverage technologies such as Kafka and Java and others listed below, to improve our legacy technology … stack. You will play a key role in the input of the design and creation of these initial systems. To be successful as a Data and Software Engineer , you should have experience with: Kafka developing Java developing Databases (e.g. Snowflake, MongoDB) Other highly valued skills include: Cloud Platform (e.g. AWS) Flink/Kstreams Linux/Shell You may … technical skills This role will be based out of our Glasgow campus. Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build More ❯

Job Description Purpose of the role To implement data quality process and procedures, ensuring that data is reliable and trustworthy, then extract actionable insights from it to help the organisation improve its operation, and optimise resources. Accountabilities Investigation and analysis of data issues related to quality, lineage, controls, and authoritative source identification. Execution of … data cleansing and transformation tasks to prepare data for analysis. Designing and building data pipelines to automate data movement and processing. Development and application of advanced analytical techniques, including machine learning and AI, to solve complex business problems. Documentation of data quality findings and recommendations for improvement. Vice President Expectations … They will also be expected to demonstrate the Barclays Mindset - to Empower, Challenge and Drive - the operating manual for how we behave. Join us at Barclays as a Data Business Partner. In this role you will be acting within a team of data partners and analysts, you will be responsible for the delivery of an evolving More ❯

Join to apply for the Data Business Partner role at Barclays Business Banking 2 days ago Be among the first 25 applicants Join to apply for the Data Business Partner role at Barclays Business Banking Get AI-powered advice on this job and more exclusive features. Join us at Barclays as a Data Business … Partner. In this role you will be acting within a team of data partners and analysts, you will be responsible for the delivery of an evolving capability within the Chief Data Office (CDO) focused on meeting data quality and control standards across multiple areas of the business. This is a unique role for an … individual with strong project delivery experience, but also a willingness to investigate business challenges at a detailed level across data sets, operational processes, business controls and applications. You will need the ability to perform detailed impact assessments, development of business requirement and business cases; with the key goal to be providing best in class data advisory More ❯