1 to 25 of 51 Data Pipeline Jobs in Glasgow

Data Architect is responsible for designing, building, and managing the data warehouse’s data architecture, ensuring it is scalable, secure, and optimized for performance. This position plays a crucial role in shaping our data strategy, working across multiple departments to design … implement a robust data ecosystem that supports our business intelligence, analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud ...

seeking a Data Engineering Specialist to join the Architecture & Modernization team. You will be instrumental in building … maintaining the data infrastructure for our Data AI platforms. This role will involve hands-on development, data pipeline creation, and close collaboration with stakeholders across the organization. This role requires a self-starter with strong execution skills and the ability to work independently. ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … automated deployment pipelines for data solutions Support the creation of documentation for pipelines, datasets, data models, and solution designs Troubleshoot pipeline failures, performance issues, and data inconsistencies, ensuring the stability and reliability of production workloads Stay current with emerging tools and capabilities across ...

looking for Data Engineer at Glasgow, Scotland – 2-3 days per week Onsite Purpose of the Role To design, build, and maintain scalable data pipelines, data lakes, and data warehouse solutions on AWS. The role focuses on developing high-performance data engineering solutions using PySpark, Spark, Python, and AWS services, enabling secure, reliable, and efficient data processing and analytics across enterprise platforms. Key Responsibilities Design, develop, and maintain scalable batch and real-time data pipelines using PySpark, Spark, Python, and AWS services. Build and optimize ...

seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data frameworks, and optimize our data platform. Location: 3days/w onsite in Glasgow Key Responsibilities Design, develop, and maintain scalable data pipelines to support data integration, transformation, and analytics requirements. Write efficient, high-performance SQL queries, stored procedures, and data ...

quality, consistency, security, and lineage throughout all stages of data processing and transformation, implementing monitoring and alerting mechanisms to maintain pipeline reliability. Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses. Lead communities of practice across … pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands ...

Principal Data Engineer (Azure) We're looking for an experienced Principal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse … Skills: Extensive Azure Data Engineering experience Microsoft Fabric, Azure Data Lake & Databricks Python, SQL and modern data pipeline development Azure DevOps & CI/CD Data governance, security and quality assurance Strong stakeholder engagement and technical leadership Desirable: Spark, Terraform/Bicep ...

currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards a Microsoft-based technology stack and is looking for someone who can help develop … more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data from external sources into the organisation's Azure environment and operational systems ...

Product Manager - Data Salary From:£64,000 Salary To:£70,000 Region:UK Wide Location:Hybrid London/Shipley/Glasgow Advertised Job Category:Technology Department:Internal Products Job type:Permanent Closing Date:23 September 2026 Product Manager - Data Permanent Full time (34.5 hours … Range £64000 - £70000 - benefits and recognition About us Macmillan Cancer Support exists to do whatever it takes to support people living with cancer. Data plays a vital role in helping us understand the people we support, make better decisions and ensure our resources have the greatest possible impact. ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … objectives. About the Role: This is a senior, client-facing role with responsibility for shaping, designing, and delivering modern data and AI solutions across a range of client engagements. You will operate across the full lifecycle, from early discovery and requirement gathering through architecture design, hands-on delivery ...

Morgan Stanley is seeking a Data Engineering Specialist to join the Architecture … Modernization team. You will build and maintain data infrastructure for Data AI platforms, performing hands-on development, data pipeline creation, and cross‐functional collaboration to evolve data strategy. In this Director-level Data & Analytics Engineering role, you will craft ...

skills and talents are valued and celebrated. At JPMorganChase, you'll help create a brighter future and make a meaningful difference through impactful data engineering. You'll work with agile teams to deliver trusted solutions that power our business. We foster a culture of inclusion, opportunity, and respect. … define data requirements and deliver solutions aligned with business objectives. Identify opportunities to optimize data workflows and improve overall pipeline performance and efficiency. Contribute to a team culture of diversity, opportunity, inclusion, and respect. Required Qualifications, Capabilities, And Skills Formal training or certification on data ...

skills and talents are valued and celebrated. At JPMorganChase, you'll help create a brighter future and make a meaningful difference through impactful data engineering. You'll work with agile teams to deliver trusted solutions that power our business. We foster a culture of inclusion, opportunity, and respect. … define data requirements and deliver solutions aligned with business objectives. Identify opportunities to optimize data workflows and improve overall pipeline performance and efficiency. Contribute to a team culture of diversity, opportunity, inclusion, and respect. Required qualifications, capabilities, and skills Formal training or certification on data ...

have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. The Chief Data & Analytics Office (CDAO) at JPMorgan Chase is responsible for accelerating the firm's data and analytics journey. This includes ensuring the quality … integrity, and security of the company's data, as well as leveraging this data to generate insights and drive decision-making. The CDAO is also responsible for developing and implementing solutionsthat support the firm's commercial goals by harnessing artificial intelligence and machine learning technologies ...

ready to shape the future of data engineering at JPMorganChase? Join a dynamic team where your unique skills will help build innovative solutions and contribute to a winning culture. You'll have opportunities for career growth, collaborate with talented professionals, and make a real impact on our business … objectives. Your expertise will empower our teams and drive success across the firm. As a Software Engineer III at JPMorganChase within Investment Banking Data Products, you will design and deliver reliable data collection, storage, access, and analytics solutions that are secure, stable, and scalable. You will ...

Description Purpose of the role To use innovative data analytics and machine learning techniques to extract valuable insights from the bank's data reserves, leveraging these insights to inform strategic decision-making, improve operational efficiency, and drive innovation across the organisation. Accountabilities Identification, collection, extraction … data from various sources, including internal and external sources. Performing data cleaning, wrangling, and transformation to ensure its quality and suitability for analysis. Development and maintenance of efficient data pipelines for automated data acquisition and processing. Design and conduct of statistical ...

Senior Data Engineer - AWS Location: Glasgow (Hybrid) | Practice Area: Technology & Engineering | Type: Permanent Engineer future-ready data platforms that power financial transformation. The Role We’re looking for a Senior Data Engineer with AWS to join our growing team of engineering experts driving next … transformation for Tier 1 financial services clients. You’ll play a pivotal role in designing, building, and deploying cloud-based data pipelines. Working across greenfield projects and enterprise-scale platforms, your work will directly impact the way data is ingested, transformed, and served at scale across ...

seeking someone to join our Data Obfuscation team as a Full Stack Developer – Data Engineering to design and deliver scalable, secure, and reusable data platforms and services that support enterprise data protection and obfuscation initiatives. In the Technology division, we leverage innovation … which is part of the job family responsible for monitoring, detecting, and responding to security incidents to ensure the organization's systems and data are protected from actual and potential threats or breaches. Since 1935, Morgan Stanley is known as a global leader in financial services, always evolving ...

passionate about building technology that transforms the way businesses operate? Join us and lead the development of advanced AI and data engineering solutions within a collaborative, agile environment. At JPMorganChase, you’ll have the opportunity to shape impactful products, work with cutting‐edge technologies, and grow your career … deliver trusted, market-leading technology products in a secure, stable, and scalable way. You will play a key role in developing AI and data engineering solutions, integrating autonomous agents, and supporting critical business objectives. You’ll collaborate with cross‐functional teams, drive innovation, and ensure our systems remain ...

accelerating chemical discovery to improve quality of life and extend the reach of humanity. The Role Everything Chemify does runs on the Unified Data Platform. When a molecule is designed, registered, sourced, synthesised by a robot, tested, and shipped, the platform is what carries it, one canonical identity … containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience with scientific data, chemical, biological, or laboratory. Experience ...

Role: Cyber Data Engineer Location: Reading,Havant, Glasgow, Perth Duration: 6 months Office requirement: 2/3 day onsite in a week. Description: This role will support the technical delivery of cyber metrics by establishing reliable data pipelines, transforming source data and enabling automated … repeatable reporting. The role will help ensure cyber metrics are based on trusted, accessible and well-managed data rather than manual collection and spreadsheet-based processes. Scope: Identify, onboard and integrate cyber security data sources. Design, build and maintain automated data pipelines and workflows. ...

beyond routine approaches. Produce architecture and design artifacts for complex applications, ensuring software code meets design constraints. Gather, analyze, and visualize large, diverse data sets to drive continuous improvement of software systems. Proactively identify hidden problems and patterns in data to improve coding hygiene and system … ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation.Familiarity with modern front-end technologies Exposure to cloud technologies Experience with ReactJS front-end development is a plus J.P. Morgan is a global ...

beyond routine approaches. Produce architecture and design artifacts for complex applications, ensuring software code meets design constraints. Gather, analyze, and visualize large, diverse data sets to drive continuous improvement of software systems. Proactively identify hidden problems and patterns in data to improve coding hygiene and system … ChatGPT, Google Bard etc. Exposure to Langchain, RAG and Fine Tuning of the LLM Models. Exposure to PySpark and Databricks for Data pipeline creation. Familiarity with modern front-end technologiesExposure to cloud technologiesExperience with ReactJS front-end development is a plusJ.P. Morgan is a global leader ...

Sword Group is seeking a Data Engineer in the United Kingdom (Glasgow area) to design, build, and optimize scalable data pipelines using Azure Data Factory, Synapse, Fabric, and Databricks. You will collaborate with clients and cross-functional teams to translate business needs into robust … data solutions. Ideal candidates will have hands-on experience with Fabric, data governance, and advanced transformations in SQL, Python, and Spark, with opportunities to mentor junior engineers and grow #J-18808-Ljbffr ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up - where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane - a greenfield platform that connects the firm's data ...