1 to 25 of 108 Permanent Data Pipeline Jobs in Scotland

Data Architect is responsible for designing, building, and managing the data warehouse’s data architecture, ensuring it is scalable, secure, and optimized for performance. This position plays a crucial role in shaping our data strategy, working across multiple departments to design … implement a robust data ecosystem that supports our business intelligence, analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud ...

seeking a Data Engineering Specialist to join the Architecture & Modernization team. You will be instrumental in building … maintaining the data infrastructure for our Data AI platforms. This role will involve hands-on development, data pipeline creation, and close collaboration with stakeholders across the organization. This role requires a self-starter with strong execution skills and the ability to work independently. ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster customer-centricity through our expertise in customer strategy, innovative design … business challenges in an inclusive environment that fosters continuous learning, knowledge sharing, and clear career development. What you will be doing Data Pipeline Development: Design and implement robust, scalable, and efficient data pipelines to collect, transform, and integrate data from various sources. Data ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … automated deployment pipelines for data solutions Support the creation of documentation for pipelines, datasets, data models, and solution designs Troubleshoot pipeline failures, performance issues, and data inconsistencies, ensuring the stability and reliability of production workloads Stay current with emerging tools and capabilities across ...

Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering … engineer in different disciplines, as well as a clear path to career development and promotion within the role. Key Responsibilities Data Pipeline Development: Design and implement robust, scalable, and efficient data pipelines to collect, transform, and integrate data from various sources. Data ...

Data Engineer/BI Developer Data Science and Artificial Intelligence Department The Bermuda Monetary Authority (Authority or BMA) is seeking the services of a skilled and capable individual to work as a Data Engineer/BI Developer in our Data Science … Artificial Intelligence Department. Reporting to the Deputy Director, the Data Engineer/BI Developer will be responsible for designing, developing and implementing a modern, scalable data management and analytics solution to assist the BMA in making effective and efficient decisions in fulfilling its prudential responsibilities. This ...

GLASGOW, LANARKSHIRE, United Kingdom Job Information Job Identification 210783041 Job Category Data Engineering Business Unit Corporate Sector Posting Date 08/20/2026, 03:18 PM Locations 315 Argyle Street, Glasgow, Glasgow City, G2 8AT, GB Job Schedule Full time Job Shift Day Job Description Join … Lead Data Engineer and help shape the future of data-driven innovation at JPMorganChase. You will collaborate with talented colleagues to deliver impactful solutions that power AI and analytics initiatives across the firm. We value your expertise, encourage growth, and support your journey to make ...

looking for Data Engineer at Glasgow, Scotland – 2-3 days per week Onsite Purpose of the Role To design, build, and maintain scalable data pipelines, data lakes, and data warehouse solutions on AWS. The role focuses on developing high-performance data engineering solutions using PySpark, Spark, Python, and AWS services, enabling secure, reliable, and efficient data processing and analytics across enterprise platforms. Key Responsibilities Design, develop, and maintain scalable batch and real-time data pipelines using PySpark, Spark, Python, and AWS services. Build and optimize ...

Description: Your Impact As a Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the DataOps infrastructure, ensuring the performance, reliability, and scalability of data ingestion … processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. What ...

hackajob is partnering directly with Leonardo to hire for this role. Job Description: Your Impact As a Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the DataOps … infrastructure, ensuring the performance, reliability, and scalability of data ingestion and processing pipelines to support evolving business and operational demands. To succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data ...

Join us as a Data Engineer and help drive data innovation at JPMorganChase. You will collaborate with talented colleagues to deliver impactful solutions that power AI and analytics initiatives across the firm. We value your expertise, encourage growth, and support your journey to make a lasting … impact. Experience a culture that celebrates diverse perspectives and fosters continuous learning. Job Summary: As a Data Engineer in the Corporate Technology team supporting CIO, Treasury & Corporate Risk Management, you will enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable ...

seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data frameworks, and optimize our data platform. Location: 3days/w onsite in Glasgow Key Responsibilities Design, develop, and maintain scalable data pipelines to support data integration, transformation, and analytics requirements. Write efficient, high-performance SQL queries, stored procedures, and data ...

quality, consistency, security, and lineage throughout all stages of data processing and transformation, implementing monitoring and alerting mechanisms to maintain pipeline reliability. Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses. Lead communities of practice across … pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands ...

technical problems. Our globally distributed team values technical excellence, ownership, proactive communication, and collaboration. About the Role We are looking for a Senior Data Platform Engineer to join a high-impact engagement with one of our partners, a global leader in wealth-management technology. This is a hybrid … this position to go to the office between 1 to 2 times per week. You will help build and evolve a financial data platform developed on top of Databricks and used by major enterprise clients. The platform supports the ingestion, transformation, modeling, and delivery of complex financial data. ...

quality, consistency, security, and lineage throughout all stages of data processing and transformation, implementing monitoring and alerting mechanisms to maintain pipeline reliability. Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses. Lead communities of practice across … pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands ...

Principal Data Engineer (Azure) We're looking for an experienced Principal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse … Skills: Extensive Azure Data Engineering experience Microsoft Fabric, Azure Data Lake & Databricks Python, SQL and modern data pipeline development Azure DevOps & CI/CD Data governance, security and quality assurance Strong stakeholder engagement and technical leadership Desirable: Spark, Terraform/Bicep ...

currently working with a well-known charity looking to hire an Azure Data Engineer to join their data and technology team during a significant transformation programme. The organisation is moving towards a Microsoft-based technology stack and is looking for someone who can help develop … more integrated, efficient and scalable data environment. The role will work across the full data journey, with a particular focus on integration and data warehousing. You'll help bring data from external sources into the organisation's Azure environment and operational systems ...

Product Manager - Data Salary From:£64,000 Salary To:£70,000 Region:UK Wide Location:Hybrid London/Shipley/Glasgow Advertised Job Category:Technology Department:Internal Products Job type:Permanent Closing Date:23 September 2026 Product Manager - Data Permanent Full time (34.5 hours … Range £64000 - £70000 - benefits and recognition About us Macmillan Cancer Support exists to do whatever it takes to support people living with cancer. Data plays a vital role in helping us understand the people we support, make better decisions and ensure our resources have the greatest possible impact. ...

driving transformational change for our clients. We leverage proven technology, specialist teams, and extensive domain expertise to create robust technical foundations across platforms, data, and business applications. Our mission is fueled by a passion for technology as a means to solve complex business problems and achieve our clients … objectives. About the Role: This is a senior, client-facing role with responsibility for shaping, designing, and delivering modern data and AI solutions across a range of client engagements. You will operate across the full lifecycle, from early discovery and requirement gathering through architecture design, hands-on delivery ...

Morgan Stanley is seeking a Data Engineering Specialist to join the Architecture … Modernization team. You will build and maintain data infrastructure for Data AI platforms, performing hands-on development, data pipeline creation, and cross‐functional collaboration to evolve data strategy. In this Director-level Data & Analytics Engineering role, you will craft ...

largest engineering investments. - Responsible for the systems that ensure accurate, scalable, and efficient accounting across global operations. - Expanding into data analytics and pipeline initiatives using Snowflake, Redis, and Kafka to manage high-volume, real-time data. - Collaborates closely with Product, Operations, and other Engineering teams to deliver … approach. - Build and maintain microservices and event-driven systems to process and distribute large-scale financial data. - Develop data integration and pipeline components that connect systems across Snowflake, SQL Server, and real-time streaming platforms. - Implement and optimize Redis-based caching and data stores ...

Optima Partners is seeking a Core Data Engineer to design, build, and optimise data pipelines, architectures, and workflows for a diverse client base in Edinburgh, UK. You will work in cross-functional teams and contribute to scalable data solutions while adopting best practices … emerging trends in data engineering. You will collaborate with data scientists, analysts, and stakeholders, delivering robust ETL/ELT processes, data integration, and documentation. #J-18808-Ljbffr ...

ensure successful client delivery of Prism solutions, playing a crucial player/coach role.This role sits at the intersection of client reporting, data engineering, and people management. The ideal candidate thrives in ambiguous, fast-evolving product environments, brings hands-on technical depth in data pipelines … drive solutions across the Prism teamOperate within a global frameworkDemonstrate effective management of both people and projects.Required skills:Deep understanding of data pipeline design, data ingestion, and data normalizationProficiency in SQL and query development for reporting and data analysisExperience with client ...

Handle data migration/integration between Databricks and AWS: storage, permissions, IAM alignment Work within CI/CD and IaC patterns for pipeline deployment; document runbooks and hand over to Evoke teams Collaborate daily with Evoke ML engineering, the CF team, and AWS ProServe counterparts Skills & experience … Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding ...

skills and talents are valued and celebrated. At JPMorganChase, you'll help create a brighter future and make a meaningful difference through impactful data engineering. You'll work with agile teams to deliver trusted solutions that power our business. We foster a culture of inclusion, opportunity, and respect. … define data requirements and deliver solutions aligned with business objectives. Identify opportunities to optimize data workflows and improve overall pipeline performance and efficiency. Contribute to a team culture of diversity, opportunity, inclusion, and respect. Required Qualifications, Capabilities, And Skills Formal training or certification on data ...