20 of 20 Permanent Data Pipeline Jobs in Scotland

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...

Join Barclays as a Senior Cloud Data Platform Engineer At Barclays, data is at the heart of our decision-making, innovation and customer experience. As a Senior Cloud Data Platform Engineer, you will play a critical role in designing, building and maintaining the cloud … based data platforms that power our business, enabling the secure and efficient collection, storage, processing and analysis of data at scale. Working with modern cloud technologies, you will develop and optimise data pipelines, data warehouses and data lakes, ensuring that ...

days in the office Salary: Up to £75,000 + Benefits Head Resourcing are partnering with an Edinburgh-founded business to recruit a Data Manager/Azure Fabric specialist to play a pivotal role in the organisation's data transformation journey. This is an opportunity … bridge the gap between business strategy and modern data platforms, helping to design, build and govern enterprise-wide analytical solutions that support regulatory reporting, risk management, customer insight, operational efficiency and strategic decision-making. Working closely with stakeholders across the business, you'll help establish data ...

Venesky-Brown’s client, is currently looking to recruit a Data Architect for an initial short term contract (20 working days) on a rate of £600/day (Outside IR35). This role will be remote. Essential skills Expert knowledge of enterprise data and analytics architecture … including data modelling, governance, metadata, lineage, master data management, data quality, interoperability and information architecture. Significant experience designing and delivering enterprise data platforms, data warehouses/lakehouses, ETL/ELT processes, APIs, data pipelines and cloud integration solutions. ...

based streaming and serving platform for the Corporate Bank, enabling the Corporate banking growth strategy Functional leadership of a global team of c.150 data engineers and software engineers Budget oversight of c.£15m pa change budget Interfaces with Accountable Execs (Business Product Owners) in the Corporate Bank Skills … Scaled Agile, LeSS or similar enterprise frameworks Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate ...

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional consulting … enabling the AI-empowered workforce of tomorrow, you’ll be working at the cutting edge of what’s next. We DESIGN next-generation data, analytics and AI platforms – You will lead the architecture and development of scalable, secure and cost-efficient platforms that power both operational and analytical ...

empowered workforce of tomorrow, you’ll be working at the cutting edge of what’s next. We DESIGN autonomous, AI-powered data platforms– You will lead the design and evolution of next-generation, self-optimising data and AI platforms that power both operational and analytical data … that can reason, adapt, and act with minimal human intervention. We ENABLE intelligent cloud transformation– You will architect intelligent, hybrid and multi-cloud data ecosystems, driving the transition from legacy platforms to AI-centric, adaptive architectures that enhance scalability, performance, and resilience. We INNOVATE with agentic and generative ...

Principal Data & AI Consultant – Waracle is a digital technology consultancy. This Hybrid role is based at Dundee, London, or Glasgow , with around 2 days per week in office. Key Aspects of the Role Include Architecture & Vision: Designing, developing, and maintaining robust data pipelines using batch … streaming processing, championing data governance, security, privacy, and legislatory compliance. Acting as a Trusted Advisor: Translating complex business challenges into clear technical roadmaps, communicating with executive stakeholders and non-technical peers. Enabling Innovation: Designing usable data models and building reliable foundations that empower advanced analytics, LLMs ...

Barclays is seeking a Senior Cloud Data Platform Engineer to design, build and maintain cloud-based data platforms at scale. You will enable secure collection, storage and analysis of data and work with stakeholders across engineering, architecture and product teams to deliver robust data solutions. Based in Glasgow, you will contribute to the evolution of data capabilities, drive efficient data pipelines and data lakes, and help unlock new opportunities for growth through secure and scalable #J-18808-Ljbffr ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up - where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane - a greenfield platform that connects the firm's data ...

third‐party tools. Work with message brokers (RabbitMQ) to design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. … Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up — where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane — a greenfield platform that connects the firm's data ...

tomorrow. Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Join our Data & AI Strategy team and be part of the future of AI consulting, where we’re not just advising clients, we’re actively disrupting traditional consulting … operate at the cutting edge of intelligent enterprise evolution. We DESIGN intelligent, agent-ready platforms – Architect and deliver scalable, secure, and cost-efficient data, analytics, and AI ecosystems that support both human and autonomous agent workloads, leveraging leading cloud platforms (AWS, Azure, GCP). We ENABLE agentic ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

serving platform for the Corporate Bank, enabling our growth strategy. You will provide functional leadership for a global team of about 150 data engineers and software engineers, with oversight of a change budget around £15m per year. In this role you will interface with Accountable Execs (Business Product … Owners) across Corporate Bank, steer data pipelines, data warehouses and data lakes, #J-18808-Ljbffr ...

software solutions with a strong focus on cost optimization. This role is hands‐on and requires advanced engineering skills to develop scalable services, data pipelines, and automation that improve cloud efficiency, governance, and performance. You will also apply AI skills and develop/manage AI agents that enable …/architecture standards, cloud resource management practices, governance frameworks, and security/compliance controls. Build and operate reliable pipelines that enable cost optimization, data flow, and scalable processing. Develop an optimization and recommendation engine, including AI agents and AI‐driven workflow automation for large‐scale processing and cost ...

make clear recommendations on what to ship, iterate, or retire. Build and maintain LLM-powered features: retrieval pipelines, reranking systems, insight agents, data mining agents, and automated taxonomy generation. Design and run robust evaluation frameworks: build test sets, define metrics, evaluate non-deterministic systems, handle class imbalance … retrieval, evolving from embedding-based approaches toward more advanced methods. Write production-quality code and collaborate closely with Engineering on productionisation, model serving, data pipelines, and monitoring. Work with Product and Commercial teams to translate business needs into practical ML solutions, and support client evaluations and accuracy benchmarking. ...

Co. is seeking a Senior Lead Software Engineer to join a small, high-impact team building a greenfield Context Plane platform that connects data mesh and AI tools. You will own components end-to-end, from ingestion to governance, and contribute to architecture decisions while mentoring engineers. … will collaborate with data scientists, product teams, and other engineers to deliver scalable, secure backend services, data pipelines, and enterprise-grade AI integrations. #J-18808-Ljbffr ...

Workflow Design: Authoring and testing Electronic Batch Records (EBR) and manufacturing recipes following ISA-95/ISA-88 standards to ensure efficient production. Data Management: Developing data pipelines and dashboards for real-time monitoring of Key Performance Indicators (KPIs) such as yield, cycle time, and OEE. ...

native software with a strong focus on cost optimization. The role is hands-on and requires advanced engineering skills to develop scalable services, data pipelines, and automation that improve cloud efficiency, governance, and performance. You will also apply AI skills to develop/manage AI agents enabling natural … language querying and analysis of large-scale cloud financial data, collaborating across teams #J-18808-Ljbffr ...