76 to 100 of 103 Data Pipeline Jobs in Scotland

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

Lorien is seeking a Cyber Data Engineer to support the technical delivery of cyber metrics from multiple data sources in Reading, Havant, Glasgow, and Perth. The role involves establishing data pipelines, transforming source data, and enabling automated reporting. Duration: 6 months with …/3 days onsite per week. You will collaborate with security teams to ensure trusted data, build scalable pipelines, and contribute to dashboards in Power BI and Databricks, delivering timely insights for cyber #J-18808-Ljbffr ...

seeking an experienced Architect specializing in infrastructure and software architecture to shape how AI workloads are designed, placed, and scaled across on-premises data centres, edge environments, and public cloud. This is an architecture leadership role: you will own the reference architectures, decision frameworks, and technical standards that … architecture for workloads spanning the on-premise server and public cloud compute and GPU estate. Define the patterns teams use for hosting, compute, data pipelines, training and fine-tuning, model serving, and retrieval-augmented systems. Workload Placement and Portability: Establish the decision framework that determines where a given ...

Methods Business and Digital Technology is seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines … manage distributed big data frameworks. Location: onsite in Glasgow (3 days per week). You will design, develop and maintain data pipelines, write high-performance SQL, build backend data processing applications in #J-18808-Ljbffr ...

JPMorganChase in the United Kingdom is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and architectures within the Compute Infrastructure Platforms team. You will collaborate with agile teams to deliver secure, reliable data solutions that power the firm … analytics and decisions. You will own end-to-end data lifecycle, from ingestion to access, implement backups and archiving, and champion data quality and security. #J-18808-Ljbffr ...

JPMorganChase is seeking a Data Engineer in the Corporate Technology team to build and deliver scalable data pipelines and analytics solutions that power AI initiatives across the firm. You will maintain critical data architectures, collaborate with global teams, and drive improvements in data ...

develop, and sustain BI solutions across the UK, with Aberdeen preferred. You will work with IT and business teams to translate requirements into data-driven decisions, ensure data quality, and support data integration and platform reliability. The role requires travel international when needed ...

FanDuel is seeking a Senior Engineering Manager to lead teams of data engineers and consultants in building scalable data pipelines powering BI, analytics, fraud detection, and reporting. You will partner with Data Architects, Product Managers, Analytics, and Engineering to set strategy, govern platforms … ensure reliable, cost-effective data services. You will mentor and grow a high-performing team, balance hands-on engineering with people leadership, and drive data-driven decision making #J-18808-Ljbffr ...

JPMorganChase's Investment Banking Data Products team is seeking a Software Engineer III to design and deliver reliable data collection, storage, and analytics solutions that are secure, scalable, and compliant with enterprise standards. You will develop and maintain data pipelines using Python and Databricks … review controls for data protection, and apply AI-assisted development tools to improve quality while ensuring traceability and auditability. #J-18808-Ljbffr ...

JPMorganChase is seeking a Data Engineer to enhance, build, and deliver scalable data collection, storage, and analytics solutions for CIO, Treasury & Corporate Risk Management. You will maintain critical data pipelines across multiple technical areas and drive AI-powered data initiatives while ensuring ...

JPMorgan Chase & Co. is seeking a Lead Data Engineer to join the Corporate Technology team in Glasgow. You will enhance, build, and deliver data collection, storage, access, and analytics solutions that support AI and analytics initiatives across the firm. The role emphasizes secure, scalable data pipelines and architectures, with a focus on governance and regulatory compliance. You will collaborate with cross‐functional teams to enable data-driven decisions, drive innovation, and raise the bar #J-18808-Ljbffr ...

JPMorgan Chase & Co. in the United Kingdom seeks a Lead Software Engineer to design and deliver AI and data engineering solutions at scale, with a focus on secure, reliable production systems. You will drive agentic AI initiatives, build data pipelines, and collaborate across teams to align ...

make clear recommendations on what to ship, iterate, or retire. Build and maintain LLM-powered features: retrieval pipelines, reranking systems, insight agents, data mining agents, and automated taxonomy generation. Design and run robust evaluation frameworks: build test sets, define metrics, evaluate non-deterministic systems, handle class imbalance … retrieval, evolving from embedding-based approaches toward more advanced methods. Write production-quality code and collaborate closely with Engineering on productionisation, model serving, data pipelines, and monitoring. Work with Product and Commercial teams to translate business needs into practical ML solutions, and support client evaluations and accuracy benchmarking. ...

Enablement Team is the catalyst for internal transformation and product acceleration across Actian. In the modern data landscape, AI is not a siloed experimental lab; it is a core capability that must be embedded into our product DNA and our engineering workflows. We are looking … safely, rapidly, and at scale. You will democratize AI across the organization, establish modern LLMOps/MLOps practices, and directly impact the Actian Data Intelligence Platform by introducing agentic workflows, intelligent data pipelines, and cutting-edge capabilities. Core Responsibilities: Internal AI tooling: Design and maintain ...

build secure production code, review peers, and drive AI-assisted engineering practices to improve quality and delivery speed. The role emphasizes containerized deployments, data pipelines, and collaboration across teams to enforce secure coding standards and automated testing. #J-18808-Ljbffr ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

team, you will build and maintain services and pipelines that power our code intelligence platform. You will connect semantic-tree and code-index data to engineering and controls workflows, implementing integrations and automated checks under the guidance of senior engineers. You will take ownership of your components, ensuring … functional teams to shape the platform's evolution. Job Responsibilities: Build and maintain scalable services and pipelines for semantic-tree and code-index data Implement integration points with CI/CD pipelines, PR checks, policy engines, and developer tooling Translate compliance and control requirements into automated checks against ...

security engineer and leading engineering initiatives in a DevSecOps environment. Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment. Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex … future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow and develop. We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview ...

security engineer and leading engineering initiatives in a DevSecOps environment. Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment. Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex … future, whilst the scale and reach of our Group means you’ll have many opportunities to learn, grow and develop. We keep your data safe. So, we’ll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview ...

Inside IR35. The role focuses on accelerating delivery of innovative AI solutions across a Scottish Public Sector organisation, embedding within Data Engineering and collaborating with stakeholders to deliver intelligent, value-driving products and services. #J-18808-Ljbffr ...

that's transforming today’s workforce. Our upskilling apprenticeships are designed for people of any age and career stage to build critical AI, data, and tech skills. Our learners have driven $2bn+ ROI for their employers, using the skills they’ve learned to improve productivity and measurable performance. … Design tool integrations. Agents are only as capable as the systems they can reach. You design and build the tool layer: MCPs, APIs, data contracts, and the error handling that makes tool use reliable. You work closely with the wider engineering org building Multiverse’s customer‐facing product ...

manage performance, identify learning opportunities, and serve as an escalation point for important inquiries. The role sits at the intersection of client reporting, data engineering, and people management, requiring hands-on depth in data pipelines and client reporting with a proven track record of leading cross ...

慨正橡扯 is seeking an AWS Developer to build and evolve our data platform, supporting critical business and regulatory outcomes within our technology function. You’ll develop resilient, scalable solutions on AWS, contribute to modern data platforms, and influence enterprise‐grade cloud services. Based in Glasgow … work in a highly collaborative engineering team delivering secure, high‐quality code, with responsibilities spanning data pipelines, AWS services, and best practices in testing and #J-18808-Ljbffr ...