76 to 100 of 109 Data Pipeline Jobs in Scotland

systems, including non-deterministic and agentic applications. OptimizeAI systems and workloads for latency, throughput,computeefficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoingoperation. Establish engineering standards,mentorengineers,and influencetechnical strategy across teams. Theminimumrequirements … model-driven applications in production. Strongproficiencyin Python anda track recordof developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

Lorien is seeking a Cyber Data Engineer to support the technical delivery of cyber metrics from multiple data sources in Reading, Havant, Glasgow, and Perth. The role involves establishing data pipelines, transforming source data, and enabling automated reporting. Duration: 6 months with …/3 days onsite per week. You will collaborate with security teams to ensure trusted data, build scalable pipelines, and contribute to dashboards in Power BI and Databricks, delivering timely insights for cyber #J-18808-Ljbffr ...

seeking an experienced Architect specializing in infrastructure and software architecture to shape how AI workloads are designed, placed, and scaled across on-premises data centres, edge environments, and public cloud. This is an architecture leadership role: you will own the reference architectures, decision frameworks, and technical standards that … architecture for workloads spanning the on-premise server and public cloud compute and GPU estate. Define the patterns teams use for hosting, compute, data pipelines, training and fine-tuning, model serving, and retrieval-augmented systems. Workload Placement and Portability: Establish the decision framework that determines where a given ...

Xcede requires a Data Modelling Specialist/Senior Python Developer to join a Glasgow-based data governance team. You will design asset models, implement Python-based data modelling solutions and collaborate across risk, compliance and architecture functions. The role emphasizes hands-on development with … Collibra, Pydantic, FastAPI and APIs, alongside SQL and data pipelines for regulatory and metadata management in financial services. #J-18808-Ljbffr ...

Methods Business and Digital Technology is seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines … manage distributed big data frameworks. Location: onsite in Glasgow (3 days per week). You will design, develop and maintain data pipelines, write high-performance SQL, build backend data processing applications in #J-18808-Ljbffr ...

JPMorganChase in the United Kingdom is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and architectures within the Compute Infrastructure Platforms team. You will collaborate with agile teams to deliver secure, reliable data solutions that power the firm … analytics and decisions. You will own end-to-end data lifecycle, from ingestion to access, implement backups and archiving, and champion data quality and security. #J-18808-Ljbffr ...

JPMorganChase is seeking a Data Engineer in the Corporate Technology team to build and deliver scalable data pipelines and analytics solutions that power AI initiatives across the firm. You will maintain critical data architectures, collaborate with global teams, and drive improvements in data ...

develop, and sustain BI solutions across the UK, with Aberdeen preferred. You will work with IT and business teams to translate requirements into data-driven decisions, ensure data quality, and support data integration and platform reliability. The role requires travel international when needed ...

FanDuel is seeking a Senior Engineering Manager to lead teams of data engineers and consultants in building scalable data pipelines powering BI, analytics, fraud detection, and reporting. You will partner with Data Architects, Product Managers, Analytics, and Engineering to set strategy, govern platforms … ensure reliable, cost-effective data services. You will mentor and grow a high-performing team, balance hands-on engineering with people leadership, and drive data-driven decision making #J-18808-Ljbffr ...

JPMorganChase's Investment Banking Data Products team is seeking a Software Engineer III to design and deliver reliable data collection, storage, and analytics solutions that are secure, scalable, and compliant with enterprise standards. You will develop and maintain data pipelines using Python and Databricks … review controls for data protection, and apply AI-assisted development tools to improve quality while ensuring traceability and auditability. #J-18808-Ljbffr ...

JPMorganChase is seeking a Data Engineer to enhance, build, and deliver scalable data collection, storage, and analytics solutions for CIO, Treasury & Corporate Risk Management. You will maintain critical data pipelines across multiple technical areas and drive AI-powered data initiatives while ensuring ...

JPMorgan Chase & Co. is seeking a Lead Data Engineer to join the Corporate Technology team in Glasgow. You will enhance, build, and deliver data collection, storage, access, and analytics solutions that support AI and analytics initiatives across the firm. The role emphasizes secure, scalable data pipelines and architectures, with a focus on governance and regulatory compliance. You will collaborate with cross‐functional teams to enable data-driven decisions, drive innovation, and raise the bar #J-18808-Ljbffr ...

JPMorgan Chase & Co. in the United Kingdom seeks a Lead Software Engineer to design and deliver AI and data engineering solutions at scale, with a focus on secure, reliable production systems. You will drive agentic AI initiatives, build data pipelines, and collaborate across teams to align ...

make clear recommendations on what to ship, iterate, or retire. Build and maintain LLM-powered features: retrieval pipelines, reranking systems, insight agents, data mining agents, and automated taxonomy generation. Design and run robust evaluation frameworks: build test sets, define metrics, evaluate non-deterministic systems, handle class imbalance … retrieval, evolving from embedding-based approaches toward more advanced methods. Write production-quality code and collaborate closely with Engineering on productionisation, model serving, data pipelines, and monitoring. Work with Product and Commercial teams to translate business needs into practical ML solutions, and support client evaluations and accuracy benchmarking. ...

Enablement Team is the catalyst for internal transformation and product acceleration across Actian. In the modern data landscape, AI is not a siloed experimental lab; it is a core capability that must be embedded into our product DNA and our engineering workflows. We are looking … safely, rapidly, and at scale. You will democratize AI across the organization, establish modern LLMOps/MLOps practices, and directly impact the Actian Data Intelligence Platform by introducing agentic workflows, intelligent data pipelines, and cutting-edge capabilities. Core Responsibilities: Internal AI tooling: Design and maintain ...

Barclays is seeking a Senior Data Scientist to transform complex data into actionable insights that drive strategic growth and innovation. You will leverage AI and ML to convert raw data into strategic intelligence that informs business decisions and competitive advantage. The role involves collaborating … with stakeholders across Barclays, developing scalable data pipelines, and deploying models to mitigate risk and identify opportunities. London, Glasgow or Northampton are potential bases. #J-18808-Ljbffr ...

build secure production code, review peers, and drive AI-assisted engineering practices to improve quality and delivery speed. The role emphasizes containerized deployments, data pipelines, and collaboration across teams to enforce secure coding standards and automated testing. #J-18808-Ljbffr ...

CreateFuture is delivering the migration of an ML estate from Databricks to an AWS SageMaker-based MLOps platform. The Senior Data Engineer (ML) will build and migrate data pipelines feeding model training and inference, ensuring parity with the old Databricks setup. This hands-on role operates ...

JPMorganChase in the UK is seeking a Senior Lead Software Engineer to join the Corporate Technology Data and Analytics Services team. You will own components end-to-end on the Context Plane, from ingestion pipelines to governed retrieval services. This hands-on, architectural role emphasizes cross‐functional collaboration … with AI, product, and data science teams, mentoring peers, and delivering scalable Python services and data pipelines that connect firm knowledge to AI agents. #J-18808-Ljbffr ...

valuation, risk and regulatory compliance. Job Responsibilities Design and develop Python applications within a large mono-repo using proprietary workflows Build graph-based data pipelines for valuation adjustment calculations and risk analysis Implement independent price verification and valuation adjustment workflows across asset classes Develop consensus pricing solutions integrating … with external market data providers Configure distributed compute, job scheduling, analytics integrations and cloud storage pipelines Write and maintain comprehensive unit, baseline and parameterized tests Investigate and remediate security vulnerabilities; support audit remediation efforts Operate with a dry-run-first, confirm-before-modify, audit-everything approach on production ...

team, you will build and maintain services and pipelines that power our code intelligence platform. You will connect semantic-tree and code-index data to engineering and controls workflows, implementing integrations and automated checks under the guidance of senior engineers. You will take ownership of your components, ensuring … functional teams to shape the platform's evolution. Job Responsibilities: Build and maintain scalable services and pipelines for semantic-tree and code-index data Implement integration points with CI/CD pipelines, PR checks, policy engines, and developer tooling Translate compliance and control requirements into automated checks against ...

security engineer and leading engineering initiatives in a DevSecOps environment. Strong expertise securing AI and ML systems at scale, including model lifecycle security, data pipelines, and secure deployment. Strong hands‐on experience with machine learning stacks, such as PyTorch, TensorFlow, MLflow, Kubeflow, or equivalent managed platforms (e.g. Vertex … future, whilst the scale and reach of our Group means you'll have many opportunities to learn, grow and develop. We keep your data safe. So, we'll only ever ask you to provide confidential or sensitive information once you have formally been invited along to an interview ...