51 to 75 of 103 Data Pipeline Jobs in Scotland

Data Science ManagerAre you an experienced Data Science leader with a passion for building and scaling AI/ML products? Lead a team of exceptional Data Scientists and ML Engineers building next-generation AI solutions for financial markets. Drive innovation using LLMs, Generative … world business impact. If you're passionate about shaping the future of AI, we'd love to talk to you. ROLE SUMMARYAs a Data Science Manager, you will lead a high-performing team of Data Scientists delivering AI-powered products that create measurable business value ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up — where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane — a greenfield platform that connects the firm's data ...

Sword Group is seeking a Data Engineer in the United Kingdom (Glasgow area) to design, build, and optimize scalable data pipelines using Azure Data Factory, Synapse, Fabric, and Databricks. You will collaborate with clients and cross-functional teams to translate business needs into robust … data solutions. Ideal candidates will have hands-on experience with Fabric, data governance, and advanced transformations in SQL, Python, and Spark, with opportunities to mentor junior engineers and grow #J-18808-Ljbffr ...

senior Python engineer who wants to work at the intersection of data platforms and applied AI? This is your opportunity to join a small, high-impact team building something new from the ground up - where your decisions shape the architecture, not just the backlog. At JPMorganChase, we invest … curious, pragmatic, and ready to grow into emerging technology stacks. As a Senior Lead Software Engineer at JPMorganChase within the Corporate Technology Data and Analytics Services team, you will be a founding contributor to the Context Plane - a greenfield platform that connects the firm's data ...

third‐party tools. Work with message brokers (RabbitMQ) to design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. … Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across all pipeline stages. Contribute to and lead discussions on system architecture, ensuring solutions are robust, scalable, and maintainable. Define technical standards and patterns for backend services ...

J.P. Morgan seeks a Software Engineer III – DevOps/AWS Engineer in Glasgow to join the Payments Technology team. You will design and deliver secure, scalable software solutions within an agile context, supporting multiple business ...

Morgan-Stanley is seeking a Data Engineering Specialist to join the Architecture & Modernization team in a hybrid UK-based role. You will build and maintain data pipelines, ETL processes, and data platforms for Data AI initiatives, collaborating with stakeholders to drive data-driven insights. The role requires 8+ years of data engineering experience, strong Python and Spark skills, and hands-on experience with Snowflake and Databricks. #J-18808-Ljbffr ...

JPMorgan Chase & Co. in Glasgow seeks a Lead Data Engineer to shape data-driven innovation and deliver data collection, storage, access, and analytics solutions in a secure, scalable way for AI and analytics initiatives. You will maintain critical data pipelines and architectures … lead data governance, and drive collaboration with stakeholders to accelerate delivery and improve operational efficiency across the firm. #J-18808-Ljbffr ...

push technical boundaries and maintain high standards of security and reliability. You will mentor engineers, advocate responsible AI use, and drive scalable data pipelines and production-grade code across the SDLC. A strong emphasis on collaboration and continuous improvement will shape your impact in #J-18808-Ljbffr ...

TogetherTechnical skillsWe'll assess you against these technical skills during the selection process: Experience building solutions like predictive models, LLM workflows, scheduling algorithms, data pipelines etcBenefitsAlongside your salary of 71,381, Ministry of Justice contributes 20,679 towards you being a member of the Civil Service Defined Benefit ...

JPMorganChase in Glasgow seeks a Software Engineer III in Investment Banking Data Products to design and deliver reliable data pipelines, analytics solutions, and secure, scalable data architectures. You’ll collaborate with talented engineers to move data smoothly from source to insight. … develop Python and Databricks workflows, review controls to protect data across the lifecycle, implement entitlements, and refine data models. #J-18808-Ljbffr ...

Consulting Limited is looking for a Data Engineer to join their Glasgow office on a contract basis for 2 days onsite. The ideal candidate will have over 5 years of experience in the banking sector, focusing on data engineering. Proficiency in SQL, Python, and various … tools, along with experience in cloud platforms like AWS, is essential. The responsibility includes developing data pipelines and ensuring data governance. A Bachelor’s or Master’s degree in a related field is required. Banking domain expertise is mandatory. #J-18808-Ljbffr ...

Security Engineering Lead to design, implement and lead security for AI/ML initiatives across the bank. The role covers model lifecycle security, data pipelines and secure deployment in hybrid environments. Based in or working across offices such as Edinburgh, Leeds, Bristol, Manchester or London, you’ll lead ...

real business problems We are looking for an experienced Software Engineer/Forward Deployed Engineer (FDE) to work at the intersection of technology, data, AI and the business. This is not a traditional software engineering role. You will work directly with our investment, operations and distribution teams, spending … Deployed Engineer, you will: Work directly with business teams to understand their workflows, challenges and opportunities. Identify high-impact problems where software, automation, data or AI can improve how we operate. Rapidly prototype solutions, test them with users and iterate based on real-world feedback. Take successful prototypes ...

being accountable for ensuring design constraints are met by software code development Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identify hidden problems and patterns in data and use these … realized by automation. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and proficient applied experience Strong hands-on data engineering experience with Databricks and AWS Hands-on practical experience in system design, application development, testing, and operational stability Proficiency in coding in Python ...

organization's technology communities to foster a culture of technical excellence and growth. Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions. Implementation of effective unit testing practices to ensure proper code design, readability, and reliability. Assistant Vice President ExpectationsTo advise … work, for business aligned support areas to keep up to speed with business activity and the business strategy. Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc).to solve problems creatively ...

Codelitt is hiring a Senior Data Platform Engineer in Edinburgh for a hybrid role. You will contribute to a financial data platform built on Databricks, working across Python services, APIs, data pipelines, and data models with an established Edinburgh team. The ideal ...

production systems using autonomous and AI-native platforms. This role requires a modern, hybrid engineering approach, blending infrastructure mastery with software development and data engineering principles. You will act as a technical expert on projects, building trusted relationships with client stakeholders, establishing engineering best practices, and mentoring engineers … self-service developer platforms that allow engineering teams to spin up compliant, ephemer environments automatically using GitOps workflows. AI & Agentic Infrastructure: Implement the data pipelines, workflow orchestrations, and specialised compute footprints needed to support enterprise AI applications, using technologies like AWS Bedrock and AWS AgentCore. Observability & Reliability: Build ...

startups and internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required Qualifications, Capabilities, And Skills Formal … tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks. Strong programming skills in Python and Java, including experience with distributed data processing. Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while ...

realized by automationRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experienceStrong software engineering fundamentals — system design, data structures, algorithms, and architectural thinking — with the ability to ramp up quickly across varied tech stacks and project typesHands-on practical experience in full … stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude ...

FairPlay Sports Media is seeking a data scientist to translate complex data into actionable strategies. You will partner with Product, Engineering, Marketing, and Operations to build predictive frameworks and uncover growth opportunities. Responsibilities include experimentation, predictive analytics, EDA, feature definition, and cross-functional collaboration. The role … also involves designing autonomous AI agents and maintaining data pipelines with Data Engineering. #J-18808-Ljbffr ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

market intelligence platform currently in development that will help recruiters identify opportunities within their markets and specialisms. We have many more plans in the pipeline for the near future too, all of which you’ll help build with us. We are a small, ambitious team. … modern stack (NestJS, TypeScript, GraphQL via Hasura, PostgreSQL, Vue.js) Legacy platform work - maintaining and improving our older Node.js applications (Express, Handlebars, MongoDB) Data and ingestion - working with large datasets, building and optimising data pipelines, and ensuring our systems perform at scale This is a hands ...

systems, including non-deterministic and agentic applications. OptimizeAI systems and workloads for latency, throughput,computeefficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoingoperation. Establish engineering standards,mentorengineers,and influencetechnical strategy across teams. Theminimumrequirements … model-driven applications in production. Strongproficiencyin Python anda track recordof developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...

deterministic and agentic applications. Optimize AI systems and workloads for latency, throughput, compute efficiency, reliability, security, and cost. Partner with business, engineering, data, risk, and control teams to take solutions from concept through production deployment and ongoing operation. Establish engineering standards, mentor engineers, and influence technical strategy across … production. Strong proficiency in Python and a track record of developing maintainable, well-tested production software. Strong SQL skills and experience working with data-intensive applications and large-scale datasets. Experience designing and building APIs, services, data pipelines, or distributed systems that support AI/ ...