51 to 75 of 81 Data Pipeline Jobs in Glasgow

Consulting Limited is looking for a Data Engineer to join their Glasgow office on a contract basis for 2 days onsite. The ideal candidate will have over 5 years of experience in the banking sector, focusing on data engineering. Proficiency in SQL, Python, and various … tools, along with experience in cloud platforms like AWS, is essential. The responsibility includes developing data pipelines and ensuring data governance. A Bachelor’s or Master’s degree in a related field is required. Banking domain expertise is mandatory. #J-18808-Ljbffr ...

GIOS Technology in Glasgow, Scotland is seeking a hands-on Data Engineer to design, build, and maintain scalable data pipelines and data lakes in AWS. You will work with PySpark, Spark, Python, and CloudFormation to deliver high-performance data solutions for enterprise … analytics. The role emphasizes collaboration with Data Scientists and Analytics teams, building production-grade ETL/ELT frameworks, and implementing CI/CD with GitLab while advancing platform modernization and secure data #J-18808-Ljbffr ...

being accountable for ensuring design constraints are met by software code development Gather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identify hidden problems and patterns in data and use these … realized by automation. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and proficient applied experience Strong hands-on data engineering experience with Databricks and AWS Hands-on practical experience in system design, application development, testing, and operational stability Proficiency in coding in Python ...

regulated technology environmentsFamiliarity with wholesale credit risk concepts, instruments, or related financial productsExposure to mobile application development or cross-platform frameworksExperience with data engineering, real-time data pipelines, or event-driven architecturesKnowledge of DevSecOps practices and security-by-design principles in cloud environmentsJ.P. Morgan ...

organization’s technology communities to foster a culture of technical excellence and growth.Adherence to secure coding practices to mitigate vulnerabilities, protect sensitive data, and ensure secure software solutions.Implementation of effective unit testing practices to ensure proper code design, readability, and reliability.Assistant Vice President ExpectationsTo advise and influence decision … work, for business aligned support areas to keep up to speed with business activity and the business strategy.Engage in complex analysis of data from multiple sources of information, internal and external sources such as procedures and practises (in other areas, teams, companies, etc).to solve problems creatively ...

/startups and internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture.Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs.Required qualifications, capabilities, and skillsFormal training … workflow tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks.Strong programming skills in Python and Java, including experience with distributed data processing.Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while validating ...

startups and internal teams to assess architectural designs, technical capabilities, and fit within existing systems and information architecture. Build scalable feature engineering and data pipelines on Databricks using data lake sources, leveraging Spark/Delta and Databricks workflows/jobs. Required qualifications, capabilities, and skills Formal … tools such as Git/BitBucket, Jira, ServiceNow, and pre-commit hooks. Strong programming skills in Python and Java, including experience with distributed data processing. Leverage enterprise-authorized AI coding assistant tools to improve code quality and delivery speed (e.g., code generation/refactoring, unit tests, documentation), while ...

while being accountable for ensuring design constraints are met by software code developmentGather, analyze, synthesize, and develop visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systemsProactively identify hidden problems and patterns in data and use these insights … improve the value realized by automation.Required qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and proficient applied experienceStrong hands-on data engineering experience with Databricks and AWSHands-on practical experience in system design, application development, testing, and operational stabilityProficiency in coding in PythonSolid understanding ...

realized by automationRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experienceStrong software engineering fundamentals — system design, data structures, algorithms, and architectural thinking — with the ability to ramp up quickly across varied tech stacks and project typesHands-on practical experience in full … stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a projectProficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness and aptitude ...

Required Qualifications, Capabilities, And Skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals — system design, data structures, algorithms, and architectural thinking — with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience Strong software engineering fundamentals system design, data structures, algorithms, and architectural thinking with the ability to ramp up quickly across varied tech stacks and project types Hands-on practical experience … full-stack or cross-functional development, spanning frontend, backend, data pipelines, or mobile, with demonstrated ability to contribute across the length and breadth of a project Proficiency in one or more of the following: Java/Spring Boot, Python/PySpark, GraphQL, or mobile development frameworks, with openness ...

market intelligence platform currently in development that will help recruiters identify opportunities within their markets and specialisms. We have many more plans in the pipeline for the near future too, all of which you’ll help build with us. We are a small, ambitious team. … modern stack (NestJS, TypeScript, GraphQL via Hasura, PostgreSQL, Vue.js) Legacy platform work - maintaining and improving our older Node.js applications (Express, Handlebars, MongoDB) Data and ingestion - working with large datasets, building and optimising data pipelines, and ensuring our systems perform at scale This is a hands ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus.Job ResponsibilitiesDesign, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user experience across … reliability best practices.Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time.Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services.Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

maintaining quality and security. Familiarity with MCP (Model Context Protocol), Agent Skills and designing agentic systems that integrate models with tools and enterprise data via structured interfaces is a plus. Job Responsibilities Design, develop, and deploy GenAI and Agentic AI solutions that improve automation, decision-making, and user … practices. Develop prompt strategies and prompt engineering assets (templates, routing, guardrails), and implement automated evaluation to improve quality over time. Build and maintain data pipelines and processing workflows required for ML/GenAI use cases using cloud services. Apply MLOps practices across the lifecycle: experimentation, versioning, CI/ ...

Xcede requires a Data Modelling Specialist/Senior Python Developer to join a Glasgow-based data governance team. You will design asset models, implement Python-based data modelling solutions and collaborate across risk, compliance and architecture functions. The role emphasizes hands-on development with … Collibra, Pydantic, FastAPI and APIs, alongside SQL and data pipelines for regulatory and metadata management in financial services. #J-18808-Ljbffr ...

Methods Business and Digital Technology is seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines … manage distributed big data frameworks. Location: onsite in Glasgow (3 days per week). You will design, develop and maintain data pipelines, write high-performance SQL, build backend data processing applications in #J-18808-Ljbffr ...

JPMorganChase in the United Kingdom is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and architectures within the Compute Infrastructure Platforms team. You will collaborate with agile teams to deliver secure, reliable data solutions that power the firm … analytics and decisions. You will own end-to-end data lifecycle, from ingestion to access, implement backups and archiving, and champion data quality and security. #J-18808-Ljbffr ...

JPMorganChase is seeking a Data Engineer in the Corporate Technology team to build and deliver scalable data pipelines and analytics solutions that power AI initiatives across the firm. You will maintain critical data architectures, collaborate with global teams, and drive improvements in data ...

ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and securityUnderstanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage … within team practicesHands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environmentPreferred qualifications, capabilities, and skillsExperience leading engineering teams within a large, complex organizationFamiliarity with modern cloud technologies and deployment practicesExperience ...

critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within … team practices Hands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environment Preferred qualifications, capabilities, and skills Experience leading engineering teams within a large, complex organization Familiarity with modern cloud technologies ...

critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within … team practices Hands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environment Preferred Qualifications, Capabilities, And Skills Experience leading engineering teams within a large, complex organization Familiarity with modern cloud technologies ...

JPMorgan Chase & Co. in the United Kingdom seeks a Lead Software Engineer to design and deliver AI and data engineering solutions at scale, with a focus on secure, reliable production systems. You will drive agentic AI initiatives, build data pipelines, and collaborate across teams to align ...

Barclays is seeking a Senior Data Scientist to transform complex data into actionable insights that drive strategic growth and innovation. You will leverage AI and ML to convert raw data into strategic intelligence that informs business decisions and competitive advantage. The role involves collaborating … with stakeholders across Barclays, developing scalable data pipelines, and deploying models to mitigate risk and identify opportunities. London, Glasgow or Northampton are potential bases. #J-18808-Ljbffr ...

build secure production code, review peers, and drive AI-assisted engineering practices to improve quality and delivery speed. The role emphasizes containerized deployments, data pipelines, and collaboration across teams to enforce secure coding standards and automated testing. #J-18808-Ljbffr ...

manage valuation, risk, and regulatory compliance.Job ResponsibilitiesDesign and develop Python applications within a large mono-repo using proprietary workflowsBuild graph-based data pipelines for valuation adjustment calculations and risk analysisImplement independent price verification and valuation adjustment workflows across asset classesDevelop consensus pricing solutions integrating with external market data … would be advantageous Experience with test-driven or test-heavy development, including unit, integration, and regression testingAbility to build and maintain multi-stage data processing pipelines (graph-based, batch, or streaming)Understanding of security best practices, including input validation and vulnerability remediationExperience with agentic AI and prompt engineering ...