Big Data Jobs in Scotland

23 of 23 Big Data Jobs in Scotland

Lead Software Engineer - AWS

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
of your career and guide a team to success at one of the world's leading financial institutions. As a Lead Software Engineer at JPMorgan Chase within the Client Data Exchange Team, you are hands-on and lead a team and manage day-to-day implementation activities by identifying and escalating issues and ensuring your team's work adheres … design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding … methods Proficient in all aspects of the Software Development Life Cycle, agile methodologies such as CI/CD, Application Resiliency, and Security Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data More ❯
Posted:

Senior Data Architect IRC265727

Edinburgh, United Kingdom
Hitachi Vantara Corporation
Description As a Data Solutions Architect you'll work closely with key stakeholders to map out their data/insights requirements and develop roadmaps and design architecture which you'll communicate effectively to the project teams, implementation teams and end-users - leading top quality solutions design and delivery. Requirements Strong experience as a Cloud data architect Skilled … one or more of the following architectural frameworks (TOGAF, ZACHMAN, FEAF) Cloud Experience: AWS or GCP preferred, particularly around migrations and cloud architecture Good technical knowledge and understanding of big data frameworks like Hadoop, Cloudera etc. Deep technical knowledge of database development, design and migration Experience of deployment in cloud using Terraform or CloudFormation Automation or Scripting experience … using languages such as Python & Bash etc. ETL and workflow management knowledge Experience of Agile methodologies Experience in the Financial Services Sector Data Engineering or Data Science experience Job responsibilities Interface with client project sponsors to gather, assess and interpret client needs and requirements. Define architecture vision, roadmaps and strategy while engaging relevant stakeholders to execute. Work across More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Lead Software Engineer -Python and Databricks

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Global Banking, Data, Analytics & Technology division, you will be an integral part of an agile team dedicated to advancing, creating, and deploying high-quality technology products, prioritizing security, stability, and scalability. Your … in one or more technical disciplines (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Ability to tackle design and functionality problems independently with little to no oversight Experience performing data analytics on AWS platforms Experience in writing efficient SQL's, implementing complex ETL transformations on big data platform. Experience in a Big Data technologies (Spark … Impala, Hive, Redshift, Kafka, etc.) Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues Experience with Databricks, Snowflake, Iceberg are required Preferred qualifications, capabilities, and skills Experience in application and data design disciplines with an emphasis on real-time processing and delivery e.g. Kafka is preferable Understanding of the More ❯
Posted:

Software Data Engineer (All Levels)

Easter Howgate, Midlothian, United Kingdom
Hybrid / WFH Options
Leonardo UK Ltd
Job Description: Your Impact As a Software Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the data operations infrastructure, manage and optimise performance, reliability, and scalability of the system to meeting growing demands on ingestion and processing pipelines. To … succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. Key areas of responsibility. Orchestration ingestion and storage of raw data into structured or unstructured solutions. Design, Develop, Deploy and Support data infrastructure … pipelines and architecture. Implement reliable, scalable, and tested solutions to automate data ingestion. Development of systems to manage batch processing and real-time streaming of data Evaluate business needs and objectives. Facilitate pipelines, which prepare data for prescriptive and predictive modelling. Working with domain teams to scale the processing of data. Combine raw information from different sources. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Data Engineer

Edinburgh, Midlothian, Scotland, United Kingdom
Hybrid / WFH Options
Motability Operations
Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯
Employment Type: Permanent, Part Time, Work From Home
Posted:

Senior Lead Software Engineer

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
experience in building and designing large-scale global software solutions. In-depth knowledge and experience in Python/Java and/or Databricks (AWS/Azure). Experience in Data Engineering, working with big data, data warehouses, and understanding data modelling; Data Mesh Architecture and building applications using Data Mesh Architecture. Familiarity with More ❯
Posted:

Python & UI Lead Software Engineer

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Firm wide Planning and Analysis Data Platform Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable … technologies Adds to team culture of diversity, equity, inclusion, and respect Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience in Data Management, Data Integration, Data Quality, Data Monitoring and Analytics experience. Experience leading teams of technologists and managing global stakeholders Experience in data engineering with proficiency … in Python and PySpark. Experience with building Cloud native applications using cloud platforms such as AWS, Azure, GCP and experience in leveraging cloud services for data storage, processing and analytics. Hands-on experience in data integration and handling projects that involves processing huge volume of data for reporting models. Hands-on experience in database system (both SQL More ❯
Posted:

Software Engineer II - AWS

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
your role and advance your career — and we have the perfect software engineering opportunity for you. As a Software Engineer III at JPMorgan Chase within the Corporate Sector Reference Data team, you will be instrumental in an agile setting, utilizing your expertise to design and develop cutting-edge technology products that emphasize security, stability, and scalability. Your role involves … design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding … or certification on Python concepts and expanding applied experience Hands-on practical experience in system design, application development, testing, and operational stability Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data More ❯
Posted:

2026 Software Engineer Program - Full-Time - Glasgow ( February Start)

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
new skills, and create positive change for the communities we serve. We value your unique skills and innovative ideas within our supportive and diverse technology organization. Ready to tackle big challenges with a global technology team? We're eager to meet you. ABOUT THE PROGRAM As a Software Engineer in the Software Engineer Program (SEP) at JPMorganChase, you will … as nonfunctional requirements to develop secure, stable software against a defined architecture Apply automation to reduce manual toil in the Software Development Life Cycle Gather, analyze, and synthesize basic data sets to troubleshoot technical issues and generate insights for continuous improvements. Breaks down routine technical tasks to troubleshoot and solve issues Work and share ideas, information and innovation with … collaborative teams to achieve organizational goals, with a commitment to fostering an inclusive and innovative culture. Foundational knowledge of programming languages (e.g., React, Python, JavaScript, Java, C++, C#), databases, data structures and algorithms Understanding of software skills including business analysis, development, maintenance, and software improvement. Proficiency in developmental toolsets Basic knowledge of industry-wide technology trends and best practices More ❯
Posted:

Sr. Applied Scientist, Last Mile Science

Edinburgh, United Kingdom
Amazon
Mile Science Are you passionate about solving complex logistics challenges that directly impact millions of customers? Our Logistics Analytics team is at the forefront of revolutionizing delivery experiences through data-driven solutions and innovative technology. As a Senior Applied Scientist, you will join a team dedicated to optimizing our delivery network, ensuring customers receive their packages reliably and efficiently. … drive impactful projects, implement advanced scheduling solutions, and develop scalable processes. In this role, you will have immediate ownership of business-critical challenges and the opportunity to make strategic, data-driven decisions that shape the future of last-mile delivery. Your work will directly influence customer experience and operational excellence. The ideal candidate will possess both research science capabilities … comfort with ambiguity. This role offers the opportunity to make a significant impact on one of the world's most sophisticated logistics networks while working with pioneering technology and data science applications. About the team Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

AI/ML Python Software Engineer III

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
and employing sophisticated algorithms to design, evaluate, and implement AI/ML applications or models to resolve these issues. You will be required to leverage the company's extensive data assets from both internal and external sources using tools like Python, Spark, and AWS. Additionally, your role will encompass extracting business insights from technical results and effectively communicating them … in AI domain, from Pattern matching, Chatbot implementation, and using GenAI. Proactively develop an understanding of key business problems and processes. Execute tasks throughout the model development process, including data wrangling/analysis, model training, testing, and selection. Generate structured and meaningful insights from data analysis and modelling exercises and present them in an appropriate format according to … the audience. Collaborate with other data scientists and machine learning engineers to deploy machine learning solutions. Conduct ad-hoc and periodic analysis as required by business stakeholders, the model risk function, and other groups. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience. Experience in statistical inference and experimental design (such More ❯
Posted:

Cloud Software Engineer

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets to identify cost saving opportunities for the firm. Develop an optimization and recommendation engine to enhance cost efficiency within the Cloud Financial Management organization. Build and maintain pipelines … for cost optimization, ensuring efficient data flow and processing. Write and analyze Splunk queries to interpret AWS CloudTrail logs, ensuring robust monitoring and security. Monitor and optimize the performance and scalability of cloud infrastructure. Contributes to software engineering communities of practice and events that explore new and emerging technologies Adds to team culture of diversity, equity, inclusion, and respect … Required qualifications, capabilities, and skills Proficiency in Python and SQL, with the ability to write efficient and scalable code for data processing and analysis. Exposure to Data Lake or Big Data technologies, with familiarity in working with large-scale data storage solutions. Strong knowledge of AWS, including the ability to design, implement, and manage cloud More ❯
Posted:

Applied Science Manager, Traffic Quality ML

Edinburgh, United Kingdom
Amazon
trust and saves them hundreds of millions of dollars of wasted spend. We are looking for a dynamic, innovative and accomplished applied sciences manager to lead machine learning and data science for the Advertising Traffic Quality vertical. Are you excited by the prospect of analyzing terabytes of data and leveraging state-of-the-art data science and … end business problems/metrics and directly impact the profitability of the company? As an applied sciences manager for Traffic Quality, you will lead a team of applied scientists, data scientists and engineers to deliver to conceptualize and build algorithms that efficiently detect and filter invalid traffic. You will be the single-threaded owner of the algorithms that go … on state-of-the-art modeling techniques, as well as generating insights that fuel critical investments. You will also lead an engineering team that works on handling terabyte scale data and implementing features and algorithms that process billions of events per day. You will interface with product managers and operations teams to bring key advertising initiatives to customers. Your More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Python Developer

Glasgow, Scotland, United Kingdom
Okta Resourcing
This is an exceptional new position for a talented Python Developer with a global Data Analytics company who have developed an independent platform which provides both management and measurement of converged TV campaigns. This is a key position with impressive potential for growth and impact, where you will own the full development lifecycle from initial idea/design through … to delivery. The person in this role will work daily with the most advanced technologies in software development, high scalability, and big data and will need exceptional Software Engineering skills. You’ll be asked to: • Set the technical standard for your team. • Be a part of and own the full development lifecycle from initial idea/design through … to delivery • Work with a team of extremely talented software engineers and data scientists in a fast-paced and engaging environment • Interact with all areas of the business, from sales to client services, to ensure the highest quality product will be delivered You should have experience of: • Developing complex software with end-to-end ownership • Python or similar (Ruby More ❯
Posted:

Applied Scientist, Personalization

Edinburgh, United Kingdom
Amazon
of world-class engineers and scientists across the Edinburgh offices and wider organization. You will lead the design of machine learning models that scale to very large quantities of data, and serve high-scale low-latency recommendations to all customers worldwide. You will embody scientific rigor, designing and executing experiments to demonstrate the technical efficacy and business value of … technical skills. If you are selected, you have the opportunity to make a difference to our business by designing and building state of the art machine learning systems on big data, leveraging Amazon's vast computing resources (AWS), working on exciting and challenging projects, and delivering meaningful results to customers world-wide. Key job responsibilities - Develop machine learning … patents or publications at top-tier peer-reviewed conferences or journals - Experience programming in Java, C++, Python or related language - Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing - Experience in building machine learning models for business application PREFERRED QUALIFICATIONS - Experience using Unix/ More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Senior Software Developer (12 month Fixed Term Contract), Global Operational Excellence

Edinburgh, United Kingdom
Amazon
the customers in operations and within the team, while owning deliverables end-to-end is expected. Critical to the success of this role is your ability to work with big data, contribute to the building of solutions both in terms of back- & frontend, develop insightful analysis, communicate findings in a clear and compelling way and work effectively as … managers and partner with Operations, Finance, Technology, Change Management and Customer Experience teams in understanding the business requirements and implementing solutions to support analytics and reports. • Conduct ad hoc data analysis and data quality investigations. • Implement training and documentation solutions that enables stakeholders to get the most out of our tools. • Develop and support the analytical technologies that … success. We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our candidates. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Full Stack Software Engineer III - Cross Risk Calculations

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
code optimization and refactoring to enhance scalability and performance Advanced understanding of agile methodologies, including CI/CD, application resiliency, and security Preferred Qualifications, Capabilities, and Skills: Proficiency in big data technologies such as Hadoop, Spark, or Kafka for handling large-scale data processing Familiar using tools like GitHub Copilot or Codeium Knowledge or practical experience with More ❯
Posted:

Java Backend Lead Software Engineer

Glasgow, Scotland, United Kingdom
J.P. MORGAN-1
artificial intelligence, machine learning, mobile, etc.) In-depth knowledge of the financial services industry and their IT systems Practical cloud native experience Preferred qualifications, capabilities, and skills Knowledge in Big Data development and software design Understanding of Risk Management and Credit Risk About Us J.P. Morgan is a global leader in financial services, providing strategic advice and products More ❯
Posted:

Cloud Operations Engineer - Trainee

Glasgow, United Kingdom
e-Careers Limited
a career in Cloud Computing. Increased earning potential and job security. Flexible working opportunities within the industry. A platform to enter other career paths including Cyber Security, Artificial Intelligence, Big Data, Machine Learning, Cloud Security, Data Analytics, Networking, and DevOps. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Cloud Computing Engineer - Trainee

Dundee, Angus, United Kingdom
e-Careers Limited
for a career in Cloud Computing. Increased earning potential and job security. Flexible working opportunities within the industry. Opportunity to enter other career paths including Cyber Security, Artificial Intelligence, Big Data, Machine Learning, Cloud Security, Data Analytics, Networking, and DevOps. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Cloud Computing Engineer - Trainee

Edinburgh, United Kingdom
e-Careers Limited
for a career in Cloud Computing. Increased earning potential and job security. Flexible working opportunities within the industry. Platform to enter other career paths including Cyber Security, Artificial Intelligence, Big Data, Machine Learning, Cloud Security, Data Analytics, Networking, and DevOps. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Cloud Operations Engineer - Trainee

Edinburgh, United Kingdom
e-Careers Limited
for a career in Cloud Computing. Increased earning potential and job security. Flexible working opportunities within the industry. Platform to enter other career paths including Cyber Security, Artificial Intelligence, Big Data, Machine Learning, Cloud Security, Data Analytics, Networking, and DevOps. More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Geospatial Consultant

Edinburgh, United Kingdom
Hybrid / WFH Options
Stantec Consulting International Ltd
transformation across Stantec and our clients within the Water sector. You will be part of a customer- and user-focused team, championing new digital workflows and integrating technology and data into our services and solutions. As a Geospatial Consultant within our team, you will play a pivotal role in helping clients make smarter, data-driven decisions by leveraging … of location-based data. You will be involved in projects that look to develop and apply our range of digital offerings across a variety of projects - whether this be data visualisation, multi-criteria analysis, automation and efficiency, or best practice data management. You will drive insights from big data to enable proactive management of assets and … client-facing work. You will have a strong proficiency with GIS platforms such as Esri ArcGIS Suite, QGIS, ArcGIS Online or ArcGIS Enterprise. You will have experience in geospatial data processing and data transformation using tools like Python, SQL, ModelBuilder or FME. You will be aware of data management and best practices and demonstrate an innovative and More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Big Data
Scotland
25th Percentile
£25,000
Median
£25,625
75th Percentile
£70,000