1 to 25 of 37 Big Data Jobs in Scotland

Compensation £60,000 - £80,000 Base + Performance Related Bonus + Benefits TL;DR Role: Senior level data engineer role Location: UK‐based, fast growing data and AI consultancy specialising in the energy sector Cloud: Strong AWS, Azure or GCP (multi‐cloud desirable, certs a plus) Consultancy/Energy Experience: Highly beneficial, not essential Visa Sponsorship: Not available … if you’re unsure, apply and let’s talk Diversity & Inclusion: We want a broad mix of people and perspectives Who We Are Hypercube Consulting is a rapidly scaling data‐and‐AI specialist focused on the energy sector. We pair deep domain know‐how with modern technology to help utilities, renewables and low‐carbon innovators unlock value from data. … Learn more about how we think on our founder’s blog at https://aesroka.susbtack.com Role purpose As a senior data engineer, you will truly understand a client’s requirements to build, test and deploy data solutions that help customers deliver more value from their data. This will be a senior role in the technical delivery teams More ❯

and motivated AI Full Stack Developer with a strong foundation in cybersecurity operations and artificial intelligence technologies. The ideal candidate will have deep technical expertise in AI/ML, data science, and programming, alongside a solid understanding of cyber threat detection and defensive operations frameworks. You will be instrumental in designing and implementing full-stack AI-driven solutions to … modern full-stack development tools and frameworks. · Collaborate with cybersecurity teams to build and enhance detection and mitigation systems based on frameworks like MITRE ATT&CK. · Develop and maintain data pipelines, APIs, dashboards, and visualization tools to support AI model insights. · Write clean, well-documented, and secure code using Python, C C#, or R. · Leverage libraries such as TensorFlow … and deploying AI services in cloud-native environments. · Familiarity with containerization (Docker, Kubernetes) and DevOps pipelines. · Exposure to security operations center (SOC) tools and SIEM platforms. · Experience working with big data platforms such as Spark, Hadoop, or Elastic Stack. #J-18808-Ljbffr More ❯

and to help clients realize the objectives they desire. BlackRock manages ~$10+ trillion in assets on behalf of investors worldwide. As such, there is a rich problem space for data scientists and engineers across all areas of the business including investments, sales, marketing, operations, product, UX, etc. and the potential to have large scale impact. In 2018 BlackRock accelerated … innovation and technology again with additional investment in artificial intelligence and data science and all the potential they represent. The AI Labs was formed to act as a central hub with a firm-wide remit to solve strategic business challenges for the firm by bringing to bear our expertise in machine learning, artificial intelligence, data science and optimization. … with a history of demonstrating machine learning at BlackRock to create alpha, the goal was to apply these same techniques throughout the business. The team has grown to 75+ data scientists and engineers. Working collaboratively, the team is multi-disciplinary with the following skills and capabilities: machine learning, optimization, statistical modeling, signal detection, natural language processing, data visualization More ❯

Join to apply for the Senior Data Scientist in Agencies role at Bank of England 2 weeks ago Be among the first 25 applicants Join to apply for the Senior Data Scientist in Agencies role at Bank of England Get AI-powered advice on this job and more exclusive features. Monetary Analysis directorate The Monetary Analysis directorate provides … agents organise visits for our policymakers across the UK so they can hear the views of businesses and communities first-hand. Key Responsibilities Line management of an Analyst in Data Science and three Senior Research Assistants. Work with the Technical Agent for Data Strategy to implement the Data Analytics/AI and Technology strategy for the Agency … Network. Lead advanced research and experimentation in AI, including Machine Learning and Generative AI, and statistical modelling Develop and implement complex data science solutions, ensuring they deliver measurable business improvements. This will include the development of AI solutions for the analysis of Agency intelligence working alongside Advanced Analytics. Work collaboratively with Agents to implement new analytical tools, including scoping More ❯

Join to apply for the Lead Data Engineer role at Motability Operations Ltd 4 days ago Be among the first 25 applicants Join to apply for the Lead Data Engineer role at Motability Operations Ltd Continuing Defleet’s data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking … for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem … of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. About You We are looking for a skilled Lead Data Engineer who: Personal Attributes Self-starter with initiative and enthusiasm More ❯

of your career and guide a team to success at one of the world's leading financial institutions. As a Lead Software Engineer at JPMorgan Chase within the Client Data Exchange Team, you are hands-on and lead a team and manage day-to-day implementation activities by identifying and escalating issues and ensuring your team's work adheres … design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding … methods Proficient in all aspects of the Software Development Life Cycle, agile methodologies such as CI/CD, Application Resiliency, and Security Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data More ❯

Join to apply for the Data Architect (Data & Analytics) role at GE Vernova . Get AI-powered advice on this job and more exclusive features. Job Description Summary GE Vernova is the leading software provider for the operations of national and regional electricity grids worldwide. Our software solutions support electricity markets, enable grid and network planning, and facilitate … real-time electricity grid operations. Data & AI are central to our ongoing digital transformation, shaping the future of grid operation, clean energy initiatives, and AI-driven customer experiences. Job Description As a Data Architect (Data and Analytics) specializing in electric utilities, you will define and implement solutions leveraging the GridOS Data Fabric, the grid data management layer of GE Vernova’s GridOS Platform. You will collaborate with clients to understand their needs, translate them into technical requirements, and design scalable, efficient data architectures. Your role involves working with cross-functional teams to ensure seamless data flow, enhancing decision-making and operational efficiency. Key Responsibilities Solution Design and Architecture: Work with utility clients More ❯

Description As a Data Solutions Architect you'll work closely with key stakeholders to map out their data/insights requirements and develop roadmaps and design architecture which you'll communicate effectively to the project teams, implementation teams and end-users - leading top quality solutions design and delivery. Requirements Strong experience as a Cloud data architect Skilled … one or more of the following architectural frameworks (TOGAF, ZACHMAN, FEAF) Cloud Experience: AWS or GCP preferred, particularly around migrations and cloud architecture Good technical knowledge and understanding of big data frameworks like Hadoop, Cloudera etc. Deep technical knowledge of database development, design and migration Experience of deployment in cloud using Terraform or CloudFormation Automation or Scripting experience … using languages such as Python & Bash etc. ETL and workflow management knowledge Experience of Agile methodologies Experience in the Financial Services Sector Data Engineering or Data Science experience Job responsibilities Interface with client project sponsors to gather, assess and interpret client needs and requirements. Define architecture vision, roadmaps and strategy while engaging relevant stakeholders to execute. Work across More ❯

team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Software Engineer at JPMorgan Chase within the Global Banking, Data, Analytics & Technology division, you will be an integral part of an agile team dedicated to advancing, creating, and deploying high-quality technology products, prioritizing security, stability, and scalability. Your … in one or more technical disciplines (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Ability to tackle design and functionality problems independently with little to no oversight Experience performing data analytics on AWS platforms Experience in writing efficient SQL's, implementing complex ETL transformations on big data platform. Experience in a Big Data technologies (Spark … Impala, Hive, Redshift, Kafka, etc.) Experience in data quality testing; adept at writing test cases and scripts, presenting and resolving data issues Experience with Databricks, Snowflake, Iceberg are required Preferred qualifications, capabilities, and skills Experience in application and data design disciplines with an emphasis on real-time processing and delivery e.g. Kafka is preferable Understanding of the More ❯

applications (e.g., microservices, APIs), setting technical direction and ensuring code quality Solve intricate back-end architectural and performance challenges, identifying and implementing innovative solutions that enhance system efficiency and data integrity Champion Agile methodologies, leading ceremonies and driving best practices within development teams Manage project software aspects, ensuring development efforts align with overall project objectives and client needs Define … members. Requirements Professional experience in Java development Strong proficiency in Java 8+ (ideally Java 11/17+) Extensive experience with Spring Framework (Spring Boot, Spring MVC, Spring Security, Spring Data JPA).Solid understanding of relational databases (e.g., PostgreSQL, MySQL, Oracle) and ORM frameworks (e.g., Hibernate, JPA) Experience with RESTful API design and development Proficiency with version control systems, particularly … AI concepts, libraries, or frameworks (e.g., TensorFlow, PyTorch, scikit-learn, Hugging Face Transformers, Keras, etc.) Familiarity with Python for AI/ML development is a significant advantage. Experience with data engineering pipelines or big data technologies (e.g., Kafka, Spark) is a plus. The recruitment process you can expect for this role is an initial call with your More ❯

Job Description: Your Impact As a Software Data Engineer, you will design, develop, deploy, and maintain data architecture which employs various methods to transform raw data into processed data. You will own the data operations infrastructure, manage and optimise performance, reliability, and scalability of the system to meeting growing demands on ingestion and processing pipelines. To … succeed in this data engineering position, you should have strong problem-solving skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages. Key areas of responsibility. Orchestration ingestion and storage of raw data into structured or unstructured solutions. Design, Develop, Deploy and Support data infrastructure … pipelines and architecture. Implement reliable, scalable, and tested solutions to automate data ingestion. Development of systems to manage batch processing and real-time streaming of data Evaluate business needs and objectives. Facilitate pipelines, which prepare data for prescriptive and predictive modelling. Working with domain teams to scale the processing of data. Combine raw information from different sources. More ❯

Description Continuing Defleet's data led journey and recognising the importance the Data & Analytics team performs in this regard, we are looking for a skilled Lead Data Engineer who is passionate about exploiting data and searching for improvements in our existing processes and technology; can work closely with business teams; drives solutions with a focused mentality … on business value and can lead, influence and drive collaboration across teams and stakeholders. It will focus on expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and … AWS tech stack. Qualifications We are looking for a skilled Lead Data Engineer who: Personal Attributes: Self-starter with initiative and enthusiasm Thrives at solving problems with minimal or no direction and developing their own solution Looks at the existing tech landscape and identifies improvements without prompting Desire and ability to continuously learn new technologies and practices and learn More ❯

an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Global Banking, Data, Analytics & Technology division,, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. … design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding … in one or more technical disciplines (e.g., cloud, artificial intelligence, machine learning, mobile, etc.) Ability to tackle design and functionality problems independently with little to no oversight Experience performing data analytics on AWS platforms Experience in writing efficient SQL's, implementing complex ETL transformations on big data platform. Experience in a Big Data technologies (Spark More ❯

experience in building and designing large-scale global software solutions. In-depth knowledge and experience in Python/Java and/or Databricks (AWS/Azure). Experience in Data Engineering, working with big data, data warehouses, and understanding data modelling; Data Mesh Architecture and building applications using Data Mesh Architecture. Familiarity with More ❯

applications (e.g., microservices, APIs), setting technical direction and ensuring code quality. Solve intricate back-end architectural and performance challenges, identifying and implementing innovative solutions that enhance system efficiency and data integrity. Champion Agile methodologies, leading ceremonies and driving best practices within development teams. Manage project software aspects, ensuring development efforts align with overall project objectives and client needs. Define … candidate Professional experience in Java development. Strong proficiency in Java 8+ (ideally Java 11/17+). Extensive experience with Spring Framework (Spring Boot, Spring MVC, Spring Security, Spring Data JPA). Solid understanding of relational databases (e.g., PostgreSQL, MySQL, Oracle) and ORM frameworks (e.g., Hibernate, JPA). Experience with RESTful API design and development. Proficiency with version control … concepts, libraries, or frameworks (e.g., TensorFlow, PyTorch, scikit-learn, Hugging Face Transformers, Keras, etc.). Familiarity with Python for AI/ML development is a significant advantage. Experience with data engineering pipelines or big data technologies (e.g., Kafka, Spark) is a plus. The recruitment process you can expect for this role is an initial call with your More ❯

We are seeking a highly motivated and experienced Data Scientist to join our team. You will contribute to designing, building, and maintaining our data analytics systems and machine learning models, and will spearhead data science projects for internal users and our customers. Our hardworking, creative, and passionate engineers are working at the forefront in the following areas … Efficient use of big data Understanding the Internet of Things Data analytics for internal and external users What you will be doing Work with large and complex datasets to identify trends, patterns, and insights Contribute to data analytics and machine learning projects Develop and implement machine learning models and algorithms Take projects from research stage through … to production Work with data storage systems, including MariaDB databases and data warehouses Optimize data pipelines for performance and scalability, ensuring efficient use of computational resources Continuously improve data pipeline processes and procedures Collaborate with cross-functional teams to understand business needs and identify opportunities for data-driven solutions Analyze data and present results More ❯

and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Firm wide Planning and Analysis Data Platform Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable … technologies Adds to team culture of diversity, equity, inclusion, and respect Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience in Data Management, Data Integration, Data Quality, Data Monitoring and Analytics experience. Experience leading teams of technologists and managing global stakeholders Experience in data engineering with proficiency … in Python and PySpark. Experience with building Cloud native applications using cloud platforms such as AWS, Azure, GCP and experience in leveraging cloud services for data storage, processing and analytics. Hands-on experience in data integration and handling projects that involves processing huge volume of data for reporting models. Hands-on experience in database system (both SQL More ❯

your role and advance your career — and we have the perfect software engineering opportunity for you. As a Software Engineer III at JPMorgan Chase within the Corporate Sector Reference Data team, you will be instrumental in an agile setting, utilizing your expertise to design and develop cutting-edge technology products that emphasize security, stability, and scalability. Your role involves … design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding … or certification on Python concepts and expanding applied experience Hands-on practical experience in system design, application development, testing, and operational stability Cloud implementation experience with AWS including: AWS Data Services: Glue ETL (or) EMR, S3, Glue Catalog, Athena, Lambda + Step Functions + Event Bridge, ECS Data De/Serialization: Parquet and JSON format AWS Data More ❯

new skills, and create positive change for the communities we serve. We value your unique skills and innovative ideas within our supportive and diverse technology organization. Ready to tackle big challenges with a global technology team? We're eager to meet you. ABOUT THE PROGRAM As a Software Engineer in the Software Engineer Program (SEP) at JPMorganChase, you will … as nonfunctional requirements to develop secure, stable software against a defined architecture Apply automation to reduce manual toil in the Software Development Life Cycle Gather, analyze, and synthesize basic data sets to troubleshoot technical issues and generate insights for continuous improvements. Breaks down routine technical tasks to troubleshoot and solve issues Work and share ideas, information and innovation with … collaborative teams to achieve organizational goals, with a commitment to fostering an inclusive and innovative culture. Foundational knowledge of programming languages (e.g., React, Python, JavaScript, Java, C++, C#), databases, data structures and algorithms Understanding of software skills including business analysis, development, maintenance, and software improvement. Proficiency in developmental toolsets Basic knowledge of industry-wide technology trends and best practices More ❯

Mile Science Are you passionate about solving complex logistics challenges that directly impact millions of customers? Our Logistics Analytics team is at the forefront of revolutionizing delivery experiences through data-driven solutions and innovative technology. As a Senior Applied Scientist, you will join a team dedicated to optimizing our delivery network, ensuring customers receive their packages reliably and efficiently. … drive impactful projects, implement advanced scheduling solutions, and develop scalable processes. In this role, you will have immediate ownership of business-critical challenges and the opportunity to make strategic, data-driven decisions that shape the future of last-mile delivery. Your work will directly influence customer experience and operational excellence. The ideal candidate will possess both research science capabilities … comfort with ambiguity. This role offers the opportunity to make a significant impact on one of the world's most sophisticated logistics networks while working with pioneering technology and data science applications. About the team Have you ever ordered a product on Amazon and when that box with the smile arrived you wondered how it got to you so More ❯

and employing sophisticated algorithms to design, evaluate, and implement AI/ML applications or models to resolve these issues. You will be required to leverage the company's extensive data assets from both internal and external sources using tools like Python, Spark, and AWS. Additionally, your role will encompass extracting business insights from technical results and effectively communicating them … in AI domain, from Pattern matching, Chatbot implementation, and using GenAI. Proactively develop an understanding of key business problems and processes. Execute tasks throughout the model development process, including data wrangling/analysis, model training, testing, and selection. Generate structured and meaningful insights from data analysis and modelling exercises and present them in an appropriate format according to … the audience. Collaborate with other data scientists and machine learning engineers to deploy machine learning solutions. Conduct ad-hoc and periodic analysis as required by business stakeholders, the model risk function, and other groups. Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience. Experience in statistical inference and experimental design (such More ❯

Job Title: Data Engineer Location: Edinburgh, UK About Us: Join one of the leading utilities companies in Edinburgh, driving innovation through data! We are looking for a skilled Data Engineer to support our data infrastructure and empower our teams with reliable and efficient data solutions. If you’re passionate about building robust data pipelines … and transforming raw data into valuable insights, we want you on our team! Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes. Collaborate with data analysts and stakeholders to understand data requirements. Ensure data integrity, security, and compliance with industry standards. Optimize data architectures for performance and scalability. Monitor and maintain … data systems to ensure high availability. Key Requirements: Proven experience as a Data Engineer or similar role. Proficiency in SQL, Python, or other data processing languages. Experience with cloud platforms (e.g., Azure, AWS, or Google Cloud). Knowledge of data warehousing concepts and big data technologies. Strong problem-solving skills and attention to detail. More ❯

Data and AI Architect Salary: £61-77K (plus up to 15% bonus & private healthcare cover) ScottishPowerHQ, Glasgow Permanent, Hybrid Help us create a better future, quicker Are you passionate about shaping the future of data and AI in the cloud? We're looking for a Data and AI Architect to lead the design and delivery of … advanced data platforms and intelligent solutions across Azure and AWS. Based in Glasgow, this role offers the chance to work on high-impact projects within the Iberdrola Group, with occasional travel across the organization. What you'll be doing In this position, you'll architect scalable, secure, and innovative systems that integrate seamlessly with cloud infrastructure. You'll design … applications, conduct proof of concepts to explore new possibilities, and ensure that best practices and governance are embedded in every solution. Collaboration is key-you'll work closely with data scientists, engineers, and business stakeholders to translate complex requirements into impactful outcomes. What you'll bring We're seeking someone with a proven track record in data architecture More ❯

for a successful and growing technology company, helping to build a large-scale video platform on the Amazon Web Services Cloud. The core product allows business users to capture data via integrated mobile services utilising video analytics and speech recognition to analyse and categorise information within the workflows of large field workforces (field engineers, field service, auditing, reporting, health … You are experienced with web API architecture e.g. REST APIs You have experience of working on SaaS products with Amazon Web Services (AWS), CloudFormation, Terraform You are familiar with big data and analytics, machine learning, computer vision and AI algorithms You're a collaborative problem solver You are degree educated in Computer Science or similar technical discipline Experience More ❯

design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets to identify cost saving opportunities for the firm. Develop an optimization and recommendation engine to enhance cost efficiency within the Cloud Financial Management organization. Build and maintain pipelines … for cost optimization, ensuring efficient data flow and processing. Write and analyze Splunk queries to interpret AWS CloudTrail logs, ensuring robust monitoring and security. Monitor and optimize the performance and scalability of cloud infrastructure. Contributes to software engineering communities of practice and events that explore new and emerging technologies Adds to team culture of diversity, equity, inclusion, and respect … Required qualifications, capabilities, and skills Proficiency in Python and SQL, with the ability to write efficient and scalable code for data processing and analysis. Exposure to Data Lake or Big Data technologies, with familiarity in working with large-scale data storage solutions. Strong knowledge of AWS, including the ability to design, implement, and manage cloud More ❯