1 to 25 of 26 Data Pipeline Jobs in Scotland

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts ...

Role: Snowflake Architect Location: Basildon, UK/Dublin, Ireland Work from Client office 5 days weekly Responsibilities: -Design, develop, and maintain robust data pipelines and ETL processes using Snowflake on AWS. -Implement data warehousing solutions, ensuring efficient storage, retrieval, and transformation of large datasets. -Collaborate with … maintain data integration solutions, ensuring seamless data flow between various sources and Snowflake. -Monitor, troubleshoot, and resolve data pipeline issues, ensuring data quality and integrity. -Stay up-to-date with the latest trends and best practices in data engineering ...

DETAILS JOB BAND: D CONTRACT TYPE: 10 Month Attachment/Fixed-term, Full-time DEPARTMENT: Product Group - Data Platform LOCATION: London, hybrid PROPOSED SALARY RANGE: Up to £75,000 depending on relevant skills, knowledge and experience. The expected salary range for this role reflects internal benchmarking and external … like more information on BBC Extend, please visit the BBC Extend webpage. (EXTEND code: EX2324). PURPOSE OF THE ROLE The BBC Data Platform underpins how data flows across the organisation. It powers our analytics, personalisation, and insights for products such as iPlayer, Sounds, and News. ...

Senior Data Engineer Contract Location: Glasgow (Hybrid 3 days per week on-site) Duration: 6 Months Day Rate: Competitive Sector: Financial Services Overview: Were looking for a highly skilled Senior Data Engineer to join a leading financial services organisation on a 6-month contract. Youll … working on a hybrid basis from their Glasgow office (3 days per week on-site), contributing to key data initiatives that support risk and analytics functions across the business. Key Responsibilities: Design, build, and optimise scalable data pipelines and ETL solutions. Work with complex datasets ...

Data Science & AI Graduate Scheme (Edinburgh) Your AI era starts now At Lloyds Banking Group, data isnt just something we store in the cloud. Its the juice that keeps ideas flowing, decisions sharper, and progress unstoppable. Our Chief Data & Analytics Office has one mission … weave data, analytics and AI into every decision we make. The goal? Simple. Every choice, everywhere, driven by data. As a Data Science & AI Graduate, you wont be on the sidelines watching the algorithms run the show. Youll be training models, crafting algorithms, deploying scalable solutions ...

Data Science and AI Industrial Placement (Edinburgh) Your AI era starts now At Lloyds Banking Group, data isnt just something we store in the cloud. Its the juice that keeps ideas flowing, decisions sharper, and progress unstoppable. Our Chief Data & Analytics Office … mission: weave data, analytics and AI into every decision we make. The goal? Simple. Every choice, everywhere, driven by data. On our Data Science & AI Industrial Placement, you wont be on the sidelines watching the algorithms run the show. Youll be training models, crafting algorithms, deploying ...

experts to design and deliver secure, scalable, and resilient systems for enterprise and government clients. We work across multiple domains - from data privacy and cloud security to AI assurance - ensuring that every solution meets the highest standards of compliance, reliability, and trust. We are now inviting a Security … Architect to join our UK-based team, contributing to large-scale digital transformation programmes that handle sensitive personal and medical data, integrating AI responsibly and securely across hybrid environments. IF YOU ARE An experienced Security Architect or Security Lead with 8+ years of experience designing secure systems ...

Machine Learning Ops Engineer, you will play a key role in building and implementing features that empower lodging customers to make data-driven pricing decisions. Some of these features will use simple heuristic data, while others will leverage advanced machine learning techniques to optimize revenue strategies. … development to production. You'll be instrumental in establishing robust MLOps practices and rigorous testing processes across the entire ML lifecycle. From structuring data pipelines to implementing and validating ML models, you'll own the end-to-end development of our revenue management application—ensuring hotels have ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. Position: Senior Data/Analytics Engineer Type: Hourly contractor Compensation: $35–$70/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design, build … modeling and semantic best practices. Integrate DBT workflows with Snowflake Cortex CLI to enable feature engineering pipelines, model training and inference tasks, automated pipeline orchestration, and monitoring and evaluation of Cortex-driven ML models. Establish best practices for DBT–Cortex architecture and usage patterns. Collaborate with data ...

FactSet creates flexible, open data and software solutions for over 200,000 investment professionals worldwide, providing instant access to financial data and analytics that investors use to make crucial decisions. At FactSet, our values are the foundation of everything we do. They express … automation within inhouse, and 3rd party licensed software service eco-systems. Implement agents within frameworks to automate various repetitive manual tasks and summarize data out of corporate tools in concise human readable form. Design insight generation techniques that summarize key highlights from large complex datasets and support natural ...

Integrations Developer - Aberdeen, Hybrid Are you a problem-solver who enjoys working with data and modern .Net technologies? Were looking for an Integrations Developer in Aberdeento join a forward-thinking company and help shape the future of a global SaaS platform used across the oil, gas, and renewables … days a week into the office Pension scheme Career progression opportunities City centre parking What you will be doing: Developing and maintaining data integrations between internal and client systems. Building reliable ETL processes to manage and transform large data sets. Working closely with clients and internal ...

Integrations Developer - Aberdeen, Hybrid Are you a problem-solver who enjoys working with data and modern .Net technologies? We’re looking for an Integrations Developer in Aberdeen to join a forward-thinking company and help shape the future of a global SaaS platform used across … days a week into the office Pension scheme Career progression opportunities City centre parking What you will be doing: Developing and maintaining data integrations between internal and client systems. Building reliable ETL processes to manage and transform large data sets. Working closely with clients and internal ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible. Coordinate teams and set best practices and standards when it comes to data eng... ...

role: Joining the Reporting product line, you would work as a member of a highly focused team. This team specialises in Java-based data engineering, designing and delivering large-scale ETL workflows on a lake house platform. You'll be working with modern big data technologies … move, transform, and optimise data for high-performance analytics and regulatory reporting. The environment encourages autonomy, problem-solving, and system-level thinking. If you're passionate about clean, well-tested, performant code and enjoy working on complex data pipelines at scale, you'll thrive here. Tech ...

complex technical problems under pressure, implement solutions that are scalable, while managing multiple customer groups. What You Will Do Support large-scale enterprise data solutions with a focus on high availability, low latency and scalability. Provide documentation and automation capabilities for Disaster Recovery as part of application deployment. … source code repository (GitHub). Demonstrable cross-functional knowledge with systems, storage, networking, security and databases Experience in designing and building production data pipelines from data ingestion to consumption within a hybrid big data architecture, using Cloud Native GCP, Java, Python, Scala, SQL etc. ...

complex technical problems under pressure, implement solutions that are scalable, while managing multiple customer groups. What You Will Do Support large-scale enterprise data solutions with a focus on high availability, low latency and scalability. Provide documentation and automation capabilities for Disaster Recovery as part of application deployment. … source code repository (GitHub). Demonstrable cross-functional knowledge with systems, storage, networking, security and databases Experience in designing and building production data pipelines from data ingestion to consumption within a hybrid big data architecture, using Cloud Native GCP, Java, Python, Scala, SQL etc. ...

across commercial battery systems. Working at the intersection of edge devices, cloud platforms, IoT, and electrical engineering, you'll turn high-frequency sensor data into actionable intelligence — helping customers save money, reduce carbon, and improve grid resilience. This is hands-on, mission-critical engineering with real-world impact. … Responsibilities of the Software Engineer: Build scalable backend services using cloud-native, microservices architectures to process real-time data from BESS, EV chargers, solar, wind, and IoT sensors Develop optimisation algorithms for peak shaving, demand response, automated load shedding, and (where appropriate) AI-driven forecasting and anomaly detection ...

across commercial battery systems. Working at the intersection of edge devices, cloud platforms, IoT, and electrical engineering, you’ll turn high-frequency sensor data into actionable intelligence — helping customers save money, reduce carbon, and improve grid resilience. This is hands-on, mission-critical engineering with real-world impact. … Responsibilities of the Software Engineer: Build scalable backend services using cloud-native, microservices architectures to process real-time data from BESS, EV chargers, solar, wind, and IoT sensors Develop optimisation algorithms for peak shaving, demand response, automated load shedding, and (where appropriate) AI-driven forecasting and anomaly detection ...

About The Role Job level: 10 Were looking for a Lead Data Engineer to join our Data Engineering and Analytics practice. In this role, you will: Lead the design, development, management and optimisation of data pipelines to ensure efficient data flows, recognising … sharing opportunities to reuse data flows where possible click apply for full job details ...

Ship & run backend systems that turn messy signals into truth Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs … data warehouses, AI products, and mission-critical decisions across the enterprise. As a Senior Backend Engineer, you will own core parts of our Scala + Python data and agent infrastructure. You will design, build, and scale existing and greenfield systems that keep our data ...

Ship & run backend systems that turn messy signals into truth Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs … data warehouses, AI products, and mission-critical decisions across the enterprise. As a Senior Backend Engineer, you will own core parts of our Scala + Python data and agent infrastructure. You will design, build, and scale existing and greenfield systems that keep our data ...

leading global investment bank working on business-critical regulatory reporting platforms. You'll help modernise legacy systems and build strategic, cloud-based data solutions used across the firm. You'll work in a collaborative Agile squad focused on Java services, Spark data pipelines, and cloud transformation … Regulatory teams. Key Responsibilities Build and enhance full-stack applications for regulatory and financial reporting Develop Java backend services and Spark-based data pipelines Modernise platforms to cloud-native architecture Work with large, complex datasets in an Agile environment Contribute to CI/CD, DevOps, and automated testing ...

leading global investment bank working on business-critical regulatory reporting platforms. You'll help modernise legacy systems and build strategic, cloud-based data solutions used across the firm. You'll work in a collaborative Agile squad focused on Java services, Spark data pipelines, and cloud transformation … Regulatory teams. Key Responsibilities Build and enhance full-stack applications for regulatory and financial reporting Develop Java backend services and Spark-based data pipelines Modernise platforms to cloud-native architecture Work with large, complex datasets in an Agile environment Contribute to CI/CD, DevOps, and automated testing ...