24 of 24 Permanent Data Engineer Jobs in Scotland

Senior Data Engineer – Contract Location: Glasgow (Hybrid – 3 days per week on-site) Duration: 6 Months Day Rate: Competitive Sector: Financial Services Overview: We’re looking for a highly skilled Senior Data Engineer to join a leading financial services organisation on a 6-month contract. You’ll be working on a hybrid basis from their Glasgow … office (3 days per week on-site), contributing to key data initiatives that support risk and analytics functions across the business. Key Responsibilities: Design, build, and optimise scalable data pipelines and ETL solutions. Work with complex datasets to enable data-driven insights and reporting. Collaborate closely with data scientists, analysts, and business stakeholders to deliver robust … data solutions. Support the migration and modernisation of data infrastructure using cloud-based technologies. Skills & Experience: Strong proficiency in Python for data engineering and automation tasks. Hands-on experience with Databricks or Snowflake (experience in both is a plus). Proven track record in developing and maintaining high-quality data solutions within complex environments. Background in More ❯

Senior Data Engineer – Edinburgh £75K - £95K Salary: £65,000 – £85,000 Location : Edinburgh (Hybrid – 2 days per week in office) ECOM Recruitment are working with a growing digital consultancy that delivers data and technology solutions for some of the UK's best-known brands. We're looking for a Senior Data Engineer to join their … growing data team. You'll be working with a talented group of engineers to design and build modern, cloud-based data platforms and pipelines that make a real impact. This is a great opportunity to get hands-on with the latest tools and technologies within a business that truly values collaboration, innovation, and quality. The Role As a … senior member of the team, you'll be responsible for building and maintaining scalable data pipelines that drive insights and decision-making for clients in fast-moving industries including the gambling sector, so it's important you're comfortable working in that space. You'll work closely with other engineers, analysts, and client stakeholders to deliver reliable, automated, and More ❯

Role: Data Engineer Location: Glasgow (Hybrid, 3 days onsite) Contract: 06-12months with possible extensions (No Sponsorship Available ) Skills/Qualifications: · 4+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. · 3+ years hands-on experience with cloud services, especially Databricks, for building and … managing scalable data pipelines · 3+ years of proficiency in working with Snowflake or similar cloud-based data warehousing solutions · 3+ years of experience in data development and solutions in highly complex data environments with large data volumes. · Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices … work collaboratively in a fast-paced, dynamic environment. · Experience with code versioning tools (e.g., Git) · Knowledge of Linux operating systems · Familiarity with REST APIs and integration techniques · Familiarity with data visualization tools and libraries (e.g., Power BI) · Background in database administration or performance tuning · Familiarity with data orchestration tools, such as Apache Airflow · Previous exposure to big data More ❯

This role is for 12-month maternity cover About Smart Data Foundry Smart Data Foundry has a purpose to unlock the power of financial data as a force to improve people’s lives. What we do We enable the research ecosystem to flourish through the provision of research ready real financial data. We create data-driven … insights based on real financial data, that identify areas to inform policy change and enhance regulation. Role Purpose This role is for 12-month maternity cover The Data Operations Engineer provides first-line support to researchers, data scientists, and partners using our Trusted Research Environment (TRE). You will help users navigate data access, troubleshoot … issues, and ensure compliance with data governance requirements whilst supporting user requests daily. As part of our growing 30-person data sharing organisation, you will have opportunities to develop new skills and take on increasing responsibility as we expand. The role requires you to have or learn command line code skills as you work within University of Edinburgh More ❯

Data Engineer Remote (to +/- 2 hrs of UK Time Zone) Are you a skilled Data Engineer with a passion for financial markets? We're working with a pioneering tech-driven company building innovative financial data solutions. This is an exciting opportunity to join a collaborative and forward-thinking engineering team working on a … cutting-edge data platform for financial datasets. Youll help shape how complex market data is processed, structured, and made accessible for analytics, research, and insight generation. What youll be doing: Designing and maintaining data pipelines Working with time-series and structured/unstructured datasets Applying your industry know-how within financial data to ensure continual product … development Tech youll work with: Functional programming i.e. Ruby, Python, Elixir PostgreSQL OpenAPI integrations Various data streaming and processing tools Whats in it for you: Fully remote working Flexible hours Trust and ownership Chance to build the future of financial data platforms! Apply now to learn more. Bright Purple are an equal opportunities employer: we are proud to More ❯

About Synechron: Synechron is a leading digital transformation consulting firm, delivering innovative solutions across Financial Services, Insurance, and more. We empower organizations to harness the power of data, technology, and strategy to drive growth and efficiency. Role Overview: We are seeking a skilled Data Engineer to join our UK team. In this role, you will be responsible … for designing, developing, and maintaining scalable ETL data pipelines leveraging Python and DataBricks. You will collaborate with cross-functional teams to understand data requirements and ensure the delivery of reliable, high-quality data solutions that support our business objectives. Key Responsibilities: Collaborate with stakeholders and cross-functional teams to gather data requirements and translate them into … efficient ETL processes. Develop, test, and deploy end-to-end ETL pipelines extracting data from various sources, transforming it to meet business needs, and loading it into target systems. Take ownership of the full engineering lifecycle, including data extraction, cleansing, transformation, and loading, maintaining data accuracy and consistency. Manage and monitor data pipelines, implementing proper error More ❯

Senior Data Engineer - Azure & Databricks Lakehouse Glasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer Business No sponsorship/relocation provided sadly Our incredibly successful client, consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into a fully automated Azure … Enterprise Landing Zone + Databricks Lakehouse . They are building a modern data platform from the ground up using Lakeflow Declarative Pipelines , Unity Catalog , and Azure Data Factory , and this role sits right at the heart of that transformation. This is a rare opportunity to join early, influence architecture, and help define engineering standards, pipelines, curated layers and … and Customer Care. If you want to build a best-in-class Lakehouse from scratch-this is the one. What You'll Be Doing Lakehouse Engineering (Azure + Databricks) Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines , PySpark , and Spark SQL across a full Medallion Architecture (Bronze - Silver - Gold) . Implement ingestion patterns for files, APIs, SaaS platforms (e.g. More ❯

Senior Data Engineer - Azure & Databricks Lakehouse Glasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer Business A rapidly scaling UK consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into a fully automated Azure Enterprise Landing Zone + Databricks Lakehouse … . They are building a modern data platform from the ground up using Lakeflow Declarative Pipelines , Unity Catalog , and Azure Data Factory , and this role sits right at the heart of that transformation. This is a rare opportunity to join early, influence architecture, and help define engineering standards, pipelines, curated layers and best practices that will support Operations … and Customer Care. If you want to build a best-in-class Lakehouse from scratch-this is the one. ? What You'll Be Doing Lakehouse Engineering (Azure + Databricks) Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines , PySpark , and Spark SQL across a full Medallion Architecture (Bronze ? Silver ? Gold) . Implement ingestion patterns for files, APIs, SaaS platforms (e.g. More ❯

Senior Data Engineer - Azure & Databricks Lakehouse Glasgow (3/4 days onsite) | Exclusive Role with a Leading UK Consumer Business A rapidly scaling UK consumer brand is undertaking a major data modernisation programme-moving away from legacy systems, manual Excel reporting and fragmented data sources into a fully automated Azure Enterprise Landing Zone + Databricks Lakehouse … . They are building a modern data platform from the ground up using Lakeflow Declarative Pipelines , Unity Catalog , and Azure Data Factory , and this role sits right at the heart of that transformation. This is a rare opportunity to join early, influence architecture, and help define engineering standards, pipelines, curated layers and best practices that will support Operations … and Customer Care. If you want to build a best-in-class Lakehouse from scratch-this is the one. What You'll Be Doing Lakehouse Engineering (Azure + Databricks) Engineer scalable ELT pipelines using Lakeflow Declarative Pipelines , PySpark , and Spark SQL across a full Medallion Architecture (Bronze Silver Gold) . Implement ingestion patterns for files, APIs, SaaS platforms (e.g. More ❯

days on-site) Contract Length: Until 31/12/2026 Day Rate: £447.50 (PAYE via Umbrella) About the Role We are seeking a highly skilled AWS Lead Data Engineer to join a long-term data engineering and cloud modernization programme. The role involves designing, building, and maintaining data systems—including pipelines, data lakes, and … data warehouses—ensuring they are secure, scalable, and high performing. Depending on skill set, you will either focus on developing AWS-based data engineering pipelines or support large-scale cloud migration efforts into Databricks. UI development experience and AWS CloudFormation are essential requirements. Key Responsibilities Lead the design and delivery of production-grade data engineering solutions. Build … optimise, and maintain large-scale data pipelines. Develop and enhance data lakes and data warehouses. Implement scalable SQL and Python/PySpark-based solutions. Use orchestration tools such as Airflow and AWS Step Functions. Analyse current processes and propose end-to-end technical improvements. Engage with stakeholders to translate business needs into technical designs. Support migrations into More ❯

Job Role: Data Engineer Location: Glasgow, UK- Hybrid Duration: 6+ months Contract Job Description: You will be responsible for: • Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and DataBricks • Developing and deploying ETL jobs that extract data from various sources, transforming it to meet business … needs. • Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation, and loading, ensuring accuracy and consistency. • Creating and manage data pipelines, ensuring proper error handling, monitoring and performance optimizations • Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives. • Conducting code reviews, provide constructive feedback, and enforce coding standards … to streamline repetitive tasks. • Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes • Utilizing REST APls and other integration techniques to connect various data sources • Maintaining documentation, including data flow diagrams, technical specifications, and processes. You Have: • Proficiency in Python programming, including experience in writing efficient and maintainable code. • Hands-on experience More ❯

I'm working with a world-class technology company in Edinburgh to help them find a Lead Data Engineer to join their team (hybrid working but there is flex on this for the right person). This is your chance to take the technical lead on complex, large-scale data projects that power real-world products used … joining a forward-thinking team that's passionate about doing things properly using a modern tech stack , cloud-first approach, and a genuine commitment to engineering excellence. As Lead Data Engineer, you'll be hands-on in designing and building scalable data platforms and pipelines that enable advanced analytics, machine learning, and business-critical insights. You'll … shape the technical vision , set best practices, and make key architectural decisions that define how data flows across the organisation. You won't be working in isolation either as collaboration is at the heart of this role. You'll work closely with engineers, product managers, and data scientists to turn ideas into high-performing, production-ready systems. You More ❯

I'm working with a world-class technology company in Edinburgh to help them find a Lead Data Engineer to join their team (hybrid working but there is flex on this for the right person). This is your chance to take the technical lead on complex, large-scale data projects that power real-world products used … joining a forward-thinking team that's passionate about doing things properly using a modern tech stack , cloud-first approach, and a genuine commitment to engineering excellence. As Lead Data Engineer, you'll be hands-on in designing and building scalable data platforms and pipelines that enable advanced analytics, machine learning, and business-critical insights. You'll … shape the technical vision , set best practices, and make key architectural decisions that define how data flows across the organisation. You won't be working in isolation either as collaboration is at the heart of this role. You'll work closely with engineers, product managers, and data scientists to turn ideas into high-performing, production-ready systems. You More ❯

Senior Data Architect/Engineer Location : Glasgow, UK Experience : Minimum of 5 - 7 years of experience Snowflake and/or databricks is must - hands on experience This role will be key to helping our divisional leadership to making informed, data-driven decisions by developing a sophisticated, scalable and explainable decision model to aid workforce planning. The ideal … candidate will have deep expertise in data science, analytics and systems thinking, with a proven ability to work across different businesses. This is a high-impact role with the work output to be visible at the executive level. Key Responsibilities: Design & Architecture : Lead design for decision support model from formation through to deployment. Define model framework that balances predictive … accuracy with interoperability and useability. Data Integration & Engineering : Partner with other teams responsible for datasets required to be leveraged so it can be sourced, cleansed, and prepared into a structured format, where possible. Model Development : Apply statistical, machine learning or optimization techniques to develop a robust decision support system. Simulate scenarios, perform sensitivity analysis, and create “what-if” tools More ❯

My client is seeking a Senior Data Engineer to play a pivotal role in designing, scaling, and maintaining data pipelines and Lakehouse architectures. You will collaborate closely with internal stakeholders and external partners to optimise existing systems, with a particular focus on enhancing fan engagement through digital platforms. Key Responsibilities Design and develop ETL/ELT pipelines … in Azure and Databricks, ensuring reliability and performance. Construct Kimball-style dimensional models to support analytics and reporting. Implement automated testing for data quality assurance and validation. Ensure compliance with data governance, legal, and regulatory standards . Collaborate with the wider Data team to optimise pipelines and enhance platform capabilities. Essential Skills & Experience Hands-on expertise with … Proven ability to build production-grade ETL/ELT pipelines , including integration with SFTP and REST APIs. Strong knowledge of Kimball methodology within Lakehouse frameworks. Advanced proficiency in Azure data services (ADF, ADLS Gen2, Event Hubs) and SQL. Excellent analytical and troubleshooting skills for data transformation and quality assurance. Strong communication skills to translate technical concepts for stakeholders More ❯

the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. YOUR ROLE We are seeking a skilled and hands-on AWS Data Engineer with strong coding expertise and deep experience in building scalable data solutions using AWS services. The ideal candidate will have a solid background in data engineering, Python development, and cloud-native architecture. YOUR PROFILE Design, develop, and maintain robust data pipelines and ETL workflows using AWS services. Implement scalable data processing solutions using PySpark and AWS Glue. Build and manage infrastructure as code using CloudFormation. Develop and deploy serverless applications using AWS Lambda, Step Functions, and S3. Perform data querying and … analysis using Athena. Collaborate with Data Scientists to operationalize models using SageMaker. Ensure secure and compliant data handling using IAM, KMS, and VPC configurations. Containerize applications using ECS for scalable deployment. Write clean, testable code in Python, with a strong emphasis on unit testing. Use GitLab for version control, CI/CD, and collaboration. Strong coding background in More ❯

Venesky-Brown’s client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 5 month contract on a rate of £550/day (inside IR35). This role will be hybrid with 2 days per week in the office. Responsibilities: - Build scalable data pipelines for sourcing, transforming and publishing … data assets for research and commercial use cases - Work collaboratively with other engineers, data scientists and product owners to build the next generation data platform products and services. - Ship high-quality, well-tested, secure, and maintainable code. - Find a path to get things done despite roadblocks to get your work into the hands of users quickly and … product development cycle. - Embody Culture and Values. Essential Skills: - Ability to identify, analyse, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience. - Architecting, Designing and building data platforms preferably in financial domains - Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security. - Infrastructure-as-Code - Security awareness (RBAC More ❯

Senior Data Engineer - Hybrid London £75K - £95K Salary: £65,000 - £85,000 Location: London (Hybrid - 2 days per week in office) ECOM Recruitment are working with a growing digital consultancy that delivers data and technology solutions for some of the UK's best-known brands click apply for full job details More ❯

SQL and Data Engineer - Edinburgh, Hybrid We are looking for an SQL expert who is also codes in C#/.Net for an Edinburgh (hybrid) role focussed strongly on Data Engineering. The company is a scale-up B2B Fintech with huge runway and funding; they need to scale the product to meet growing demand. The role will … days holiday + birthday off Autonomy to make an impact and shape your career path The role: Communicate with customers to problem solve and troubleshoot Help with large data migrations and code to integrate Build new tools for customers that are bespoke to their integration Use SQL and C#/.Net to optimise and build new features Key skills More ❯

SQL and Data Engineer - Edinburgh, Hybrid We are looking for an SQL expert who is also codes in C#/.Net for an Edinburgh (hybrid) role focussed strongly on Data Engineering. The company is a scale-up B2B Fintech with huge runway and funding; they need to scale the product to meet growing demand. The role will … days holiday + birthday off Autonomy to make an impact and shape your career path The role: Communicate with customers to problem solve and troubleshoot Help with large data migrations and code to integrate Build new tools for customers that are bespoke to their integration Use SQL and C#/.Net to optimise and build new features Key skills More ❯

BI Data Architect Edinburgh - office based Head Resourcing are pleased to be working with a global manufacturer who are headquartered in Scotland as they look to hire a talented BI Data Architect. Our client is a long-established, family-owned business with global operations producing a wide range of high-quality products. The BI Data Architect is … a new position within our clients IT structure and will be responsible for designing, implementing, and maintaining scalable data architectures which support business intelligence, analytics, and reporting across the organisation. The successful candidate will be able to bridge the gap between data engineering and strategic decision making. Required skills: Experienced in Data Engineering with strong knowledge of … Data Architecture Advanced SQL for data manipulation and querying Experience with ETL tools in Azure Knowledge of BI tools such as Power BI, Tableau, or fabric Strong communication skills and the ability to explain technical concepts to non-technical users If this sounds of interest and you'd like a confidential chat to find out more, please apply More ❯

BI Data Architect Edinburgh - office based Head Resourcing are pleased to be working with a global manufacturer who are headquartered in Scotland as they look to hire a talented BI Data Architect. Our client is a long-established, family-owned business with global operations producing a wide range of high-quality products. The BI Data Architect is … a new position within our clients IT structure and will be responsible for designing, implementing, and maintaining scalable data architectures which support business intelligence, analytics, and reporting across the organisation. The successful candidate will be able to bridge the gap between data engineering and strategic decision making. Required skills: Experienced in Data Engineering with strong knowledge of … Data Architecture Advanced SQL for data manipulation and querying Experience with ETL tools in Azure Knowledge of BI tools such as Power BI, Tableau, or fabric Strong communication skills and the ability to explain technical concepts to non-technical users If this sounds of interest and you'd like a confidential chat to find out more, please apply More ❯

Role Title: Sr. Databricks Engineer Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 MUST BE PAYE THROUGH UMBRELLA Role Description: We are currently migrating our data pipelines from AWS to Databricks, and are seeking a Senior Databricks Engineer to lead and contribute to this transformation. This is a hands-on engineering role … focused on designing, building, and optimizing scalable data solutions using the Databricks platform. Key Responsibilities: • Lead the migration of existing AWS-based data pipelines to Databricks. • Design and implement scalable data engineering solutions using Apache Spark on Databricks. • Collaborate with cross-functional teams to understand data requirements and translate them into efficient pipelines. • Optimize performance and … cost-efficiency of Databricks workloads. • Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools. • Ensure data quality and reliability through robust unit testing and validation frameworks. • Implement best practices for data governance, security, and access control within Databricks. • Provide technical mentorship and guidance to junior engineers. Must-Have Skills: • Strong hands-on experience More ❯

technology company that has rapidly grown to become a success story in its sector. They are now entering an exciting new phase of expansion and are looking for a Data & Backend Engineer to join their team and help deliver operational excellence and platform enhancements. This role offers a unique blend of hands-on engineering and operational problem-solving. … It's ideal for someone who enjoys working with data, building robust backend solutions, and creating tools that make a real impact for customers. The Role You'll split your time between supporting operational requests and delivering backend engineering projects that improve the experience for all clients. This includes automating processes, building reporting pipelines, and contributing to platform integrations. … scripts) Document processes, SQL scripts, and workflows Identify recurring tasks and automate them for efficiency Collaborate with support to triage requests and ensure safe operating procedures Complete one-off data migrations during client onboarding Engineering (50%) Build and optimise customer-facing reports and internal dashboards Implement backend workflows and CRM integrations aligned with the product roadmap Contribute to bug More ❯