1 to 25 of 41 Permanent Azure Data Factory Jobs in Scotland

Data Engineer - (Python and Power BI) at N Consulting Ltd Job Summary : We are seeking a skilled Data Engineer with expertise in Python development and Power BI to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines, transforming raw data … and insights to drive business decisions. Design, develop, and optimize ETL/ELT pipelines using Python and SQL. Develop and maintain Power BI dashboards and reports to visualize data and track KPIs. Work with stakeholders to gather business requirements and translate them into technical solutions. Perform data wrangling, cleaning, and transformation to prepare datasets for analysis. … Integrate data from multiple sources (APIs, databases, cloud storage). Ensure data quality, integrity, and security across systems. Collaborate with data analysts, scientists, and engineering teams to support advanced analytics. Monitor and improve pipeline performance, scalability, and reliability. Advanced SQL skills (joins, CTEs, indexing, optimization) Experience with relational databases (e.g., SQL Server, PostgreSQL, MySQL More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time reporting, and managing data from mergers and acquisitions. … At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients … complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills, with a focus on Microsoft Azure, although experience with other cloud platforms is also desirable. Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues. More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … you will: Collaborate with stakeholders across development, analytics, and business teams to define and implement components of the data landscape in line with strategic data goals Translate business and end-user needs into robust technical solutions, delivery plans, and architectural designs Build and maintain highly automated, scalable data pipelines using modern cloud-based tools More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Lead Data Engineer with Azure Experience Location: Sunderland, UK About the Role: We are currently looking for a Lead Data Engineer to manage teams on client projects. … Your Profile: Proven experience as a Lead Data Engineer with a focus on Azure cloud services. Experience of managing small teams whilst also being hands-on. Strong database fundamentals including SQL/TSQL, performance and schema design. Experience architecting and building data applications using Azure, specifically a Data Warehouse and More ❯

EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 10.06.2025 Expiry Date: 25.07.2025 col-wide Job Description: Key Responsibilities Lead the technical delivery of complex data engineering projects, ensuring solutions are scalable, secure, and aligned with our delivery framework, and client goals. Design and build high-quality data pipelines and integration workflows, setting … throughout the development lifecycle. Collaborate with multidisciplinary teams, including a wide range of other roles, to shape solutions that meet both technical and business requirements. Mentor and support data engineering teams, fostering a culture of continuous improvement, knowledge sharing, and technical excellence. Support testing activities by ensuring pipelines are testable, observable, and reliable; work with QA and analysts … with a positive attitude and a strong sense of ownership and accountability. Technologies, Methodologies and Frameworks: Direct delivery experience using cloud-native data services, specifically in Microsoft Azure, Fabric, Dataverse, Synapse, Data Lake, Purview. Deep expertise in data engineering tools and practices, including Python, SQL, and modern ETL/ELT frameworks (e.g. More ❯

capabilities have been clearly demonstrated. Coupled with at least 4 years of design and development. experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required. Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred. Experience with healthcare industry regulations … data security and compliance standards (e.g. GDPR), and EDI standards (e.g. FHIR, HL7), etc. is very valuable. Developer certifications of Azure and/or Microsoft suite technologies is a big plus. Technical skills: In-depth knowledge and thorough experience in programming, configuring, and/or integrating using/with Azure integration tools like Data factory, LogicApps, Functions, API Management, Data catalog, WebApps, Integration service environment, configuring monitoring & diagnostics, etc., and connectivity & security configurations (certificates, encryptions, etc.). In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes. Knowledge and More ❯

Data Engineer - Near Edinburgh (Hybrid) - 60-70K DOE Lorien's long-standing, successful (and growing) client, with offices very commutable from Central Edinburgh and the surrounding, is looking to recruit a Data Engineer to join their technical function in a brand-new role for the firm as it expands its Data team. In … have placed into this firm already from Software and Hardware Engineers to PMs, Support and Operations staff, Managers and more. What You'll Be Doing: Design and develop Data Solutions, Pipelines and ETL Processes using tools such as Azure Data Factory/Azure Data Lake/Azure SQL/SSIS and other relevant offerings Build and tailor Data Models and Data Warehouses Work with other Data personnel such as Analysts/Scientists as well as stakeholders to gather and understand requirements, draft possible solutions, deliver on them, monitor their performance, and continuously improve as you work and adapt to More ❯

Senior Consultant, AI & Data, Financial Services, Data Platforms, Edinburgh The EY Financial Services AI & Data Consulting team in Scotland is continuing to grow and develop unique advisory propositions in response to market needs and demand. We fully support the Scottish Financial Enterprise (SFE) vision for an ecosystem with Data, AI and emerging … success on a global scale, delivering exceptional career experiences and advancing Scotland’s position as a world leader in Financial Services. Our mission is to deliver AI-ready Data enabling our Financial Services clients to deliver superior market products and experiences. We are currently looking for exceptional Senior Consultants with good experience in Financial Services and Data Platform solutions to join our team and actively contribute to this mission, locally and globally. Joining the Edinburgh EY AI & Data team in this exciting period of growth will offer a huge variety of opportunity to make a tangible impact to our clients’ businesses and to your career. The opportunity In this AI & Data More ❯

We are seeking a Senior Data Engineer for our Oil & Gas Operator client based in Aberdeen. This is a STAFF role working as part of a Data Team where you will be focussed on process and looking for improvements. As a candidates you will be currently working as a Data Engineer and ideally with … years or more experience and have a strong working knowledge of PySpark, Azure Data Bricks, Azure Data Factory and Azure Data Lake Storage. Ideally you will be based in Aberdeen or within a commutable distance of Aberdeen as the role cannot be worked remotely. Experience required … Proven competency working with data warehousing, ETL/ELT, integration tools and business intelligence solutions that will help to deliver the data and analytics strategy. Skills with Synapse (notebooks and data flows) is essential for Senior Data Engineer. Working knowledge of PySpark is essential for Senior Data Engineer Capability working More ❯

Job Description Lead AI and Data Engineer (Edinburgh) Our client is looking for a technical and strategic AI and Data Engineer to take ownership of AI and data engineering practices. You’ll play a central role in shaping modern data platforms, building production-grade AI solutions, and embedding best practices in data and AI engineering. Key Responsibilities: Lead the design and delivery of scalable data architectures and pipelines to meet analytics and AI needs. Develop and maintain AI and data products aligned to business outcomes. Champion automation-first engineering practices across ingestion, transformation, and deployment. Design and deploy generative and predictive AI solutions using Azure … business decision-making. About You: Deep expertise in data engineering, data pipelines, and semantic models. Hands-on experience building data platforms on Microsoft Azure (Data Factory, Synapse, Databricks, Purview). Skilled in deploying machine learning models and generative AI applications in production. Strong programming skills in Python, SQL More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving theirdeliveryin a secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle andAmazon Web Services (AWS) are usedin FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load ETL and Extract Load and Transform ELT ) in the Azure cloud platforms. You will work with structured and … for which purpose Understand industry-recognised data modelling patterns and standards, and when to apply them Compare and align different data models Knowledge of Microsoft data engineering toolsets specifically Azure Data Factory, however all relevant data experiences is valuable and will be considered. Understanding of relational More ❯

officially designated Posts. Our UK-based staff work in King Charles Street, London, Abercrombie House in East Kilbride and in Milton Keynes. These roles contribute to FCDOs Data Strategy to improve insights to the business by provisioning it with reliable and trustworthy data sources and improving their delivery in a secure manner in compliance with Data regulations. The team is primarily Azure focused but other Cloud technologies such as Oracle and Amazon Web Services (AWS) are used in FCDO. The successful candidates will build complex data pipelines (both Extract Transform and Load {ETL} and Extract Load and Transform {ELT}) in the Azure cloud platforms. You will work with … for which purpose Understand industry-recognised data modelling patterns and standards, and when to apply them Compare and align different data models Knowledge of Microsoft data engineering toolsets specifically Azure Data Factory, however all relevant data experiences is valuable and will be considered. Understanding of relational More ❯

Job Description Data Engineering Consultant (Azure) – hiring at multiple levels Hiring in London, Midlands, Edinburgh & Glasgow Salary Ranges from £40,000 - £65,000 + Car Allowance + Bonus Hybrid Working (x3 days in office, x2 remote) OVERVIEW A major global consultancy operating across a breadth of industries & sectors is scaling it's Data function … and hiring for multiple Data Engineering Consultants across various levels (Consultant, Senior & Principal). You will be joining a Data function working across a breadth of interesting projects for their clients, demonstrating both technical ability and stakeholder engagement skills when delivering impactful Data Engineering projects. Your responsibilities as a Data Engineering Consultant … YOUR SKILLS & EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven More ❯

Job Description Data Engineering Consultant (Azure) – hiring at multiple levels Hiring in London, Midlands, Edinburgh & Glasgow Salary Ranges from £40,000 - £65,000 + Car Allowance + Bonus Hybrid Working (x3 days in office, x2 remote) OVERVIEW A major global consultancy operating across a breadth of industries & sectors is scaling it's Data function … and hiring for multiple Data Engineering Consultants across various levels (Consultant, Senior & Principal). You will be joining a Data function working across a breadth of interesting projects for their clients, demonstrating both technical ability and stakeholder engagement skills when delivering impactful Data Engineering projects. Your responsibilities as a Data Engineering Consultant … YOUR SKILLS & EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven More ❯

Social network you want to login/join with: Data Engineering Consultant (Azure) – hiring at multiple levels Hiring in London, Midlands, Edinburgh & Glasgow Salary Ranges from £40,000 - £65,000 + Car Allowance + Bonus Hybrid Working (x3 days in office, x2 remote) OVERVIEW A major global consultancy operating across a breadth of industries & sectors is … scaling it's Data function and hiring for multiple Data Engineering Consultants across various levels (Consultant, Senior & Principal). You will be joining a Data function working across a breadth of interesting projects for their clients, demonstrating both technical ability and stakeholder engagement skills when delivering impactful Data Engineering projects. Your responsibilities … YOUR SKILLS & EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven More ❯

Social network you want to login/join with: Data Engineering Consultant (multiple levels), edinburgh col-narrow-left Client: Xcede Location: edinburgh, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 1 Posted: 25.05.2025 Expiry Date: 09.07.2025 col-wide Job Description: Data Engineering Consultant (Azure) – hiring at multiple … Car Allowance + Bonus Hybrid Working (x3 days in office, x2 remote) OVERVIEW A major global consultancy operating across a breadth of industries & sectors is scaling it's Data function and hiring for multiple Data Engineering Consultants across various levels (Consultant, Senior & Principal). You will be joining a Data function working across a … YOUR SKILLS & EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven More ❯

Social network you want to login/join with: Data Engineering Consultant (multiple levels), livingston col-narrow-left Client: Xcede Location: livingston, United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Data Engineering Consultant (Azure) – hiring at multiple … Car Allowance + Bonus Hybrid Working (x3 days in office, x2 remote) OVERVIEW A major global consultancy operating across a breadth of industries & sectors is scaling it's Data function and hiring for multiple Data Engineering Consultants across various levels (Consultant, Senior & Principal). You will be joining a Data function working across a … YOUR SKILLS & EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven More ❯

narrow-left Client: Xcede Location: Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 8 Posted: 06.06.2025 Expiry Date: 21.07.2025 col-wide Job Description: Data Engineering Consultant (Azure) – hiring at multiple levels Hiring in London, Midlands, Edinburgh & Glasgow Salary Ranges from £40,000 - £65,000 + Car Allowance + Bonus Hybrid Working … x3 days in office, x2 remote) OVERVIEW A major global consultancy operating across a breadth of industries & sectors is scaling it's Data function and hiring for multiple Data Engineering Consultants across various levels (Consultant, Senior & Principal). You will be joining a Data function working across a breadth of interesting projects for their … YOUR SKILLS & EXPERIENCE A successful Data Engineering Consultant will have the following: Solid technical ability in Python , SQL & Azure (essential). Strong proficiency in Microsoft Azure and relevant tools/technologies ( Databricks, Azure Data Factory, Azure Data Lake, Azure Synapse ). Proven More ❯

GB Macclesfield, GB Glasgow, GB Company: Royal London Group Contract Type: Permanent Location: Wilmslow or Edinburgh or Glasgow Working style: Hybrid 50% home/office based The Group Data Office (GDO) is responsible for enhancing the effectiveness of how data is used across Royal London (RL). The function provides Data Governance, Data Management, Data Strategy, Analytics/AI and Insight capabilities. It sets and oversees data related policies and standards, so data is collected, processed, and exploited in accordance with the Group’s risk appetite. Role Overview Royal London is seeking experienced data modellers with extensive data warehouse design skills … to join a newly formed Core Engineering team who play a pivotal part in the data engineering, modelling and data structure design across Royal London’s Enterprise Data Platform (EDP) which is being built on Azure Databricks. The EDP is a Data Lakehouse built using the Databricks Medalion architecture and More ❯

the Scottish market Full-time · Permanent · Remote/Hybrid (Glasgow-based office) A leading SaaS business at the forefront of digital transformation is seeking an experienced Senior Engineer - Data to join its growing data team. As the company scales its next-generation platform, data is central to delivering fast, accurate, and intelligent user experiences. … This is a fantastic opportunity to play a key role in shaping a modern data and search infrastructure using cutting-edge technologies. About the Role You’ll be part of an agile, cross-functional team building a powerful data platform and intelligent search engine. Working with technologies like Apache Lucene, Solr, and Elasticsearch, you'll contribute … and development of scalable systems, with opportunities to explore machine learning, AI-driven categorisation models, and vector search. What You’ll Be Doing Design and build high-performance data pipelines and search capabilities. Develop solutions using Apache Lucene, Solr, or Elasticsearch. Implement scalable, test-driven code in Java and Python. Work collaboratively with Business Analysts, Data More ❯

Social network you want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations … keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of daily data operations. You’ll work closely with both technical colleagues and stakeholders across the business to support reliable … well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries and providing ad hoc extracts where needed. Maintaining and administering access to More ❯

Social network you want to login/join with: North Scout are working in partnership with a major corporate client, we're looking to appoint a Data Operations Engineer to play a hands-on role within their established Data function. This is a great opportunity for someone with a solid foundation in Data Operations … keen to build on their experience in a collaborative, delivery-focused setting. The role As part of a Consultancy team, you’ll be embedded within the client’s data function, helping to ensure the smooth running of daily data operations. You’ll work closely with both technical colleagues and stakeholders across the business to support reliable … well-documented data processes. This will include; Monitoring and supporting daily data loads and pipeline activity. Writing and refining SQL queries to transform, validate and extract data. Investigating and resolving data quality issues and anomalies. Responding to internal data queries and providing ad hoc extracts where needed. Maintaining and administering access to More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Data Solution Architect Location: Newcastle Upon Tyne/Sunderland, UK The Role: We are looking for a highly skilled Data Solution Architect with deep expertise in designing and … implementing cloud-native data platforms . The ideal candidate will have strong experience across Azure and AWS , with the ability to create scalable, secure, and high-performing data architectures that meet complex business needs. You will play a key role in shaping data strategies, designing end-to-end data solutions More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Data Solution Architect Location: Newcastle Upon Tyne/Sunderland, UK The Role: We are looking for a highly skilled Data Solution Architect with deep expertise in designing and … implementing cloud-native data platforms . The ideal candidate will have strong experience across Azure and AWS , with the ability to create scalable, secure, and high-performing data architectures that meet complex business needs. You will play a key role in shaping data strategies, designing end-to-end data solutions More ❯

in the digital lifecycle and helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation … improvement. Backed by Goldman Sachs Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Data Solution Architect Location: Newcastle Upon Tyne/Sunderland, UK The Role: We are looking for a highly skilled Data Solution Architect with deep expertise in designing and … implementing cloud-native data platforms . The ideal candidate will have strong experience across Azure and AWS , with the ability to create scalable, secure, and high-performing data architectures that meet complex business needs. You will play a key role in shaping data strategies, designing end-to-end data solutions More ❯