19 of 19 ETL Jobs in Scotland

modern cloud data platforms (e.g. Microsoft Fabric, Databricks) Expertise with multiple data analytics tools (e.g. Power BI) Deep understanding of data wareho using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity ...

Data Engineer, preferably within the railway or transport sector Strong proficiency with FME and Microsoft Power Platform tools. Solid understanding of data integration, ETL processes, and data warehousing concepts. Experience working with railway industry data, including familiarity with relevant standards and regulations. Proficiency in SQL, Python, and/or other ...

design and deliver data solutions that meet real analytical needs Designing and building Data Warehouses, Data Lakes and Lakehouse architectures Developing complex and reliable ETL pipelines Designing secure, scalable and high-performance data infrastructure Ensuring solutions are well documented from both a design and support perspective Acting as a trusted ...

and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality ...

and analytics for live energy assets. Key responsibilities Design, build, and maintain scalable data pipelines using Databricks (including Delta Live Tables). Develop robust ETL/ELT workflows ingesting data from operational, telemetry, and third-party systems. Optimise pipeline performance, reliability, and cost efficiency in cloud environments. Ensure data quality ...

months. It is also fully remote. Key Responsibilities • Design, develop, and maintain batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources ...

Exposure to multi-platform integration (MS tools preferred). On premise SQL environments, legacy SSIS, SSRS and other SQL-related technologies employed in complex ETL or ELT patterns Synapse Link for Dataverse Dataverse, Data Flows, Cloud Flows, DAX and Power Platform implementations Synchronisation methods for Synapse and Fabric from D365 ...

strategic decision making. Required skills: Experienced in Data Engineering with strong knowledge of Data Architecture Advanced SQL for data manipulation and querying Experience with ETL tools in Azure Knowledge of BI tools such as Power BI, Tableau, or fabric Strong communication skills and the ability to explain technical concepts ...

within a cloud environment, ideally Azure (ADF, Storage, Service Bus, Monitor). Solid understanding of data pipeline orchestration, data validation patterns, and ELT/ETL processes. Background in containerisation, CI/CD, and DevOps practices. If youre ready to make an impact in a growing tech company and play ...

workflows. Design data architectures and pipelines that support multi-OpCo deployment, ensuring modularity and interoperability. Required Skills & Experience Expertise in Python, SQL, and modern ETL frameworks. Hands-on experience with cloud platforms (AWS preferred). Strong knowledge of data modeling and API integration. Proven experience in developing, testing, and deploying ...

management, integration, or analytics for utilities or energy sectors. Strong knowledge of data fabric architectures, metadata management, and data governance principles. Experience with SQL, ETL tools, and big data technologies (e.g., Hadoop, Spark, Kafka). Familiarity with cloud platforms (AWS, Azure, or Google Cloud) and data integration frameworks. Strong problem ...

Oracle Analytics Cloud (OAC dashboards, DV, RPD/semantic modelling). Experience with Autonomous Data Warehouse (ADW) and Oracle Fusion data structures. Data modelling, ETL/ELT, SQL tuning and general analytics engineering skillset. Proven ability to collaborate with AI teams, data scientists or ML engineers in shared workloads. ...

experience with Snowflake (essential) ** Proven experience leading data engineering projects end-to-end ** Strong Python background and modern data engineering practices ** Deep understanding of ETL/ELT, data modelling and transformations ** Practical machine learning experience (desirable) ** Strong communication with technical and non-technical teams You'll be joining ...

Interest in regulatory systems, financial platforms, or enterprise technology Exposure to CI/CD tooling (e.g. Jenkins) and Agile delivery methodologies Strong SQL and ETL knowledge Experience with database performance analysis and tuning Axiom experience is a plus, but not essential – full training provided This is an excellent opportunity ...

Interest in regulatory systems, financial platforms, or enterprise technology Exposure to CI/CD tooling (e.g. Jenkins) and Agile delivery methodologies Strong SQL and ETL knowledge Experience with database performance analysis and tuning Axiom experience is a plus, but not essential – full training provided This is an excellent opportunity ...

metrics (burn-down, cycle time, throughput, flow efficiency) and identify improvement opportunities. ? Enable squads to break down epics/user stories for data ingestion, ETL/ELT pipelines, APIs, cloud migration, metadata/lineage, and data provisioning services. CDS Platform & Technical Coordination ? Coordinate delivery dependencies across the CDS platform including … and coach teams on Scrum, Kanban, and scaled Agile ways of working. ? Identify inefficiencies and help teams adopt better working patterns around data modelling, ETL development, automated testing, and CI/CD pipelines. ? Mentor teams to become self-organising and reinforce Agile principles such as transparency, inspection, adaptation, and value ...

Design, build, and maintain reliable, scalable data pipelines using Azure services Create and implement data integration solutions that support business goals Develop and manage ETL processes for data ingestion, transformation, and loading Work closely with data scientists, analysts, and business teams in an Agile/Scrum environment Take an active … WILL BRING TO THE ROLE Extensive experience building and running data platforms on Microsoft Azure Hands-on skills in data modelling, warehousing and ETL using Azure Data Factory and SQL Database Practical experience with Python, SQL coding and Azure data pipelines, plus exposure to modern data processing tools like Databricks ...

architecture decisions, and act as a trusted technical partner on complex data initiatives. Key responsibilities include: Designing and building scalable data platforms and ETL/ELT pipelines in Azure and AWS Implementing serverless, batch, and streaming data architectures Working hands-on with Spark, Python, Databricks, and SQL-based analytics platforms … Redshift, Lambda, and SQL-based analytics services Strong Python skills and experience using Apache Spark Hands-on experience with Databricks Experience designing and maintaining ETL/ELT pipelines Solid understanding of data modelling techniques Experience working in cross-functional teams on cloud-based data platforms Ability to work with SDKs ...

Real Time Monitoring and Predictive AI Key responsibilities: Design and maintain scalable data pipelines. Structure, transform, and optimize data in Snowflake. Implement multi-source ETL/ELT flows (ERP, APIs, files). Leverage the AWS environment, including S3, IAM, and various data services. Prepare data for Data Science teams and … services including S3, IAM, Glue, and Lambda. Languages: Advanced SQL and Python for data manipulation, automation, and ML integration. Data Engineering: Proven experience in ETL/ELT pipeline design. AI/ML Integration: Ability to prepare data for model training and deploy AI models into production workflows (batch or real ...