1 to 25 of 47 Permanent ETL Jobs in Scotland

data platforms using SQL and Python. Experience with Microsoft Fabric, Azure data services or a comparable cloud data platform. Understanding of data modelling, ETL/ELT, APIs, data quality and structured and unstructured data processing. Experience applying software engineering practices including version control, testing, documentation and deployment. Practical understanding ...

Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising for cost and performance Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic ...

analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud-based data platforms. The Data Architect will be a key partner in driving data-driven decisions and future-proofing Jazwares ...

This role is crucial in transforming raw data into actionable insights that drive business decisions. You will design, develop, and maintain data pipelines and ETL processes, create and manage data models, dashboards, and reports using BI tools, and analyse complex datasets to identify trends and patterns. You will collaborate with … cross-functional teams to understand business needs and translate them into data requirements. Responsibilities: Design, develop, and maintain data pipelines and ETL processes. Create and manage data models, dashboards, and reports using BI tools. Analyse complex datasets to identify trends, patterns, and opportunities for improvement. Collaborate with cross-functional teams ...

deployment pipelines and controlled deployment processes. Power BI performance analysis and optimisation using tools such as DAX Studio. Experience with SSIS or other ETL/data integration technologies. Experience supporting or integrating BI solutions with business applications. Relevant Microsoft certification, such as PL-300 (Power BI Data Analyst ...

Office Suit (Word, Excel, PowerPoint, Outlook, etc.).May also have: Previous experience implementing and configuring tax technology solutions. Annin depth understanding of data modelling, ETL/ELT processes, and data warehousing. An understanding of the broader Microsoft ecosystem and cloud services. An understanding of tax and accounting with prior experience ...

. Strong command of database design and data warehouse principles, including modelling for scale and performance. Proven experience designing and delivering data integration and ETL/ELT processes. Expert-level data manipulation, data cleansing and transformation techniques. Strong knowledge of data governance and best practices in data management. Proven ability ...

inclusive environment through collaborative leadership, resolving organisational challenges, and mentoring colleagues. What You'll Bring Core Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow ...

many of these points and are excited about the role, we encourage you to apply: Core Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and a variety of database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and an open-minded approach to tech ...

Financial Services & Insurance experience. Domain & Technical Expertise Data & AI Architecture Fluency: Deep understanding of modern data stacks (Data Lakehouses, Data Mesh, Real-time Streaming, ETL/ELT pipelines) and AI/ML lifecycle management (MLOps, GenAI integration, Model Governance). Ability to challenge architectural patterns and supervise technical teams without ...

pipelines for Power BI reports, ensuring seamless updates and version control. Configure automated data refresh schedules to keep reports up-to-date. Collaborate with ETL developers, database administrators, and other technical teams to align BI solutions with overall architecture. Data Warehousing and Data Lakes Contribute to the design and maintenance … ensuring efficient storage and retrieval. Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data. Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions. Implement data governance practices within the data warehouse and data lake environments. General Participate ...

Proficient in DataOps methodologies and tools, including experience with continuous integration/continuous delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands ...

onsite. Required Skills & Experience 5+ years of experience as a Data Engineer. Strong expertise in SQL and Python/Scala. Hands-on experience with ETL tools and frameworks. Experience with data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with ...

professional experience in data engineering, software engineering, or a related field. Strong expertise in database architecture, design, and management. Proven experience developing and maintaining ETL/ELT pipelines and scalable data workflows. Strong proficiency in Python and SQL, or other relevant programming languages. Experience with CI/CD pipelines, automation ...

Oracle eBusiness Suite background with recent cloud experience (e.g, SQL/PLSQL/Java/OAF/BI/Forms/Reports.* Data Migration, ETL, knowledge. A strong candidate will have experience in data migration from Oracle eBusiness Suite to Oracle Fusion Cloud and experience using Oracle Data Integrator ...

deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience with scientific data, chemical, biological ...

understanding of modern data environments, with desirable experience across: Azure, Databricks, Lakehouse, MDM, Customer Data Platforms, APIs & Event-Driven Integration, Data Quality, Metadata & Lineage, ETL/ELT, Data Migration. You do not need to be a hands-on architect, but must have sufficient technical depth to challenge architecture, engineering approaches ...

wide range of Data and MI/BI platforms; experience supporting applications in regulated industries (e.g., government, aerospace and defence); knowledge of integration concepts (ETL, Event, APIs, message‐based interfaces); exposure to deployment automation or DevOps practices. Personal Attributes Strong analytical and problem‐solving mindset. Clear communicator able to work ...

and security expectations; ability to guide peers on safe and effective usage within team practices Hands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environment Preferred qualifications, capabilities, and skills Experience leading engineering teams within ...

coding hygiene and system architectureRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experience with SQL, Data Transformation, ETL, Python. Working knowledge of AWS, Databricks and big data technologies and concepts. Hands-on practical experience in system design, application development, testing, and operational stabilityExperience ...

player; comfortable collaborating across engineering, product, and operations teams. Preferred qualifications, capabilities, and skillsProficiency in Python for data processing, automation, and service integration (e.g., ETL/ELT jobs, orchestration, or platform tooling).Demonstrated expertise in Agile/Scrum practices, including facilitating ceremonies (standups, planning, refinement, reviews, retrospectives), backlog hygiene, and ...

resiliency and security expectations; ability to guide peers on safe and effective usage within team practicesHands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environmentPreferred qualifications, capabilities, and skillsExperience leading engineering teams within a large ...

experience in Python (or another language) and confidence working across the full stack. Demonstrated experience designing and delivering production data pipelines and system integrations (ETL/ELT, APIs, batch and streaming). Strong understanding of distributed systems, APIs and database design (SQL/NoSQL). Experience deploying into enterprise environments ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

with others and using data to create positive outcomes, we'd love to hear from you. Day to Day Design, build and maintain reliable ETL/ELT data pipelines using AWS or Azure cloud-native services and established engineering patterns Develop and support data integration components and services, including Java … Functions and Logic Apps PySpark SQL (Athena, Redshift, Azure Synapse SQL) AWS S3 or Azure Data Lake Storage Gen2 Python and/or Java ETL/ELT data pipeline development Data quality, validation and monitoring Git, CI/CD and Agile delivery practices Eligibility for SC Clearance Manchester Greater Manchester ...