1 to 25 of 61 ETL Jobs in Scotland

Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising for cost and performance Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic ...

accelerate development and testing of data pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience ...

accelerate development and testing of data pipelines (e.g. GitHub CoPilot, Claude Code). Required qualifications, capabilities, and skills Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing. Proficiency in SQL, Python, and PySpark, with experience in query optimization and performance tuning. Hands-on experience ...

Managed Instance (MI) - including configuration, connectivity, authentication, security and troubleshooting integration with cloud-based systemsPerformance tuning, query optimization, and indexing strategies. Experience with ETL processes and data integration. Knowledge of data governance, data quality, and information security principles. Familiarity with source control and software development lifecycle practices. Strong experience delivering ...

and our communities in more than 40 countries around the world. What you'll do in the role: Develop and maintain data pipelines and ETL (Extract, Transform, Load) processes. Work with structured and unstructured data to ensure it is accessible and usable. Optimize data systems for performance and scalability. Implement ...

analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud-based data platforms. The Data Architect will be a key partner in driving data-driven decisions and future-proofing Jazwares ...

performance tuning, data modelling, and complex query development. Strong Java development experience, including object-oriented design and enterprise application development. Experience designing and developing ETL/ELT pipelines. Experience working with relational databases such as PostgreSQL, SQL Server, Oracle, or MySQL. Understanding of data warehousing concepts and dimensional modelling. Experience ...

Amazon Redshift, or AWS Understanding of data integration processes and tools such as Databricks, DBT, or Glue Ability to design data models aligned with ETL pipelines Understanding of data management standards, regulatory compliance including GDPR and HIPAA, and security protocols Deep knowledge of entity-relationship modeling, normalization and denormalization, and ...

data modeling and writing complex DAX measures Solid understanding of relational data models, data structures, and system integrations Experience building or supporting data pipelines, ETL processes, or structured data workflows Working knowledge of Python, Power Automate, or similar tools for automation and data processing Familiarity with applying AI tools ...

Experience working with CRM systems, preferably Microsoft Dynamics CRM Other Desirable Skills Experience with Microsoft Dynamics 365 Finance & Operations Experience using Dataiku or similar ETL/data transformation tools Experience supporting a customer satisfaction programme Some ad hoc business travel may be required in line with business projects/demand ...

Experience working with CRM systems, preferably Microsoft Dynamics CRM Other Desirable Skills Experience with Microsoft Dynamics 365 Finance & Operations Experience using Dataiku or similar ETL/data transformation tools Experience supporting a customer satisfaction programme Some ad hoc business travel may be required in line with business projects/demand ...

inclusive environment through collaborative leadership, resolving organisational challenges, and mentoring colleagues. What You'll Bring Core Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow ...

many of these points and are excited about the role, we encourage you to apply: Core Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and a variety of database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and an open-minded approach to tech ...

Financial Services & Insurance experience. Domain & Technical Expertise Data & AI Architecture Fluency: Deep understanding of modern data stacks (Data Lakehouses, Data Mesh, Real-time Streaming, ETL/ELT pipelines) and AI/ML lifecycle management (MLOps, GenAI integration, Model Governance). Ability to challenge architectural patterns and supervise technical teams without ...

pipelines for Power BI reports, ensuring seamless updates and version control. Configure automated data refresh schedules to keep reports up-to-date. Collaborate with ETL developers, database administrators, and other technical teams to align BI solutions with overall architecture. Data Warehousing and Data Lakes Contribute to the design and maintenance … ensuring efficient storage and retrieval. Work with data lakes (such as Azure Data Lake Storage) to ingest and process large volumes of data. Understand ETL (Extract, Transform, Load) processes and their impact on BI solutions. Implement data governance practices within the data warehouse and data lake environments. General Participate ...

Proficient in DataOps methodologies and tools, including experience with continuous integration/continuous delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands ...

Proficient in DataOps methodologies and tools, including experience with continuous integration/continuous delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands ...

core operational systems Build and develop data warehousing solutions using Microsoft Fabric, transforming data for reporting and analytics Work hands-on with SQL, APIs, ETL processes and Python to automate and improve existing data processes Support the integration of systems including Salesforce, alongside the organisation's wider move towards ...

onsite. Required Skills & Experience 5+ years of experience as a Data Engineer. Strong expertise in SQL and Python/Scala. Hands-on experience with ETL tools and frameworks. Experience with data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with ...

data persistence. - Hands-on exposure to Kafka or similar publish-subscribe systems for real-time event processing. - Familiarity with Snowflake and data pipeline concepts (ETL, batch vs. streaming). - Experience with Agentic coding and general understanding of how LLMs are working - Strong focus on clean architecture, maintainability, and production readiness. ...

/Definition of Done Some other highly valued skills may include: Exposure to Broader Banking Product Stacks : Payments domain deep‐dive, Core banking systems, ETL/reporting flows, Integration with middleware (Kafka, MQ, file‐based patterns) Technical Awareness & Analytical Tools : SQL/data interpretation, Understanding of data models, interfaces and ...

Improve data reliability, coverage, traceability and timeliness. Key Skills Data engineering and analytics expertise. Experience with Power BI and Databricks. Strong data modelling and ETL skills. Understanding of cyber security technologies and security data sources. #J-18808-Ljbffr ...

effective enterprise-wide data governance framework Lead the Data Governance Committee Drive improvements in data quality, controls and master data management Oversee data warehouse, ETL, reporting, analytics and visualisation capabilities Ensure data platforms are secure, resilient, scalable and aligned with wider technology strategy Develop and enhance management information, business intelligence ...

deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience with scientific data, chemical, biological ...

wide range of Data and MI/BI platforms; experience supporting applications in regulated industries (e.g., government, aerospace and defence); knowledge of integration concepts (ETL, Event, APIs, message‐based interfaces); exposure to deployment automation or DevOps practices. Personal Attributes Strong analytical and problem‐solving mindset. Clear communicator able to work ...