1 to 25 of 51 ETL Jobs in Scotland

Databricks Integrate data from multiple systems into Azure Data Lake Storage or OneLake, ensuring consistency, reliability, and performance Develop and maintain ELT/ETL processes using Azure-native tools and Fabric capabilities, optimising for cost and performance Build and maintain Microsoft Fabric artefacts including lakehouses, warehouses, notebooks, dataflows, and semantic ...

enable reliable data products and insights for stakeholders, and you\'ll collaborate with data architects, analysts, and product teams to deliver robust ELT/ETL pipelines, model data for performance and usability, and apply best practices in security and data quality. Working within the Data & AI team, you will contribute ...

analytics, data apps, AI and data science initiatives. The ideal candidate will have a deep understanding of data warehousing best practices, data modeling techniques, ETL/ELT processes, and cloud-based data platforms. The Data Architect will be a key partner in driving data-driven decisions and future-proofing Jazwares ...

This role is crucial in transforming raw data into actionable insights that drive business decisions. You will design, develop, and maintain data pipelines and ETL processes, create and manage data models, dashboards, and reports using BI tools, and analyse complex datasets to identify trends and patterns. You will collaborate with … cross-functional teams to understand business needs and translate them into data requirements. Responsibilities: Design, develop, and maintain data pipelines and ETL processes. Create and manage data models, dashboards, and reports using BI tools. Analyse complex datasets to identify trends, patterns, and opportunities for improvement. Collaborate with cross-functional teams ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

deployment pipelines and controlled deployment processes. Power BI performance analysis and optimisation using tools such as DAX Studio. Experience with SSIS or other ETL/data integration technologies. Experience supporting or integrating BI solutions with business applications. Relevant Microsoft certification, such as PL-300 (Power BI Data Analyst ...

Snowflake, Databricks, Redshift). Semantic Layer: Design and implementation for governed reusable data views. Data Governance Tools: Collibra, Alation, Talend or equivalent. Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica) Security: Data Privacy, Data Protection & Encryption frameworks & governance Enterprise Architecture Frameworks: TOGAF, Zachman; familiarity with ITIL processes. ...

across the modern data engineering stack while working on problems that matter to the firm and its clients. Job responsibilities Design, build, and support ETL/ELT pipelines and data services on AWS, ensuring solutions are secure, stable, and scalable Develop and maintain data workflows using AWS Glue, including ...

. Strong command of database design and data warehouse principles, including modelling for scale and performance. Proven experience designing and delivering data integration and ETL/ELT processes. Expert-level data manipulation, data cleansing and transformation techniques. Strong knowledge of data governance and best practices in data management. Proven ability ...

Proficient in DataOps methodologies and tools, including experience with continuous integration/continuous delivery (CI/CD) pipelines, containerisation, and workflow orchestration. Familiar with ETL/ELT frameworks, and experienced with Big Data Processing Tools (e.g. Spark, Airflow, Hive, etc.) Knowledge of programming languages (e.g. Java, Python, SQL) Hands ...

inclusive environment through collaborative leadership, resolving organisational challenges, and mentoring colleagues. What You'll Bring Core Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and various database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and openness to tech stacks such as SSIS, Airflow ...

many of these points and are excited about the role, we encourage you to apply: Core Data Engineering Foundation: Practical experience with data modelling, ETL/ELT, and a variety of database technologies. Technical Versatility: Fluency in data processing languages (Python, SQL, PySpark) and an open-minded approach to tech ...

Financial Services & Insurance experience. Domain & Technical Expertise Data & AI Architecture Fluency: Deep understanding of modern data stacks (Data Lakehouses, Data Mesh, Real-time Streaming, ETL/ELT pipelines) and AI/ML lifecycle management (MLOps, GenAI integration, Model Governance). Ability to challenge architectural patterns and supervise technical teams without ...

Oracle eBusiness Suite background with recent cloud experience (e.g, SQL/PLSQL/Java/OAF/BI/Forms/Reports.* Data Migration, ETL, knowledge. A strong candidate will have experience in data migration from Oracle eBusiness Suite to Oracle Fusion Cloud and experience using Oracle Data Integrator ...

onsite. Required Skills & Experience 5+ years of experience as a Data Engineer. Strong expertise in SQL and Python/Scala. Hands-on experience with ETL tools and frameworks. Experience with data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with ...

wide range of Data and MI/BI platforms; experience supporting applications in regulated industries (e.g., government, aerospace and defence); knowledge of integration concepts (ETL, Event, APIs, message‐based interfaces); exposure to deployment automation or DevOps practices. Personal Attributes Strong analytical and problem‐solving mindset. Clear communicator able to work ...

/Definition of Done. Some other highly valued skills may include: Exposure to Broader Banking Product Stacks: Payments domain deep-dive, Core banking systems, ETL/reporting flows, Integration with middleware (Kafka, MQ, file-based patterns) Technical Awareness & Analytical Tools: SQL/data interpretation, Understanding of data models, interfaces and ...

professional experience in data engineering, software engineering, or a related field.* Strong expertise in database architecture, design, and management.* Proven experience developing and maintaining ETL/ELT pipelines and scalable data workflows.* Strong proficiency in Python and SQL, or other relevant programming languages.* Experience with CI/CD pipelines, automation ...

understanding of modern data environments, with desirable experience across: Azure, Databricks, Lakehouse, MDM, Customer Data Platforms, APIs & Event-Driven Integration, Data Quality, Metadata & Lineage, ETL/ELT, Data Migration. You do not need to be a hands-on architect, but must have sufficient technical depth to challenge architecture, engineering approaches ...

and security expectations; ability to guide peers on safe and effective usage within team practices Hands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environment Preferred qualifications, capabilities, and skills Experience leading engineering teams within ...

deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience with scientific data, chemical, biological ...

experience in Python (or another language) and confidence working across the full stack. Demonstrated experience designing and delivering production data pipelines and system integrations (ETL/ELT, APIs, batch and streaming). Strong understanding of distributed systems, APIs and database design (SQL/NoSQL). Experience deploying into enterprise environments ...

Scorus Solutions in Glasgow is seeking a Business Intelligence and Data Analytics Engineer to design, build, and maintain data pipelines and ETL processes on-site. You will create data models, dashboards, and reports using BI tools, analyze large datasets for trends, and collaborate with cross-functional teams to translate business ...

data warehouse and data lake solutions, delivering end-to-end data pipelines and analytics platforms in an Agile environment. You will implement serverless architectures, ETL/ELT pipelines, and dashboards, collaborating with stakeholders to deliver BI-ready data assets and governance practices. #J-18808-Ljbffr ...