1 to 25 of 27 ETL Jobs in Scotland

enable reliable data products and insights for stakeholders, and you’ll collaborate with data architects, analysts, and product teams to deliver robust ELT/ETL pipelines, model data for performance and usability, and apply best practices in security and data quality.Working within the Data & AI team, you will contribute ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

modern cloud and data platforms including Azure, AWS, GCP, Databricks, Microsoft Fabric and Snowflake Developing and maintaining scalable batch and streaming data pipelines, applying ETL/ELT patterns to ingest, validate, normalise, cleanse and transform data at scale Building and supporting cloud platform infrastructure using Infrastructure as Code tools such ...

deployment pipelines and controlled deployment processes. Power BI performance analysis and optimisation using tools such as DAX Studio. Experience with SSIS or other ETL/data integration technologies. Experience supporting or integrating BI solutions with business applications. Relevant Microsoft certification, such as PL-300 (Power BI Data Analyst ...

e.g. Snowflake, Databricks, Redshift).Semantic Layer: Design and implementation for governed reusable data views. Data Governance Tools: Collibra, Alation, Talend or equivalent. Expertise in ETL tools and processes (e.g., Apache NiFi, Talend, Informatica)Security: Data Privacy, Data Protection & Encryption frameworks & governanceEnterprise Architecture Frameworks: TOGAF, Zachman; familiarity with ITIL processes. Additional ...

through data modelling, pipeline delivery and ongoing governance — ensuring what the team builds is fit for business and AI consumption, not just technically correctLead ETL/ELT modernisation and cloud migration programmes, applying AI-assisted approaches to accelerate analysis, mapping and delivery of legacy-to-cloud transitionsArchitect observability, resiliency and ...

similar role. Strong knowledge of Kubernetes and containerized application architectures. Experience designing solutions on Microsoft Azure . Understanding of data integration patterns , APIs, ETL/ELT processes, and database technologies. Experience working with enterprise data platforms such as Databricks , PostgreSQL , or similar technologies. Strong stakeholder management and communication skills. Desirable ...

data tools and frameworks such as Kafka, Spark, Databricks, and cloud-native services (AWS, GCP, or Azure).Deep understanding of streaming architectures, distributed systems, ETL/ELT pipelines, infrastructure-as-code, and build processes.Proficiency at least one object-oriented programming language (e.g., Python, Java, Scala) and scriptingDemonstrated experience working ...

Defence and Security programmes What We're Looking For Experience working with Palantir Foundry Strong xehkeey data engineering and data modelling skills Experience building ETL/data pipelines and integrating complex data sources Understanding of data governance, quality and lineage Ability to translate business requirements into technical solutions Strong consulting ...

Oracle or whatever a client runs) across subledgers and the general ledger, consolidation, close and reconciliation tooling. You set the pipeline design across ETL, ELT and API patterns, and you know when finance is served by a scheduled batch load and when it needs change-data capture or a streaming ...

structured correctly and loads as expected.Able to validate data quality by checking for issues like missing data, duplicates, incorrect values, or broken logic in ETL/ELT processes.Comfortable using SQL to look at data, troubleshoot issues, and confirm that transformed data is correct across different layers.Responsible for planning the test ...

into that estate (SAP, Oracle or whatever a client runs) across subledgers and the general ledger, consolidation, close and reconciliation tooling. You work with ETL, ELT and API patterns, with both scheduled batch loads and change-data-capture feeds, and you handle the things source systems do in practice: master ...

/Definition of Done. Some other highly valued skills may include: Exposure to Broader Banking Product Stacks: Payments domain deep-dive, Core banking systems, ETL/reporting flows, Integration with middleware (Kafka, MQ, file-based patterns) Technical Awareness & Analytical Tools: SQL/data interpretation, Understanding of data models, interfaces and ...

teams to influence data strategy and architecture. Required Experience Strong hands-on experience building and operating production-grade data platforms. Expertise in data architecture, ETL/ELT pipelines, data modelling and orchestration. Experience working with large-scale or complex datasets. Background delivering analytics and business intelligence solutions. Experience designing secure ...

teams to influence data strategy and architecture. Required Experience Strong hands-on experience building and operating production-grade data platforms. Expertise in data architecture, ETL/ELT pipelines, data modelling and orchestration. Experience working with large-scale or complex datasets. Background delivering analytics and business intelligence solutions. Experience designing secure ...

such as data lakes, warehouses, or cloud-based systems.Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.Develop and maintain ETL processes for ingesting, transforming, and loading data from diverse sources.Conduct advanced data analysis, modelling, and visualization to identify patterns and insights.Ensure data quality, reliability, and … Presto, etc.) and cloud services (e.g., Azure, AWS, GCP).Familiarity with data visualization tools and business intelligence (e.g., Power BI). Solid grasp of ETL workflows within databases/warehouses such as Oracle, PostgreSQL, SQL Server etc.Excellent problem-solving and interpersonal skills.Preferred Qualifications: Experience with machine learning frameworks and tools ...

used in critical processes. What You Will Need to Succeed The following skills and experience are essential for this role: * Knowledge and experience with ETL methodologies and practices. * Understanding of data cleanse principles and the ability to apply them across large data sets. * Ability to understand systems topography and develop ...

used in critical processes. What You Will Need to Succeed The following skills and experience are essential for this role: * Knowledge and experience with ETL methodologies and practices. * Understanding of data cleanse principles and the ability to apply them across large data sets. * Ability to understand systems topography and develop ...

results, supporting data engineers and stakeholders on data analysis issues.Designing and implementing a data streaming service, including the development of new data models and ETL processes.Ensuring the successful delivery of completed data loads for customers, Data Analysts and Data Scientists, troubleshooting where required.Designing, building and testing data products and solutions … information to support analysis, assurance and decision-making.An interest in developing technical skills in: IT programming and automation, using tools such as industry standard ETL tools, network databases and scheduling and orchestration tools, using modern/open source programming languages in order to deliver data development/engineering products, using ...

data modelling, pipeline delivery and ongoing governance ensuring what the team builds is fit for business and AI consumption, not just technically correct Lead ETL/ELT modernisation and cloud migration programmes, applying AI-assisted approaches to accelerate analysis, mapping and delivery of legacy-to-cloud transitions Architect observability, resiliency … Data modelling including dimensional/Kimball design, medallion architecture and source-to-target mapping, with the ability to translate these into scalable, reusable patterns ETL/ELT delivery and legacy-to-cloud migration at scale Data product thinking experience owning the full pipeline-to-product journey, with a consumption-first ...

performing engineering capability. Key Responsibilities Data Engineering & Platform Development Design, build, and optimise data pipelines supporting a modern medallion architecture. Develop and maintain scalable ETL/ELT solutions across ingestion, transformation, storage, and serving layers. Build and support data platform capabilities using Microsoft technologies, including SQL-based environments and modern … delivery forecasting. Essential Experience Significant hands-on data engineering experience in a technical leadership role. Strong expertise in modern data platforms, including data pipelines, ETL/ELT, data warehousing or lakehouse architectures, SQL, Python, and orchestration frameworks. Proven experience building and operating medallion architecture platforms (Bronze, Silver, Gold). Strong ...

threading and multiprocessing libraries and ensure robust error handling and resource management in parallel execution environments. Deliver secure, high-performance and efficient database and ETL capabilities using Java Collections Framework, data structures, algorithms, and object-oriented design principles, while ensuring scalability, governance, and reliability. Design and develop full-stack applications … including responsive web user interfaces, RESTful APIs, backend services, and integrations with database and ETL platforms. Build self-service capabilities, operational dashboards, workflow automation, and metadata-driven solutions using modern web technologies and microservices architectures. Develop AI-driven solutions to discover, classify, and protect sensitive information within unstructured data, leveraging ...

deadlines while adhering to high quality standardsCoordinate across project teams communicating regular status updates for assigned data projects and while effectively setting expectationsRun python ETL scripts and at times modify, fix or debug as neededRaise keys issues to project team members and senior leadership as necessaryPrioritize and context-switch effectively … experience working in technology and financeFluent in EnglishExperience working with colleagues spread across multiple global locationsProficient in Python programming language and well versed in ETL conceptsUnderstands financial markets and has experience with financial products and portfolio dataExcellent written and oral communication skills with the ability to convey complex information ...

operational guidance to the team within the technical data functionExecute hands-on contribution to projects through data migration and data transformation using Python-based ETL tools.Manage the team’s work allocation and coordinate activities to ensure results are driven by the team in collaboration with others.Guide the team in issue … Master’s degree.Domain Knowledge: Strong understanding of portfolio, wealth, or investment management and financial data structures.Technical Skills: Proficient in Python and knowledgeable in ETL workflows and data transformation logic.Communication: Strong communication skills, able to conduct technical presentations and convey complex ideas clearly.Organization: Highly organized with attention to detail, able ...

healthcare research and innovation. Key Responsibilities Manage and process a variety of data types, including structured, unstructured, and imaging data. Develop and maintain ETL processes, data quality routines, and data mapping to support research. Deliver projects from initial feasibility assessments through to dataset delivery. Create and maintain SQL and/… Python-based ETL solutions, integrating data into the central repository. Work closely with clinicians, researchers, project teams, and stakeholders, providing technical guidance and support. Requirements Good experience with ETL development, MS SQL, relational databases, and query optimisation. Excellent communication skills, with the ability to engage both technical and non-technical ...