14 of 14 ETL Jobs in Scotland

Lakehouse architectures to tools such as Power BI and Tableau. Hands-on experience in Databricks engineering: Spark, Delta Lake, PySpark. Skilled in building scalable ETL pipelines using Workflows and Delta Live Tables. Proficiency in Python, Scala, or SQL. Knowledge of Databricks security best practices. Strong communication and stakeholder management skills. ...

end.* Strong background in Lakehouse Architecture, including structured and unstructured data.* Expertise in Spark, PySpark, Delta Lake, and Databricks workflows.* Experience building scalable ETL/ELT pipelines, including Delta Live Tables.* Strong programming skills in Python, Scala, or SQL.* Solid understanding of data modelling (3NF, Kimball, Data Vault).* Experience ...

with Azure data services Strong programming skills in Python Strong programming skills in SQL Experience delivering solutions across: Data Governance, Data Migration, Data Modelling ETL/ELT Data Warehousing & Data Lakes Strong understanding of data engineering best practices, including: Git & version control, APIs Containers & microservices Orchestrating data pipelines Experience working ...

with batch and/or streaming data processing Awareness of data governance and best practices Technical Skills Strong Python and SQL skills Experience building ETL/ELT pipelines Exposure to orchestration tools (e.g. workflows, dbt, or similar) Experience with version control and CI/CD tooling is a plus ...

issues. Key Responsibilities: Develop and maintain enterprise-grade Power BI reports, datasets, and data models (including star schemas and dimensional models). Lead ETL/ELT design and optimisation within Microsoft Fabric Lakehouse, including Data Pipelines, Notebooks, and cloud-based ingestion/transformation layers. Deliver complex SQL, Python, and PySpark ...

issues. Key Responsibilities: Develop and maintain enterprise-grade Power BI reports, datasets, and data models (including star schemas and dimensional models). Lead ETL/ELT design and optimisation within Microsoft Fabric Lakehouse, including Data Pipelines, Notebooks, and cloud-based ingestion/transformation layers. Deliver complex SQL, Python, and PySpark ...

spatial databases, automation, and data management. Essential skills and experience include: QGIS FME Form and FME Flow GeoServer ArcGIS Online Data handling, cleaning, and ETL procedures Python scripting – ability to automate GIS workflows or develop QGIS plugins. SQL proficiency – ability to write complex queries and manage spatial databases. Spatial database ...

Investor Protection Corporation, Investment Advisers Act of 1940). Experience with OpenAI and/or Anthropic APIs at scale. Background in data pipelines and ETL for financial data. Experience building autonomous agent frameworks or multi-agent systems. Contributions to open-source AI/ML projects. ____________________________________________________________ Disclaimer: Calyptus uses an automated ...

and analytics workloads. Develop and maintain scalable data architectures including Azure Data Lake, Azure SQL Data Warehouse, and Synapse Analytics. Build and maintain reliable ETL/ELT workflows, ensuring high data quality, accessibility, and performance. Collaborate with data scientists and analysts to translate business and data requirements into production-grade … TensorFlow, PyTorch, Scikit-learn MLOps & Model Management: MLflow, Model versioning, CI/CD Cloud & Big Data: Databricks, Databricks APIs, MCP, Blob Storage Data Engineering: ETL/ELT pipelines, DLT, Delta Lake Infrastructure as Code (IaC): Terraform, ARM templates, Ansible Version Control & DevOps: Git, Azure DevOps, Jenkins Experience 3+ years ...

with Risk and Compliance teams to translate regulatory needs into technical design. Data Integration & Enterprise Connectivity: - Design and govern enterprise data integration architectures using ETL/ELT frameworks, API-based integration, event-driven and streaming integration, message queues and middleware. - Define integration patterns for real-time, near real-time, and … with at least 5+ years of hands-on experience in enterprise data architecture, design, governance, and implementation. - Strong experience designing and implementing enterprise-grade ETL/ELT data pipelines. Hands-on experience with tools such as SQL, NoSQL Datastores, Talend, Informatica, IBM DataStage, or equivalent platforms, Collibra, Data Lineage, Alfresco. ...

Terraform for infrastructure provisioning. Demonstrated experience in migrating legacy systems (on-prem or other cloud) to GCP. Strong understanding of data warehousing concepts and ETL/ELT frameworks. Experience in leading teams and managing end-to-end delivery. ...

Proven team leadership in high-volume, deadline-driven environments Strong KPI management, problem-solving, and attention to detail Experience with SFTP, data workflows, or ETL processes preferred This is a permanent opportunity within the heart of Glasgow.Progressive firm, autonomy and a chance to make a difference.Apply Now Is this ...

Glasgow Hybrid Work: 3 days per week and 2x WFH Salary: Competitive but around £50,000 - £60,000 Tech stack: Python, AWS, CI,CD, ETL, Data Warehouse We CANNOT sponsor or accept anyone on a PSW or Graduate Visa. **This Role is Exclusive to Cortech so you MUST apply … with Infrastructure as Code, CDK ideally (Terraform or Serverless potentially) Great to have but can be taught: Data and stream processing - AWS Firehose and ETL platforms Experience with authentication frameworks CI/CD GitHub actions (GitLab, TeamCity, CircleCI) This is data related software development, responsible for whole lifecycle and developed ...

GDPR Data Architect - Oracle, NoSQL, ETL £730 (Outside IR35) Glasgow/Hybrid 6 months My client is an instantly recognisable consultancy, who are looking for a seasoned Data Architect to lead the design and governance of GDPR-compliant data architectures across Oracle, NoSQL, unstructured data, and enterprise data warehouse platforms. … requirements: Proven experience as an Enterprise/Lead Data Architect. Strong hands-on experience with ETL/ELT, SQL, NoSQL, Oracle, and tools such as Talend, Informatica, DataStage, Collibra, and Alfresco. Expertise in metadata management, data quality, data warehousing, analytics, and GDPR governance. Advanced data modelling skills (conceptual/logical ...