51 to 66 of 66 ETL Jobs in Scotland

and complex query writing skills. Expertise in Shell/Python/Ansible scripting. Knowledge of Patroni for HADR and streaming replication. Desirable Skills: ETL process implementation. Experience with Informatica, Talend. Cloud computing expertise (AWS, Azure, GCP). Experience with PostgreSQL & Greenplum. Interested? Apply now and be part of a dynamic ...

work closely with client services, strategy and digital colleagues to build and maintain data pipelines and architecture, including data dictionaries, databases, and ETL processes using tools such as Adverity and BigQuery. You'll also help design and QA bespoke dashboards, maintain data integrity, and ensure consistent, clean, and accurate data ...

work closely with client services, strategy and digital colleagues to build and maintain data pipelines and architecture, including data dictionaries, databases, and ETL processes using tools such as Adverity and BigQuery. You'll also help design and QA bespoke dashboards, maintain data integrity, and ensure consistent, clean, and accurate data ...

both technical and executive audiences, whether impromptu on a whiteboard or using presentations and demos Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Extensive hands-on expertise with SQL and SQL analytics and scripting languages like Python, Bash, Shell … Business Objects, Tableau) Experience and understanding of large-scale infrastructure-as-a-service platforms (e.g. Amazon AWS, Microsoft Azure, GCP, OpenStack, etc.) Experience implementing ETL pipelines using custom, packaged tools and software development experience using C/C++, Java etc. SnowPro Core Certification ...

environments. Key Responsibilities Design, build, and maintain scalable data pipelines using PySpark and Python for high-volume, high-velocity data processing. Develop and manage ETL/ELT workflows, ensuring data accuracy, consistency, and performance. Orchestrate complex workflows using Apache Airflow, including scheduling, dependency management, and failure handling. Architect and implement … with experience in writing optimized, production-grade code. In-depth knowledge of Apache Spark internals and Apache Airflow. Proven experience designing and implementing ETL pipelines for large-scale data platforms. Strong hands-on experience with AWS cloud services, especially API Gateway, Lambda, Redshift, Glue, CloudWatch, S3, and EMR. Experience provisioning ...

Data Scientist (GIS) - Remote (Data Scientist, Data Science, Data Analyst, Data Analysis, ETL, Sparse data, Spatial data processing, QGIS, Spatial data storage, PostGIS, Jupyter notebooks, Python, Azure Data Factory, Cosmos DB, PostgreSQL, Statistics, Data Analytics, C# .NET, Data Scientist, Data Science, Data Analyst, Data Analysis) Our client is a prestigious … last 12 months. They are looking for a Data Scientist with a strong GIS focus to be responsible for analysing large datasets to extract actionable insights, build predictive models and develop data-driven solutions to complex problems. You will play a major part in data visualization, statistical analysis and collaboration ...

Data Scientist (GIS) - Remote (Data Scientist, Data Science, Data Analyst, Data Analysis, ETL, Sparse data, Spatial data processing, QGIS, Spatial data storage, PostGIS, Jupyter notebooks, Python, Azure Data Factory, Cosmos DB, PostgreSQL, Statistics, Data Analytics, C# .NET, Data Scientist, Data Science, Data Analyst, Data Analysis) Our client is a prestigious … last 12 months. They are looking for a Data Scientist with a strong GIS focus to be responsible for analysing large datasets to extract actionable insights, build predictive models and develop data-driven solutions to complex problems. You will play a major part in data visualization, statistical analysis and collaboration ...

play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies … collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure ...

play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies … collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure ...

play a pivotal role in delivering innovative, data-driven solutions for high-profile government clients. You'll be responsible for designing and implementing robust ETL pipelines, leveraging cutting-edge big data technologies, and driving excellence in cloud-based data engineering. This role offers the opportunity to work with leading technologies … collaborate with data architects and scientists, and make a significant impact in a fast-paced, challenging environment. Key Responsibilities: Design, implement, and debug ETL pipelines to process and manage complex datasets. Leverage big data tools, including Apache Kafka, Spark, and Airflow, to deliver scalable solutions. Collaborate with stakeholders to ensure ...

and collaboration. Responsibilities: Design, develop, and maintain scalable data pipelines and transformation processes utilizing modern tools and frameworks Implement and optimise data workflows and ETL procedures within Snowflake Create robust data models to support advanced analytics and machine learning initiatives Collaborate with cross-functional stakeholders to understand business data requirements … experience with Python and data transformation techniques Must have led and developed a team of Data Engineers Expertise in Snowflake cloud data platform and ETL process optimisation Familiarity with machine learning tools such as TensorFlow or scikit-learn Strong communication skills, capable of translating complex technical concepts to non-technical ...

through personally developed code, solution architectures and implementation recommendations Act as a trusted advisor to customer executive leadership for thought leadership and solution approaches Extract business requirements from customers and translate them into a well-architected recommendation Develop and provide forward looking guidance and future state roadmaps Leverage known best … lead role for analytics projects for large enterprises Experience implementing and operating Snowflake centric solutions Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Familiarity with industry common BI and ETL solutions Hands-on experience in a technical role leveraging ...

through personally developed code, solution architectures and implementation recommendations Act as a trusted advisor to customer executive leadership for thought leadership and solution approaches Extract business requirements from customers and translate them into a well-architected recommendation Develop and provide forward looking guidance and future state roadmaps Leverage known best … lead role for analytics projects for large enterprises Experience implementing and operating Snowflake centric solutions Understanding of complete data analytics stack and workflow, from ETL to data platform design to BI and analytics tools Familiarity with industry common BI and ETL solutions Hands-on experience in a technical role leveraging ...

great chance to work on impactful data projects across NHS and private healthcare organisations. Role Deliver data warehouse and reporting solutions Develop ETL and data integration processes Turn requirements into production-ready data solutions Maintain existing data warehouse products Produce technical documentation Test and validate outputs Skills & Experience 5+ years … ETL development 5+ years SQL development Experience with large databases NHS/healthcare experience NHS EPR or PAS data experience Strong ETL/data handling skills Knowledge of NHS datasets (CDS, RTT, MHSDS) SSRS, SSIS, BI tools Data warehouse modelling EPR migration experience NO SPONSORSHIP IS AVAILABLE FOR THIS ROLE ...

great chance to work on impactful data projects across NHS and private healthcare organisations. Role Deliver data warehouse and reporting solutions Develop ETL and data integration processes Turn requirements into production-ready data solutions Maintain existing data warehouse products Produce technical documentation Test and validate outputs Skills & Experience 5+ years … ETL development 5+ years SQL development Experience with large databases NHS/healthcare experience NHS EPR or PAS data experience Strong ETL/data handling skills Knowledge of NHS datasets (CDS, RTT, MHSDS) SSRS, SSIS, BI tools Data warehouse modelling EPR migration experience NO SPONSORSHIP IS AVAILABLE FOR THIS ROLE ...

utilities like gpload, pxf, and GP Spark for efficient data loading and integration. * Ensure database security, compliance, and adherence to best practices. * Knowledge about ETL processes and its implementation * Knowledge of SQL and complex query writing. * Implement monitoring solutions to proactively identify and resolve issues. * Develop scripts in Shell/… writing * Expertise in Shell/Python/Ansible scription knowledge * Expertise in Patroni for HADR and streaming replication Desirable skills/knowledge/experience: * ETL processes and its implementation * Building data ingestion pipelines with tools like Informatica, Talend etc * Cloud computing experience with AWS, Microsoft Azure, Google Cloud This ...