51 to 68 of 68 ETL Jobs in Scotland

collect, transform, and integrate data from various sources. Data Architecture: Develop and optimise data architectures, including data warehouses, data lakes, and other storage solutions. ETL/ELT Processes: Create and maintain reliable ETL/ELT workflows to ensure data quality and accessibility. Collaborate: Partner with data scientists, analysts, and client ...

results, supporting data engineers and stakeholders on data analysis issues.Designing and implementing a data streaming service, including the development of new data models and ETL processes.Ensuring the successful delivery of completed data loads for customers, Data Analysts and Data Scientists, troubleshooting where required.Designing, building and testing data products and solutions … data analysis, solution design and end user reporting.Experience of any of the following: IT programming and automation, using tools such as industry standard ETL tools, network databases and scheduling and orchestration tools, using modern/open source programming languages in order to deliver data development/engineering products, using public ...

made to enable individuals with disabilities to perform the essential functions. Professional Experience Very desirable is experience with Agentic AI in a ELT/ETL capacity (Preferred) Exposure to Kafka or streaming platforms from an infrastructure or operational perspective (Preferred) Experience with observability tooling (logging, metrics, alerting) for cloud platforms … Preferred) Experience supporting Spark‐based platforms (e.g. EMR, Glue, Databricks) (Preferred) Proficient with DevOps tools and practices (Git, Jenkins, Docker, Kubernetes) as well as ETL frameworks (Apache Spark, Airflow, AWS IoT Analytics/Device Management/Events). (Preferred) Programming expertise in Python, Java, Scala, SQL, Spark, Unix shell scripting ...

Morgan Stanley in Glasgow requires a capable Full Stack Developer – Data Engineering to design scalable, secure data platforms and services supporting enterprise protection and obfuscation initiatives. You will build on-prem and cloud-based database ...

systems, services and data domains.Technology background and CFA/FRM charters are highly appreciated.Strong environment strategy and architecture design experience.Strong experience in data mining, ETL experience platforms, data visualization/reporting/presentation tools. Exposure to messaging protocols, public/private cloud platforms and EDMsExperience integrating with other industry providers ...

scalable data solutions while adopting best practices and emerging trends in data engineering. You will collaborate with data scientists, analysts, and stakeholders, delivering robust ETL/ELT processes, data integration, and documentation. #J-18808-Ljbffr ...

prem and multi-cloud environments, security and performance. You will collaborate across teams to build AI-driven, metadata-enabled solutions and robust ETL pipelines, while aligning with #J-18808-Ljbffr ...

leverage Java and Scala to build pipelines, manage distributed big data frameworks, and optimize our data platform. The role emphasizes strong SQL, Java development, ETL/ELT experience, and collaboration with data architects and stakeholders to translate requirements into robust data solutions. Onsite in Glasgow with 3 days per week ...

work on enterprise-scale applications and integrations. You will develop and support scalable Java applications, implement workflows in AWS, ensure robust data processing and ETL flows, and collaborate with architects and DevOps in a 5-day onsite environment. This is a 6-month initial contract with potential FTC/ ...

Change is seeking a Data Engineer to join a greenfield enterprise knowledge management program. You’ll shape target-state architecture, build scalable ETL/ELT pipelines and develop knowledge graphs with GCP, BigQuery, Spanner and Neo4j. Hybrid working model (Manchester/Edinburgh/Leeds) with about 2 days onsite ...

integrated solution and business outcome. Apply technical understanding of data architecture and data models -including relational and non-relational data structures, data flows, ETL/ELT, cloud data platforms, data quality, metadata and lineage to challenge solution approaches, inform technical decisions and effectively direct specialist engineering and architecture teams. Work … assessment, feasibility, data readiness, risk, business-case development and implementation planning. Strong technical understanding of modern data architectures and platforms, including data modeling concepts, ETL/ELT patterns, cloud data platforms such as Snowflake and Databricks, data quality tools, metadata tools, lineage tools and data governance tools such as Collibra ...

design event‐driven and asynchronous integration patterns. Collaborate with stakeholders to ensure seamless data flow across interconnected systems. Design, develop, and maintain background ETL processes for data ingestion, transformation, and loading. Build and optimize data pipelines that support analytics, reporting, and operational workflows. Ensure data integrity, reliability, and traceability across … similar message brokers for asynchronous processing. Practical experience with cloud services, preferably Microsoft Azure and/or GCP. Demonstrated expertise in designing and implementing ETL pipelines and background processes. Strong understanding of system architecture principles – microservices, event‐driven design, and API gateways. Soft Skills Strong team player with excellent collaboration ...

threading and multiprocessing libraries and ensure robust error handling and resource management in parallel execution environments.Deliver secure, high-performance and efficient database and ETL capabilities using Java Collections Framework, data structures, algorithms, and object-oriented design principles, while ensuring scalability, governance, and reliability.Design and develop full-stack applications, including responsive … user interfaces, RESTful APIs, backend services, and integrations with database and ETL platforms.Build self-service capabilities, operational dashboards, workflow automation, and metadata-driven solutions using modern web technologies and microservices architectures.Develop AI-driven solutions to discover, classify, and protect sensitive information within unstructured data, leveraging advanced natural language processing and ...

support the needs of Data Products.To be successful in the role of a Business Analyst for Data Products you should have:Ability to extract Data Requirement and prepare Business Requirement Doc (BRD), Functional Requirement (FR), Non-Functional Requirement (NFR).Excellent SQL Skills with Data Warehousing and Data Lake understanding.Understand Data … Model, ETL Data Pipeline, Data Lineage.An understanding of Data Products, business analysis techniques, including requirement gathering, documentation, function design and process flows.Articulate your ideas, playing back the business needs in a language that can be easily understood while being able to articulate technical concepts to non-technical stakeholders.Some other highly ...

influence target-state architecture, data design, technical spikes and platform development from the outset. What you’ll be doing Design and develop scalable ETL/ELT data pipelines across multiple enterprise sources. Build enterprise data solutions using GCP, BigQuery, Google Spanner, Neo4j and Vector Databases. Develop Knowledge Graphs and data … solutions using Python and SQL. Collaborate with AI Engineers, Data Scientists, Architects and Governance teams. What we’re looking for Strong GCP experience. Strong ETL/ELT experience. Experience working with complex, cloud-native data environments. BigQuery experience. Kafka/event-driven architectures. Neo4j/Knowledge Graphs. AI/ ...

ideal candidate will have over 5 years of experience in the banking sector, focusing on data engineering. Proficiency in SQL, Python, and various ETL tools, along with experience in cloud platforms like AWS, is essential. The responsibility includes developing data pipelines and ensuring data governance. A Bachelor’s or Master ...

clients with respect to data assessment processes and procedures.Advise clients and face off to the vendor with respect to the reconciliations approach surrounding the ETL design.Management and coordination of data loads in conjunction with the vendor and downstream systemsOversee any manual extract/transformation of data from source systems and … process where required.Engage with the migration or UAT test team as part of test strategy definition and delivery.Develop a consolidated cutover runbook detailing the ETL execution and supporting processes.Connect to your skills and professional experience Strong consulting experience, preferably in the wealth management or pensions domains. Experience in successfully managing ...

Java Full Stack Developer - AWS Mandatory Skills: Java FSD, AWS, webMethods Integration, Flow Services, Database Performance Tuning, File Processing, ETL/Flink. Location: Glasgow Working: 5 days onsite Contract: 6 months initially Rate: £350/day Inside IR35 - maximum Experience: 7+ years MUST HAVE Future Opportunity: Potential FTC/… Full Stack Development Java 17+, Spring Boot, Microservices AWS Cloud webMethods Integration Server & Flow Services File processing & data transformation SQL, database performance tuning & optimisation ETL/Apache Flink or equivalent REST APIs, messaging & event-driven architecture CI/CD, Git & DevOps Frontend: Angular/React, JavaScript, HTML, CSS Responsibilities: Develop ...