26 to 50 of 68 ETL Jobs in Scotland

skills. Desirable Skills Experience supporting applications hosted within Microsoft Azure. Azure DevOps and CI/CD pipeline exposure. Power Platform. Logic Apps. SSIS and ETL processes. Oracle databases. Experience supporting integrations with third-party systems. Experience working within public sector environments. Microservices architecture. ITIL Foundation certification. Microsoft Azure certifications. Security ...

onsite. Required Skills & Experience 5+ years of experience as a Data Engineer. Strong expertise in SQL and Python/Scala. Hands-on experience with ETL tools and frameworks. Experience with data warehousing concepts and dimensional modeling. Strong experience in cloud platforms such as AWS/Azure/GCP. Experience with ...

data persistence. - Hands-on exposure to Kafka or similar publish-subscribe systems for real-time event processing. - Familiarity with Snowflake and data pipeline concepts (ETL, batch vs. streaming). - Experience with Agentic coding and general understanding of how LLMs are working - Strong focus on clean architecture, maintainability, and production readiness. ...

Improve data reliability, coverage, traceability and timeliness. Key Skills Data engineering and analytics expertise. Experience with Power BI and Databricks. Strong data modelling and ETL skills. Understanding of cyber security technologies and security data sources. #J-18808-Ljbffr ...

effective enterprise-wide data governance framework Lead the Data Governance Committee Drive improvements in data quality, controls and master data management Oversee data warehouse, ETL, reporting, analytics and visualisation capabilities Ensure data platforms are secure, resilient, scalable and aligned with wider technology strategy Develop and enhance management information, business intelligence ...

deploying to and reasoning about containerised workloads in a managed K8s environment. Experience orchestrating pipelines with Dagster, Airflow, Prefect, or similar. Solid grasp of ETL concepts and production‐grade pipeline design. Beneficial Skills Interest in chemistry, life sciences, robotics, or manufacturing. Hands‐on experience with scientific data, chemical, biological ...

modern data engineering technologies Practical experience developing Production-scale Cloud-native data engineering solutions in commercial environments Familiarity with Cloud Data engineering services (e.g., ETL, Glue, S3, Athena) and MLOps stack Ability to convey design choices and results clearly and communicate effectively to stakeholders of various backgrounds Preferred qualifications, capabilities ...

coding hygiene and system architectureRequired qualifications, capabilities, and skillsFormal training or certification on software engineering concepts and advanced applied experience with SQL, Data Transformation, ETL, Python.Working knowledge of AWS, Databricks and big data technologies and concepts.Hands-on practical experience in system design, application development, testing, and operational stabilityExperience in developing ...

and system architecture Required Qualifications, Capabilities, And Skills Formal training or certification on software engineering concepts and advanced applied experience with SQL, Data Transformation, ETL, Python. Working knowledge of AWS, Databricks and big data technologies and concepts. Hands-on practical experience in system design, application development, testing, and operational stability ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

automation scripts or custom AI agents using node or python. Data Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real-time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside ...

implementing modern and scalable data management platforms (including modern data lake and enterprise data warehouse solutions as well as consolidated and modern data pipelines (ETL\ELT) to extract, aggregate and manipulate data from various sources Designing, developing and implementing end-to-end Business Intelligence (BI) solutions with data semantic models ...

such as data lakes, warehouses, or cloud-based systems.Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions.Develop and maintain ETL processes for ingesting, transforming, and loading data from diverse sources.Conduct advanced data analysis, modelling, and visualization to identify patterns and insights.Ensure data quality, reliability, and … Presto, etc.) and cloud services (e.g., Azure, AWS, GCP).Familiarity with data visualization tools and business intelligence (e.g., Power BI). Solid grasp of ETL workflows within databases/warehouses such as Oracle, PostgreSQL, SQL Server etc.Excellent problem-solving and interpersonal skills.Preferred Qualifications: Experience with machine learning frameworks and tools ...

and CloudFormation to deliver high-performance data solutions for enterprise analytics. The role emphasizes collaboration with Data Scientists and Analytics teams, building production-grade ETL/ELT frameworks, and implementing CI/CD with GitLab while advancing platform modernization and secure data #J-18808-Ljbffr ...

into reliable data solutions, this is a great opportunity with a reputed client. You'll develop SQL databases, SSRS reports and data models, maintain ETL processes feeding an established data warehouse, and work closely with teams across the business to improve reporting capability and analytical maturity. The role offers ...

and system architecture Required qualifications, capabilities, and skills Formal training or certification on software engineering concepts and advanced applied experience with SQL, Data Transformation, ETL, Python. Working knowledge of AWS, Databricks and big data technologies and concepts. Hands-on practical experience in system design, application development, testing, and operational stability ...

and security expectations; ability to guide peers on safe and effective usage within team practices Hands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environment Preferred Qualifications, Capabilities, And Skills Experience leading engineering teams within ...

resiliency and security expectations; ability to guide peers on safe and effective usage within team practicesHands-on experience building and operating data pipelines (e.g., ETL/ELT patterns, orchestration/scheduling, monitoring, and data quality checks) in a production environmentPreferred qualifications, capabilities, and skillsExperience leading engineering teams within a large ...

Spark, Python, and AWS services. Build and optimize data lakes and data warehouse solutions ensuring data quality, security, and accessibility. Develop reusable, production-grade ETL/ELT frameworks and data processing solutions. Implement orchestration workflows using AWS Step Functions, Airflow, and other automation tools. Develop and maintain cloud infrastructure using … Engineering with delivery of production-grade solutions. Expertise in PySpark, Apache Spark, Python, and SQL. Strong experience designing and optimizing complex data pipelines and ETL/ELT frameworks. Hands-on experience with AWS services including: S3 Glue Lambda Step Functions ECS IAM KMS VPC SageMaker (preferred) Experience with AWS CloudFormation ...

Build and evolve the serving layer - including graph and vector retrieval, GraphRAG, response assembly, and a Model Context Protocol endpoint consumed by downstream agents Extract and promote reusable components into a shared core library, reducing duplication across the platform's repositories Integrate with data sources and services across the firm … tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAI Experience with Databricks, MongoDB, or large‐scale extract, transform, and load/data integration workflows Knowledge of data governance, lineage, and entitlements concepts in an enterprise environment ABOUT US J.P. Morgan is a global leader ...

patterns (tool/function calling, Model Context Protocol), or platforms such as Bedrock or Azure OpenAIExperience with Databricks, MongoDB, or large-scale extract, transform, and load/data integration workflowsKnowledge of data governance, lineage, and entitlements concepts in an enterprise environmentJ.P. Morgan is a global leader in financial services, providing ...

seeking a Data Engineering Specialist to join the Architecture & Modernization team in a hybrid UK-based role. You will build and maintain data pipelines, ETL processes, and data platforms for Data AI initiatives, collaborating with stakeholders to drive data-driven insights. The role requires 8+ years of data engineering experience ...

collect, transform, and integrate data from various sources. Data Architecture: Develop and optimise data architectures, including data warehouses, data lakes, and other storage solutions. ETL/ELT Processes: Create and maintain reliable ETL/ELT workflows that ensure data quality and accessibility. Collaboration: Work closely with data scientists, analysts, and ...

will shape the data strategy, collaborating across departments to create a robust data ecosystem. The ideal candidate brings deep expertise in data warehousing, modeling, ETL/ELT, and cloud platforms, and will partner with teams to enable reliable, high-quality data for decision making and future AI initiatives. #J ...

team’s continuous development Ability to contribute to the practice development with publications, approach, toolkits, benchmarks, position papers, studies, insightsExperience working in Data Architecture, ETL development, and Data Warehousing across Finance and Accounting processesExperience working with Finance software vendors both in go-to-market activities, design and implementation ...