6 of 6 Data Lake Jobs in Scotland

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

Data Architect We are currently partnered with a a UK-based financial services organisation providing banking and insurance products to millions of customers nationwide. The business has a strong heritage in retail-focused financial services, with a clear purpose of making money management simpler, more accessible, and better … pipelines to support data hydration and consumption. Own and evolve cloud architecture designs, primarily on AWS, applying modern data lake technologies and integration patterns for data ingestion, transformation, and analytics use cases. Provide architectural leadership within regulated environments such as financial services ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

Senior Data Engineer | Edinburgh | Competitive Pay & Great Benefits Design the future of data with one of Scotland's leading Microsoft Partners Are you a Data Engineer who loves turning complex data into powerful, scalable platforms? Do you thrive working directly with clients … Scotland's largest Microsoft Partners and a Microsoft Direct Cloud Solutions Provider (CSP) — is growing fast, and we're looking for a Senior Data Engineer to join our well-established and expanding Data team. This is a hands-on, client-facing role where you'll lead ...

Senior Data Engineer | Remote (UK or Europe) A leading prop trading firm is hiring a Senior Data Engineer to take ownership of their trading and market data infrastructure. Operating globally with connectivity to dozens of exchanges, the firm executes millions of trades daily with … data playing a mission-critical role in every aspect of the business. This is a high-impact, high-autonomy role in a lean engineering environment. You'll design and maintain real-time and historical data systems, power internal analytics tooling, and ensure data quality ...

role You will support and evolve an internally developed Unified Policy Portal (UPP) - a web application with an Azure-hosted data lake Back End used for Firewall rule recertification (Check Point, Illumio, Fortinet). The role includes designing new features to support WAF, network segmentation, and Proxy … documentation, governance, and peer review practices What you'll bring Strong experience in software and solution architecture , including: System design and architecture patterns Data modelling and entity relationship design API design and system integration Broad IT background with the ability to engage confidently with non-security SMEs Experience ...