76 to 100 of 138 Data Lake Jobs in the UK

Silver/Gold). Developing scalable models and Power BI semantic layers for enterprise reporting. Enhancing and supporting components across Azure Data Lake, ADF, Synapse, Azure SQL and related Microsoft stack tools. Applying engineering discipline across testing, code management, CI/CD and performance optimisation. Working closely … alignment with architectural standards. What You'll Need to Succeed Strong hands-on engineering experience within Microsoft Fabric (Lakehouse, Pipelines, Dataflows Gen2, Notebooks, Direct Lake). Previous experience with Azure Databricks and Delta Lake engineering. Solid working knowledge of the Microsoft data stack: Azure Data ...

Technical Data Engineer/Analyst | Contract | Azure | 6 months | Hybrid | Outside IR35 | £425 - £475 | Nottingham | We’re supporting a major data transformation programme and looking for a Technical Data Analyst to help migrate legacy systems into a modern Azure data platform . … Strong SQL skills and experience working with Azure-hosted datasets Power BI reporting/dashboards creation Python experience Exposure to Azure Data Lake, Databricks, or Data Factory is beneficial If this is a role that suits your skill set, you are immediately available ...

Delivery Manager - Data Engineering Manchester (Hybrid) We're working with a leading global investment firm looking to hire a Delivery Manager - Data Engineering to lead a team of Data, DataOps and MLOps engineers. This is a great opportunity to take ownership … Engineering/DataOps background Experience with AWS, Python/PySpark, ETL/ELT pipelines Strong understanding of data platforms (Data Lake/Lakehouse/EDW) Hybrid working (3 days in office) + strong bonus and benefits package. ...

time. Your Role: Design, develop, and optimise large-scale cloud data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark, and Unity Catalog. Collaborate with underwriting, actuarial, Delegated Authority, bordereaux, exposure management, reinsurance, finance, and Solvency … Your Skills: Expert-level hands-on experience with Azure Data Services and Databricks in enterprise, highly regulated environments. Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, distributed compute, data modelling, and performance optimisation. Strong programming skills in Python, PySpark, and Spark SQL, with experience ...

working with a company in the financial sector who is leveling up their Data and we're looking for a Data Engineer who can design high-quality pipelines, develop robust data models and help shape the next generation of our enterprise data …/CD with Azure DevOps Monitor, troubleshoot and improve pipeline performance Ensure strong governance, security and GDPR compliance Tech stack Azure Data Lake * Databricks * ADF * dbt * SQL * Python/PySpark * Data Vault * Kimball * Git * Azure DevOps What you bring 3-5 years' experience in data ...

Principal Data Architect - Hybrid - London - No Sponsorship Available About the Role We are seeking an experienced and visionary Principal Data Architect to join a leading consultancy in the financial services sector. This strategic role involves leading complex, high-profile data initiatives that drive innovation … Strong expertise in cloud technologies (AWS, Azure, GCP) with relevant certifications highly desirable. In-depth knowledge of data modeling, data lake design, and metadata management tools. Proven ability to design secure, scalable, and cost-effective data solutions in cloud ecosystems. Experience ...

Turn messy, fragmented data into something the business can actually trust. About the client: You will be working with a major UK-based organisation that operates across a portfolio of well-known brands, delivering at scale within a complex distribution environment. With deeply integrated ERP and finance systems … architecture that can be leveraged across multiple business units. Tech environment: You will be working across a modern Azure stack including Data Lake, Synapse, Databricks, Data Factory, and SQL, with exposure to complex enterprise data environments. What we are looking ...

Senior Data Engineer | £600 per day Outside IR35 | 6 Month Contract A PE-backed asset/wealth management firm managing multi-billion pounds in assets is seeking a Senior Data Engineer to design and deliver a new Azure-based data warehouse. The organisation … take a hands-on role building a robust data platform from ingestion through to consumption. Tech Environment: Azure Data Lake Storage Azure Synapse Medallion Architecture ETL/data ingestion pipelines Dimensional modelling Strong governance, security, and error handling Ideal Experience: Azure-based data ...

Microsoft Data Solution Architect Remote based. Paying up to 80k basic + 20-30k commission A leading Microsoft Consultancy is looking for a Data & AI Presales Solution Architect to join the business on a permanent basis. This is a key role within their growing Data … technical role within the Microsoft ecosystem. Deep understanding of Azure Data Services , including Data Factory, Synapse, Databricks, Data Lake, Microsoft Fabric and related analytics tools. Knowledge of AI and machine learning capabilities within Azure, such as Cognitive Services and Azure OpenAI. Ability ...

Head of Data (Maternity Cover) London £90,000 to £100,000 plus benefits This is a standout opportunity to lead a data function during a pivotal digital transformation. You will play a key role in shaping product and supply chain data foundations, guiding … overhaul, and driving data quality across an international consumer brand. If you enjoy delivering structure, enabling teams, and building scalable data ecosystems, this role offers real impact. The Company They are a global consumer brand within the comfort-focused footwear market, operating across ecommerce, wholesale ...

Data Engineer Hybrid/UK (DV Clearance Required) We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise … professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets ...

Data Engineer Hybrid/UK (DV Clearance Required) We are working with a leading global consultancy to hire a DV-cleared Data Engineer who will turn complex data into actionable insights. In this role, youll collaborate with multidisciplinary teams to design, build, and optimise … professional development, including technical courses, certifications, mentoring, and coaching. Tech stack: AWS cloud (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB) for ETL, data lake/warehouse design, and data movement. Programming: Java, Python, Scala, Spark, SQL. Experience integrating and processing large-scale structured and unstructured datasets ...

Data Engineer - Databricks - Hybrid (London) - Azure/AWS - Up to £75,000 If you're a Data Engineer who enjoys working close to the business, solving real problems and seeing the impact of what you build, this is worth a look. You'll be joining … supportive, down-to-earth team What they're looking for: Solid experience with Databricks (Azure or AWS) Good understanding of tools like Delta Lake, Unity Catalog, MLflow Strong SQL and Spark (Python or Scala) Experience working with data pipelines and modern data platforms A good ...

Business Intelligence Developer We are looking for a skilled and motivated Business Intelligence Developer to join a data and analytics team. This role is ideal for someone with strong technical expertise in Power BI , Microsoft Business Intelligence tools , SQL , and DAX , who is passionate about transforming data … into technical BI solutions. Strong analytical thinking and problem-solving skills. Desirable Skills Experience working with data warehouses or data lake architectures. Knowledge of ETL processes and data integration. Experience with Azure data services or cloud-based BI platforms. Understanding ...

Were looking for a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to join our growing data team. If youre passionate about building scalable, modern data platforms in Microsoft Azure, wed love to hear from you. What Youll Do Design, build … processes using tools such as Azure Data Factory Work with large datasets in Azure Synapse Analytics and Azure Data Lake Storage Collaborate with analysts and stakeholders to deliver high-quality, reliable data solutions Ensure data governance, security, and performance best practices ...

Title: Data Solution Architect (AWS, Data Engineering) Location: Norwich, Norfolk (3 Days a week) Job Type: Contract (Inside IR35) Duration … Months The Role Your Responsibilities: (Up to 10, Avoid repetition) Experience as Solution Designer and should be currently working on Data Lake (Big Data) based projects click apply for full job details ...

Role – Azure Data Engineer Technology – MS Fabric, Azure, PowerBI Location – Leeds, UK Job Description Today, the corporate landscape is dynamic, and the world ahead is full of possibilities! None of the amazing things we do at Infosys would be possible without an equally amazing culture, the environment where … high‐quality delivery of modern analytics platforms. Required •Strong hands-on expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, Azure SQL, Synapse. •Proven experience designing and developing solutions using Microsoft Fabric: o Lakehouse o Data Pipelines o Dataflows Gen2 ...

companies globally – with offices in New York, London, Madrid and Singapore. We are at an early and exciting stage of embedding AI and data capabilities across the firm. This hire is central to that effort. The Role: We are looking for a commercially minded AI and data … into the business in a practical, considered way Data Infrastructure and Reporting Help maintain and extend our Snowflake-based data lake, supporting data quality and accessibility across the business Build and maintain Power BI dashboards and reports that drive commercial decision-making across ...

Raytheon UK have a full time, permanent opportunity for a Data Engineer to join our team on our Manchester, Gloucester or London sites working onsite. Our Data Engineering role will be responsible for building and maintaining data processing pipelines and also the transformation … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices We appreciate you may not be an expert in every area ...

Next.JS, React, any web development experience would be a plus) Bonus points for Knowledge of asynchronous messaging patterns Experience with Azure Data Lake, Data Factory, and Logic Apps Exposure to AI, machine learning, or data engineering CI/CD experience with Azure DevOps ...

Principal Data Architect, Secure Government and Defence Programmes Location: UK, hybrid, client site as required Security Requirement: Developed Vetting (DV) clearance is mandatory. This role is only suitable for candidates who currently hold active DV clearance. Overview A leading UK consulting organisation delivering mission-critical digital and data transformation across defence, national security, and sensitive government environments is seeking a Principal Data Architect. This is a senior, client-facing role focused on defining and delivering secure, scalable data platforms within highly classified programmes. Due to the nature of the work and access ...

existing Netezza structures. Produce the EDW logical and physical data models, dimensional models for the Semantic Layer, and Data Lake zone architecture (Bronze/Silver/Gold). Define Enterprise Semantic Layer design, including pre-computed aggregations, dimensional models, and Tableau connectivity specifications. Lead source … with at least 3 years leading enterprise data model design. Experience designing Lakehouse architecture: medallion architecture (Bronze/Silver/Gold), Delta Lake, or equivalent. Proficiency in dimensional modelling (Kimball methodology) and enterprise data modelling. Experience with Databricks (Unity Catalog, Delta Lake) or Snowflake ...

working with a well known education provider based in London to hire a Power BI Analyst. This role will involve transforming raw data into actionable insights and playing a key role in delivering dashboards, KPI frameworks and analytical solutions across the organisation. As the Power BI Analyst … closely with stakeholders across the business to gather requirements, design and develop interactive dashboards, and deliver scalable BI solutions. You’ll also support data governance, improve data quality across SQL, Dataverse and Synapse environments, and contribute to predictive analytics and machine learning initiatives. Skills required ...

across engagements. What you'll do Lead the engineering, optimisation and governance of Azure-based data platforms, spanning ADF, Data Lake, Azure Functions, Key Vault, Databricks, Delta Lake, PySpark and Unity Catalog . Collaborate closely with insurance domain teams- Underwriting, Actuarial, Delegated Authority, Bordereaux … bring Expert-level hands-on experience with Azure data services and Databricks in enterprise-scale environments. Strong knowledge of Delta Lake , Medallion architecture, distributed compute and Lakehouse engineering patterns. Advanced Python, PySpark and Spark SQL skills, including deploying data workloads through Azure DevOps CICD , branching ...

Role/Job Title: Security Engineer Work Location: Manchester ( 2 to 3 days) Duration of Assignment: 6 Month Role Description Supported Data Security Posture Management (DSPM) through structured and unstructured data discovery and scanning Deployed and managed applications using Kubernetes and Helm Implemented data privacy and regulatory controls aligned with General Data Protection Regulation Automated data security processes using scripting and CI/CD workflows Key Responsibilities Performed structured and unstructured data discovery and classification to support Data Security Posture Management (DSPM) Deployed ...