16 of 16 Contract Data Lake Jobs in London

pipelines and data integration workflows using Microsoft Azure services such as Data Factory, Synapse Analytics, Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain … EXPECTATIONS IN THE ROLE Strong hands-on experience with Microsoft Azure data services (Data Factory, Synapse Analytics, Data Lake, Databricks). Direct experience delivering solutions using Microsoft Fabric. Advanced SQL skills and experience with data modelling, transformation, and integration. Familiarity with ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices … Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory ...

Senior Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best ...

Details Role/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management: Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing ...

Role Overview We are looking for a Finance-specialised Data Business Analyst to support FP&A transformation and finance data projects. This role combines financial reporting understanding with strong business analysis skills to deliver accurate, insightful data solutions across the Finance/… deliverables. Act as the liaison between finance teams, data engineers, and technology teams. Conduct GAP analysis between current state Data Lake & desired future state Coordinate UAT & ensure compliance with FP&A controls. Manage expectations and provide regular updates on progress and risks. Support creation ...

Developer on a 12-month FTC. The focus of the role is to provide technical expertise to deliver effective BI systems across the data functions within the organisation. The focus is to ensure that the organisation develops a strong internal data-related BI environment to inform … data architecture team to enhance the accuracy of data held in the data warehouse/data lake When necessary, provide line management and deputise for senior colleagues Essential Skills and Experience: Extensive experience developing PowerBI reports, dashboards, advanced DAX expressions ...

Your new company Working for a renowned commodity, metals, trades and exchange group. You'll be a key part of the Enterprise Data team helping to replace legacy ETL tools (Informatica) and deliver modern data engineering capabilities. Your work will include managing data pipelines … visualisation, and collaborating with ETL developers and wider technology teams to deliver solutions aligned with our strategic roadmap. You'll work across backend, data, and infrastructure engineering, contributing to solution design, implementation, deployment, testing, and support. This is a hands-on role for someone with strong data ...

Technical Business Analyst (BA) and Architect to drive enterprise-scale digital transformation initiatives. This role combines business analysis, solution architecture, cloud architecture, and data architecture, acting as a bridge between business stakeholders and technology teams. Key Responsibilities: Business Analysis (BA): - Engage with stakeholders to gather and document business … initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm, Terraform - Ensure ...

Role: EU Data Manager Location: Paddington, London (Hybrid/Remote with occasional office visits) Start Date: ASAP Duration: 12-Month Contract Rate: £414.44 - £550 per day (Inside IR35) Are you a data-driven professional with a passion for the FMCG sector? We are looking … shaping the future data strategy for the region. Key Responsibilities Reporting Ownership: Act as the primary lead for the Data Lake and the SPRINT external reporting suite (managed by Red Slim). Data Strategy: Plot and map data suppliers (NielsenIQ, ePOS ...

mining, and visualization to extract insights. Design and implement Big Data solutions using Hadoop, Spark, PySpark, and Data Lake architectures. Develop and deploy ML models (supervised, unsupervised, tree-based, ensemble methods). Implement deep learning architectures (CNN, RNN, LSTM) using TensorFlow, PyTorch … Analytical Tools: EDA, Data Mining, Visualization (Plotly, Matplotlib, Seaborn) Statistical & Multivariate Analysis Big Data: Hadoop, MapReduce, HDFS, DataBricks, Spark, PySpark DataLake Architecture, AWS Redshift, Kinesis, EMR Machine Learning Supervised Models: Nave Bayes, Logistic Regression, SVM, Linear Regression, KNN, Tree-Based Models: Decision Trees, Random Forest, Gradient ...

Data Platform Engineer - Terraform, Azure Services, ADF, Synapse £Market Rate (Inside IR35) London/Hybrid 6 months My client is an instantly recognisable firm who urgently require a Data Platform Engineer with core strengths in Building and Operating Data Platforms, and hands on expertise … Factory (ADF), including network configurations and integration runtime options Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts Ability to showcase DevOps and CI/CD capabilities Working knowledge of designing and deploying infrastructure Experience in efficient handling of large ...

with the organisations goals and best practices. Key Responsibilities: Design and implement enterprise-grade data architectures using Azure Fabric Architect and optimise datalakes for analytics, reporting, and advanced workloads Lead data governance, cataloguing, and compliance initiatives using Microsoft Purview Own and oversee data platform … Data Architect in Azure environments Strong hands-on knowledge of Azure Fabric and modern data architectures Experience designing and implementing datalakes (e.g. medallion architectures) Practical experience with Microsoft Purview for data governance and lineage Track record of delivering successful data platform implementations ...

Data Architect with current SC Clearance, we have a new contract role we would like to discuss with you. Please note this role is inside IR35 and requires one day per week onsite. As a Data Architect you will … responsible for the following: Design & build high performing data solutions utilising Databricks Design & oversee delivery of secure data warehouses and datalakes Design & implement AI/ML Models Ensure data governance and security is managed Work with existing team around MS Cloud platforms including Azure ...

Manager (EPM) - 1 YEAR CONTRACT - HYBRID WORKING - NO SPONSORSHIP AVAILABLE Job Description We are seeking an experienced Enterprise Project Manager to focus on data capabilities within an innovative organisation. The ideal candidate will be working on enhancing data capabilities, ensuring effective project management in alignment with … strategic objectives. Responsibilities Lead and manage projects related to data capabilities, ensuring alignment with organisational goals. Collaborate with cross-functional teams to implement data solutions using AWS and Data Lakes. Coordinate the integration of message bus systems into existing data infrastructures. Oversee ...

build analysis - Provide architectural input to support Product's evaluation of vendor offerings and internal options. -Defining preferred target architecture -Document current integrations, data flows, and system dependencies - Previous experience with Adtech Integration's within broadcast or non linear advertising solutions including how existing systems connect to client … systems, including ad servers, Freewheel, ATS, DAM/MAM, data platforms, and downstream delivery system -Data lakes -Digital advertising -Addressable and targeted advertising -Advertising market places -Airtime Sales/adsales traffic systems, e.g. Imagine Landmark -Freewheel -Programmatic advertising DSP, e.g. Tradedesk -VOD players -TV Beat -Tech ...