1 to 25 of 27 Contract Data Lake Jobs

secure, reliable, and efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azure Data Lake Storage. The engineer will work closely with cross functional teams to translate business requirements into technical solutions that support analytics, reporting, and data … Synapse Analytics. Implement incremental loads, CDC, and real-time data ingestion when needed. Architect and manage datasets in Azure Data Lake Storage (ADLS Gen2). Optimize data storage formats (Delta, Parquet, Avro, ORC) for performance and cost. Maintain and optimize Synapse SQL Pools ...

Months The Role Your Responsibilities: (Up to 10, Avoid repetition) Experience as Solution Designer and should be currently working on Data Lake (Big Data) based projects. Guide the full lifecycle of a BI solution, including requirements impact analysis, platform selection, technical architecture design, application design … with proven expertise in delivering challenging assignment. Provide thought leadership for Data Management, Data Migration Strategy and Data Lake Solutions. Good knowledge on Data Modelling and able to translate Business requirements to Design and Data Models, technical designs ...

Data Architect 6 month contract Glasgow 2-3 days per week £700 per day We are seeking an experienced Data Architect who can define, govern, and deliver GDPR compliant enterprise data architectures across relational (Oracle), NoSQL, unstructured data platforms, and Data Warehouse. The ideal candidate will possess strong expertise in data integration, migration, and centralisation initiatives, ensuring privacy by design across complex, distributed data landscapes. Key Responsibilities: Data Architecture & Modelling: - Define enterprise data architecture aligned with GDPR and organisational data ...

data architecture using Azure services including Azure Postgres, Azure Storage Account, Azure Data Factory, Microsoft Fabric, Azure Data Lake Storage, and Azure Synapse Analytics - Define data cataloguing, metadata management, and data life cycle strategies - Support batch and streaming data … government security standards Essential Skills: - Experience with Azure services such as Azure Data Factory, Microsoft Fabric, and Azure Data Lake Storage - Expertise in data modelling (conceptual, logical, physical) - Knowledge of ETL/ELT and modern data pipelines - Strong SQL and Scripting ...

Responsibilities Define the architecture and blueprint for a federated data platform built on Databricks Design and shape a centralised data lake architecture Translate business and PE investment metrics into measurable data engineering KPIs Identify data gaps, data availability issues … Architecture roles Strong experience with Databricks Deep understanding of data transformation, modelling, and engineering logic Experience designing data lake/lakehouse architectures Ability to translate business objectives into data architecture and KPIs Experience building data platform roadmaps and delivery ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Warwick (Hybrid Working) Contract: 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead … design, development, and maintenance of data integration solutions and data warehouse environments. This role will focus on building and optimising ETL/ELT pipelines, supporting data warehousing initiatives, and ensuring the quality, performance, and reliability of large-scale data systems. The successful ...

Role: Data Migration Specialist - Defence Sector Location: London (On-site) Start Date: ASAP Contract: Freelance Duration: 12 Months + A leading organisation within the defence sector is seeking a Data Migration & Data Synchronisation Specialist to support a large-scale data transformation initiative. … This role requires a contractor experienced in designing and delivering secure data migration frameworks across complex enterprise environments, integrating both on-premise and cloud platforms. Candidates must be freelance contractors and have Security clearance or eligible for Security clearance due to the nature of the programme The successful ...

Cleared Data Warehouse Engineer - Outside IR35 - Remote Role Overview We are seeking a skilled Data Warehouse Engineer to design, build, and maintain scalable data warehouse solutions within the Microsoft Azure ecosystem. The role focuses on developing robust data models, optimizing analytical queries … Data Engineering Experience with: Azure Synapse Analytics Azure Data Factory or similar ETL tools Azure Storage/Data Lake Experience designing data pipelines and transformations. To apply for this role please submit your CV or contact Dillon Blackburn ...

Data Architect/Technical Data Architect/Senior Data Architect/Lead Data Architect The client is are searching for multiple experienced Data Architect's to play a key role in a large-scale organisational transformation focused on significantly improving … enterprise data capabilities. This role will shape the target data architecture, enable modern data platform adoption, and support the delivery of trusted, scalable, and governed data products across the organisation. Working closely with engineering, analytics, governance, and senior business stakeholders, you will ...

deployment of scalable, secure, and cost-effective distributed data solutions [MA2.1]using Azure services (e.g., Azure Databricks, Azure Data Lake Storage, Azure Data Factory).• Architect and implement advanced data pipelines using Databricks, Delta Lake, Python and Spark, ensuring performance … fostering a culture of continuous learning, innovation, and technical excellence. Experience needed: • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory.• Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Data Governance Technical Product Owner - £550 p/d Inside IR35 – 12-month contract – London/Hybrid We are currently looking for a Data Governance Product Owner to join a Global Media organisation, responsible for leading the implementation of a Data Governance Framework within … Quality Reporting • Strong capabilities to manage Data Catalogues and Data Lineage • Experience within Data Warehouses, Data Lake and Data Mesh • Experience with Python, Pyspark and ETL is desirable. This is an exciting opportunity to lead and influence data ...

Type: Contract (Inside IR35) Duration: 6 Months Job Summary: We are looking for a Senior Technical Lead with in-depth expertise in data governance, data quality, metadata management , and a strong background in delivering solutions using the Collibra platform . You will play a pivotal role … defining solution architectures, leading Collibra configuration and integration, implementing governance workflows, and collaborating closely with enterprise architects, data stewards, and platform teams. Key Responsibilities: Solution Architecture & Design Lead the design and implementation of Collibra-based data governance solutions, including: Data Catalog Business Glossary Policy ...

Type: Contract (Inside IR35) Duration: 6 Months The Role We're looking for a Senior Technical Delivery Manager to lead large-scale Data & Analytics programs for insurance enterprises. You will drive program governance, lead steering groups, manage vendor and customer stakeholders, and orchestrate cross-functional teams to deliver … merge, survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature ...

Description: Cybersecurity Consultant (Cloud, Data, AI & Microsoft Security) Department: Information Security - (Data & AI team) Duration: Duration 4 months Location : London (Hybrid) Role Overview We are looking for a highly skilled Cybersecurity Consultant with strong expertise across Microsoft Security , Cloud Security , Data Protection , and emerging … into clear business language and actionable recommendations. Desirable Skills Experience with secure data platforms (Azure Data Factory, Data Lake, SQL, or similar). Knowledge of API, container security, Kubernetes, and infrastructure-as-code security. Familiarity with PCI, GDPR, data privacy requirements ...

Principal Architect – Data Platforms/Data Lakes/Cloud/Python – 12 Month Contract – £700 p/d Inside IR35 – London A global digital media organisation are looking for a Principal Architect to join their Data Foundation & Product Analytics team on an initial … hybrid role (London-based) with flexibility in a fast-paced, multi-cloud, multiplatform environment. You will partner with the Enterprise Data Lake and Governance teams, architecting robust data pipelines and platforms across cloud and on-prem ecosystems, whilst establishing and enforcing standards for data ...

Interim Head Of Data & Digital Architecture 3-6-Month Contract | Inside IR35 | £600-£800 per dayRemote First with Occasional National TravelStart: ASAP Your New Organisation A large, national, mission-driven organisation is undergoing significant digital, data and technology modernisation. To maintain momentum during a period … transition, they are seeking an Interim Head of Data & Digital Architecture to provide technical leadership, delivery assurance and stability across their data and digital transformation portfolio.This is an ideal role for an experienced interim who can quickly embed, guide teams, and take ownership of critical data ...

Interim Head Of Data & Digital Architecture 3-6-Month Contract | Inside IR35 | £600-£800 per dayRemote First with Occasional National TravelStart: ASAP Your New Organisation A large, national, mission-driven organisation is undergoing significant digital, data and technology modernisation. To maintain momentum during a period … transition, they are seeking an Interim Head of Data & Digital Architecture to provide technical leadership, delivery assurance and stability across their data and digital transformation portfolio.This is an ideal role for an experienced interim who can quickly embed, guide teams, and take ownership of critical data ...

Data Engineer (Pharma Background Essential) £550 per day - INSIDE IR35 6 Months Hybrid - 1 day per week in London Role Purpose We are currently looking for a Data Engineer to be responsible for designing, building and maintaining our clients data pipelines and platform infrastructure … written and verbal communication skills, with the ability to explain technical concepts to non-technical audiences Desirable Skills Experience with Azure Data Lake Storage, Azure Synapse Analytics or Azure Data Factory prior to Fabric migration. Familiarity with Microsoft Purview for data governance ...

Silver/Gold). Developing scalable models and Power BI semantic layers for enterprise reporting. Enhancing and supporting components across Azure Data Lake, ADF, Synapse, Azure SQL and related Microsoft stack tools. Applying engineering discipline across testing, code management, CI/CD and performance optimisation. Working closely … alignment with architectural standards. What You'll Need to Succeed Strong hands-on engineering experience within Microsoft Fabric (Lakehouse, Pipelines, Dataflows Gen2, Notebooks, Direct Lake). Previous experience with Azure Databricks and Delta Lake engineering. Solid working knowledge of the Microsoft data stack: Azure Data ...

Technical Data Engineer/Analyst | Contract | Azure | 6 months | Hybrid | Outside IR35 | £425 - £475 | Nottingham | We’re supporting a major data transformation programme and looking for a Technical Data Analyst to help migrate legacy systems into a modern Azure data platform . … Strong SQL skills and experience working with Azure-hosted datasets Power BI reporting/dashboards creation Python experience Exposure to Azure Data Lake, Databricks, or Data Factory is beneficial If this is a role that suits your skill set, you are immediately available ...

working with a company in the financial sector who is leveling up their Data and we're looking for a Data Engineer who can design high-quality pipelines, develop robust data models and help shape the next generation of our enterprise data …/CD with Azure DevOps Monitor, troubleshoot and improve pipeline performance Ensure strong governance, security and GDPR compliance Tech stack Azure Data Lake * Databricks * ADF * dbt * SQL * Python/PySpark * Data Vault * Kimball * Git * Azure DevOps What you bring 3-5 years' experience in data ...

Title: Data Solution Architect (AWS, Data Engineering) Location: Norwich, Norfolk (3 Days a week) Job Type: Contract (Inside IR35) Duration … Months The Role Your Responsibilities: (Up to 10, Avoid repetition) Experience as Solution Designer and should be currently working on Data Lake (Big Data) based projects click apply for full job details ...

shifts None at the moment To be published on job boards from below onwards The Role Candidate will lead the development of core data products that enhance customer understanding, improve customer experiences, optimise marketing effectiveness, and support data monetisation. Working within Sainsburys evolving data … growing the internal product community. Desirable skills/knowledge/experience: Knowledge of data platforms (e.g. Snowflake, Azure Data Lake). Understanding of monitoring, model performance tracking, and observability best practices ...

Salary: Competitive The Role We are looking for a Python Developer with strong GIS experience to join a growing engineering team building geospatial data platforms used by global organisations. This role sits within the Client Solutions team , responsible for developing tools and data pipelines that deliver … risk analytics and intelligence in a geospatial context. Youll work in a modern engineering environment using Python, Django, AWS and geospatial data tooling , building scalable systems that process large volumes of spatial data and power mapping solutions used by clients worldwide. This is a strong opportunity ...

using GitHub, GitHub Actions, and containerization with Docker. Work closely with cross functional units within DSO-including DSO Ops, Flexibility, Network Access, and Data Science teams-to deliver high value engineering solutions. Participate in code reviews, follow coding standards, and support customer led technical assessments (including Python coding … preferred over React/Angular). Backend Expert level Python programming (mandatory). Database Experience with Delta Tables or similar modern data lake table formats. Cloud & DevOps Mandatory experience with: o CI/CD pipelines o Docker o GitHub & GitHub Actions Desirable skills/knowledge/experience ...