22 of 22 Contract Data Lake Jobs in London

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

Responsibilities Include: Designing and owning conceptual, logical, and physical data models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting … Modeller Strong expertise in data modelling (conceptual, logical, and physical) Demonstrable experience designing data warehouses and data lake architectures Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/ ...

Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark … Proven ability to engage senior stakeholders and clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working ...

Python for data engineering Experience delivering solutions on cloud data platforms ( AWS preferred , Azure acceptable) Understanding of data lake and lakehouse architectures Ability to work autonomously and collaboratively within delivery squads Experience working within Central Government departments (highly desirable) Desirable Azure Data Lake, Synapse, Delta Lake Streaming technologies (Kafka, Event Hubs ...

Interim Principal Azure Data Architect Location: North London (hybrid) Contract: Interim Rate: £900 per day outside IR 35 A complex organisation based in North London is seeking an Interim Principal Azure Data Architect to reset, review, and re-implement its data architecture . This … architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets ...

development teams. Key Responsibilities Architecture Design: Create end-to-end blueprints using Azure Data Factory (ADF) , Synapse Analytics , and Data Lake Gen2 . Data Engineering: Oversee the development of scalable ETL/ELT workflows and automation scripts using Python and SQL . Legacy … knowledge of Azure Data Factory (ADF) and Azure Synapse Analytics . Data Storage: Deep experience with Azure Data Lake Gen2 and modern data warehousing patterns. Scripting: Proficiency in Python (for automation/processing) and advanced SQL tuning. ETL Legacy: Strong background ...

datasets. Act as a hands-on Data Engineer across the full BI stack, leveraging Azure Synapse, SSIS, SQL, and Data Lake technologies. Provide technical support and maintain the organisation's BI infrastructure. Lead and support migration and reconciliation of data from legacy systems … infrastructure Skills & Experience Required Degree or postgraduate-level education. Strong technical background in SQL, Power BI, Azure cloud technologies, Data Lake, and enterprise BI environments. Experience designing and developing modern BI solutions at scale. Excellent communication skills, with the ability to work across both technical ...

skills. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: MLflow, Azure ML, Airflow, Docker, Fargate, FastAPI Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable skills/knowledge/experience: Knowledge … data platforms (e.g. Snowflake, Azure Data Lake). Experience deploying models as APIs (FastAPI, Azure Functions). Understanding of monitoring, model performance tracking, and observability best practices. ...

Automation Leadership Lead and support the selection, design, and transition from fragmented security tooling to a unified SIEM platform and security data lake . Drive a fundamental shift from incident-focused, task-based workflows to preventative security activities and platform optimisation . Proactive Threat Focus Guide … high-availability environments. End-to-End Programme Ownership Full lifecycle ownership of major initiatives including MDR consolidation, SIEM, SOAR, and security data lake deployments , delivering measurable business outcomes. Formal RFP & Vendor Management Expertise Proven experience authoring RFPs, evaluating vendors, and overseeing complex onboarding and integration. Battle-Tested ...

Azure Data Engineer - Outside IR35 - Hybrid ( 3 Days in London) About the Role The IT Data Engineer is responsible for analysing, designing, and delivering software and data solutions that improve business processes, enhance decision-making, and optimise analytics. Working within a small, high-performing … service readiness and support considerations Skills & Experience Strong Microsoft Azure knowledge, including Azure SQL Database, Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics Solid data engineering background (ETL, data warehousing, data modelling) Advanced SQL skills Programming experience ...

Contract Azure Data Engineer - £600/pd Outside IR35 Please note - this is a London based role which will require you to attend the London office three days per week. To be eligible for this role you must be based in the UK and have the unrestricted right … Solid data engineering experience (ETL, modelling, warehousing). Hands-on Azure Data Services: Data Factory, Data Lake, Synapse, Azure SQL. Proficient SQL and programming skills (Python/Java/C#). Understanding of DevOps and CI/CD (Azure DevOps/ ...

Senior Data Engineer (Contract) Location: London (Hybrid) We are seeking an experienced Senior Data Engineer to lead the design and implementation of a cloud-based digital operations system supporting several major infrastructure programmes. This role is central to integrating critical operational technologies into a unified, resilient … like data from essential infrastructure systems. Build and maintain cloud data assets using Azure Databricks, Synapse and Data Lake technologies. Deliver real-time data processing using Kafka, Event Hub and Spark Streaming. Establish and maintain data governance, quality frameworks ...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Senior Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/high-level data platforms that power analytical and business … insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs ...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Senior Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/high-level data platforms that power analytical and business … insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs ...

renowned global consultancy. This is a remote role with very rare possible to onsite visits in Hursley Your new role Seeking a Data Engineer to help to design, build, and maintain reports and interactive dashboards using Power BI. Translate business requirements into meaningful insights through data modelling, DAX measures, and visualisations. Work closely with data engineers to ensure data accuracy, availability, and quality. Support the data team by maintaining data dictionaries, metrics definitions, and documentation. Perform data validation, analysis, and ad-hoc reporting while ...

IR35 - Hybrid The Senior BI Developer will design, develop, and maintain scalable Business Intelligence (BI) solutions leveraging Microsoft Fabric and the broader Microsoft data ecosystem. This role is responsible for delivering a modern, secure, and high-performing Azure-based data platform that enables high-quality reporting … across a modern Microsoft data stack, including: Azure Synapse Analytics SQL Server Integration Services (SSIS) SQL-based database technologies Data Lake architectures SKILLS & EXPERIENCE Essential Educated to degree or postgraduate level in a relevant discipline Extensive expertise in: Database technologies (e.g., SQL) Reporting tools (e.g. ...

maintain the end-to-end architecture for Azure Databricks-based data platforms. Design Lakehouse architectures using Azure Databricks, Azure Data Lake Storage (ADLS Gen2), and associated Azure services. Produce and maintain High-Level Designs (HLDs) and Low-Level Designs (LLDs). Establish and govern data … support mitigation planning. Essential Skills and Experience Demonstrable experience designing Azure Databricks architectures in enterprise environments. Strong understanding of Databricks Lakehouse architecture, Delta Lake, and governance concepts. Architectural-level knowledge of Spark-based platforms. Experience designing secure, governed data platforms in regulated or public sector environments. Proven ...

able to articulate use cases delivered) Python for data engineering and orchestration Experience delivering complex designs across Snowflake, Data Lake, Salesforce, and ACM Strong expertise in data modelling, data contracts, mapping, and ingestion/export processes Comfortable engaging with Product Owners ...

reports into more efficient, scalable solutions. Support integration of Power BI with Fabric (experience here highly beneficial). Work with Azure Data Lake and wider Azure ecosystem for data sourcing and performance improvements. Provide best practice guidance for managing a full reporting suite … scaling BI solutions across multiple customers/environments. Familiarity with Fabric (hands-on experience a big plus). Experience with Azure and Data Lakes. Someone who has managed the full lifecycle of reporting suites, including integrations. If this sounds like you and you're looking for your next ...

knowledge of GRC, CMDBs, SIEM tooling as well as Service acceptance criterias, key artefacts and good understanding of how to build out a Data Lake.Key Requirements: · Proven experience as an IT Project Manager with demonstrable expertise in Cyber Security and GRC within large, complex organisations · Demonstrable experience … Platform implementation (into live) · Previous experience of building out a CMDB and good understanding of how to build out a Data Lake · Excellent knowledge of SIEM tooling and commercial understanding of bringing data in from different places · Strong knowledge of Service acceptance criterias ...

Hands-on experience with CI/CD pipelines , GitHub , GitHub Actions , and Docker Experience working with Delta Tables or similar modern data lake table formats Experience integrating with cloud and on-prem systems, including Dash Enterprise Comfortable delivering into fast-paced, production-grade environments Knowledge of Kubernetes ...