14 of 14 DemandTrendContract Data Lake Jobs in London

working on high-impact projects for clients across sectors, delivering intuitive, visually engaging tools that connect directly to data platforms like Microsoft Fabric’s Data Lake, Power.B.I., Qlik Sense, SQL Server, Airtable, and Databricks. The role calls for someone equally comfortable coding clean, scalable applications as they are working with APIs, shaping UI/UX … that deliver real business value. RESPONSIBILITIES Develop, test, and deploy custom web applications and dashboards, connecting to multiple enterprise data sources (e.g., Microsoft Fabric Data Lake, Power.B.I., Qlik Sense, SQL Server, Airtable, Databricks) Build advanced data visualisations using D3.JS and other JavaScript libraries to create highly interactive, responsive interfaces Integrate applications with APIs … development and integration (REST, GraphQL) Familiarity with database technologies and query languages (SQL, NoSQL) Experience working with data sources such as Microsoft Fabric’s Data Lake, Power.B.I., Qlik Sense, Airtable, and Databricks Good grasp of DevOps practices, including CI/CD pipelines and code management workflows Cloud deployment experience with Azure and/or AWS More ❯

Lead Data Engineer - M&A Data Integration Fully Remote £550-£600 outside IR35 About the Role We are seeking an experienced Lead Data Engineer to play a critical role in integrating data assets following a major acquisition. The acquired company operates across 20+ enterprise application systems , and this role will lead the … enforce data governance, lineage, and quality frameworks across acquired datasets. Leverage Azure-native services such as Azure Data Factory, Synapse Analytics, Databricks, Data Lake, and Purview to build modern, cloud-first data pipelines. Act as a point of escalation for data integration issues and ensure rapid resolution in a … years of experience in data engineering , including leading enterprise-scale migrations. Proven track record in Azure cloud data services (ADF, Synapse, Databricks, Data Lake, Purview, Event Hubs, Functions). Strong proficiency in SQL and Python Experience integrating 20+ enterprise systems such as SAP, Oracle, Dynamics 365, Salesforce, Workday, or ServiceNow. Deep understanding of More ❯

Data Modeler x 2 + 3-6 month + contracts available + Fully remote - occasional trip into London office + £750-£850 per day - Inside IR35 Key Skills: + Data Transformation & ETL - QLIK + AWS, other Cloud Data Modeler - London Markets We're looking for a dedicated Data Modeler to join a … on contract role (not an Architect, not a Developer-who-dabbles, not a Manager-in-hiding). You'll be laser-focused on designing and delivering enterprise-grade data models across warehouses, lakes, and vaults. The Role You'll be responsible for: Designing and developing conceptual, logical, and physical data models . Implementing models across RDBMS … ODS, data marts, and data lakes (SQL/NoSQL). Translating business needs into robust, long-term data models. Applying Data Vault 2.0 techniques in real-world implementations. Supporting metadata management, governance, and best practices with tools like Erwin or ER/Studio . What We're Looking For (Must-Haves) 5+ More ❯

If you are an experienced Data Engineer with excellent communication skills and a proven track record of working on large scale data enablement projects, we have a new contract we would like to discuss with you. Please note this role requires onsite attendance once a week and has been deemed inside IR35. Requirement: Experience in Azure … Synapse, ETL, Pyspark, SQL , data Modelling and Data Bricks. Design and develop Azure Pipelines including data transformation and data cleansing Document source-to-target mappings Re-engineer manual data flows to enable scaling and repeatable use Build accessible datasets for distribution and analysis Development of Azure Pipelines for transforming data A scalable meta-data driven ingestion and transformation framework Aligning transformation pipelines and datasets with Purview Experience of working with Azure Data Lakes, Data warehousing, and pipelines and Storage accounts Experience in building and managing Pipelines including: building data interfaces to source systems, combining and transforming data into More ❯

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting through … cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance Tuning : Partitioning, caching, Spark job optimization Cloud Architecture : Infrastructure-as-code, monitoring, automation Finance Domain More ❯

Contract Opportunity: Lead Azure Data Engineer (Remote - 500/day Outside IR35) We're hiring for a Lead Azure Data Engineer to join our team on a hybrid contract based in London, supporting key finance stakeholders and transforming our data platform. This role offers the chance to shape the future of financial reporting through … cutting-edge cloud engineering and data architecture. Location : Central London (UK-based candidates only) Rate : £500/day IR35 Status : Outside IR35 Start Date : ASAP - Interviews next week Duration : 6 months with potential for extension The Role You'll lead the design and delivery of scalable data products that support financial analysis and decision-making. Working … Essential Skills Azure Databricks : Expert in Spark (SQL, PySpark), Databricks Workflows Data Pipeline Design : Proven experience in scalable ETL/ELT development Azure Services : Data Lake, Blob Storage, Synapse Data Governance : Unity Catalog, access control, metadata management Performance Tuning : Partitioning, caching, Spark job optimization Cloud Architecture : Infrastructure-as-code, monitoring, automation Finance Domain More ❯

Job Description: We are seeking a highly skilled Senior Data Engineer with strong expertise in Azure cloud technologies and ETL processes. The ideal candidate will have a deep understanding of data architecture, data modeling, and data integration to support scalable and high-performance data solutions. Key … Responsibilities: Design and implement end-to-end Azure-based data solutions using services such as Azure SQL Database, Data Factory, Synapse Analytics, Data Lake, DevOps, and Storage. Develop and optimize ETL processes using Informatica for data integration and migration across UNIX and Windows environments. More ❯

We're partnering with a Globally known Financial Services Giant as they grow out their analytics capability and are currently seeking to hire a new Data & Reporting Analyst to support their Customer Optimisation and Lifecycle Marketing programmes. This is a newly created role where you'll split your time between data management and reporting/analysis … helping to power experimentation and customer growth. Be part of a newly created role with room to shape how they work with data! Role Requirements: Manage data pipelines to ensure reliable, timely data availability for testing and campaigns. Write and run SQL queries, shaping and maintaining key datasets. Support experimentation by measuring outcomes, analysing … skills Hands-on experience with reporting tools (eg. Tableau or Qlik Sense). Exposure to data pipelines or data management AWS/data lake experience is a plus but not essential. Analytical mindset with the ability to support experimentation frameworks. *Rates depend on experience and client requirements More ❯

Data Engineer | Part Time | 3 months | £225 - £250 per day | Outside IR35 We're recruiting for a Part Time contract Data Engineer to join our marketing agency client to assist with one of their key customers for an initial 3-month period with high likelihood of extension. This role can be completed on a fully remote … two days of work per week. Key Requirements Proficiency with Python and SQL for data transformation, pipeline development, and model integration Experience with modern data lake technologies such as BigQuery or Snowflake Experience working with large, complex, and high-volume data sets The ability to unify, collate, and interpret data to … support data-driven decisions Proficient in using analytics platforms and user behaviour tools to extract actionable insights Skilled in data visualisation and reporting using tools like Power BI , Looker Studio , or Tableau What to do next If this Part Time Data Engineer role sounds like a good fit, please apply with your most up More ❯

Data Engineer | Part Time | 3 Months | £225 – £250 per day | Outside IR35 We’re recruiting for a Part Time contract Data Engineer to join our marketing agency client to assist with one of their key customers for an initial 3-month period with high likelihood of extension. This role can be completed on a fully remote … two days of work per week. Key Requirements Proficiency with Python and SQL for data transformation, pipeline development, and model integration Experience with modern data lake technologies such as BigQuery or Snowflake Experience working with large, complex, and high-volume data sets The ability to unify, collate, and interpret data to … support data-driven decisions Proficient in using analytics platforms and user behaviour tools to extract actionable insights Skilled in data visualisation and reporting using tools like Power BI , Looker Studio , or Tableau What to do next If this Part Time Data Engineer role sounds like a good fit, please apply with your most up More ❯

SAP Finance Data & Analytics Specialist ( Interim State Management) Luton - 12 months - outside IR35 - £580 per day The SAP Finance Data & Analytics Specialist ( Interim State Management) will be responsible for ‘keeping the lights on’ for all the critical Finance global & local reporting solutions. Apply data, analytics, process, and object expertise to support interim state and … S/4 design, acting as an integral part of the Data and Analytics design team, considering both business process and analytics requirements. SAP Finance Data & Analytics Specialist ( Interim State Management) will be managing 7 non-SAP analytics applications and responding to changes driven by the ongoing S4 Transformation' Essential Skills – 15 + years of experience …/4HANA and ECC in the FI/CO module functionalities. Experience and knowledge of Analytics tools and Data Warehouses like PowerBI, Qlik, Azure Data Lake, Snowflake, SAP B4H, SAP Analytics Cloud etc. SAP Finance Data & Analytics Specialist ( Interim State Management) Osirian Consulting is committed to working with our clients to promote equality More ❯

reporting. Consolidate multiple customer-specific reports into more efficient, scalable solutions. Support integration of Power BI with Fabric (experience here highly beneficial). Work with Azure Data Lake and wider Azure ecosystem for data sourcing and performance improvements. Provide best practice guidance for managing a full reporting suite in a SaaS environment. What We're … APIs and driving automation. Background in scaling BI solutions across multiple customers/environments. Familiarity with Fabric (hands-on experience a big plus). Experience with Azure and Data Lakes. Someone who has managed the full lifecycle of reporting suites, including integrations. If this sounds like you and you're looking for your next contract- apply now! PowerBI … possibility of extension) | ASAP Oscar Associates (UK) Limited is acting as an Employment Business in relation to this vacancy. To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website. More ❯

via Docker/Kubernetes and integrate with orchestration systems (e.g., Airflow, custom schedulers). ? Work with platform engineers to embed Spark jobs into InfoSum's platform APIs and data pipelines. ? Troubleshoot job failures, memory and resource issues, and execution anomalies across various runtime environments. ? Optimize Spark job performance and advise on best practices to reduce cloud compute and … In-depth knowledge of AWS Glue, including job authoring, triggers, and cost-aware configuration. ? Familiarity with distributed data formats (Parquet, Avro), data lakes (Iceberg, Delta Lake), and cloud storage systems (S3, GCS, Azure Blob). ? Hands-on experience with Docker, Kubernetes, and CI/CD pipelines. ? Strong documentation and communication skills, with the ability to … support and coach internal teams. Key Indicators of Success: ? Spark jobs are performant, fault-tolerant, and integrated into InfoSum's platform with minimal overhead. ? Cost of running data processing workloads is optimized across cloud environments. ? Engineering teams are equipped with best practices for writing, deploying, and monitoring Spark workloads. ? Operational issues are rapidly identified and resolved, with root More ❯

Senior Project Manager/Programme Manager Business Intelligence (BI/Dashboard Innovation London (City) - Hybrid Working Available £(Apply online only) per day. 12 month contract. Outside IR35. Agile, Data, BI, Business Intelligence, Dashboard Our client is a specialist business lines insurer based in the City of London, providers of insurance cover for small businesses, entrepreneurs, SMEs and retailers. … Following on from a consolidation of Legacy data lakes and improvements to meet continued compliance with GDPR, the business now wishes to make better use of data and wishes to recruit a Project Manager to lead a series of Business Intelligence, Data Analytics and Dashboard projects, accompanied by associated process changes and changes around … ways of working, aimed at improving the use of data within the insurer, and improving decision making. The incoming Senior Project Manager/Programme Manager will firstly need to understand what the As Is' arrangements are within the business, conducting a full discovery phase, prior to working with stakeholders, executives and staff to define the To Be' model More ❯