22 of 22 Remote Data Lake Jobs in Central London

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … a blend of greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric … brownfield projects. Comfortable working independently in a remote setup. Strong communication and stakeholder engagement skills. Nice to Have: Experience with other Azure services such as Azure Data Lake, Databricks, or Power BI. Familiarity with DevOps/DataOps processes and tools. Microsoft Certified: Fabric Analytics Engineer Associate Start Date: ASAP or July start acceptable Apply now to join More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

Senior Data Engineer - SC Cleared Remote (UK-based) £75,000 - 85,000 + Benefits Full-Time | Central Government Projects We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact central government programmes. This is a fully remote role , but … active SC clearance is essential . Applicants without current SC clearance cannot be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional experts to solve complex data challenges. You'll champion engineering best … stakeholders to translate requirements into solutions Promoting engineering standards and contributing to internal capability building You'll Need: Active SC Clearance Proven experience with Microsoft Azure (Data Lake, Synapse, Purview) Strong understanding of secure data handling, DevOps, and compliance Experience with structured and unstructured data sources (e.g., Azure SQL, MongoDB) Familiarity with Power More ❯

A leading, technology-focused, multi-strategy Hedge Fund are seeking a Senior Data Engineer (Front Office) to join their innovative and highly experienced team Essential Skills: 5+ years of experience with a proven track records of building data platforms Expert-level Python and SQL skills (C++ experience is a plus, but not essential) Interest in contributing … merging technology and research to solve some of the most complex challenges and deliver high-quality returns. This flexible role (2 days WFH) involves building and supporting bespoke data solutions for Quants and Traders, and developing a scalable, global Data Lakehouse used by multiple trading … desks. You’ll design and implement data pipelines in Python within an AWS cloud environment, working on data modelling for large-scale Data Lake and OLAP systems. Key responsibilities will include optimising performance in cross-region setups, ensuring data completeness and quality, and contributing to the software and infrastructure design. This More ❯

Azure Data Architects x 2 The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten … and support staff. Mostly remote some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end-to-end cloud solutions on … such as: Azure Synapse Analytics Azure Data Factory Azure Databricks Azure SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong knowledge of data More ❯

Are you a Data Engineer who is looking for a more purposeful career? Feel like your current role, limits you to what you can achieve and that there isn’t any more room to grow? If the answer is yes, I could have just the role for you. Recruit with Purpose are supporting one the UK’s largest … Design and maintain scalable, high-performance data pipelines using Azure Data Platform tools such as Databricks (PySpark), Data Factory, and Data Lake Gen2. Develop curated data layers (bronze, silver, gold) optimised for analytics, reporting, and AI/ML, ensuring they meet performance, governance, and reuse standards. Translate business needs … architecture diagrams, lineage, and testing protocols. What they are looking for from you: High level of experience with Microsoft Azure (Azure Data Factory, Databricks, Data Lake Gen 2) Experience building stable and accurate data pipelines Expertise with SQL and Python Familiarity with medallion architecture 4+ years working in a fast-paced data More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery … shape a growing practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical … Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in cloud data lake architectures, ETL/ELT patterns, and metadata/data quality management. • Expertise in Matillion, Redshift, Glue, Lambda, DynamoDB, and data pipeline automation. • Familiarity with data More ❯

Hybrid | 3 days/week working from office) Duration: 6 months Contract Skill Sets: • Palantir Foundry • ETL • Spark • Python • PySpark • Informatica • AWS • SQL, PLSQL • Shell scripting • Data Lake • Data warehousing • Scala • Oracle • MS SQL Server • PowerBI. Thanks & Regards Milan | Talent Acquisition | Europe & UK Ampstek Services Limited Kemp House, 152-160, City Road London-EC1V 2NX More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯

Principal Data Engineer – AWS Location: London (Hybrid/Flexible) - Other UK Locations available Salary: £95,000 - £105,000 + Bonus A leading consultancy is hiring for a Principal Data Engineer to join their fast-growing data team, delivering cloud-native data platforms for high-profile clients across sectors. This role will focus … on designing and implementing end-to-end data solutions using modern AWS tooling. It suits someone who thrives in greenfield environments, enjoys client engagement, and values clean, scalable, well-documented engineering. Key Responsibilities: Design and build robust data pipelines using AWS (S3, Redshift, Glue, Lambda, Step Functions, DynamoDB). Deliver ETL/ELT solutions with Matillion … pipelines in cloud environments. Proficient in working with structured/unstructured data (JSON, XML, CSV, Parquet). Skilled in working with relational databases and data lake architectures. Experienced with Matillion and modern data visualisation tools (QuickSight, Tableau, Looker, etc.). Strong scripting and Linux/cloud environment familiarity. Desirable: Exposure to big data More ❯

Are you a talented Solutions Architect looking to make your mark in the banking sector? Our client is seeking an enthusiastic and skilled individual to join a critical data remediation programme within the Markets Platform Surveillance Team. This is a fantastic opportunity to contribute to a dynamic environment and enhance the organization's capabilities while navigating a highly … umbrella) What You'll Do: As a Solutions Architect, you will play a pivotal role in improving our CI/CD platform and ensuring the seamless integration of data into our surveillance systems. Your expertise will help shape the future of our data handling and surveillance efforts. Key responsibilities include: Data Integration : Pulling data into the surveillance system from various sources, including data lakes and data warehouses on Google Cloud Platform (GCP). Platform Enhancement : Improving the CI/CD platform using Terraform and ensuring efficient deployment processes. Pipeline Tracking : Utilizing tools like JIRA to track pipelines and manage workflows effectively. Containerization : Implementing containerization solutions to optimize application More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the Banks’ strategy, which has allowed it to make significant inroads … deploy, scale and innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from multiple players globally and over … Our dynamic integration frame and architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This is a hands-on leadership More ❯

to present complicated technical information appropriately to business areas including architecture governance to enable informed decisions. • Excellent understanding of Microsoft Azure, with experience of: express route, data lake, Office 365, hybrid network architecture models, role-based access control, PaaS and IaaS. This is a little tastier of the role and a more detailed spec is available upon More ❯

a fraction of the cost. From customised front end mobile apps and online banking portals, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“Bank-in-a-Box”) or in part, as required. Our technology stack has gained positive attention from multiple players globally and over More ❯

teams to deliver cohesive smart building outcomes. Define non-functional requirements including performance, scalability, reliability, and security. Create architecture blueprints, roadmaps, and solution documentation. Ensure compliance with relevant data protection, energy, and building regulations. Work with vendors and integrators on smart sensor deployments and BMS APIs. Provide technical leadership during design, build, and go-live phases of smart … technology domains. Deep understanding of Microsoft Azure ecosystem: Azure IoT Hub, IoT Edge Azure Digital Twins Azure Functions, Logic Apps Azure Event Grid, Stream Analytics Azure Data Lake, Time Series Insights Experience integrating with Building Management Systems (BMS) Knowledge of building communication protocols. Strong grasp of edge-to-cloud integration and data architecture for smart More ❯

senior AWS Consultant, you will provide expert technical consultancy to various large-scale customers. You will be expected to utilise your deep expertise in building platforms for AWS Data Lakes and Landing Zones to provide concise consultancy to clients and internal teams alike and provide hands-on input throughout related projects when required. You will also have key … implementing, solutioning and configurating AWS Data Lakes environment. Providing consultancy to customers and delivering on projects Responsible for providing solutions, configuring and optimising the data lake environment Responsible for providing solutions, configuring and optimizing with AWS key services with AWS cloud infrastructure management, data processing, security, and virtual desktops. Designing and implementing with … Landing Zones/Transit Gateways/Redshift/Firehose/CloudTrail/Workspaces Experience creating design documentation Experience within Linux based environments Strong understanding of AWS Data Lake solutions and AWS Redshift AWS Certified Solutions Architect, Developer, or SysOps Administrator certifications are highly desirable Deployment experience with AWS CloudFormation or Terraform Knowledge of AWS Core services i.e. More ❯