1 to 25 of 26 Remote Data Lake Jobs in the City of London

for the Databricks Lakehouse Platform. Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow) and complementary cloud services (e.g. … Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build & Development Hands-on Implementation: Act as a lead engineer in the initial build-out of … sessions to ensure long-term sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data Factory, Azure Data More ❯

Social network you want to login/join with: Data Architect (GCP), london (city of london) col-narrow-left Client: Anson McCade Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Role : Data Architect (GCP … Location : London We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture and engineering. This unit is driving major transformation initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable … cloud-native solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible for defining the platform strategy, leading a team of data engineers, and ensuring high standards of More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Data Analytics Developer Location: London (Hybrid) Type: Permanent | Full-Time My client is seeking a talented and driven Data Analytics Developer to join our fast-paced and evolving data team. This is a reporting-first technical role, ideal for someone with a passion for building insightful dashboards, collaborating with senior stakeholders, and working at … the forefront of cloud-based data platforms. We're looking for someone who thrives in a dynamic, start-up-style environment - adaptable, switched-on, and ready to take ownership of their work while contributing to the development of our growing data ecosystem. Key Responsibilities: * Design, develop, and maintain high-impact dashboards and reports using Power BI … dashboard/report development and DAX * Solid experience in SQL/T-SQL for data extraction and transformation * Hands-on experience with Azure technologies (Data Lake, Data Factory, Synapse, etc.) * Data modelling experience (star/snowflake schemas, normalization, etc.) * Familiarity with ETL processes and working alongside Data Engineers * Excellent More ❯

A leading, technology-focused, multi-strategy Hedge Fund are seeking a Senior Data Engineer (Front Office) to join their innovative and highly experienced team Essential Skills: 5+ years of experience with a proven track records of building data platforms Expert-level Python and SQL skills (C++ experience is a plus, but not essential) Interest in contributing … merging technology and research to solve some of the most complex challenges and deliver high-quality returns. This flexible role (2 days WFH) involves building and supporting bespoke data solutions for Quants and Traders, and developing a scalable, global Data Lakehouse used by multiple trading … desks. You’ll design and implement data pipelines in Python within an AWS cloud environment, working on data modelling for large-scale Data Lake and OLAP systems. Key responsibilities will include optimising performance in cross-region setups, ensuring data completeness and quality, and contributing to the software and infrastructure design. This More ❯

Azure Data Architects x 2 The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten … and support staff. Mostly remote some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end-to-end cloud solutions on … such as: Azure Synapse Analytics Azure Data Factory Azure Databricks Azure SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong knowledge of data More ❯

Are you a Data Engineer who is looking for a more purposeful career? Feel like your current role, limits you to what you can achieve and that there isn’t any more room to grow? If the answer is yes, I could have just the role for you. Recruit with Purpose are supporting one the UK’s largest … Design and maintain scalable, high-performance data pipelines using Azure Data Platform tools such as Databricks (PySpark), Data Factory, and Data Lake Gen2. Develop curated data layers (bronze, silver, gold) optimised for analytics, reporting, and AI/ML, ensuring they meet performance, governance, and reuse standards. Translate business needs … architecture diagrams, lineage, and testing protocols. What they are looking for from you: High level of experience with Microsoft Azure (Azure Data Factory, Databricks, Data Lake Gen 2) Experience building stable and accurate data pipelines Expertise with SQL and Python Familiarity with medallion architecture 4+ years working in a fast-paced data More ❯

Senior Data & AI Consultant Homebased - Must be happy to travel to customer sites and London Full-time, Permanent Eligible for SC Clearance/Actively SC Cleared Be part of a growing consulting team with a leading Microsoft Partner. This role is for a Senior Azure Data & AI Consultant, who will deliver high-impact solutions that transform … You’ll play a critical role in guiding organisations through the AI journey — from identifying opportunities to architecting and deploying real-world solutions using modern cloud platforms and data technologies. You’ll work in a dynamic, fast-paced environment alongside experienced consultants and technical teams, helping clients unlock the full value of AI through innovation, collaboration, and expertise. … Looking For Proven experience delivering AI and data solutions in a Microsoft Partner or specialist technology consultancy environment Strong technical proficiency across Azure Synapse , Data Lake , Databricks , Power BI , Microsoft Fabric , and relevant AI services (e.g. Azure OpenAI, ML Studio) Deep understanding of modern data architectures, data governance, and operationalisation of More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Hybrid | 3 days/week working from office) Duration: 6 months Contract Skill Sets: • Palantir Foundry • ETL • Spark • Python • PySpark • Informatica • AWS • SQL, PLSQL • Shell scripting • Data Lake • Data warehousing • Scala • Oracle • MS SQL Server • PowerBI. Thanks & Regards Milan | Talent Acquisition | Europe & UK Ampstek Services Limited Kemp House, 152-160, City Road London-EC1V 2NX More ❯

Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead end … to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking For … Proven Data Engineering experience (5+ years). Consultancy experience is a must. Leadership and multi-project environments experience. Expertise in ETL, data modelling, and Azure Data Services. Experience in designing and implementing data pipelines, data lakes, and data warehouses. Hands-on experience with Apache Spark and bonus points More ❯

Social network you want to login/join with: Data Engineering Manager/London/Microsoft Gold Partner, london (city of london) col-narrow-left Client: Opus Recruitment Solutions Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job … Description: Are you a passionate Data Engineering Manager ready to unlock the power of data? Our client is a leading UK-based consultancy seeking a skilled professional to shape data strategies, mentor dynamic teams, and deliver cutting-edge solutions. With hands-on expertise in Spark, SQL, and cloud platforms like Azure, you’ll lead … end-to-end projects, drive innovation, and collaborate with clients across industries. What You’ll Do: Lead complex data engineering solutions with technical excellence. Mentor teams and foster a culture of growth and quality. Showcase your expertise in pre-sales and client workshops. Design data pipelines, lakes, and warehouses with best practices. Skills They're Looking More ❯

Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery … shape a growing practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical … Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in cloud data lake architectures, ETL/ELT patterns, and metadata/data quality management. • Expertise in Matillion, Redshift, Glue, Lambda, DynamoDB, and data pipeline automation. • Familiarity with data More ❯

Principal Solution Architect Job Summary We are seeking a highly skilled Principal Solution Architect with deep expertise in IT Architecture, AWS Cloud Technologies, and data platform implementation. The ideal candidate will have strong networking knowledge and hands-on experience designing and developing scalable data platforms. This role requires leadership skills, cross-functional collaboration, and the ability … to drive the development of a new global data platform. Key Responsibilities Architectural Design in cloud based environments: Develop and implement robust IT architecture strategies for cloud and hybrid environments, leveraging AWS best practices. Design scalable, secure, and high-availability solutions tailored to business needs. Architect and optimize data platforms to enable efficient data … Route 53, and CloudFront. Configure and troubleshoot complex networking scenarios, including hybrid cloud setups. Manage network performance and security standards, including SLAs, bandwidth, latency, and IPSec VPN configurations. Data Platform Implementation: Lead the design and development of a new global data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to More ❯

Are you a talented Solutions Architect looking to make your mark in the banking sector? Our client is seeking an enthusiastic and skilled individual to join a critical data remediation programme within the Markets Platform Surveillance Team. This is a fantastic opportunity to contribute to a dynamic environment and enhance the organization's capabilities while navigating a highly … umbrella) What You'll Do: As a Solutions Architect, you will play a pivotal role in improving our CI/CD platform and ensuring the seamless integration of data into our surveillance systems. Your expertise will help shape the future of our data handling and surveillance efforts. Key responsibilities include: Data Integration : Pulling data into the surveillance system from various sources, including data lakes and data warehouses on Google Cloud Platform (GCP). Platform Enhancement : Improving the CI/CD platform using Terraform and ensuring efficient deployment processes. Pipeline Tracking : Utilizing tools like JIRA to track pipelines and manage workflows effectively. Containerization : Implementing containerization solutions to optimize application More ❯

proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet … diverse functional and non-functional requirements. Data Architecture Expertise: Proven experience in designing and delivering complex batch and streaming data pipelines, understanding orchestration, and database capabilities across multiple solutions. Problem-Solving Ability: A strategic and creative thinker who can tackle complex challenges and develop innovative, robust solutions. Collaboration & Communication Skills: Strong interpersonal skills that can influence … Architect certifications. Cyber & Data Security Understanding: An appreciation for the architectural implications of application design and implementation. Modern Data Capabilities: Knowledge of Data Lake, Data Warehouse, and Machine Learning architectures. QA Best Practices: A solid understanding of data quality concepts and practices. Why Join Us? This is your chance More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯

Paragon Alpha are partnered closely with a multi-manager hedge fund, who have placed technology and data at the centre of their ethos, allowing technological innovation to … drive the firm forward. They're looking for a Rust/Python Engineer to join an data platform team, who're building a centralized data lake, housing disparate data-sets from research, trading and alternative sources. Stack: Rust, Python, AWS, Kubernetes, Kafka, SQL They need someone wit 8 years+ of experience in industry More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the Banks’ strategy, which has allowed it to make significant inroads … deploy, scale and innovate at a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from multiple players globally and over … Our dynamic integration frame and architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This is a hands-on leadership More ❯

to present complicated technical information appropriately to business areas including architecture governance to enable informed decisions. • Excellent understanding of Microsoft Azure, with experience of: express route, data lake, Office 365, hybrid network architecture models, role-based access control, PaaS and IaaS. This is a little tastier of the role and a more detailed spec is available upon More ❯

a fraction of the cost. From customised front end mobile apps and online banking portals, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“Bank-in-a-Box”) or in part, as required. Our technology stack has gained positive attention from multiple players globally and over More ❯

senior AWS Consultant, you will provide expert technical consultancy to various large-scale customers. You will be expected to utilise your deep expertise in building platforms for AWS Data Lakes and Landing Zones to provide concise consultancy to clients and internal teams alike and provide hands-on input throughout related projects when required. You will also have key … implementing, solutioning and configurating AWS Data Lakes environment. Providing consultancy to customers and delivering on projects Responsible for providing solutions, configuring and optimising the data lake environment Responsible for providing solutions, configuring and optimizing with AWS key services with AWS cloud infrastructure management, data processing, security, and virtual desktops. Designing and implementing with … Landing Zones/Transit Gateways/Redshift/Firehose/CloudTrail/Workspaces Experience creating design documentation Experience within Linux based environments Strong understanding of AWS Data Lake solutions and AWS Redshift AWS Certified Solutions Architect, Developer, or SysOps Administrator certifications are highly desirable Deployment experience with AWS CloudFormation or Terraform Knowledge of AWS Core services i.e. More ❯