10 of 10 Remote Data Lake Jobs in East London

for the Databricks Lakehouse Platform. Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow) and complementary cloud services (e.g. … Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build & Development Hands-on Implementation: Act as a lead engineer in the initial build-out of … sessions to ensure long-term sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data Factory, Azure Data More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Are you a Data Engineer who is looking for a more purposeful career? Feel like your current role, limits you to what you can achieve and that there isn’t any more room to grow? If the answer is yes, I could have just the role for you. Recruit with Purpose are supporting one the UK’s largest … Design and maintain scalable, high-performance data pipelines using Azure Data Platform tools such as Databricks (PySpark), Data Factory, and Data Lake Gen2. Develop curated data layers (bronze, silver, gold) optimised for analytics, reporting, and AI/ML, ensuring they meet performance, governance, and reuse standards. Translate business needs … architecture diagrams, lineage, and testing protocols. What they are looking for from you: High level of experience with Microsoft Azure (Azure Data Factory, Databricks, Data Lake Gen 2) Experience building stable and accurate data pipelines Expertise with SQL and Python Familiarity with medallion architecture 4+ years working in a fast-paced data More ❯

Senior Data & AI Consultant Homebased - Must be happy to travel to customer sites and London Full-time, Permanent Eligible for SC Clearance/Actively SC Cleared Be part of a growing consulting team with a leading Microsoft Partner. This role is for a Senior Azure Data & AI Consultant, who will deliver high-impact solutions that transform … You’ll play a critical role in guiding organisations through the AI journey — from identifying opportunities to architecting and deploying real-world solutions using modern cloud platforms and data technologies. You’ll work in a dynamic, fast-paced environment alongside experienced consultants and technical teams, helping clients unlock the full value of AI through innovation, collaboration, and expertise. … Looking For Proven experience delivering AI and data solutions in a Microsoft Partner or specialist technology consultancy environment Strong technical proficiency across Azure Synapse , Data Lake , Databricks , Power BI , Microsoft Fabric , and relevant AI services (e.g. Azure OpenAI, ML Studio) Deep understanding of modern data architectures, data governance, and operationalisation of More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

A leading, technology driven multi-strategy Hedge Fund, based in London, are seeking a talented Software Developer – Data Integration Specialist to join their innovative and highly experienced team. Essential Skills: Skilled software developer with 5+ years of experience in a related field … Strong communicator with the ability to translate complex, user needs into smart, scalable solutions A Polygot developer – particularly strong knowledge of Python Comfortable with AWS technologies and familiar with datalakes and databases A natural curiosity to explore new technologies, tools and techniques Experienced with Git and collaborative development workflows Confident working independently within a fast-paced, globally distributed team Worked … with both structured and unstructured data (bonus) Prior exposure to financial data sets (equities/derivatives) (bonus) This dynamic, global company, at the forefront of the investment industry, is looking for top-tier talent to contribute to their collaborative culture, focused upon innovation, technology and research. In this flexible role (2 days WFH), you’ll be More ❯

Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery … shape a growing practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical … Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in cloud data lake architectures, ETL/ELT patterns, and metadata/data quality management. • Expertise in Matillion, Redshift, Glue, Lambda, DynamoDB, and data pipeline automation. • Familiarity with data More ❯

proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet … diverse functional and non-functional requirements. Data Architecture Expertise: Proven experience in designing and delivering complex batch and streaming data pipelines, understanding orchestration, and database capabilities across multiple solutions. Problem-Solving Ability: A strategic and creative thinker who can tackle complex challenges and develop innovative, robust solutions. Collaboration & Communication Skills: Strong interpersonal skills that can influence … Architect certifications. Cyber & Data Security Understanding: An appreciation for the architectural implications of application design and implementation. Modern Data Capabilities: Knowledge of Data Lake, Data Warehouse, and Machine Learning architectures. QA Best Practices: A solid understanding of data quality concepts and practices. Why Join Us? This is your chance More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯