18 of 18 Permanent Data Lake Jobs in East London

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … a blend of greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric … brownfield projects. Comfortable working independently in a remote setup. Strong communication and stakeholder engagement skills. Nice to Have: Experience with other Azure services such as Azure Data Lake, Databricks, or Power BI. Familiarity with DevOps/DataOps processes and tools. Microsoft Certified: Fabric Analytics Engineer Associate Start Date: ASAP or July start acceptable Apply now to join More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the … front-office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to … streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you … ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business … stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring More ❯

The Opportunity A leading global consultancy organisation is seeking a skilled Data Architect to design and deliver robust, scalable data platforms on Google Cloud Platform (GCP). The ideal candidate will bring extensive experience in building and maintaining large-scale data warehouses, ensuring high standards of data quality, and adhering to best … practices in data architecture. Key Responsibilities Define and develop the overall data strategy in line with client requirements and compliance standards. Lead and mentor a team of data engineers to implement scalable and efficient data solutions. Translate business needs into technical solutions by collaborating with both technical and non-technical stakeholders. Ensure … data platforms follow GCP best practices for performance, reliability, and security. Required Skills and Experience Proven background in designing data warehouse and data lake architectures. Demonstrable experience in building and operating large-scale data platforms on Google Cloud Platform, with a focus on data quality at scale. Hands-on More ❯

Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet data requirements. Optimize data … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills. Experience More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

Are you a Data Engineer who is looking for a more purposeful career? Feel like your current role, limits you to what you can achieve and that there isn’t any more room to grow? If the answer is yes, I could have just the role for you. Recruit with Purpose are supporting one the UK’s largest … Design and maintain scalable, high-performance data pipelines using Azure Data Platform tools such as Databricks (PySpark), Data Factory, and Data Lake Gen2. Develop curated data layers (bronze, silver, gold) optimised for analytics, reporting, and AI/ML, ensuring they meet performance, governance, and reuse standards. Translate business needs … architecture diagrams, lineage, and testing protocols. What they are looking for from you: High level of experience with Microsoft Azure (Azure Data Factory, Databricks, Data Lake Gen 2) Experience building stable and accurate data pipelines Expertise with SQL and Python Familiarity with medallion architecture 4+ years working in a fast-paced data More ❯

Join the Merlin Entertainments Digital & Data Team – where technology, data, and digital innovation meet magic! At Merlin Entertainments, we're transforming the entertainment and hospitality industries through superb digital experiences. Our Digital & Data function is connecting our global technology estate, delivering digital experiences to enchant more than 60 million guests in over 20 countries … and in-park interactions, improving global operations, or directly supporting guests by keeping attractions running smoothly. If you're a hands-on, passionate professional ready to modernise technology, data, and digital products while crafting memorable guest experiences, we'd love to hear from you! The Orchestration and Data Movement Service Systems Analyst is responsible for ensuring … the efficient and seamless movement of data across systems, applications, and environments, with a focus on orchestration. This role plays a key part in designing, implementing, and maintaining automated workflows that facilitate data integration, processing, and delivery. The Analyst will ensure that data movement processes are efficient, secure, and compliant with organisational standards while More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, you’ll not only be part of a creative and open work culture focused on innovation … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

Data Engineer Location: London (4 days/week on-site) Type: Contract (Outside IR35) Duration: 6 months A leading physical commodities trading firm is seeking a Data Engineer for a 6-month contract (Outside IR35). You’ll work on-site in London 4 days per week, building and optimizing data pipelines in a … fast-paced, data-driven trading environment. Responsibilities: Build and maintain scalable data pipelines (ETL/ELT) Support data users with ingestion, debugging, and navigation Integrate data from diverse sources (structured & unstructured) Monitor and ensure data quality Maintain and improve existing production processes Develop dashboards and visualizations Work closely with data scientists and stakeholders Follow CI/CD and code best practices (Git, testing, reviews) Tech Stack & Experience: Strong Python (Pandas), PySpark, and SQL skills Cloud data tools (Azure Data Factory, Synapse, Databricks, etc.) Data integration experience across formats and platforms Strong communication and data literacy Nice to Have: Commodities/ More ❯

Principal Data Engineer – AWS Location : London (Hybrid) Salary : £105,000 Job Type : Permanent A top-tier digital consultancy is making a key strategic hire at the Associate Director level for a hands-on, stakeholder-savvy Principal Data Engineer. You will take the helm of public and private sector data transformation programmes, drive technical delivery … shape a growing practice at scale. This is a greenfield opportunity for a high-impact leader with deep AWS expertise and a consulting mindset as an experienced Principal Data Engineer. Key Responsibilities • Lead and deliver enterprise-grade data engineering solutions using core AWS services (S3, Glue, Lambda, Redshift, Matillion, etc.). • Define architecture, mentor large technical … Proven track record leading multi-million-pound projects within consulting or enterprise-level engagements. • Strong stakeholder engagement at CxO or Director level. • Deep experience in cloud data lake architectures, ETL/ELT patterns, and metadata/data quality management. • Expertise in Matillion, Redshift, Glue, Lambda, DynamoDB, and data pipeline automation. • Familiarity with data More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯

to enhance EUC performance, automation, and user experience across client's global footprint. Technical Responsibilities: Architect and implement the XMO operating model aligned with EUC transformation goals. Integrate data sources including ServiceNow, Entra ID, Lakeside SysTrack, zScaler, Tanium, Intune into a centralized data lake. Define KPIs for user experience scoring, anomaly detection, and zero-touch incident … resolution. Oversee development of dashboards and reporting interfaces using Power BI/Tableau. Conduct gap analysis on telemetry and feedback data to identify improvement areas. Collaborate with client stakeholders to align XMO outputs with business objectives. Technical Requirements: 10+ years in IT operations, with 3+ years in EUC/XMO leadership. Deep … understanding of EUC architecture including VDI, AVD, Citrix, Windows 10/11, MacOS, iOS. Experience with enterprise tools: ServiceNow, SysTrack, Tanium, Intune, JAMF, zScaler. Familiarity with data lake architecture and analytics platforms. Strong knowledge of automation frameworks and incident management workflows. Benefits A supportive, diverse and global team with a brilliant culture. Competitive compensation and benefits that More ❯

to life. The Role As a – Data Architect , you will be responsible for designing end-to-end data solutions for large-scale Data Lake (Big Data) projects. You will guide the full lifecycle of business intelligence solutions, from requirements analysis and platform selection to architecture design, development, deployment, and testing. This … strategy and ensure scalable, high-performing data architecture Your Profile Essential skills/knowledge/experience: Extensive experience as Solution Designer. Currently working on Data Lake (Big Data) based projects. Experience in Snowflake, DBT, Glue, Airflow. Ability to demonstrate structured consideration of multiple options, comparing competing technologies, and different functional design approaches e.g. … Produce a KDD. Ability to present and discuss competing options and make recommendations to key stakeholders. Good understanding of Data Lake and Big Data technologies. Good understanding of Insurance Domain. Experience in data vault model. Understanding of AWS Services. Rewards & Benefits TCS is consistently voted a Top Employer in the UK and globally. More ❯

Nutrition and Royal Canin businesses. This transformation spans ERP modernization, edge systems integration (e.g., Salesforce, OMP), and advanced data and analytics platforms like Mars Data Lake and SAP BTP. We are hiring a Global Chief Architect to lead the architectural vision and execution across this transformation. You will: Shape and govern the enterprise architecture for … our Digital Core and growth programs. Lead a team of architects across domains (ERP, data, platform, security). Partner with business leaders, product owners, and tech teams to ensure scalable, interoperable, and future-ready systems. Represent Royal Canin in Mars’ global architecture forums and drive alignment with enterprise strategy. This is a unique opportunity to define the digital More ❯