Permanent Data Lake Jobs in London

1 to 25 of 97 Permanent Data Lake Jobs in London

Reporting and ETL Developer

Greater London, England, United Kingdom
Catch Resource Management
D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … with Microsoft Dynamics 365 Finance Operations and Project Operations 4+ years' experience working with Microsoft Power BI 4+ years' experience working with enterprise data warehouse/BI projects. … 4+ years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake, Lake House and Delta Lake Experience Responsibilities: Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
BPP
business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »
Posted:

Data Technical Lead

London Area, United Kingdom
Hybrid / WFH Options
Brown & Brown Europe
Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »
Posted:

Data Architect

London Area, United Kingdom
HCLTech
Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »
Posted:

Data Delivery Manager

London Area, United Kingdom
Hybrid / WFH Options
Brown & Brown Europe
Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »
Posted:

Data Engineer

London Area, United Kingdom
Endeavor
brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business … business hours and weekends when required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Lorien
Our client within the Education sector are looking for a Senior Data Engineer to join them on a contract basis. Inside IR35 … month contract Hybrid 1 – 2 days per week onsite Technical Skills: In depth knowledge of relevant Azure services such as Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Stream Analytics, etc. Strong Python or Scala with Spark … and analytics. Apache Spark: Deep understanding of Apache Spark for large-scale data processing. Azure Blob Storage and Azure Data Lake Storage: Expertise in setting up and optimizing Azure Data Lake Storage for storing and managing large volumes of data. Cloud Experience more »
Posted:

Data Architect

London, England, United Kingdom
Hybrid / WFH Options
Aventum Group
Title: Data Architect Reporting to: Head of Data Location: Hybrid - London office 2/3 days a week Job description The role of a Data Architect is a visionary who translates business requirements into technology requirements and defines data standards and principles. … The data architect is responsible for visualizing and designing the organisation's enterprise data management framework for how IT infrastructure supports our data strategy. This role aims to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS, and high-level programming knowledge on Spark is a plus. more »
Posted:

Data Support Engineer

London Area, United Kingdom
Pantheon
Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »
Posted:

Data Engineer - Tech Lead

London Area, United Kingdom
Tata Consultancy Services
Role: Data Engineer - Tech Lead Job Type: Permanent Location: London, UK Do you strive for engineering excellence and are ready to lead a modern tech transformation ? Do you have experience as a Azure, Pyspark, Cloud? We have the perfect role for you- Data Engineer - Tech Lead … analysis on large datasets. Architect Data Storage Solutions: Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with Cross-functional Teams: Collaborate with cross-functional teams including data … effectiveness, leveraging Azure monitoring and logging services. Your Profile Expertise in Azure cloud services, Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. Expertise in Data Engineering, Solution designing and Cloud Computing. Programming skills in Python, with developing data processing applications using more »
Posted:

Data Delivery Lead

London Area, United Kingdom
Hybrid / WFH Options
Brown & Brown Europe
Data Delivery Lead Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision of … superior data services. The Data Delivery Lead is responsible for ensuring the successful and timely delivery of data projects and initiatives. You will lead a team of Brown & Brown and third-party data specialists, manage resources, and act as a bridge between … patterns and best practice, including data pipelines delivering projects in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, Power BI The rewards: negotiable basic salary and all the normal benefits you’d expect more »
Posted:

Data Architect

London Area, United Kingdom
Mirai Talent
Data Architect We are on the lookout for a visionary Data Architect to translate business requirements into technology requirements and defines data standards and principles for a leading and dynamic insurance company. You’ll be responsible for visualising and designing the organisation's enterprise … data management framework for how IT infrastructure supports our data strategy. The goal of this role is to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. The data architecture built will be the foundation of any … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS and high-level programming knowledge on Spark is a plus. more »
Posted:

Lead Data Engineer

London Area, United Kingdom
Endeavor
brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »
Posted:

Senior Data Engineer

Greater London, England, United Kingdom
La Fosse
Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal … in driving value for customers through modelling, sourcing, and data transformation. The Senior Data Engineer will collaborate closely with core technology and architecture teams, delivering strategic data solutions while promoting Agile and DevOps methodologies in data engineering delivery. Responsibilities: Automate data … mentoring abilities and good critical thinking with problem-solving skills. Nice to Have: Experience with relevant technologies such as Synapse, Azure Data Lake, Azure Data Factory, and Databricks. Why Join: This is an opportunity to join a collaborative environment that encourages innovation and values each more »
Posted:

Data Warehouse Architect (JR100692)

London, England, United Kingdom
Clarion Events
a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to … overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability Work with product management and business subject matter experts to translate business requirements into … Analytics platform including Azure Synaps Azure Logic Apps, Azure Functions, Azure Storage Azure SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache more »
Posted:

Data Engineer

London Area, United Kingdom
Prism Digital
Lead Azure Data Engineer | Power BI, Synapse, Data Factory/Data Lake | Tech for Good/Charity Rate: £500 per day circa Duration: 6-12 months IR35: Outside Location: Remote with occasional travel to London (Once a month max) Essential skills required: Azure … solid experience required Ability to build a data platform on Azure (Synapse, Azure Data Factory, PowerBI) Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client … so if you are interested apply ASAP. Lead Azure Data Engineer | Power BI, Synapse, Data Factory/Data Lake | Tech for Good/Charity more »
Posted:

Data Architect-Uk

London Area, United Kingdom
Hybrid / WFH Options
Ampstek
Hi Professionals, Greetings From Ampstek!! Hope you are high in your spirits. Please stay safe. Our client is looking for Data Architect to join a high-growth organization. If you are interested share you resume sudhakaran.m@ampstek.com Role: Data Architect Location: London, UK (Hybrid) Duration: Contract … data with existing data architecture (called as UDP but essentially on Azure that consists of Stream Analytics, Data Lake, Ingestion and orchestration layers) Analysing existing solution (Legacy MES) to extract the data from its complex data model Skills needed … solution – SSRS) Should be well versed with Azure/Amazon cloud data architecture (Data Ingestion, Stream Analytics, Data Lake and Orchestration) Should have knowledge on Unified Namespace or equivalent standards Should be well versed with potential solutions options that can be used to more »
Posted:

Data Warehouse Architect

London Area, United Kingdom
Clarion Events
a successful, dynamic, and creative global business then we want to hear from you. The Opportunity: We have an exciting opportunity for a Data Warehouse Architect to join a rapidly growing data team in Clarion. The role will report into the Senior Architect, with responsibility to … overcome complex challenges, and grow your design through developing skills with the new initiatives we are looking to explore. Key Responsibilities: Analyse existing data design and suggest improvements that promote performance, stability, and interoperability. Work with product management and business subject matter experts to translate business requirements into … Analytics platform including Azure Synaps Azure Logic Apps, Azure Functions, Azure Storage Azure SQL Data Warehouse, Azure Data Lake, Azure Databricks Azure Cosmos DB, Azure Data Factory, Azure Search, Azure Stream Analytics Delta Lake and Data Lakes Apache more »
Posted:

Data Platform Product Manager - Azure/PowerBI - London/Hybrid

City of London, London, United Kingdom
Hybrid / WFH Options
Tech Talent Identified Ltd
A Data Platform Product Manager required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. You will be required to build strong relationships across the client and use … a strong commercial mindset and data expertise to define and execute the roadmap and backlog for the data engineering and products. Experience should include: Significant experience 3 years+ as a data business partner/manager/product owner/data analyst or … technical business analyst in a data platform domain Be an experienced subject matter expert within the data platform domain, with strong technical knowledge and demonstrable passion, including understanding on (some of): Data lakes, data marts, data warehousing (Azure Data more »
Employment Type: Permanent
Salary: £85,000
Posted:

Senior Data Engineer

London Area, United Kingdom
Franklin Fitch
Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »
Posted:

Cloud Platform Solution Architect

London Area, United Kingdom
Tata Consultancy Services
Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do … knowledge/experience: Experience of AWS Data platform experience including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS Service Selection, Container design. Designing DevSecOps pipelines. Experience in … Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS is consistently voted a Top Employer in the UK more »
Posted:

Senior Data Architect - Financial Services

London, United Kingdom
Capco
Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that … agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and … procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience more »
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Analyst

London Area, United Kingdom
Hybrid / WFH Options
Brown & Brown Europe
Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d expect (Holiday, company more »
Posted:

Data Architect

City of London, London, United Kingdom
Hybrid / WFH Options
Nigel Frank International
Azure Data Architect - Databricks - London I'm currently working with a global organisation that are going through an awesome period of transformation. As an company, they're very people centric and love the culture and environment that they've created not just in their UK offices but also … the most exciting projects across the world. For this role, they're looking for someone to come in and take ownership of the Data Architecture and strategy. They've recently implemented a Modern Data Platform along side Databricks so the successful applicant is expected to come … and engineering initiatives Experience of Azure Data Technologies such as Data Warehousing, Data Factory, Purview, Data Lake and Data bricks Experience in data modelling, database design, data integration and best practices Extensive experience with cloud more »
Employment Type: Permanent
Salary: £70000 - £90000/annum
Posted:

Data Engineer

London, England, United Kingdom
Carrot Pharma Recruitment
Data Engineer – London/Hybrid – Leading Communications Consultancy – Upto £120k Salary D.o.E + The Company A highly innovative and creative communications agency is looking for an experienced Data Engineer to join their insights practice. This company are a true powerhouse within their industry. They work with … challenges of our time through science, technology and engineering. They help them tell their story! The Role Collaborate closely with business operations and data science teams to comprehend data sources and business requirements. Develop, cleanse, enrich, and transform structured, semi-structured and unstructured data … around PowerBI. You Excellent experience in using Python. Excellent experience of SQL, relational databases, and modern data warehousing (Azure data lake/warehousing and snowflake desirable). Experienced with Azure Platform, architecture and costing. Building and maintaining reliable ETL/data pipelines. Experienced more »
Posted:
Data Lake
London
10th Percentile
£58,750
25th Percentile
£70,000
Median
£110,000
75th Percentile
£142,500
90th Percentile
£149,000