Data Lake Jobs in London

76 to 100 of 156 Data Lake Jobs in London

Customer Data Platform Product Manager

london, south east england, United Kingdom
Hybrid / WFH Options
Freshminds
A global leader in the design, marketing and distribution of premium lifestyle products is seeking a customer data platform product manager, to join their global customer insights team. You will be responsible for leading the development of their customer data platform. The ideal candidate will understand … customer facing businesses, have ROI-driven digital marketing acumen, be data fluent, and play a pivotal role to bridge the gap between business and technical teams. Responsibilities: Bridge the gap between the business and IT; ensure all requirements are documented, understood, and delivered. Own customer data … and EMEA, managing best practice communication and guidelines. Serve as the first point of contact for platform-related questions and support resolution of data issues. Understand consumer privacy regulations like GDPR and work with DPO, legal, engineering, and marketing teams to ensure compliance. Work to define data more »
Posted:

Report Writer

london, south east england, United Kingdom
Hybrid / WFH Options
83zero
will include… You will be able to produce a variety of reports focusing on a range of areas, including; Security, Performance, compliance audits, data collected from various IT Systems and tools. Strong ability to maintain and develop technical documentation, including system configurations, network diagrams, operating procedures to support … clients IT Environments. You will be analysing large data-sets to identify trends, patterns and anomalies, and have the ability to extract worthwhile insight to be included in the reports. Be an SME around identifying opportunities where automation report created can be used, using scripting languages and reporting … tools to enhance efficiency and scalability. What you’ve got… Experienced background in Report Writing, Data Analysis, or technical documentation within the IT/Tech industry. Experience on Microsoft office applications! Particularly Excel + Word, for documenting and report writing purposes. Being confident on Azure is a must more »
Posted:

Big Data Lead - Leading Tech firm

Greater London, England, United Kingdom
Hybrid / WFH Options
Hunter Bond
My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »
Posted:

Big Data Lead - Leading Tech firm

london, south east england, United Kingdom
Hybrid / WFH Options
Hunter Bond
My client are looking for a talented and motivated Big Data Architect (Azure, Databricks, Spark) to be based … in their London office. You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's datalake initiatives, as they provide increasing numbers of services to consumers across multiple digital channels. You'll be responsible for managing a remote engineering team of …/experience is essential: Strong implementation experience using Spark and Databricks Strong Cloud experience (ideally Azure) Previously heavily involved in an implementation programme Data Warehouse Strong stakeholder management experience Excellent IT background, ideally within Telco/Wireless service providers but not essential Salary: Excellent + bonus + package more »
Posted:

Lead Data Engineer

London, United Kingdom
Hybrid / WFH Options
Understanding Recruitment
Lead Data Engineer A brand-new and exciting opportunity has arisen for a Lead Data Engineer with extensive experience in Azure, SQL, ETL and mentoring/managing engineers to join the UK's Largest Charity based remote. The Lead Data Engineer will be intrumental … engineering function. If you are currently a Lead Data Engineer who has a strong experience in Azure (ADF, Databricks, Data Lake), SQL, ETL and mentoring/managing a team who is looking for a step up then this would be perfect for you! Skills that … are required for the Lead Data Engineer are: Experience in Azure (ADF, Databricks and Data Lake) Experience leading/mentoring/managing a team and keen to manage a bigger team Strong data engineering principles working with SQL, ETL Pipelines and Cloud infrastructure more »
Employment Type: Permanent, Work From Home
Salary: £70,000
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Adecco
Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »
Employment Type: Permanent
Salary: £55000 - £60000/annum + perm benefits+bonus
Posted:

Data Architect

London, United Kingdom
83zero Ltd
closely with Data Architecture, Data Management, The EDP product owner and the Technology team delivering the EDP. Data Lake Structure and Design: Validate the medallion model data lake structure (bronze, silver, gold) as the optimal approach and recommend alternatives if … needed. Create a Data Lake design including namespace hierarchy, and naming standards. Design to optimise storage and retrieval based on data types, usage patterns, and the emerging Data Domain segregation. Establish policies for moving data between different storage tiers within the … data lake (e.g. hot, warm, cold storage) based on access frequency and cost considerations. Establish policies for data integrity, consistency, conformance, and accuracy when transforming data from Bronze to Silver, and Silver to Bronze. Develop a Data Modelling Design, including a more »
Employment Type: Contract
Rate: £700 - £800/day
Posted:

Azure Data Engineer

London Area, United Kingdom
Venturi
Are you ready to take your data engineering expertise to new heights? This is your chance to become an integral part of a pioneering construction leader that's shaping the future! With a rich history, my client is an acclaimed construction powerhouse, renowned for iconic projects that transcend … data solutions aligned with business requirements. Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services. Develop, optimize, and maintain data pipelines for automated data integration from … and/or BI Developer. Proficiency in Azure data tools such as Data Factory, Synapse, Databricks, SQL, Data Lake or Delta Lake. Strong data engineering and data modeling skills, with the ability to craft complex data models. more »
Posted:

Data Engineer

London, England, United Kingdom
Version 1
do things differently. We’re focused on our core values; using these we’ve seen significant growth across our practices and our Digital, Data and Cloud team is preparing for the next phase of expansion. This creates new opportunities for driven and skilled individuals to join one of … consecutive years Have practical experience designing and delivering using AWS or Azure such as:Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar … scripting languages such as Python, Java or similar Have expertise in data modelling, data warehouse design and data lake concepts and practices. Additional Information This role can be delivered in a hybrid nature from one of these offices: Belfast, Birmingham, Edinburgh, London, Manchester more »
Posted:

Data Architect

London Area, United Kingdom
Lawrence Harvey
Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 15 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »
Posted:

Lead Product Manager

Greater London, England, United Kingdom
3Search
informed and clearer financial decisions to create better financial well-being. The company has created a new role in the company focused on data to reimagine how data is utilised in the organised About the Lead Product Manager role We are looking for a very data-centric Lead Product Manager, who will report to the Chief Data Officer and have 1 direct report which may grow to two. You will support and lead the team acting as a servant leader while working closely with data, engineering and the wider business … to ensure that data is used, ingested and provided to all company areas. This role sits horizontally across the entire company and is pivotal in the success of multiple teams and the wider company. Skills Required for this role: Product Leader who has managed and scaled successful product more »
Posted:

Customer Data Platform Product Manager - 12 month FTC

London Area, United Kingdom
Hybrid / WFH Options
Datatech Analytics
Customer Data Platform (CDP) Product Manager- London Office/Hybrid working 2 days PW in office 12 Month FTC - - Salary negotiable dep on experience Up to £80,000 - J12776 Please note all applicants require full and indefinite right to work in the UK as this client is unable … to provide sponsorship To work in a team who manage all aspects of market research, customer segmentation, first part data build up and consumer activation along the customer journey for all brands across this companies’ group. Fuelling the ambition to put data at the heart of … decision making and investing in our data platform to create a trusted single view of the customer and understand, analyse and leverage customer data to create a truly connected customer experience. Seeking an experience Customer Data Platform Product Manager to join and lead the more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Velocity Tech
with one of the best leading insurance companies, in collaboration with a prestigious bank in London. We're actively seeking a talented Senior Data Engineer to enrich our … dynamic team. Responsibilities: Experience designing data models and developing industrialized data pipelines. Strong knowledge of database and data lake systems, with proficiency in Python and SQL (any flavor). Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading cloud providers more »
Posted:

SQL Engineer

London Area, United Kingdom
Gravitas Recruitment Group (Global) Ltd
SQL Engineer | SQL | T-SQL | ETL | Azure | Azure DevOps | Enterprise Data Warehouse SQL Engineer needed on a FTC basis. Gravitas continue their support for a leading non for profit organisation on their search for a SQL Engineer. You will be responsible for maintaining and developing BI applications and … solutions. Supporting the Lead BI SQL Developer with all things Enterprise Data Hub related. Role: SQL Engineer Location: London - Once a month onsite Salary: £55,000 - £62,000 Type: 12 month FTC Benefits: 27 days holidays plus bank holidays, additional leave purchase scheme, group pension plan 6% contribution … as gym, restaurants and cafes. The essential skills needed for this position: Strong, hands on experience with SQL and T-SQL. Experience with Data Warehousing and the ETL process. Strong project management experience, including CICD and DevOps. Strong analytical & communication skills Good stakeholder engagement skills. The knowledge you more »
Posted:

Senior Data Scientist - Flexipay

London Area, United Kingdom
Hybrid / WFH Options
Funding Circle UK
The role We are looking for a Senior Data Scientist to help us improve our FlexiPay Acquisitions. Who are we? Our mission is to build the place where small businesses get the funding they need to win. We do this by uniting cutting-edge data and … and other lifecycle management. Work with our Collections and Technology teams to help set up appropriately automated collections processes. Provide requirements to our data team to ensure all necessary data for analysis on FlexiPay is suitably stored within our data lake. Proactively problem solving more »
Posted:

AWS Data Engineer

London, Liverpool, Merseyside, United Kingdom
Hybrid / WFH Options
Opus Recruitment Solutions
About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand datadata quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and data warehouse solutions on AWS. Participate in code reviews and provide constructive feedback to peers. Required Skills and Experience more »
Employment Type: Contract
Rate: £250 - £400/day
Posted:

Reporting and ETL Developer

London Area, United Kingdom
Catch Resource Management
D365, D365 F&O, D365 Consultant, AX 2012, Dynamics AX, Microsoft power BI, SSRS, ETL, Reporting developer, SQL, Azure synapse, Data Lake, Lake House, Delta Lake, Data verse, DAX, BI reports, Paginated Report Builder, South London, Hybrid, £60-£75K Our end user client … with Microsoft Dynamics 365 Finance Operations and Project Operations 4+ years' experience working with Microsoft Power BI 4+ years' experience working with enterprise data warehouse/BI projects. … 4+ years' experience working with Data Analysis Expressions (DAX) Extensive experience with SQL Experience with Data Verse Data Lake, Lake House, and Delta Lake Experience Responsibilities: Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and more »
Posted:

Data Technical Lead

London Area, United Kingdom
Hybrid / WFH Options
Brown & Brown Europe
Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »
Posted:

Data Engineer

London Area, United Kingdom
Axtria - Ingenious Insights
for designing, developing, and maintaining data pipelines and systems in Azure Cloud environments, with a strong emphasis on Azure Data Lake, Azure Data Factory, and Microservices architecture. Key Responsibilities: Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. Design and implement scalable and efficient data processing solutions using technologies such as ServiceBus, REST API, App Service, SQL Data Warehouse, and Data Mart. Utilize Vector Databases, Cosmos DB, Redis, and Elasticsearch … engineering. Bachelor’s Degree or higher in Computer Science or a related field. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Experience with Vector Databases, Cosmos DB, Redis, Elasticsearch. Strong programming skills in Python, Spark, Databricks, Pyspark, SQL more »
Posted:

Data Engineer

London, England, United Kingdom
Hybrid / WFH Options
Aventum Group
Job Title - Data Engineer Entity - Aventum Reports to - Head of Data Location - London/Hybrid Who We Are At The Aventum Group, we’re not one for following the usual rules. We work hard at being different and that very much extends to how we look … to advance their careers at Aventum. Role Summary You will work in various settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible so … Fabric, Profisee), Snowflake Data Integration, Azure Service Bus, Deltalake, BigQuery, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Apache Airflow, Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, Azure ML is a plus Experience with Azure more »
Posted:

Developer

London Area, United Kingdom
Hybrid / WFH Options
Janus Henderson Investors
be a developer in the Client Reporting Product Team within Distribution Technology. The Client Reporting Product team partners with Marketing, Reporting Operations and Data Management teams in Technology to build data integration solutions for the automation of a wide variety and high volume of reports. This … software development skills and can pick up new technologies and assist in all aspects of the team’s work such as development using data warehouse and master data vendor platform tools. You will not only need excellent problem-solving skills, but you should also be able … Informatica or similar ETL/ELT platforms, as well as knowledge of data warehousing, data mart, and data lake concepts and processes Work within the team as directed to automate and improve existing data designs and data models, including more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Tata Consultancy Services
Role: Senior Data Engineer Job Type: Permanent Location: London (Hybrid) Ready to utilize your experience in Data Engineering, Solution designing and Cloud Computing? Are you passionate about Azure Cloud and Python? Are you keen to build your career with a dynamic global IT Consultancy implementing cutting … data transformations, aggregations, and analysis on large datasets. Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with cross-functional teams including data scientists, analysts, and software engineers … Data Engineering, Solution designing and Cloud Computing. in Azure cloud services, particularly Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. programming skills in Python, with experience developing data processing applications using PySpark. Solid understanding of SQL for data manipulation more »
Posted:

Big Data Engineer

London, England, United Kingdom
ubs
Group Functions Job Reference # 294845BR City London Job Type Full Time Your role Do you have proven track record of building big data solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in-class, cloud … and share knowledge with other engineers in UBS • shape the Data and Distribution architecture and technology stack within our new cloud-based datalake-house.be a hands-on contributor, senior lead in the big data and data lake space, capable to collaborate and influence … identifying linkages across disparate datasets. • Expert in creating data structures optimized for storage and various query patterns for e.g. Parquet and Delta Lake • Experience in traditional data warehousing concepts (Kimball Methodology, Star Schema, SCD)/ETL tools (Azure Data factory, Informatica) • Experience in more »
Posted:

Cloud Architect

London Area, United Kingdom
Axtria - Ingenious Insights
Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »
Posted:

Data Support Engineer

London, England, United Kingdom
iO Associates - UK/EU
Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »
Posted:
Data Lake
London
10th Percentile
£62,375
25th Percentile
£78,969
Median
£112,500
75th Percentile
£142,500
90th Percentile
£156,599