101 to 125 of 243 Data Lake Jobs in London

We are looking for a data scientist who will help us discover the information hidden in vast amounts of data and make smarter decisions to deliver even better products. Your primary focus will be on applying data mining techniques, statistical analysis, and building high … quality prediction systems integrated with our products. A data scientist is someone who creates value from data. Such a person proactively fetches information from various sources and analyses it to better understand how the business performs and to build AI tools that automate certain processes within the company. … reporting SQL at least basics but by year 3 should be quite proficient with at least pulling data Data Lake implementation and processing. Knowledge of Snowflake or equivalent XGBoost, LightGBM and the ability to use them for tabular data NLP and familiar More ❯

within related disciplines (e.g., data ingestion, data storage, data serving, APIs) Hands-on experience with data lake or data warehouse technologies (e.g., Spark, ETL, Databricks) Practical experience in system design, application development, testing, and operational stability Ability to independently More ❯

to Move to Skip to Content Link Select how often (in days) to receive an alert: The job you're considering The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety … of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and AWS tools. Adopt DevOps Practices: Utilize DevOps methodologies and tools for continuous integration and deployment (CI/CD), infrastructure More ❯

Data & AI Technologies - Technical Trainer Salary: Up to £60,000 (Based on candidate experience) Hybrid Model: Mostly remote (ad-hoc travel to London expected) Job Type: Permanent About you: You will have a hands-on technical training session covering Data-focused our AI & Data Practice, specializing in Starburst, Dell Data Lakes, and Data Warehousing solutions. You'll design and deliver training that enables clients to maximize value from modern data architectures and be adept at teaching complex concepts to a variety of learners while ensuring training … and virtual sessions, guiding hands-on workshops and offering immediate feedback Design and develop content, including creating hands-on training for Starburst, Dell Data Lakes, and Data Warehouse Develop practical labs, case studies, and learning materials Adapt teaching methods to different technical levels Stay current with More ❯

Data Modeler A SME Insurer are looking for a Data Modeler to build out data models to facilitate reporting, generating insights and data science applications. The role would be working close with Bas and Data Engineers and translate business requirements … into effective data models and mapping documents. Essential skills for the Data Modeler: Strong experience as a Data Modeler/Architect London … Market Insurance industry experience Using Data Modelling such as Erwin Experience with modelling methodologies including Kimball etc Usage of Data Lake formats such as Parquet and Delta Lake Strong SQL skills Rate: £600 - £700 P/D Outside IR35 Contract Duration: 6 months Location More ❯

Data Modeler A SME Insurer are looking for a Data Modeler to build out data models to facilitate reporting, generating insights and data science applications. The role would be working close with Bas and Data Engineers and translate business requirements … into effective data models and mapping documents. Essential skills for the Data Modeler: Strong experience as a Data Modeler/Architect London … Market Insurance industry experience Using Data Modelling such as Erwin Experience with modelling methodologies including Kimball etc Usage of Data Lake formats such as Parquet and Delta Lake Strong SQL skills Rate: £600 - £700 P/D Outside IR35 Contract Duration: 6 months Location More ❯

Data Engineer – HIRING ASAP Start date: ASAP Duration: 6 Months Location: Remote Rate: £450 - £500 per day outside ir35 Summary We are currently working with a new generation consultancy based across UK and EU and founded on the premises of the engineering excellence and empowering people to make … stacks and typically run agile scrum on all our projects. Responsibilities We expect you to work closely with business to understand their current data problems and to know how to analyse and cleanse their data. Also, we expect you to design data storage solutions and be … experience Good understanding of data modelling, change data capture and/or ACID compliant table structure. Good data lake/data Lakehouse understanding, very good understanding of a traditional data platform. Experience on different aspects of ingestion, via api More ❯

bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory, and operational challenges. We provide data-driven, technology-enabled advisory and consulting, implementation, staffing and managed services solutions to the regulatory compliance, risk, financial crimes, and capital markets functions of … Design and implement Databricks-based solutions for managing, processing, and analyzing large datasets within the financial services sector. Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to develop and optimize data pipelines, workflows, and data models. Guide and support the migration of … legacy systems to Databricks, ensuring seamless transitions from legacy to cloud-based environments. Ensure data integrity, security, and compliance with financial industry regulations. Build and optimize ETL processes using Databricks, Spark, and other data processing tools. Implement data governance best practices within the Databricks More ❯

Overview The Manual Data QA will be responsible for executing comprehensive manual tests to ensure the quality of data flows across various Chambers products and platforms, with a primary focus on the Databricks environment. This role plays a critical part in maintaining the integrity and reliability … of our data services. Main Duties and Responsibilities Testing Execution : Conduct detailed manual tests to validate data flows and processing within the Databricks platform. Ensure that data integrity, accuracy, and consistency are maintained across all stages of data handling. Strategy and Planning … data solutions into existing systems. Skills and Experience Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data More ❯

Fabric Data Architect I am working with a data driven Microsoft partnered consultancy who are looking for a Fabric Data Architect to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on … projects on Fabric implementations. You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle and work … focused on MS Fabric Strong ETL experience with tools such as ADF or SSIS Experience working with Azure technologies - Synapse, Databricks, Data Lake Knowledge of data architecture principles and data modelling In this role you will be required to attend the office on More ❯

Overview: The Manual Data QA will be responsible for executing comprehensive manual tests to ensure the quality of data flows across various Chambers products and platforms, with a primary focus on the Databricks environment. This role plays a critical part in maintaining the integrity and reliability … of our data services. Main Duties and Responsibilities: Collaborate with cross-functional teams to understand data migration requirements and ensure smooth data transition to the cloud platform. Develop and execute comprehensive test plans for data migrations, database implementations, and ETL processes. Perform … assess system scalability and identify potential bottlenecks. Skills and Experience: Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data More ❯

Job Description: The Food & Nutrition Data Architect will be a key driving force in transforming the Food & Nutrition (F&N) business segment. Working closely with our partners, you will have overall accountability for data solution design, including Analytics, Visualisation, Dashboards, and Ops. You will be responsible … them to ways of working. As a trusted advisor, you will collaborate with segment cross-functional teams to design and implement cutting-edge data solutions that enhance customer experiences, drive revenue growth, and maintain a competitive edge in the digital marketplace. Moving to One Enterprise Data … in synergy with segment Data Platform Lead, Segment EA and central Mars Inc COE Analytics teams - to enhance the data lake and a real-time reporting environment for operations. Lead complex data improvement and project management engagements, spanning cross divisions and markets in More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. Azure certified Data Engineer/Architect Knowledge More ❯

Staffworx are planning for future talent pool projects. Azure Data Engineer with AI/Machine Learning experience for a leading specialist consulting ogranisaiton and Digital FS Fintech client. Key Responsibilities for the Azure Data Engineer. Excellent experience in the Data Engineering Lifecycle, you will … have created data pipelines which take data through all layers from generation, ingestion, transformation and serving. Strong experience in building data solutions using Azure, Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, Azure Synapse, Data Fabric. Azure certified Data Engineer/Architect Knowledge More ❯

Your new company Working for a global small/medium Asset Management firm. Your new role Working as a Data Engineer in three key areas, firstly the support of ETL monitoring … and maintaining the ETL process, where you will manage, support and develop ETL pipelines to ingest data into their data lake/data warehouse - diagnosing and fixing data-related issues, log analysis, tracing errors back to the source. Secondly, Mi reporting …/Bi reporting and data analysis providing analysis/reports from the in-house data warehouse. You will be supporting extending business reports and migrating business reports into Power Bi as well as liaising with users to determine requirements for reporting/data extracts More ❯

Your new company Working for a global small/medium Asset Management firm. Your new role Working as a Data Engineer in three key areas, firstly the support of ETL monitoring … and maintaining the ETL process, where you will manage, support and develop ETL pipelines to ingest data into their data lake/data warehouse - diagnosing and fixing data-related issues, log analysis, tracing errors back to the source. Secondly, Mi reporting …/Bi reporting and data analysis providing analysis/reports from the in-house data warehouse. You will be supporting extending business reports and migrating business reports into Power Bi as well as liaising with users to determine requirements for reporting/data extracts More ❯

Shape the Future with Data A leading global technology and consulting firm is seeking a talented data engineering consultant to join its team. As a pioneer in digital transformation, they're at the forefront of innovation, and you'll be instrumental in driving client success. Why … career with a work-life balance. Contribute to projects with a positive societal impact. What You'll Do: Design and implement cutting-edge data architectures. Collaborate with clients to deliver tailored data-driven solutions. Stay at the forefront of emerging data technologies and trends. … Mentor and develop team members. Contribute to business growth initiatives. About You: A proven track record in delivering complex data-driven projects within consulting. Exceptional analytical and problem-solving skills to extract actionable insights. Strong communication and stakeholder management for effective collaboration. Deep expertise in data More ❯

Principal Data Engineer Consulting London, UK £95,000 £103,000 Hybrid A leading consultancy is seeking a Principal Data Engineer to take ownership of delivering scalable, cloud-first data solutions across greenfield and transformation programmes. This is a hands-on role where you'll … design, build, and deploy enterprise-grade platforms and pipelines using AWS and modern ETL tools. As Principal Data Engineer, youll work directly with clients to understand complex requirements, shape the solution architecture, and lead end-to-end technical deliveryalways with a focus on quality, performance, and value. Your … Your previous experience as Principal Data Engineer will include: Strong background across AWS data stack and modern data lake architectures Experience delivering complex ETL pipelines and cloud warehouse solutions Proven business development exposure within a consulting or pre-sales context Familiarity with RDBMS More ❯

Sr. Product Mgr, Business Data Technologies At Amazon, data is critical to everything we do, from understanding product inventories across our global fulfillment centers to predicting what products to recommend to customers. Data ceaselessly informs our flywheel, helping us to understand customer needs, onboard … new sellers and selection, and identify opportunities for cost savings. Business Data Technologies (BDT) provides trustworthy, intuitive, and cost-efficient solutions for Amazonians to secure, store, analyze, and transform this data at unparalleled scale. BDT owns, develops, and operates Andes, one of the largest data … policies and law of the land. The BDT Data Governance organization works to ensure that users of the Andes data lake and policy owners have a consistent and seamless experience complying with Amazon's data handling policies across multiple applications, UIs, APIs, CDK More ❯

We are seeking a skilled senior data engineer to join a dynamic team in London responsible for building a global and scalable data lakehouse which will be used by multiple trading desks at the fund. This role offers the opportunity to work with cutting-edge technologies … and collaborate with multiple trading teams to drive data-driven decision-making. Key Responsibilities: Design, develop, and maintain a robust data lakehouse solution for use by multiple trading desks. Collaborate with trading teams to understand their data needs and provide tailored solutions. Implement data … cloud software development kits (APIs). Optimise performance, data storage and retrieval processes for efficiency and scalability. Ensure the data lake and Online Analytical Processing DB (OLAP - Redshift or similar) is able to handle large volumes and highly concurrent data acess. Ensure data More ❯

Roles: Azure Data Engineer (Databricks) Location: London Key Skills: 8 plus years of experience in building/architecting data … analytic solutions. 3 years of experience in building data platform using Azure services including Azure Databricks, Azure Data Factory, Delta Lake, Azure Data Lake (ADLS), Power BI. Solid hands-on experience with Azure Databricks - Pyspark coding and Spark SQL coding - Must have. … Very good knowledge of data warehousing skills including dimensional modeling, slowly changing dimension patterns, and time travel. Experience in delivering Agile projects with implementation knowledge on CI/CD pipelines, preferably on Azure DevOps. Experience in delivering data analytical platform for insurance customers. Experience in Lloyd More ❯

Data Science Analyst Central London – 4 Days in Office Up to £85,000 + Benefits The Company This 30-person private equity firm is all about creating value—working closely with portfolio companies in industries such as pharma, healthcare, financial services, tech, and industrials, they focus on strategic … projects that drive growth, efficiency, and innovation. As a Data Scientist , you’ll work closely with the management team, portfolio companies, and the operational strategy team to deliver high-impact data solutions. From understanding KPIs to delivering insights that drive strategic decisions, you’ll play a … outcomes for the firm’s investments. Key Responsibilities Engage with C-level stakeholders to understand business needs and define KPIs. Build and maintain data pipelines, integrate data systems, and manage the data lake. Conduct data analysis, reporting, and visualisation to support key More ❯

over 94% of our employees approve of the CEO, and 89% would recommend working at Persistent to a friend. Position: Senior Client Partner (Data Sales) Location: London, United Kingdom Experience: Minimum 15 Years of Experience Want to be part of an innovative and entrepreneurial sales environment? Want to … who will be responsible for leading sales activities in his/her respective region for our Enterprise Digital Transformation business primarily driven by data services. This role is for you is you are passionate about the innovation economy, love to dabble in next gen technologies and excited about … role and responsibilities will include lead generation, prospecting, identifying, qualifying and creating opportunities and selling Persistent data engineering including data lake, data analysis, AI/ML services to software ISVs and software enabled enterprises. Key to the role is to inspire customers on More ❯

The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for overseeing the planning, development, and design of data engineering processes within a customer-facing data warehousing product. This product plays a critical role in delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data … Engineer Strong Data Engineer Language Skills (Python, SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (Flink, Spark) Experience of a variety of data More ❯

Databricks Architect I am working with a data driven Microsoft partnered consultancy who are looking for a Databricks Architect to join their growing team. You will have the opportunity to work with some of the latest Microsoft technologies with a focus on projects on Azure and Databricks implementations. … You will join a team at the centre of a number of data-driven projects where you will be responsible for the design, development and creation of data solutions. You will work on the full end-to-end product lifecycle and work collaboratively with other architects … Data Platform Strong ETL experience with tools such as ADF or SSIS Experience working with Azure technologies - Synapse, Databricks, Data Lake Knowledge of data architecture principles and data modelling In this role you will be required to attend the office on More ❯