1 to 25 of 99 Data Lake Jobs in London

Develop and optimize MS SSAS cubes (tabular and dimensional) Develop and improve solutions spanning data processing activities from the data lake (stage) to star schemas and reporting view’s/tables and finally into SSAS. Desired Skills and Experience: You have 5 years experience building … domain understanding, Ideally in finance, marketing, CRM, compliance. You should have a strong understanding of data. Have experience working with large volumes of data (millions or records per day). Can build tabular (or OLAP) cubes properly (with DAX or MDX). Advanced SQL knowledge and ability to … write performance optimized queries. You should have industry standard Data Modelling skills (i.e. Kimball) Whats in it for you? A regular bonus. Competitive salary. Healthcare support, including dental, private medical, and health screening. Wellbeing support And so much more... If the above sounds like it could be you more »

more liquid world. The more we share, the more we all gain. Responsibilities Sharegain is currently in the process of seeking a dedicated Data Engineer to become an integral member of our innovative R&D team. You will play a vital role in managing the entirety of our … data processing framework and infrastructure. Your valuable contributions will not only steer data-centric decision-making but also actively contribute to the evolution of Data monitoring and management solutions across our organization. Within this role, your tasks will encompass the design and execution of … teams (R&D, architects, business) to devise and actualize tailored solutions for their unique operational needs Expand the capabilities of the Data Lake by seamlessly incorporating different data sources Requirements "Can do attitude" Bring over 3 years of hands-on experience in the realms of more »

business in the coming years. We’re looking for an engineer to help us build BPP’s platforms, products and user experiences. The Data Engineering team will enable BPP to leverage data, to inform and optimise how we deliver scalable, secure and performant experiences that delight … pipelines to extract data from various source systems (log files, APIs, databases) and load them into our data lake/data warehouse confidentially using modern data tools and technologies Transform data into highly accessible and usable structures … as AWS, GCP, Azure) Good understanding of data modelling methods and data partitioning and compaction methods in Data Lake Experience of working with event driven architectures or real time streaming analytics Confident in writing and reading code in multiple languages Possess a deep more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

Contract Data Engineer: Fintech | AWS | Airflow | Glu This dynamic FinTech are looking to add to their already strong DataOps team. As a Data Engineer, you will be working closely with devOps and analytics teams building out and supporting the Data Warehouse (Redshift, migrating to … Snowflake), core data pipelines, and supporting our data infrastructure, and analytics capabilities. The role will also have DBA responsibilities for databases across our estate on Aurora MySQL, RDS MySQL, PostgreSQL, MSSQL. You will be responsible for (not limited to): Contributing to the data architecture … and evolution of our Data technology stack Working and communicating effectively with other data engineers, DevOps engineers, data modellers, data scientists and analysts Designing and building new data pipelines as well as maintenance and support of existing data more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Data Engineer role sits within the Engineering team of the Data Services department responsible for all data applications across the company’s divisions globally from Big Data, Data Warehousing, Business … business hours and weekends when required You Have These: Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Digital are happy to be supporting one of our clients in the Research sector who are currently on the look-out for a Data Engineer. Data Engineer Tech Stack & Experience; Python & large volumes of data. SQL. Google DataFlow would be handy. Cloud Experience (AWS, Google, Azure … a mindset to grow into more of a leadership position would be very helpful. Have come from a highly statistical/mathematical background. Data Engineer Responsibilities; Design, develop, and maintain scalable data pipelines. Implement ETL/ELT processes to extract data from a variety … of sources and load it into the data warehouse or data lake. Collaborate with data scientists and analysts to understand their requirements and design data models that support their needs. Write efficient Python code to perform data transformation, cleaning, and more »

Delivery Manager – Data Ops Location: Hybrid - London Package: Negotiable + Benefits Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them to provide great customer service and grow through the provision … of superior data services The Delivery Manager for Data Operations is responsible for ensuring the successful and timely delivery of data to the business. You will lead a team of Brown & Brown data specialists, manage resources, act as a bridge between data … engineering design patterns and best practice, including data pipelines. Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Cosmos DB, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d more »

Purpose of Position Pantheon require a passionate hands-on Data Support Engineer to support the delivery of change to existing systems as well as conduct analysis for root cause & software issues. Pantheon is at the start of a multi-year programme to establish itself as a data … technologies (ETL, SQL Database, Reporting) Knowledge of Dimension Modelling Strong SQL skills, experience in writing complex SQL queries Knowledge of Azure Data Lake, Data Factory, Databricks and Functions Essential Experience Experience in supporting traditional Data Warehouses Exposure in building Azure based data ingestion and transformation pipelines, data lake, data warehouse/data marts etc. Experience working with Agile development methodologies such as Kanban/Scrum A natural problem-solving attitude. Conversant with current industry and technology trends. Experience with dealing directly with stakeholders more »

as a Power BI Expert Analyse large datasets and draw on your expertise with Power BI to provide expert reporting and intelligence into data driven decision making for key Customer Focused areas across the business. Work with data engineers across IT & Data teams to … provide guidance and consultancy on producing an efficient and accurate reporting infrastructure. To mentor and provide training to the Data Team, to develop their skills with Power BI and surrounding processes. Experience & Skills Required Expertise with Data Visualisation and Report Presentation using Power BI. Able to … design, data transformation and engineering for reporting purposes. Proficiency with the Azure Suite, Data Factory, SQL DB, Data Lake Storage What’s in it For You? Amazing company to work for! Exciting project at SME level within a large enterprise. 9 months contract more »

Data Engineering in Animal Health London/Kent – approx. 80% remote £60-70k basic salary plus 10% bonus If you’re as much of an animal lover as you are a data engineer, you won’t find a better opportunity to use your skills for … good. In this newly created role you’ll be setting up the data infrastructure that will help this thriving veterinary care company to hugely improve outcomes for pets – and their two-legged friends[MW1] . It's a role with the potential to be both personally and professionally … a UK work visa already in place. Able to set up, maintain and support a cloud data platforms/data lake such as Snowflake A solid understanding of analytics, reporting and dashboarding technologies Proficiency in API integration, and data extraction methodologies. Strong coding more »

have created is unique and difficult to replicate, with our ‘best of both’ approach combining deep human expertise with advanced digital, tech and data capabilities. This combination not only allows us to deliver excellent customer experiences, but to do so efficiently and at scale. We are proud of … of a business that cares too Want to continue to grow professionally and be the best version of yourself Job Description The Lead Data Engineer is a key role to ensure Shawbrook unlocks the value contained in its data across the organisation in a well-governed … and table formats (Delta etc) This is an incredibly exciting role that rarely becomes available. You will own a well-designed data lake serving a 50+ user community who run '000s of queries across TBs of data each month with a mandate to take it more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »

Data Technical Lead Location: Hybrid - London Package: Negotiable + Benefits Brown & Brown, Inc. is one of the largest insurance brokers globally having in excess of $4bn revenue in 2023 by providing risk management solutions to help protect what our customers value most. We have experienced significant growth over … size of the business by improving customer experience, growing organically and acquiring, accelerating knowledge and capabilities of teammates and using technology with purpose. Data and Data services is a key strategic enabler in Brown and Brown Europe as we look to integrate acquired business, enable them … Technical Skills – Deep hands on experience with the following data technologies: Stack including, Azure Data factory, Azure Data Lake Storage, Azure SQL, Azure Cosmos DB, Azure Power Platform, primarily power BI Data Lake & Data Mesh implementation The rewards more »

Retail and CPG, and Public Services. Consolidated revenues as of $13 billion. Job Description - Job Description- We are seeking a talented and experienced Data Architect to join our team. The ideal candidate will have a strong background in designing and implementing data solutions in an AWS … DevOps microservices environment using Kafka and Snowflake. As a Data Architect, you will play a crucial role in defining and implementing the data architecture, data modeling, and data integration solutions for our organization. Responsibilities : Design and implement scalable and efficient data architecture solutions in an AWS environment, leveraging microservices architecture and DevOps principles. Work closely with development teams to understand data requirements and design appropriate data models and schemas for various applications and services. Implement and maintain data pipelines using Kafka for real more »

Role: Data Engineer - Tech Lead Job Type: Permanent Location: London, UK Do you strive for engineering excellence and are ready to lead a modern tech transformation ? Do you have experience as a Azure, Pyspark, Cloud? We have the perfect role for you- Data Engineer - Tech Lead … analysis on large datasets. Architect Data Storage Solutions: Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with Cross-functional Teams: Collaborate with cross-functional teams including data … effectiveness, leveraging Azure monitoring and logging services. Your Profile Expertise in Azure cloud services, Databricks, Synapse, Azure SQL Database, and Azure Data Lake Storage. Expertise in Data Engineering, Solution designing and Cloud Computing. Programming skills in Python, with developing data processing applications using more »

Contract Relevant context A fast growing Energy & Commodities trading company is embarking on a transition from a CTRM-centric technology architecture to a data-centric model, termed as the Digital Data Hub (DDH), to enhance scalability and stability. The first phase involves the integration of a … Allegro to Topaz derivatives integration project. Engage in the development of various test automation frameworks targeting web applications, thin client, microservices, real-time data processors, data analytics/visualizations reports. Ensure the automation test frameworks and tests are aligned with the existing programme test automation strategy … experience, backend test experience. Exposure/experience in cosmos dB and azure event hub. in data quality assurance around Data Lake, Data bricks and ETL. Exposure working with Power BI. Knowledge and experience of implementing test best practice. This is an Outside IR35 more »

Job Description: Lead Data Engineer Location: Central London (Hybrid: 2 days per week onsite.) £600-£700 Outside Company Description: My Client is a leading financial organisation committed to leveraging cutting-edge technology and data-driven insights to empower stakeholders and drive innovation within the industry. As … they continue to expand their data capabilities, they are seeking a skilled Lead Data Engineer to spearhead the development and implementation of their data platform whilst also advising and consulting on legacy data migrations from on-prem to the cloud to increase … carbon neutrality. Role Overview: As a Lead Data Engineer, you will play a pivotal role in designing, building, and maintaining their data infrastructure while collaborating closely with senior stakeholders across the organisation. Your expertise in Azure, Databricks, Spark, Python, and data modelling will be more »

Senior Data Engineer - Azure/Databricks - £75-80,000 Scalexperts are partnered with an education business who after making a few recent senior leadership hires in Data & Technology are now scaling their Data Engineering function. They are looking for a Senior Data Engineer to join them to work on building a brand new data platform which is still in early stage development. They are looking to combine all the data into one common data warehouse so that reporting & insight/analytics becomes much clearer … depth knowledge of and experience with Databricks Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc Experience with SQL is a must, some Python is a bonus Experience of working with a number of different data sources more »

Senior Data Engineer Fully Remote or Hybrid Working Up to £70,000 per annum + Bonus An excellent opportunity has arisen for an experienced and engaging Senior Data Engineer, to join a well-known organisation within the legal sector. The successful applicant will join a well … established team as a point of expertise for all data related projects. They will design, build and deploy high quality solutions across company platforms and ensure they meet the required standard. Main duties include: Mentoring a team of developers to effectively create, optimise and maintain automated systems and … role Excellent understanding of Databricks and Pyspark Strong knowledge of Azure Cloud Services Excellent understanding of SQL Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Excellent more »

GBP per annum and Benefits applicable by the Client Purpose of Role: At Client we are committed to ensuring our data and processes are successfully maintained and enhanced to keep our customers moving. We are therefore recruiting for a Data Product Owner to join our new … purpose today and ready for the challenges of the future, providing a bridge between our operational teams and technology department and facilitating better data decision making for our customers. Reporting to the Data Product Manager, you will: • Play a vital role in owning and developing the … their need’s; successfully gathering and acting on user feedback and effectively communicating on updates and issues. • Become an expert in Asset Risk data systems and processes and provide business knowledge when interacting with internal stakeholders and 3rd parties. • Collaborate with key business stakeholders from a variety of more »

Lead Data Engineer London - Hybrid Up to £70,000 Benefits include: 30 day holidays plus Bank Holidays. 75% commute costs covered, Private Medical, Private Dental, Pension up to 12% This role is remote heavy with some expectations to go into the London office when needed (est. 2 x … is to improve systems available across the UK and provide a more sustainable and efficient experience for all. In this role the Lead Data Engineer will work with Product Owners to understand the business strategy to align and influence the technical solutions throughout. Providing insight, value and suggestions … across complex data engineering projects. This is a hands on Technical Lead role, management experience is not required. Senior Data Engineers with excellent commercial experience ready to step up into a Technical Lead role will also be considered. The Lead Data will work across more »

Cloud Architect/Data Architect Google Cloud/GCP, Machine Learning/Generative AI London Based - New Offices, Refurbed in the Heart of a buzzing area £90k-£120k basic salary + bonus Benefits: 25 days holiday + bank holidays Private Healthcare Discounted Gym Membership (Nuffield + Hussle) Life … Insurance, Income Protection, Employee Assistance Program Pension Scheme (max 10%) We are working with an AI/Data Consultancy with core clients within the Retail, Financial Services, Gaming, SaaS sectors. The successful Cloud Architect will work with an array of technologies with clients from several industries & sectors meaning … devising innovative solutions to address their needs, defining project parameters, and supervising the execution of these projects. Role of the Cloud Architect/Data Architect: Utilising advanced data processing and cloud technologies effectively to stimulate innovation. Engaging with clients to create top-notch solutions tailored to more »

Senior Data Engineer – Higher Education – 6 Months (Rolling) - London - £522.50 One of the UK’s leading higher education clients now requires a Senior Data Engineer on an initial six-month contract to improve their learning engagement platform. The Data Engineer will be predominantly responsible … for setting up and configuring a new Azure Data Lake. The ideal Data Engineer will have the following skills/experience: Proven Experience working on Azure Data Factory Previously worked with Python and SQL Previously worked with Power BI Interpersonal and Stakeholder Management Skills … position and would require you onsite 1 – 2 day(s) per week onsite at their office in London. If you’re an experienced Data Engineer looking for an exciting new opportunity with a leading Higher Education client, please apply more »