16 to 40 of 112 Data Lake Jobs in London

Data Architect We are on the lookout for a visionary Data Architect to translate business requirements into technology requirements and defines data standards and principles for a leading and dynamic insurance company. You’ll be responsible for visualising and designing the organisation's enterprise … data management framework for how IT infrastructure supports our data strategy. The goal of this role is to show the company's infrastructure how data is acquired, transported, stored, queried, and secured. The data architecture built will be the foundation of any … Apache Iceberg, Apache Spark, Apache Hudi, Apache Kafka, Power BI, BigQuery, DeltaLake, Azure DevOps, Azure Monitor, Azure Data Factory, SQL Server, Azure DataLake Storage, Azure App Service, Azure ML is a plus. Languages : Python, SQL, T-SQL, SSIS and high-level programming knowledge on Spark is a plus. more »

brand licensing through IMG; live event experiences and hospitality through On Location; full-service marketing through global cultural marketing agency 160over90; and sports data and technology through IMG ARENA and OpenBet. Endeavor is also the majority owner of TKO Group Holdings (NYSE: TKO), a premium sports and entertainment … company comprising UFC and WWE. What You’ll Do: The Lead Data Engineer role sits within the Data Services department, you will work actively to unlock the value of data by building and enabling product teams and data practitioners to use the … and needs assessment. You Have These: Team management experience Exposure to, and ideally experience with, modern data architectures (e.g. data lake, lake house, data mesh) and accompanying technologies (e.g. Azure Synapse, Snowflake, Amazon Redshift) Awareness of data governance and all more »

Senior Data Engineer - 6 month FTC London (Hybrid Role) £85,000 per annum Senior Data Engineer Opportunity An exciting opportunity has arisen for a Senior Data Engineer to join a dynamic team dedicated to shaping effortless, digital-first customer experiences. This role is pivotal … in driving value for customers through modelling, sourcing, and data transformation. The Senior Data Engineer will collaborate closely with core technology and architecture teams, delivering strategic data solutions while promoting Agile and DevOps methodologies in data engineering delivery. Responsibilities: Automate data … mentoring abilities and good critical thinking with problem-solving skills. Nice to Have: Experience with relevant technologies such as Synapse, Azure Data Lake, Azure Data Factory, and Databricks. Why Join: This is an opportunity to join a collaborative environment that encourages innovation and values each more »

As the Data Architect, you'll lead data architecture initiatives, establishing standards and practices essential for effective data management. Your focus will be on designing and implementing robust data and information systems, ensuring they meet stringent criteria for modelling, flow, lineage, quality … and security. Working closely with stakeholders and data governance teams, you'll drive adherence to established standards, facilitating data-driven decision-making processes across the organisation. This role encompasses: Developing and maintaining a comprehensive Data Architecture Framework and maturity roadmap. Enforcing best data … Azure stacks, including data pipelines, security and networking Expertise with data warehousing, data lakes and data lake houses Experience with master data management software and technologies Experience with ETL technologies including SQL Server, SSIS, Azure Data Factory more »

Job Title: AWS Data Architect Location: United Kingdom (U.K.) - Hybrid The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy dedicated to delivering exceptional value to our clients in the public sector. Our company culture promotes collaboration, autonomy, and rapid learning, empowering our … work environment focused on deliverable outcomes, along with a range of benefits to support our employees’ well-being and professional development. Key Responsibilities: Data Architecture Design: Collaborate with stakeholders to understand data requirements and design scalable and secure data architectures on AWS. Develop data models, data flow diagrams, and architectural documentation to support financial applications. Cloud Data Management: Design, implement, and manage cloud-based data solutions on AWS, including data lakes, data warehouses, and analytics platforms. Ensure the scalability, performance, and cost more »

A Data Platform Product Manager required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. You will be required to build strong relationships across the client and use … a strong commercial mindset and data expertise to define and execute the roadmap and backlog for the data engineering and products. Experience should include: Significant experience 3 years+ as a data business partner/manager/product owner/data analyst or … technical business analyst in a data platform domain Be an experienced subject matter expert within the data platform domain, with strong technical knowledge and demonstrable passion, including understanding on (some of): Data lakes, data marts, data warehousing (Azure Data more »

unparalleled educational experience. By attracting and retaining the finest educators worldwide, our client ensures an environment where excellence thrives. Job Purpose As the Data Platform Engineer overseeing the Data Warehouse and analytics infrastructure, you will shape the backbone of our client's business analysis and reporting … capabilities, both now and into the future. They are seeking a visionary with a proven track record of architecting enterprise-level data ecosystems, someone who thrives on pushing the boundaries of what's possible in data manipulation. Your expertise will ensure data is not … Remarkable experience with Development and maintenance of data pipeline and ETL processes using Azure data Factory, Azure Data Lake and Azure Databricks. Exceptional experience developing codes, testing for quality assurance, administering Azure Databricks platform and exposure to Unity Catalog. Exposure of Performance Tuning more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do … knowledge/experience: Experience of AWS Data platform experience including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS Service Selection, Container design. Designing DevSecOps pipelines. Experience in … Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS is consistently voted a Top Employer in the UK more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that … agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and … procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience more »

partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within … Transaction Monitoring and Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data more »

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d expect (Holiday, company more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

our team in London. As a BI Consultant, you will work closely with our clients to understand their business needs and develop innovative data-driven solutions to drive business growth and improve decision-making processes. Responsibilities: 1. Collaborate with clients to identify their business requirements, objectives, and key … performance indicators (KPIs) for effective data analysis and reporting. 2. Design and develop scalable and efficient business intelligence solutions, including data models, dashboards, reports, and analytics using industry-leading tools and technologies. 3. Extract, transform, and load (ETL) data from various sources into data warehouses or data lakes, ensuring data integrity, consistency, and quality. 4. Conduct data profiling, data cleansing, and data validation to ensure accuracy and reliability of business intelligence solutions. 5. Perform data analysis and interpretation to identify more »

Azure Data Engineer - £60,000 + Benefits, London … weekly on-site You must have full right to work authorisation. No sponsorship available. Azure data platform technologies, including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Working in a leading UK and global business you will be a key part of the … platforms, offering near real-time process reporting solutions. Your Profile : Extensive experience with Azure data platform technologies, ideally including Data Lake Gen 2, Synapse, Analysis Services, and Power BI. Proven skills with Azure Data Factory & Databricks/Apache/Sparx, along with extensive more »

We are looking for Senior Data Solution Architect Below are details Data Solution Architect Proven experience as architect and engineering lead in Data & Analytics stream In-depth understanding of data structure principles and data platforms Problem-solving attitude, solution mindset … with implementation expertise Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Well-versed with the end2end data management philosophies and governance processes Has pre-sales experience and have involved in RFP/RFI/RFQ processes Creative problem-solver with … strong communication skills Excellent understanding of traditional and distributed computing paradigm Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write more »

About the job Role: Data Platform Product Manager Location: Central London (2 days per week in office) Harmonic is delighted to partner with a high-growth research and insights scale-up, undergoing a phase of rapid expansion. They have grown 20% YoY for the past 5 years, and … following recent investment are continuing to scale. Being a data-led organisation carrying out some extremely interesting work, the data team has a significant role to play in aiding the growth and success of the organisation and offers the opportunity to work on cutting-edge technologies … such as AI and ML. The Data Platform team currently sits at a headcount of 4 but will double to 8 before the end of the year, offering amazing progression opportunities! Job Responsibilities: Directly lead and manage a team of 2 Data Analysts Embrace a visionary more »

Data Engineer | Hybrid | £70,000 - £85,000 + Bonus | Professional Services Are you looking to join a global professional services organisation? Are you looking to join a technical team full of driven and passionate people? Are you looking to work with cutting-edge technology? As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure on the Azure cloud platform. You will be responsible for building and optimizing data pipelines, integrating various data sources, and ensuring the reliability and scalability of our … scalable data pipelines on Azure cloud platform. Integrate and transform data from diverse sources into a unified data lake environment. Implement data governance and security best practices to ensure data integrity and compliance. Optimize performance and efficiency of data more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

capability development, business intelligence solution delivery, performance and quality management, and maintaining technical expertise. The ideal candidate has extensive experience in Business Intelligence, data modeling, Azure platform, SQL databases, and DevOps practices. Desired skills include stakeholder relationship management, familiarity with big data technologies and Azure cloud … Detailed working knowledge of one or more market leading business intelligence platforms or tools (PowerBI, Tableau). * Expert knowledge of business intelligence concepts, data visualisation and analytic methods. * Data Engineering: A strong background in data engineering, with thorough understanding of concepts like ETL (Extract … Services: Hands-on experience with Azure data services like Azure SQL Database, Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics. * SQL Database Experience: Proficiency in SQL databases with the ability to write complex queries and procedures. Experience with Azure SQL more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »