26 to 50 of 138 Data Lake Jobs in London

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture … Spearhead the design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors … Skills and Experience: Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. Advanced skills in SQL programming, with the ability to design, optimize, and maintain complex queries and databases. Strong experience in more »

Are you looking for an exciting opportunity in Solution Architecture ? Are you passionate about everything cloud and data ? Join us as an AWS Cloud Data Platform Solution Architect Careers at TCS: It means more TCS is a purpose-led transformation company, built on belief. We do … knowledge/experience: Experience of AWS Data platform experience including AWS-EMR Cluster Platform, Glue, EC2, S3, VPC, IAM, RDS, Redshift, Sagemaker, Lake formation and Glue catalogue. Data Storage Fundamentals. Cloud specific patterns and technologies. AWS Service Selection, Container design. Designing DevSecOps pipelines. Experience in … Pyspark. Good to have: Experience in Databricks platform. Insurance domain knowledge (Pensions & Annuity.) Understand the data platform solutions like data lake, data warehouse, data marts. AWS solution architect certifications. Rewards & Benefits: TCS is consistently voted a Top Employer in the UK more »

Senior Data Engineer About us HENI is a technology company pioneering art markets and information. We work with world-leading artists and estates across various sectors, including printmaking, book publishing, NFTs, digital content, and art research – all underpinned by cutting-edge research in analytics, AI, and machine learning. … Our team comprises of talented web developers, data engineers, data scientists, and infrastructure specialists who thrive on solving complex problems. We enjoy developing machine learning tools and embracing the latest in infrastructure and coding methodologies. We maintain high standards of technical quality via thorough testing and … ingestion, Prefect for pipeline orchestration, AWS Glue for managed ETL, along with Pandas and PySpark for pipeline logic implementation. We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day more »

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that … agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and … procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience more »

partner with Deutsche Bank to support contingent recruitment processes. Job description - the role On behalf of Deutsche Bank, we are looking for a Data Governance Analyst for an initial 6 month contract based in the Banks London Office on a hybrid working model of 3 days per week … Together we're sharing new perspectives and transforming what it means to be a bank.' Purpose of the role: Transaction Monitoring & Screening Global Data Steward Office is responsible for Data Governance, Data Quality Management (DQM) & Data Programme delivery covering key functions within … Transaction Monitoring and Screening. Working as part of the DQM team the Senior Data Analyst will be responsible for supporting the Data Quality Management Framework and for contributing towards the central Data Analytics capability. Data Quality Management Framework covers Data more »

Data Analyst Location: Hybrid - London Package: Negotiable + Benefits The Data Analyst for Data Operations will be responsible for gathering, collating and analysing data issues and translating them into data and reporting needs, using technical expertise to ensure data accuracy and high-quality, whilst ensuring delivery deadlines meet business requirements. Working closely with the data operations team, business stakeholders and the wider data team in resolving operational and data issues. The day to day: You will be an experienced analyst who … communication and collaboration skills Experience with data warehousing Experience in the Microsoft stack - Azure Data factory, Azure Data Lake Storage, Azure SQL Server, Azure Power Platform, Power BI. The rewards: negotiable basic salary and all the normal benefits you’d expect (Holiday, company more »

Job order - J(Apply online only) - Permanent Full Time Title Senior Data Technology Consultant Category Business Consulting City UK Wide - Various, UK Wide - Various, United Kingdom Job Description Senior Data Technology Consultant Position Description Challenge yourself, change lives and help shape the UKs digital revolution. We … open, friendly community of experts. Well train and support you in taking your career wherever you want it to go. As a Senior Data Technology Consultant within our successful Business Consulting practice, you, alongside a collaborative team of consulting colleagues, will take a central role in providing support … technologies. You will be familiar and ideally hold certifications with AWS and Azure data tooling and understand Data Lake, Data Warehouse and Lakehouse concepts. You will have the ability to deliver high quality data consulting services to meet clients more »

Data Engineer – London/Hybrid – Leading Communications Consultancy – Upto £120k Salary D.o.E + The Company A highly innovative and creative communications agency is looking for an experienced Data Engineer to join their insights practice. This company are a true powerhouse within their industry. They work with … challenges of our time through science, technology and engineering. They help them tell their story! The Role Collaborate closely with business operations and data science teams to comprehend data sources and business requirements. Develop, cleanse, enrich, and transform structured, semi-structured and unstructured data … around PowerBI. You Excellent experience in using Python. Excellent experience of SQL, relational databases, and modern data warehousing (Azure data lake/warehousing and snowflake desirable). Experienced with Azure Platform, architecture and costing. Building and maintaining reliable ETL/data pipelines. Experienced more »

Data Architect - Consulting - FS A leading global consulting firm is looking for a Data Architect to join their team! As the successful candidate, you will be in charge of designing and implementing scalable architecture and lead a global rollout of the client's digital content platform. … office and it is offering up to £155,000 + bonus + excellent benefits! Required skills: More than 5 years of experience in Data Architecture implementing data migrations to at least one cloud platform including AWS, GCP and/or Azure Data … modernisation and data ingestion experience Experience leading at least one implementation of Databricks and/or Snowflake is required Data Lake and data storage design experience for both structure and unstructured data Experience working for a consultancy or for a financial more »

𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫 - 𝐌𝐚𝐜𝐫𝐨 𝐇𝐞𝐝𝐠𝐞 𝐅𝐮𝐧𝐝 - 𝐋𝐨𝐧𝐝𝐨𝐧 - 𝐔𝐩 𝐭𝐨 £𝟏𝟓𝟎𝐤 + 𝐁𝐨𝐧𝐮𝐬 Note: I have a plethora of live Data Engineering opportunities. Therefore, even if you don't feel your profile is relevant for the role mentioned below, we encourage you to apply anyway to discuss one of the … other positions. A well established Quant Fund we are working with is looking to develop a new high frequency data platform to support the development and deployment of new strategies. The sort of work you would get exposure to includes … building greenfield market data processing systems that will handle very large amounts of market/exchange data, data lake development using AWS Glue, Apache Kafka/Airflow and dbt, and more traditional end-to-end Data Pipeline development. Lastly, part of more »

We are looking for Senior Data Solution Architect Below are details Data Solution Architect Proven experience as architect and engineering lead in Data & Analytics stream In-depth understanding of data structure principles and data platforms Problem-solving attitude, solution mindset … with implementation expertise Working experience on Modern data platforms which involves Cloud & related technologies, Graph databases, Virtualization Well-versed with the end2end data management philosophies and governance processes Has pre-sales experience and have involved in RFP/RFI/RFQ processes Creative problem-solver with … strong communication skills Excellent understanding of traditional and distributed computing paradigm Should have excellent knowledge in data warehouse/data lake technology and business intelligence concepts Should have good knowledge in Relational, No-SQL, Big Data Databases and should be able to write more »

About the job Role: Data Platform Product Manager Location: Central London (2 days per week in office) Harmonic is delighted to partner with a high-growth research and insights scale-up, undergoing a phase of rapid expansion. They have grown 20% YoY for the past 5 years, and … following recent investment are continuing to scale. Being a data-led organisation carrying out some extremely interesting work, the data team has a significant role to play in aiding the growth and success of the organisation and offers the opportunity to work on cutting-edge technologies … such as AI and ML. The Data Platform team currently sits at a headcount of 4 but will double to 8 before the end of the year, offering amazing progression opportunities! Job Responsibilities: Directly lead and manage a team of 2 Data Analysts Embrace a visionary more »

Data Engineer | Hybrid | £70,000 - £85,000 + Bonus | Professional Services Are you looking to join a global professional services organisation? Are you looking to join a technical team full of driven and passionate people? Are you looking to work with cutting-edge technology? As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining our data infrastructure on the Azure cloud platform. You will be responsible for building and optimizing data pipelines, integrating various data sources, and ensuring the reliability and scalability of our … scalable data pipelines on Azure cloud platform. Integrate and transform data from diverse sources into a unified data lake environment. Implement data governance and security best practices to ensure data integrity and compliance. Optimize performance and efficiency of data more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients … in the development of disaster recovery and business continuity plans. Preferred Qualifications: 3-5 years working in Azure cloud environments, Azure Data Lake, Azure Data Factory Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Experience working in healthcare … or pharmaceutical industry. Proficiency in Azure Cloud environments, Azure Data Lake, Azure Data Factory, Microservices architecture. Knowledge of Azure DevOps, CI/CD pipelines, GitHub, Kubernetes (AKS). Additional certifications in relevant areas such as Azure Security, Azure Networking, or Azure AI/ML. Experience more »

you realize your potential. Our team is key to our success. We’re people-first. We value collaboration, curiosity and commitment. As a Data Principal Software Engineer at JPMorgan Chase within the International Consumer Bank, you are the heart of this venture, focused on getting smart ideas into … huge difference – on us as a company, and on our clients and business partners around the world.Job responsibilitiesLead, manage & mentor a team of data engineers to design, develop, and implement data platforms, pipelines, and infrastructure for our multi-cloud product across GCP and AWS.Architecture and design … as experience with big data processing tools like Apache Spark, Hadoop, and DataflowExperience in designing & operating Operational Datastore/Data Lake/Data Warehouse platforms at scale with high-availabilityData integration: Familiarity with data integration tools and techniques, including ETL (Extract more »

Apollo Solutionshttps://www.apollo-solutions.comAzure Data Platform EngineerJoin our remote-first team of cloud experts who build and support dynamic, powerful, cost optimised AWS and Azure cloud solutions that deliver the agility, performance and scale needed by our customers to succeed. Demand for our services is booming … are our business, the key to our success and that of our customers. Join us. Be a part of something specialJob Title:Azure Data Platform EngineerEmployment Type:PermanentWhat We Need:Hands on design, develop, and implement data solutions using Azure services.Azure Kubernetes Service (AKS) knowledge.Build and … communication and interaction with external systems.Required Skills and Qualifications:Strong knowledge and experience with Azure services, including AKS, Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics.Proficiency in continuous integration and continuous deployment (CI/CD) methodologies and tools.Solid more »

I'm looking for a Data Engineer with skills in Databricks, Azure Data Factory and SQL Server, for a Fixed Term Contract role until August 2025. It's with an international organisation headquartered in London, and this role will require you to be in their offices … near Victoria station 3 days per week. You will be joining a small cross-functional data team, where you will focus on the development of their newly-created Azure Data Platform - this will involve designing and developing ETL pipelines using Azure Data Factory, and … Factory Strong experience with Azure Databricks Some knowledge of the Azure tech stack would be beneficial but not essential: Databricks, Azure Data Lake, Azure Data Factory, Azure Synapse Analytics Benefits: Salary up to £70,000 depending on experience Please Note: This is a permanent role more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »

An industry-leading organisation are looking for an experienced Senior Data Engineer who is well-versed in Databricks, PySpark and SQL to join their growing Data Engineering team. This role can be largely remote, with some travel to their Central London Head Office, likely around … times per month. This organisation have invested a lot into their data function in recent years, and they are now operating on Azure, with a desire to start utilising Artificial Intelligence and Machine Learning in the future, making this is an incredibly exciting time to join the team … SQL programming Experience designing, developing and maintaining data warehouses and data lakes Knowledge of Azure technologies including Data Lake, Data Factory, and Synapse Knowledge of Agile methodology Excellent communication and problem-solving skills Benefits Salary up to £70,000 depending on more »

BI Developer that has a strong background in Python and Power BI to join the Software Delivery team to strengthen the power of data within the business. The company is moving its data from legacy stores to a strategic data warehouse and data … coding standards, and tools, while also working collaboratively with the team by utilising communication and problem solving skills. Key responsibilities: Ability to build data pipelines that will allow optimal extraction, transformation, and incorporation of data from various data sources. Be able to utilise Power … BI to build dashboards and reports. Understand the Data Virtualisation layer and partner with the Business for continued deployment and Business enhancements. Improve solutions and be able to anticipate where the demand is for the business. Build analytics tools that utilise the data pipeline to provide more »

Senior) Engineering Manager – Data & ML GlobalAXA XL recognizes digital, data and information assets are critical for the business, both in terms of managing risk and enabling new business opportunities. Data Science and Applied AI assets should not only be high quality, but also drive … a sustained competitive advantage and delivering a superior experience to our internal, external customers and improving efficiency. Our Innovation, Data and Analytics function is focused on driving innovation by optimizing how we leverage digital, data and AI to drive strategy and differentiate ourselves from the competition.As … applications – from data engineering to ML operations (training, serving, monitoring), and microservice/web application engineering.Our tech stack: Azure Data Lake, Azure Databricks (Notebooks, APIs, Workflows), MLflow, dbt, Harness CI/CD, OpenShift, Docker, GitHub, JIRADISCOVER your opportunity What will your essential responsibilities include?· Set more »

extensive array of digitally enhanced products and services, tailored to satisfy the diverse needs of their customers who are looking for a lead data and analytics specialist to join their team. Responsibilities: Lead the upskilling, coaching, and mentoring of fellow data engineers. Establish and reinforce data engineering best practices and guidelines. Conceptualize, build, and sustain data pipelines for the efficient extraction, transformation, and loading of data from various sources into our data warehouse and data lakes. Uphold data integrity, quality, and consistency throughout the … entire process. Create and enhance ETL/ELT workflows capable of handling substantial data volumes. Collaborate with data analysts, data scientists, and other stakeholders to comprehend their data needs. Develop and implement appropriate data models to support efficient data more »

safe, and designed for the future.Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and … public-sector, Methods is now building a significant private sector client portfolio.Methods was acquired by the Alten Group in early 2022.As a Lead Data Engineer at Methods you will be expected to get involved with projects from conception to delivery - leading and supervising other engineers to meet requirements … JSON, Parquet, XML etc.Experience with or developed understanding of the application of ETL/ELT tools.Experience with NoSQL type environments, Data Lakes, Lake-Houses (Cassandra, MongoDB or Neptune).Experience with distributed storage, processing engines such as Apache Hadoop and Apache Spark.Experience with message brokering/stream processing more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »

A global boutique (re)insurance broker are looking for an experienced Azure Data Engineer to join their growing team, to act as the lead Engineer on the support and development of their brand-new next-generation data platform. This is a permanent role with hybrid working … incredibly digitally-driven and are fully operating on Azure, with no legacy systems. You'll be joining their small (but growing) Cloud and Data team as their sole Data Engineer, making this a role with huge growth potential. They're currently working with an external partner … flexible working hours. Requirements : Strong experience with Azure Data Services - Azure SQL database, Azure Data Factory, Azure Data Lake Storage, Azure Synapse, Azure HD Insight etc. Expertise in SQL programming, including designing and optimising complex queries and databases ETL process design using Azure more »