151 to 175 of 625 Data Lake Jobs in London

Germany. The Telefónica Tech UK&I hub has an end-to-end portfolio of market leading services and develops integrated technology solutions to accelerate digital transformation through: Cloud, Data & AI (Adatis), Enterprise Applications (Incremental), Workplace Services and Cyber Security & Networking. Values: Open, Trusted and Bold HPE: Platinum Partner – FY23 UK&I Solution Provider of the Year Palo Alto … responding to questions from customers. Engage in cross-functional activities and collaborate across organizational boundaries. What experience/skills do I need? Industry experience in designing data lake, data warehouse and analytics solutions on Microsoft Azure with a good grounding in all associated areas Ability and aptitude towards investigating and sharing new technologies Strong spoken … we'll help you get those! Core: SQL Server (T-SQL and DBA) Azure Databricks Azure Data Factory Microsoft Fabric Power BI, DAX Azure Data Lake Supporting: Azure ML Azure AI Services Azure Infrastructure Python, PySpark Microsoft Purview Principles: Relational and Dimensional Modelling Data Warehouse Theory Data platform Architecture models such More ❯

their Central London office. This role dose come with a hybrid working. We are seeking a Dashboard Developer to play a pivotal role in how we display complex data in an intuitive, easy to view and use dashboards. Key responsibilities will include translating user requirements into dynamic and user-friendly dashboard solutions. You'll work collaboratively with cross … data that facilitate actionable insights. Furthermore, you will play a pivotal role in envisioning how these upgraded dashboards can leverage the capabilities of the Data Lake, maximizing data accessibility and relevance. Experienced desired: • Experience of working with SQL, data and databases to explore data. • Proven experience in designing and developing interactive … dashboards and reports using PowerBI, Tableau, QlikView or another similar platform. • Familiarity with data warehousing concepts and cloud platforms (e.g., Azure, AWS). • Proficient in SQL for data manipulation and extraction. • Experience of working with big data storage solutions, such as Data Warehouses and/or Data Lakes. • Experience of More ❯

achieve their individual goals. We are currently looking for a Senior BI Developer, to be based in London on a full-time basis, reporting into the Head of Data and Analytics. Responsibilities: Designing, developing and maintaining BI solutions (Dashboards, reports and data models-semantic, using tools such as PowerBI, SQL). Support the Head of Data Analytics and Insight with identifying and documenting the end to end data architecture incl. systems and relevant processes across MRS GM. Identifying gaps/areas for improvement across the data eco-system and outline appropriate solutions. Be the figurehead for data support throughout MRS GM ensuring that the team as well as … with experience working with relational databases and writing SQL and Python or similar. Power BI (semantic data modelling and DAX skills). Experience in Data Lake technologies (DataBricks) and/or Dataiku. Experience with Data Science and AI tools and frameworks (e.g., TensorFlow, PyTorch, Scikit-learn). Knowledge of machine learning algorithms, statistical More ❯

Build the future of the AI Data Cloud. Join the Snowflake team. We are looking for data experts who have a strong background in building data platforms and love to use their skills to supercharge data teams. Our team helps customers on their data journey with Snowflake, which is very … fast becoming the central data platform for companies big and small. That means you will work on some of the most challenging data projects you can find, in a post-sales capacity. We are hiring a range of seniority levels, though we do not currently hire people without relevant experience. During the interview process, we will … career levels. What we are offering: We help each other to stay on top of the game and up-to-date with the latest features in the Snowflake Data Cloud. Snowflake had the biggest software IPO of all times and we continue to grow at a rapid pace, which means there is ample opportunity to change the future More ❯

processes within a related technical discipline (e.g. data ingestion, data storage, data serving, APIs, etc.). Hands-on experience in data lake or data warehouse and related technologies (e.g. Spark, ETL, Databricks). Hands-on practical experience delivering system design, application development, testing, and operational stability Ability to tackle More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: The job you're considering The Cloud Data Platforms team is part of the Insights and Data Global Practice and has seen strong growth and continued success across a variety of projects and sectors. Cloud Data Platforms is the home of the Data Engineers, Platform Engineers, Solutions Architects and Business Analysts who are focused on driving our customers digital and data transformation journey using the modern cloud platforms. We specialise on using the latest frameworks, reference architectures and technologies using AWS, Azure and GCP. Hybrid working: The places that you … Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and AWS tools. Adopt DevOps Practices: Utilize DevOps methodologies and tools for continuous integration and deployment (CI/CD), infrastructure as code (IaC), and automation More ❯

Role Overview We have an exciting opportunity for a Data Architect to join our growing Data & AI team. The successful applicant will work alongside our architects and consultants to deliver high-quality data solutions to help our customers become more successful in becoming a data-guided organisation. The Data Architect … Designing cloud-based data platforms and data solutions using a wide range of Azure Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse, Azure Cosmos DB, Azure Data Factory and Azure Blob storage. Building conceptual, logical and physical data models optimised for analytical use cases. … Security and Compliance. Strong experience in Data Warehouse methodologies. Experience working across Azure Data Services including Azure Databricks, Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Data Factory, Azure Blob storage and Power BI. Strong experience in SQL. Good understanding of Azure infrastructure (Subscriptions/Resource Groups, Virtual More ❯

pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range Direct message the job poster from Xcede Associate Director – Data & AI Recruitment Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to … and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

London – Senior Data Engineer, Consultant Ekimetrics UK Job Description About Ekimetrics Ekimetrics is a leader in data science and AI-powered solutions. Since 2006, we’ve pioneered the use of AI and data science applied to unified marketing performance, measurement and holistic business optimization aligned with sustainability goals. Our goal: Combine high-impact AI … role will be part of a global Data Engineering & Architecture team which helps keep data science projects operational across business lines (e.g., data lake implementation, data strategies, data transformation, advance machine learning), actively contributes to the transformation of our clients’ infrastructure and organisation, and democratises data-driven … Proactively support the Managers in building high-end client materials and commercial proposals Be the subject matter expert, advising and building solutions, in the contexts of PoC, Datalab or Datalake Have an innovative mindset to implement complex algorithms in a Big Data environment Engineering lead and mentoring; contribute to the development of Data Engineers through knowledge More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced AWS Databricks Data Architect to join their team. They are a leader within the consulting space and are experiencing growth, backed by a large multi-equity firm aiming to strengthen their financial position. The company anticipates year-on-year growth, enabling them … recent implementations of Gen AI. Your role will include: Designing and implementing effective architectural solutions around AWS serverless technologies (S3, Lambda, Athena, Kafka) and Databricks, including Data Lake and Data Warehousing. Assessing database implementation procedures to ensure GDPR and data compliance. Guiding and influencing technology teams and stakeholders on solution options, benefits, and … EKS, Terraform. Strong knowledge of data modeling and Kinesis. Understanding of SQL and database management. Hands-on experience with Data Warehouse and Data Lake technologies, preferably on AWS. Benefits include: Hybrid work (2 days in London) 28 days holiday plus bank holidays Private medical health insurance Pension scheme And more... This is an More ❯

My client is based in the London area are currently looking to recruit for an experienced AWS Databricks Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data Architect to join their team. They … the market. Your role will include: Responsible for designing and implementing effective Architectural solutions around the AWS Severless Technologies (S3, Lambda, Athena, Kafka) and Databricks including Data Lake and Data Warehousing. Assess database implementation procedures to ensure they comply with GDPR and data compliance. Guide, influence and challenge the technology teams and stakeholders … Terraform, Excellent understanding of Data Modelling & Kinesis An understanding of SQL/database management. Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around AWS. My client is providing access to; Hybrid 2 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical Health Pension Scheme And More... This role More ❯

Social network you want to login/join with: Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change. Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization. Become part of a fast-growing international and diverse … business challenges in a range of domains. Collect functional and non-functional requirements, consider technical environments, business constraints, and enterprise organizations. Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs … web services, training and scoring machine learning models. Collaborate closely with partners, strategy consultants, and data scientists in a flat and agile organization where personal initiative is highly valued. Share data engineering knowledge by giving technical training. Guide and mentor team members. What you will bring 3-4 years of experience in data engineering. More ❯

Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet data requirements. Optimize data … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills. Experience More ❯

Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with data analysts and other stakeholders to meet data requirements. Optimize data … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage, Azure Data Factory. Knowledge of data modelling, ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills. Experience More ❯

Social network you want to login/join with: We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact central government programmes. This is a fully remote role , but active SC clearance is essential . Applicants without current SC clearance cannot … be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional experts to solve complex data challenges. You'll champion engineering best practices and bring thought leadership to technical planning, client engagement, and innovation. … stakeholders to translate requirements into solutions Promoting engineering standards and contributing to internal capability building You'll Need: Active SC Clearance Proven experience with Microsoft Azure (Data Lake, Synapse, Purview) Strong understanding of secure data handling, DevOps, and compliance Experience with structured and unstructured data sources (e.g., Azure SQL, MongoDB) Familiarity with Power More ❯

Senior Data Engineer - SC Cleared Remote (UK-based) £75,000 - 85,000 + Benefits Full-Time | Central Government Projects We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact central government programmes. This is a fully remote role , but … active SC clearance is essential . Applicants without current SC clearance cannot be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional experts to solve complex data challenges. You'll champion engineering best … stakeholders to translate requirements into solutions Promoting engineering standards and contributing to internal capability building You'll Need: Active SC Clearance Proven experience with Microsoft Azure (Data Lake, Synapse, Purview) Strong understanding of secure data handling, DevOps, and compliance Experience with structured and unstructured data sources (e.g., Azure SQL, MongoDB) Familiarity with Power More ❯

Title: Director, Data Cloud Architecture Location: London Reporting to: Sr. Director, Architecture WHO WE ARE Choreograph is WPP’s global data products and technology company. We’re on a mission to transform marketing by building the fastest, most connected data platform that bridges marketing strategy to scaled activation. We work with agencies and clients … to transform the value of data by bringing together technology, data and analytics capabilities. We deliver this through the Open Media Studio, an AI-enabled media and data platform for the next era of advertising. We’re endlessly curious. Our team of thinkers, builders, creators and problem solvers are over 1,000 strong, across … markets around the world. WHO WE ARE LOOKING FOR We are seeking a seasoned and visionary Director, Data & Cloud Architecture to lead the design, strategy, and implementation of our data and cloud infrastructure. In this leadership role, you will be responsible for architecting scalable, secure, and high-performing cloud and data ecosystems that align More ❯

Job Description An exciting opportunity has arisen for an experienced data engineering leader to drive innovation and build a best-in-class data infrastructure at a leading private markets firm. This role will lead a high-performing team in designing and scaling data platforms, with a strong emphasis on Azure Databricks , to enhance investment … decision-making and operational efficiency. The Role As Head of Data Engineering , you will be responsible for shaping and executing the firm’s data strategy, working closely with stakeholders across technology, investment, and transformation teams. Your expertise in data architecture, cloud platforms, and engineering best practices will be instrumental in building scalable, high-performance … engineering, data architecture, or analytics, ideally within investment management, financial services, or private markets. Strong expertise in Azure cloud services, Synapse, Databricks, Spark, and data lake architectures. Deep understanding of ETL/ELT processes, data modeling, and high-performance data warehousing. Experience managing large-scale data platforms and optimizing More ❯

Social network you want to login/join with: I'm currently working with a SaaS product organisation that is expanding its data engineering team with a key senior hire, working directly with the CDO. Responsibilities Data Ownership: Drive the design, development, and evolution of data models across multiple domains and clients. Serve as … an expert in the SaaS platform, ensuring consistency and best practices in all data-related aspects. Technical Leadership: Lead and mentor other data engineers, fostering technical excellence and effective use of data platforms. Establish and promote best practices for data engineering within the organisation. Client Engagement: Collaborate with client delivery teams to … Databricks, Spark Orchestration frameworks such as Dataform, Airflow, and GCP Workflows. Modern architecture and cloud platforms (GCP, AWS, Azure) DevOps practices Data warehouse and data lake design and implementation Familiarity with containerization and IaC tools (e.g., Docker, Kubernetes, Terraform). Experience working within an agile environment (Scrum, Kanban, etc). Previous experience in the retail More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced Azure Data Architect (Databricks Specialist) to join their team. They are a leader within the Insurance space and are going through a period of growth. Backed by a large multi-equity firm, they aim to strengthen their financial position. They anticipate year … to implement and utilize the most in-demand and cutting-edge technology available. Your role will include: Designing and implementing effective database solutions and models, including Data Lake and Data Warehousing. Assessing database implementation procedures to ensure GDPR and data compliance. Guiding, influencing, and challenging technology teams and stakeholders to understand the benefits … pros, and cons of various solution options. Setting the technical direction for the data platform landscape and solutions in collaboration with delivery and engineering teams. Designing conceptual and logical data models and flowcharts. My client is offering: Hybrid Working 28 Days Holiday plus Bank Holidays Private Medical Health Pension Scheme And more... Candidate requirements include experience More ❯

Time left to apply: End Date: June 28, 2025 (5 days left to apply) Job requisition id: R-061903 Job Title Data Engineer Location Asda House Employment Type Full time Contract Type Permanent Hours Per Week 37.5 Salary Competitive salary plus benefits. Category Data Science Closing Date 27 June 2025 This role requires on-site presence … at Asda House in Leeds for at least three days per week. We’re really looking forward to having you around! Are you passionate about turning data into powerful insights and scalable solutions? We’re looking for a Data Engineer to join our dynamic Data Team and help shape the future of data at Asda. In this hands-on role, you’ll be a key player within one of our Agile data squads, working side-by-side with Product Managers, Visualisation Engineers, Data Analysts, and Data Architects. Together, you’ll design and deliver high-quality, reliable data products that fuel strategic decisions and More ❯