201 to 225 of 277 Data Lake Jobs in London

base that offers regular travel to Western Europe and North America. They are now looking to add an experienced individual to their ranks that can help shape their data engineering strategy and improve the technical offering they provide for their clients. As a Principal Data Engineer , you'll have the opportunity to design and implement a … modernise how data is used within the private capital markets industry. The tech stack is largely centred around the services within Microsoft Azure, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps. Minimum Requirements: An excellent educational background, preferably in a STEM-based discipline. Expert knowledge of Microsoft Azure, SQL, and … in a client-facing environment. Previous experience working within the private equity market. Additional Information: Company: Graduate Recruitment Bureau (Hiring for client) Salary Range: £85K-100K Courses Considered: Data Science, Economics, IT, Maths, and Stats Course Notes: STEM-based degree; experience outweighs academics Related Job Opportunities: One of the largest providers of consulting and technology services, offering a More ❯

look to our Business Consultants, to drive change, inspire trust with clients, and take responsibility for some of the world’s most ambitious transformation projects. As a Senior Data Technology Consultant within our successful Business Consulting practice, you, alongside a collaborative team of consulting colleagues, will take a central role in providing support to our clients with a … focus on driving their business outcomes using data and technology. You will also support the growth of the wider evolving business consulting function. A key focus of the role will be to deliver practical advice to clients relating to their enterprise data technologies and strategies whilst looking out for opportunities to support them further leveraging our … quality consulting services to clients, presenting technical concepts in simple, accessible language. • Leverage your deep understanding of legacy and cloud-based data technologies, including Data Lake, Data Warehouse, and Lakehouse concepts. • Bring broad technical knowledge of Azure data products, with subject matter expertise in areas like Azure Data Factory More ❯

Senior Data Project Manager page is loaded Senior Data Project Manager Apply locations London time type Full time posted on Posted Yesterday time left to apply End Date: July 31, 2025 (30+ days left to apply) job requisition id R Who are we? Howden is a collective - a group of talented and passionate people all around … work/life balance, career progression, sustainability, volunteering - you'll find like-minded people driving change at Howden. About the Role: We are seeking an experienced and strategic Data Project Manager to lead complex projects within our Group Data Function . You will manage high-priority initiatives across global business units, ensuring the successful delivery of … data-driven and technology projects . A strong background in data lakes, analytics, and cloud platforms is highly preferred. You will drive best practices, provide leadership, and influence stakeholders at all levels. Key Responsibilities: Strategic Project Leadership: Oversee the end-to-end execution of high-impact, multi-regional data technology projects. Stakeholder & Executive Engagement More ❯

Are you a curious and open-minded individual with an interest in state-of-the-art machine learning engineering and research? Thomson Reuters Labs is seeking a Data Engineer with a passion for solving challenging machine learning problems in a data-rich, complex and innovative environment. What does Thomson Reuters Labs do? We experiment, we build … hire worldleading specialists in SWE/Applied ML, as well as Research, to drive the company's leading internal AI model development, fueled by an unprecedented wealth of data and powered by cutting-edge technical infrastructure. You will have the opportunity to contribute to a data curation & filtering system combining the best of real-world scalable … Experience with data pipeline orchestration tools. Experience with cloud-based data platforms such as AWS, GCP, or Azure (e.g., S3, BigQuery, Azure Data Lake Storage). Comfortable working in fast-paced, agile environments, managing uncertainty and ambiguity. Preferred qualifications : Additional legal knowledge as evidenced by a degree or interest in the legal domain. More ❯

heights by spearheading the Digital Supply Chain (DSC) team. Collaborate with visionary leaders and diverse colleagues in a global environment, unlocking your full potential. If you thrive on data and digital transformation, this role is designed for you. KEY RESPONSIBILITIES: Be a part of the Digital Supply Chain (DSC) team, a new team of 40+ FTE that will … used cases for deploying digital transformation and AI in the Procurement vertical. Evaluate the feasibility of used cases from both domain (procurement) as well as Tech perspective (available data, data structure, solution integration, current project pipeline, digital & analytical capabilities, etc.). Connect with the Procurement as well as IT teams and prepare a viable business case … for all Procurement technology requests. Oversee the correct migration of existing Procurement systems and dashboards from Unilever's systems into the Ice Cream Co's own data lake/systems. Manage the transition from the existing local-dominated tooling landscape into a centralized landscape, in line with the "Global First, Local by Exception" digital agenda. Through an More ❯

Are you a talented Solutions Architect looking to make your mark in the banking sector? Our client is seeking an enthusiastic and skilled individual to join a critical data remediation programme within the Markets Platform Surveillance Team. This is a fantastic opportunity to contribute to a dynamic environment and enhance the organization's capabilities while navigating a highly … umbrella) What You'll Do: As a Solutions Architect, you will play a pivotal role in improving our CI/CD platform and ensuring the seamless integration of data into our surveillance systems. Your expertise will help shape the future of our data handling and surveillance efforts. Key responsibilities include: Data Integration : Pulling data into the surveillance system from various sources, including data lakes and data warehouses on Google Cloud Platform (GCP). Platform Enhancement : Improving the CI/CD platform using Terraform and ensuring efficient deployment processes. Pipeline Tracking : Utilizing tools like JIRA to track pipelines and manage workflows effectively. Containerization : Implementing containerization solutions to optimize application More ❯

proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet … diverse functional and non-functional requirements. Data Architecture Expertise: Proven experience in designing and delivering complex batch and streaming data pipelines, understanding orchestration, and database capabilities across multiple solutions. Problem-Solving Ability: A strategic and creative thinker who can tackle complex challenges and develop innovative, robust solutions. Collaboration & Communication Skills: Strong interpersonal skills that can influence … Architect certifications. Cyber & Data Security Understanding: An appreciation for the architectural implications of application design and implementation. Modern Data Capabilities: Knowledge of Data Lake, Data Warehouse, and Machine Learning architectures. QA Best Practices: A solid understanding of data quality concepts and practices. Why Join Us? This is your chance More ❯

proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet … diverse functional and non-functional requirements. Data Architecture Expertise: Proven experience in designing and delivering complex batch and streaming data pipelines, understanding orchestration, and database capabilities across multiple solutions. Problem-Solving Ability: A strategic and creative thinker who can tackle complex challenges and develop innovative, robust solutions. Collaboration & Communication Skills: Strong interpersonal skills that can influence … Architect certifications. Cyber & Data Security Understanding: An appreciation for the architectural implications of application design and implementation. Modern Data Capabilities: Knowledge of Data Lake, Data Warehouse, and Machine Learning architectures. QA Best Practices: A solid understanding of data quality concepts and practices. Why Join Us? This is your chance More ❯

proven track record of delivering technical solutions in Agile environments with expertise in JIRA and Confluence. Proven Solution Architect Experience: Deep technical expertise in various solution architectures, especially data platforms and complex data pipelines on public cloud platforms, with a focus on GCP. Robust Application Design Skills: Experience in designing scalable, low-latency solutions that meet … diverse functional and non-functional requirements. Data Architecture Expertise: Proven experience in designing and delivering complex batch and streaming data pipelines, understanding orchestration, and database capabilities across multiple solutions. Problem-Solving Ability: A strategic and creative thinker who can tackle complex challenges and develop innovative, robust solutions. Collaboration & Communication Skills: Strong interpersonal skills that can influence … Architect certifications. Cyber & Data Security Understanding: An appreciation for the architectural implications of application design and implementation. Modern Data Capabilities: Knowledge of Data Lake, Data Warehouse, and Machine Learning architectures. QA Best Practices: A solid understanding of data quality concepts and practices. Why Join Us? This is your chance More ❯

the top 10 Investment Banks, leading Asset Managers, Hedge Funds and Law Firms. What you'll work on You will be a manager of a cross functional DDEP (Data, Design, Engineering & Product) team as well as a line manager of highly skilled, passionate, dedicated and ambitious software engineers. You will be accountable for workflow optimisation, fostering technical excellence … team, you will understand the company strategy and business goals, communicating this to both your reports and the cross-functional team you manage. You will use insights and data to make informed decisions that drive effectiveness and efficiency, including driving technical innovation (eg using genAI to maximize engineer effectiveness). Every day is different, but here's an … facilitation, technical knowledge and feedback on technical planning, design, system architecture and risk management. Contribute to product strategy, setting project goals. Develop relationships across product, engineering, design and data science, as well as key business stakeholders across 9fin. Cultivate a culture of continuous development of software engineers at 9fin, whilst maintaining work-life balance and a friendly, kind More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯

for musicians and artists to use to promote their music. At un:hurd music, we've created a music-tech platform that uses proprietary technology to turn music data into stronger promotional campaigns for artists. We've created both mobile and web applications which act as the 'digital marketing companion' for independent artists, facilitating data-led … responsible for the software development and technical infrastructure needed to design, train, deploy and scale machine learning models in production environments. You will harness a diverse array of data sources, from streaming services to social media, revolutionizing the way artists promote their music. Our Data Team members are full stack data professionals who independently … Management and Storage : Utilize PySpark for scalable processing of large datasets, implementing best practices for distributed computing. Optimize data storage and querying within a data lake environment to enhance accessibility and performance. ML R&D : Collaborate on model prototyping and development, identifying the most relevant and efficient solutions to the core problems that artists face. More ❯

s efforts with the objectives of the Master Systems Integration service. This might involve ensuring that projects contribute to the development and implementation of ontologies, technical submittal reviews, data migration processes, and program development. Compliance with Security Standards: The Project Manager is responsible for ensuring that data migration processes are conducted securely and in accordance with … Controls specialists and System Architects. Good understanding of networking principles. Knowledge of working in AWS, GCP and migration of data from building outputs to data lake an advantage. Must have excellent verbal and written communication skills. Strong interpersonal skills and an ability to deal with both internal and external customers. Training and mentoring for the … Budget Management: Capability to manage project budgets effectively and efficiently allocate resources. Technical Proficiency: Understanding of MSI Concepts: Familiarity with Master Systems Integration concepts and practices, including ontologies, data migration, and technical submittal review. Technical Background: A background in a technical field related to systems integration, information technology, or a relevant domain. Security and Compliance: ISO 27001 Knowledge More ❯

is hugely advantageous Qualifications Degree qualified in a science or IT based discipline Proven technical architecture experience covering common design patterns and platforms such as UIs, micro-services, data lakes, APIs, RDBMS, and NoSQL databases Strong familiarity of formal design and SDLC methodologies, in particular Agile/SAFe Significant experience of designing solutions in distributed highly resilient environments More ❯

is hugely advantageous Qualifications Degree qualified in a science or IT based discipline Proven technical architecture experience covering common design patterns and platforms such as UIs, micro-services, data lakes, APIs, RDBMS, and NoSQL databases Strong familiarity of formal design and SDLC methodologies, in particular Agile/SAFe Significant experience of designing solutions in distributed highly resilient environments More ❯

re using Typescript top to bottom , and Apollo GraphQL sits in the middle. We keep our data in DynamoDB , Postgres and snowflake for our data-lake using one or the other as best suits a particular workload. You can learn more about our tech stack at While we're looking for talented and driven individuals More ❯

Paragon Alpha are partnered closely with a multi-manager hedge fund, who have placed technology and data at the centre of their ethos, allowing technological innovation to … drive the firm forward. They're looking for a Rust/Python Engineer to join an data platform team, who're building a centralized data lake, housing disparate data-sets from research, trading and alternative sources. Stack: Rust, Python, AWS, Kubernetes, Kafka, SQL They need someone wit 8 years+ of experience in industry More ❯

Paragon Alpha are partnered closely with a multi-manager hedge fund, who have placed technology and data at the centre of their ethos, allowing technological innovation to … drive the firm forward. They're looking for a Rust/Python Engineer to join an data platform team, who're building a centralized data lake, housing disparate data-sets from research, trading and alternative sources. Stack: Rust, Python, AWS, Kubernetes, Kafka, SQL They need someone wit 8 years+ of experience in industry More ❯

Understand our existing data and architecture deeply (granular level). • Design Business Object, Canonical and Semantic Models at the enterprise and/or individual line of business and/or product level. • Be responsible for the development of the conceptual, logical, and physical data models, the implementation of RDBMS, operational data store (ODS), data marts, and data lakes on target platforms. • Oversee and govern the expansion of existing data architecture and the optimization of data query performance via best practices. The candidate must be able to work independently and collaboratively. • Define and govern data modeling and design standards, tools, best practices, and related development … for enterprise data models. • Be able to make presentations to senior management. • Contribute to the development of the Data Modeling team's tools, skills, culture, and impact. Skills • 10+ years of extensive work experience in various data modeling techniques (relational, data warehouse, semi-structured, etc.), application development, advanced data querying More ❯

Hybrid - in office 1/2 days per week. About the Role We're looking for a great candidate to join our clients Platform team to help deliver data … engineering and technical pipeline solutions that support their growing product portfolio. This will include orchestration of complex pipelines that bridge software products, frameworks and our own data lake infrastructure. Responsibilities Working within the Platform Team to architect, build and maintain pipeline/data engineering solutions for geospatial and non-spatial datasets. Integrate and consume data from WFS/WMS services. Support the deployment and maintenance of Geoserver instances. Collaborate with analysts, developers, and stakeholders to define data requirements. Ensure data integrity, quality, and security across all sources. Liaise with other team members, including within the Platform team and wider Make/Sell teams in order to determine their requirements More ❯

Hybrid - in office 1/2 days per week. About the Role We're looking for a great candidate to join our clients Platform team to help deliver data … engineering and technical pipeline solutions that support their growing product portfolio. This will include orchestration of complex pipelines that bridge software products, frameworks and our own data lake infrastructure. Responsibilities Working within the Platform Team to architect, build and maintain pipeline/data engineering solutions for geospatial and non-spatial datasets. Integrate and consume data from WFS/WMS services. Support the deployment and maintenance of Geoserver instances. Collaborate with analysts, developers, and stakeholders to define data requirements. Ensure data integrity, quality, and security across all sources. Liaise with other team members, including within the Platform team and wider Make/Sell teams in order to determine their requirements More ❯

Principal Data Engineer – Consulting | £90K–£105K | London/Leeds/Bristol Our client, a global leader in digital transformation consulting, is hiring a Principal Data Engineer to lead the design and delivery of advanced cloud-native data solutions. Based in London, Leeds, or Bristol , this is an opportunity to work on greenfield projects that … solve complex data challenges across enterprise environments. Salary: £90,000 – £105,000 Location: London, Leeds, or Bristol Hybrid (2 days per week in office) ️ Must be eligible for SC (Security Check) clearance The Role As a Principal Data Engineer , you’ll propose and implement solutions using a range of AWS infrastructure. Working within a multidisciplinary consulting … team, you’ll collaborate directly with clients to shape strategy, drive delivery, and guide internal engineering standards. Your responsibilities: Build and maintain large-scale data lakes and ETL pipelines using AWS S3, Redshift, Glue, Lambda, DynamoDB, and Matillion Translate client requirements into scalable and secure data architectures Drive infrastructure-as-code and CI/CD deployment More ❯

Overview The Manual Data QA will be responsible for executing comprehensive manual tests to ensure the quality of data flows across various Chambers products and platforms, with a primary focus on the Databricks environment. This role plays a critical part in maintaining the integrity and reliability of our data services. Main Duties and Responsibilities … Testing Execution : Conduct detailed manual tests to validate data flows and processing within the Databricks platform. Ensure that data integrity, accuracy, and consistency are maintained across all stages of data handling. Strategy and Planning : Assist in developing and defining the QA testing strategy and test plans specifically tailored for continuous data verification … ensure seamless integration of new data solutions into existing systems. Skills and Experience Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data validation and testing. Proficiency in More ❯

Senior Data Platform Engineer Salary: £80,000 - 90,000 + Bonus and benefits Location: London - Hybrid We are currently seeking a Senior Data Platform Engineer to join a prestigious retailer that's evolving into a digital-first, data-led organisation. In this role, you'll be pivotal to shaping the data landscape … and will work alongside a talented, collaborative team to build, optimise, and secure scalable data infrastructure. Reporting to the Head of Data Platforms, you'll have the opportunity to contribute directly to data-driven decision-making, helping millions of customers and thousands of colleagues alike. The Opportunity As a Senior Data Platform … Professional Development : Tailored induction and training programs to develop your skills. Parental Support : Industry-leading parental, adoption, and neonatal policies. Skills and Experience Expertise in Azure Data Lake Storage, Azure Compute, and Azure Databricks. Strong understanding of DevOps practices, using tools like Azure DevOps, Jenkins, or GitHub Actions. Solid knowledge of security best practices on Azure, including More ❯