126 to 150 of 240 Data Lake Jobs in London

Data Architect Salary: £90,000 - £110,000 Location: Remote/Hybrid Data Idols are working with a fast-growing technology company who are disrupting the software engineering industry. They are looking for a Data Architect with strong experience in data engineering and … experience in delivering innovative solutions. The Opportunity In this role as a Data Architect, you will play a pivotal role in ensuring the efficiency of their data architecture while heading the migration from legacy systems to modern cloud solutions. You will design and build scalable database and data lake solutions, implement CICD pipelines and automate the deployment of data products into production environments. Skills and Experience Proficiency in AWS Great communication More ❯

Understand our existing data and architecture deeply (granular level). • Design Business Object, Canonical and Semantic Models at the enterprise and/or individual line of business and/or product level. • Be responsible for the development of the conceptual, logical, and physical data models, the … implementation of RDBMS, operational data store (ODS), data marts, and data lakes on target platforms. • Oversee and govern the expansion of existing data architecture and the optimization of data query performance via best practices. The candidate must be able to … work independently and collaboratively. • Define and govern data modeling and design standards, tools, best practices, and related development for enterprise data models. • Be able to make presentations to senior management. • Contribute to the development of the Data Modeling team's tools, skills, culture, and More ❯

be a self-starter who is passionate about discovering and solving complicated problems, learning complex systems, working with numbers, and organizing and communicating data and reports. You will be detail-oriented and organized, capable of handling multiple projects at once, and capable of dealing with ambiguity and rapidly … Information Technology, or a related field Proficiency in automation using Python Excellent oral and written communication skills Experience with SQL, ETL processes, or data transformation Preferred Qualifications Experience with scripting and automation tools Familiarity with Infrastructure as Code (IaC) tools such as AWS CDK Knowledge of AWS services … you will collaborate closely with business partners, architect, design, implement, and BI projects & Automations. Responsibilities: Design, development and ongoing operations of scalable, performant data warehouse (Redshift) tables, data pipelines, reports and dashboards. Development of moderately to highly complex data processing jobs using appropriate technologies More ❯

Data Lakehouse Project Manager - Hybrid - Inside IR35 Our client, a leading global Insurance broker, are currently seeking a Data Lakehouse Project Manager to join the team on a contract basis. This would be for a hybrid working role with the client site based in London Inside … IR35 basis. We are seeking an experienced and strategic Data Project Manager to lead complex projects within our Data Lakehouse Programme. You will manage high-priority initiatives across global business units, ensuring the successful delivery of data-driven and technology projects. A strong background … in data lakes, analytics, and cloud platforms is highly preferred. You will drive best practices, provide leadership, and influence stakeholders at all levels. Experience: Strong project management skills with experience in leading and delivering Data Lakehouse or Data Warehousing projects. Knowledge of project management More ❯

Data Lakehouse Project Manager - Hybrid - Inside IR35 Our client, a leading global Insurance broker, are currently seeking a Data Lakehouse Project Manager to join the team on a contract basis. This would be for a hybrid working role with the client site based in London Inside … IR35 basis. We are seeking an experienced and strategic Data Project Manager to lead complex projects within our Data Lakehouse Programme. You will manage high-priority initiatives across global business units, ensuring the successful delivery of data-driven and technology projects. A strong background … in data lakes, analytics, and cloud platforms is highly preferred. You will drive best practices, provide leadership, and influence stakeholders at all levels. Experience: Strong project management skills with experience in leading and delivering Data Lakehouse or Data Warehousing projects. Knowledge of project management More ❯

incredibly digitally driven - they truly are a modern broker built for today's world, with incredibly forward-thinking working practices. Working within the Data team, you will lead on the end-to-end delivery of insightful Power BI reporting solutions for various stakeholders on a global scale. This … and would be well-suited to someone who enjoys working in a fast-paced and dynamic environment. You'll also get involved in Data Engineering projects - they're currently operating on an Azure Data Platform, with plans to move to a multi-cloud platform using Google …/T-SQL and data modelling skills Experience working in an Azure environment - exposure to Data Factory, Data Lake etc. Some Data Engineering experience such as ETL Excellent communication and stakeholder management skills Benefits: Salary up to around £65,000 depending More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used … by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a … hedge fund or HFT shop, you’ll know what this role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to building the core platform used … by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end More ❯

A rapid growth gaming firm have created a new role for a Head of Data Engineering. The Head of Data Engineering will work in a Data Rich Testing environment, and be will be tasked with building their own team to help deploy cutting edge … Machine Learning techniques in a number of different areas of the company. Reporting into the Head of Data Science & working closely with the CTO and Software Engineering team … the Head of Data Engineering in the first 18 months will also be responsible for: Building the Companies Big Data Lake Pushing out various cutting edge Data Science Models Infrastructure Management around the huge Volumes of Data being collected This role More ❯

and open-minded individual with an interest in state-of-the-art machine learning engineering and research? Thomson Reuters Labs is seeking a Data Engineer with a passion for solving challenging machine learning problems in a data-rich, complex and innovative environment. What does Thomson Reuters …/Applied ML, as well as Research, to drive the company's leading internal AI model development, fueled by an unprecedented wealth of data and powered by cutting-edge technical infrastructure. You will have the opportunity to contribute to a data curation & filtering system combining the … pipeline orchestration tools. Experience with cloud-based data platforms such as AWS, GCP, or Azure (e.g., S3, BigQuery, Azure Data Lake Storage). Comfortable working in fast-paced, agile environments, managing uncertainty and ambiguity. Preferred qualifications : Additional legal knowledge as evidenced by a degree or More ❯

Senior Data Platform Engineer Salary: £80,000 - 90,000 + Bonus and benefits Location: London - Hybrid We are currently seeking a Senior Data Platform Engineer to join a prestigious retailer that's evolving into a digital-first, data-led organisation. In this role, you … ll be pivotal to shaping the data landscape and will work alongside a talented, collaborative team to build, optimise, and secure scalable data infrastructure. Reporting to the Head of Data Platforms, you'll have the opportunity to contribute directly to data-driven … training programs to develop your skills. Parental Support : Industry-leading parental, adoption, and neonatal policies. Skills and Experience Expertise in Azure Data Lake Storage, Azure Compute, and Azure Databricks. Strong understanding of DevOps practices, using tools like Azure DevOps, Jenkins, or GitHub Actions. Solid knowledge of security More ❯

are currently looking for a Senior BI Developer, to be based in London on a full-time basis, reporting into the Head of Data and Analytics. Responsibilities: Designing, developing and maintaining BI solutions (Dashboards, reports and data models-semantic, using tools such as PowerBI, SQL). … Support the Head of Data Analytics and Insight with identifying and documenting the end to end data architecture incl. systems and relevant processes across MRS GM. Identifying gaps/areas for improvement across the data eco-system and outline appropriate solutions. Be the figurehead … databases and writing SQL and Python or similar. Power BI (semantic data modelling and DAX skills). Experience in Data Lake technologies (DataBricks) and/or Dataiku. Experience with Data Science and AI tools and frameworks (e.g., TensorFlow, PyTorch, Scikit-learn). Knowledge More ❯

We are looking for a Chief Data Architect with a track record of leading teams of modellers/architects to help shape our enterprise-wide data strategy and and own data architecture (strategy, roadmap etc) for a FTSE 250 business going through a major … modernization programme. What You’ll Do Define and own the data strategy, setting the vision and roadmap for data architecture in alignment with our transformation goals. Lead and develop a high-performing team of data architects and engineers, fostering a culture of innovation. Deliver … enterprise-scale data solutions, designing and overseeing the implementation of cloud-first, scalable architectures. Engage with executive stakeholders to embed data-driven thinking across the organization. Establish best practices for data governance, management, security, and compliance. What You Need to Bring Proven leadership experience More ❯

We are looking for a Chief Data Architect with a track record of leading teams of modellers/architects to help shape our enterprise-wide data strategy and and own data architecture (strategy, roadmap etc) for a FTSE 250 business going through a major … modernization programme. What You’ll Do Define and own the data strategy, setting the vision and roadmap for data architecture in alignment with our transformation goals. Lead and develop a high-performing team of data architects and engineers, fostering a culture of innovation. Deliver … enterprise-scale data solutions, designing and overseeing the implementation of cloud-first, scalable architectures. Engage with executive stakeholders to embed data-driven thinking across the organization. Establish best practices for data governance, management, security, and compliance. What You Need to Bring Proven leadership experience More ❯

Octopus Energy, a leading force in the energy sector, is seeking a Data Engineer to join their Energy Markets team. This role sits at the intersection of energy trading, forecasting, and technological innovation, supporting the company's mission towards Net Zero transition. The position offers a unique opportunity … to work with complex data engineering challenges while contributing to sustainable energy solutions. As a Data Engineer, you'll be responsible for designing and maintaining critical data pipelines that support core trading, forecasting, risk, and PPA processes across all Octopus international regions. The role … automations and alerts for pipeline monitoring Set up and maintain processes for capturing, preparing and loading data into the data lake Design and build operational dashboards Work with international teams to ensure best practices and code standardization Take ownership of data platform improvements More ❯

in data engineering? Join our dynamic team at Chase UK, where your expertise will shape the future of our data lake and drive impactful business decisions. We offer unparalleled opportunities for career growth in a collaborative environment where you can thrive and contribute to meaningful … projects. As a Data Engineer III at JPMorgan Chase within the Chase UK team, you will design and implement scalable data solutions, focusing on the ingestion and transformation stages. You will leverage modern technologies to tackle unique challenges and work on projects with broad impact. Your … role will involve collaborating with cross-functional teams to ensure data quality and availability, while fostering a culture of innovation and excellence. Job Responsibilities Design and implement complex, scalable solutions to process data and ensure timely availability for querying. Develop reusable frameworks, prioritizing quality and long More ❯

Information Office team here at RSA on a hybrid basis. Role Requirements As the DataOps Lead you will design, implement, and maintain automated data pipelines in the Azure cloud environment (Databricks, Data factory, Synapse, SQL). You will develop and manage CI/CD pipelines for … data workflows, ensuring seamless deployment and version control. You will design and develop Infrastructure as Code (IaC) using tools like Terraform, ARM templates to provision and manage Azure resources. You will monitor data pipeline performance and troubleshoot issues to ensure high availability and reliability. You will … managing Azure resources. You will have experience in Azure cloud services, including Data Factory, Databricks, Synapse Analytics, and Azure Data Lake Storage (ADLS). You will have proficiency in developing and managing CI/CD pipelines using tools like Azure DevOps, GitHub Actions, or Jenkins. More ❯

be working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the … The successful candidate will work across two main areas. Working alongside their tech partner and ultimately take over the build and maintanence of their Lake house. Build and manage new and existing pipelines as new products and functions become available on the platform Be comfortable or show an interest … IaC and Infra tooling using Terraform, Ansible and Jenkins whilst automating everything with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such More ❯

be working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the … The successful candidate will work across two main areas. Working alongside their tech partner and ultimately take over the build and maintanence of their Lake house. Build and manage new and existing pipelines as new products and functions become available on the platform Be comfortable or show an interest … IaC and Infra tooling using Terraform, Ansible and Jenkins whilst automating everything with Python Tech (experience in any listed is advantageous) Python Cloud: AWS Lake house: Apache Spark or AWS Glue Cloud Native storage: Iceberg, RDS, RedShift, Kafka IaC: Terraform, Ansible CI/CD: Jenkins, Gitlab Other platforms such More ❯

Job Details: Head of Enterprise Data Architecture Employment Type: Permanent Location: London About Brit: At Brit, we believe that the uncertainty of the future should never stand in the way of progress. That's why we exist. To help people and businesses face the future and thrive. We … risks they face, but to stay on the front foot and keep moving forward. What you'll be doing: As Head of Enterprise Data … Architecture you'll be responsible for how Brit ingests, manages, and moves data across the organisation through the operational, data lake & analytics landscape. You'll also be responsible for defining and evolving the overall data architecture, working closely with business, technology & data More ❯

Snr Data Engineer - Global Accounts, Professional Services, AWSI-SDT-APJ-Japan Our AWS Professional Services consultants deliver IT infrastructure and application architecture guidance, lead proof-of-concept projects, perform enterprise portfolio assessments, review operational best practices and conduct skills transfer workshops. AWS consultants collaborate with customers and partners … to address security and compliance, performance and scale, availability and manageability. They advise customers on data platforms using the full range of AWS services. They also assist with the non-technical change management work on policies, processes and people changes. At AWS, we're looking for technical architects … experience, and ability to learn fast in a fast-paced environment. They will focus on customer solutions that enable customers to be a data-first organization. Key job responsibilities Expertise: Collaborate with AWS field sales, pre-sales, training and support teams to help partners and customers learn and More ❯

Job Summary We are seeking a highly skilled Principal Solution Architect with deep expertise in IT Architecture, AWS Cloud Technologies, and data platform implementation. The ideal candidate will have strong networking knowledge and hands-on experience designing and developing scalable data platforms. This role requires leadership … skills, cross-functional collaboration, and the ability to drive the development of a new global data platform. Key Responsibilities Architectural Design in cloud based environments: Develop and implement robust IT architecture strategies for cloud and hybrid environments, leveraging AWS best practices. Design scalable, secure, and high-availability solutions … tailored to business needs. Architect and optimize data platforms to enable efficient data collection, storage, and processing. Implement and manage cloud-native services, including compute, storage, databases (SQL & NoSQL), and serverless architectures. Ensure cost-efficient and optimized cloud usage. Networking Focus: Design and implement secure networking More ❯

Solution Architect Job Summary We are seeking a highly skilled Principal Solution Architect with deep expertise in IT Architecture, AWS Cloud Technologies, and data platform implementation. The ideal candidate will have strong networking knowledge and hands-on experience designing and developing scalable data platforms. This role … requires leadership skills, cross-functional collaboration, and the ability to drive the development of a new global data platform. Key Responsibilities Architectural Design in cloud based environments: Develop and implement robust IT architecture strategies for cloud and hybrid environments, leveraging AWS best practices. Design scalable, secure, and high … availability solutions tailored to business needs. Architect and optimize data platforms to enable efficient data collection, storage, and processing. Implement and manage cloud-native services, including compute, storage, databases (SQL & NoSQL), and serverless architectures. Ensure cost-efficient and optimized cloud usage. Networking Focus: Design and implement More ❯

Job Summary We are seeking a highly skilled Principal Solution Architect with deep expertise in IT Architecture, AWS Cloud Technologies, and data platform implementation. The ideal candidate will have strong networking knowledge and hands-on experience designing and developing scalable data platforms. This role requires leadership … skills, cross-functional collaboration, and the ability to drive the development of a new global data platform. Key Responsibilities Architectural Design in cloud based environments: Develop and implement robust IT architecture strategies for cloud and hybrid environments, leveraging AWS best practices. Design scalable, secure, and high-availability solutions … tailored to business needs. Architect and optimize data platforms to enable efficient data collection, storage, and processing. Implement and manage cloud-native services, including compute, storage, databases (SQL & NoSQL), and serverless architectures. Ensure cost-efficient and optimized cloud usage. Networking Focus: Design and implement secure networking More ❯

Data Tester Opportunity at Ten10 - Join a Leading Tech Consultancy! Permanent Hybrid - 2 days/week in-office London Start date - May 2025 Ten10, one of the UK's top Quality Engineering consultancies, is expanding! We are looking for two experienced Data Warehouse Quality Engineers to … support multiple analytics projects for a prestigious client. About You: Expertise in testing Oracle, Snowflake, and Postgres databases and data warehouses Experience delivering fully reconciled Facts and Dimensions with accurate end-user reports Proficiency with reporting tools such as Oracle OAS and Microsoft Power BI Deep understanding of … business rules Proficiency with querying tools such as SQL Developer and PostgreSQL/DBeaver Skilled in using Snowflake and Snowsight for data lake testing Experience with ETL tools (e.g., ODI) and data replication tools (Oracle GoldenGate, AWS DMS) Python scripting and experience with CI/ More ❯