1 to 25 of 148 Data Lake Jobs in London

About Us: ATREIDES is a leader in advanced geospatial technologies, big data solutions, and data analytics. We specialize in providing cutting-edge software platforms that enable our clients to process, analyze, and visualize large-scale geospatial and sensor data for critical decision-making. Our mission is to deliver innovative, scalable, and high-performance platforms … that help organizations unlock the full potential of their data for various industries, including defense, national security, environmental monitoring, and urban planning. We are seeking a highly skilled Senior Data Engineer with a strong focus on big data, data analytics, and geospatial data intelligence to join our engineering team. In … this role, you will help design and develop robust, scalable platforms that handle vast amounts of geospatial data and provide actionable insights through data analytics. Job Overview: As a Senior Data Engineer at ATREIDES, you will be responsible for developing and optimizing our core software platform, with an emphasis on integrating and processing big More ❯

Join to apply for the Data Architect - Defence role at Kainos 5 days ago Be among the first 25 applicants Join to apply for the Data Architect - Defence role at Kainos Join Kainos and Shape the Future At Kainos, were problem solvers, innovators, and collaborators - driven by a shared mission to create real impact. Whether were … youll be part of a diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data flows, data … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos, we believe in the power of More ❯

that solves real-world problems for large blue-chip companies and governments worldwide. We're pioneers of meaningful AI : our solutions go far beyond chatbots. We are using data and AI to solve the world's biggest issues in telecommunications, sustainable water management, energy, healthcare, climate change, smart cities, and other areas that have a real impact on … re underpinned by over 300 engineers and scientists working across Africa, Europe, the UK and the US. ABOUT THE ROLE Sand Technologies focuses on cutting-edge cloud-based data projects, leveraging tools such as Databricks, DBT, Docker, Python, SQL, and PySpark to name a few. We work across a variety of data architectures such as Data Mesh, lakehouse, data vault and data warehouses. Our data engineers create pipelines that support our data scientists and power our front-end applications. This means we do data-intensive work for both OLTP and OLAP use cases. Our environments are primarily cloud-native spanning AWS, Azure and GCP More ❯

condition, or are neurodiverse. If you'd like to apply and need adjustments made, you can let us know in your application. About the role As an Azure Data Engineer, your role involves designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. Your responsibilities will include, but not limited to: Data … grow! Data Management and Storage: You'll work with various data storage options provided by Microsoft Azure, including Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage. Your task is to design data storage systems that scale, perform efficiently, and meet the organisation's requirements. Essential Skills Proficiency in … SQL, SQL Server Understand parallel processing and data architecture patterns Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Storage Ability to design and implement pipelines in ADF. Build complex efficient processes for transformation using SQL & ADF Pipelines Ensure secure, organised, and reliable data pipelines Troubleshoot all data More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data … Infrastructure Automation Cloud Expertise: Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings. Data Lake/Zone/Governance Experience: Demonstrable experience designing, building, and managing data lakes and data zones. Familiarity with data governance tools and frameworks. More ❯

Join our rapidly expanding team as a hands-on Cloud Data Analytics Platform Engineer and play a pivotal role in shaping the future of data at Citi. We're building a cutting-edge, multi-cloud data analytics platform that empowers our users with secure, scalable, and efficient data insights. This role sits … like S3/GCS, Glue, BigQuery, Pub/Sub, SQS/SNS, MWAA/Composer, and more to create a seamless data experience. (Required) Data Lake , Data Zone, Data Governance: Design, build, and manage data lakes and data zones within our cloud environment, ensuring data … Infrastructure Automation Cloud Expertise: Proven hands-on experience with AWS and/or GCP, including a deep understanding of their data analytics service offerings. Data Lake/Zone/Governance Experience: Demonstrable experience designing, building, and managing data lakes and data zones. Familiarity with data governance tools and frameworks. More ❯

Senior Data Engineer - (Azure/Databricks) page is loaded Senior Data Engineer - (Azure/Databricks) Apply locations London - Scalpel time type Full time posted on Posted 7 Days Ago job requisition id REQ05851 This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our … data solutions are secure, efficient, and optimized. Key Responsibilities: Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage. Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. - Automate loads using Databricks workflows and Jobs Develop, test and … warehousing, and real-time streaming. Knowledge of developing and processing full and incremental loads. Experience of automated loads using Databricks workflows and Jobs Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow. Strong experience with Azure Data Factory (ADF) for data integration and orchestration. Hands-on experience with Azure DevOps, including pipelines, repos More ❯

Join to apply for the Data Architect (Trading) role at Keyrock Join to apply for the Data Architect (Trading) role at Keyrock About Keyrock Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation. Data Architect About Keyrock Since … s progress with our research and governance initiatives. At Keyrock, we're not just envisioning the future of digital assets. We're actively building it. Position Overview The Data Architect is responsible for designing, implementing, and maintaining an organization's data architecture and strategy, ensuring that data is collected, stored, and processed efficiently and … securely to support business intelligence, data analytics, and machine learning operations (MLOps) practices. Key Responsibilities Designing Data Architecture: Plan and implement a robust, scalable data architecture that integrates data from various sources and supports diverse analytical needs, while optimizing costs and meeting business requirements. Implementing Data Engineering Pipelines: Design and More ❯

ll be part of a diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you'll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data flows, data sourcing and data governance. Data Architects work closely with clients to understand their data requirements and take responsibility for ensuring solutions are fit for purpose. They also provide technical leadership for the rest of the team in the area of data. Data Architects may also work at the solution or … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building More ❯

is a strong culture where people are encouraged to be present, bold and curious, allowing them to achieve their individual goals. We are currently looking for a Lead Data Architect, to be based in London on a full-time basis, reporting into the Data & Transformation Strategy Lead. Responsibilities: Collaborate with business stakeholders, data scientists … analysts, and IT teams end to end to understand business needs and translate them into effective data architecture solutions. Design and implement scalable and efficient data architectures that support business goals, including data warehousing, data lakes, and real-time data processing. Lead the evaluation, selection, and integration of new data technologies and tools to optimise data management processes. Support the development of data products, through robust architecture, data governance policies, ensuring data quality, integrity, security, and compliance with relevant regulations (GDPR). Lead a team to develop and maintain data models, schemas, and data dictionaries to More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full … development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with … movements, including assisting with solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports and dashboards; in-line with the company data management framework and enterprise data More ❯

Data Engineer Lead - NatGas and Power page is loaded Data Engineer Lead - NatGas and Power Apply locations London posted on Posted 12 Days Ago job requisition id JR102268 Job Title: Data Engineer Lead - NatGas and Power Contract Type: Time Type: Job Description: Reporting to the Head of Data, the Data … ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI , Plot.ly, matplotlib) Programming OOP DevOps Application development lifecycle Web technologies HTTP … with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Excellent communication and stakeholder management skills. Ability to mentor junior More ❯

are a brand embarking on a very exciting plan and we are seeking new members of the team who want to contribute to this. THE ROLE As a Data Architect (contract) for Project Nova, you will be instrumental in shaping AllSaints' journey to become a truly data-driven, AI-powered organisation. You will lead the design … and implementation of our enterprise data architecture. This role is central to the Data & Integration workstream of Project Nova, building on our existing data warehouse and BI capabilities to accelerate our data transformation and enable the use of greater AI-driven insight and actions. You will ensure our data assets … ensure a cohesive and integrated technology ecosystem. You will be part of a dynamic team driving the core technology transformation for AllSaints. WHAT WILL I BE DOING? 1. Data Strategy & Architecture Design: Define and evolve AllSaints' enterprise data architecture to support Project Nova's strategic objectives Design and develop conceptual, logical, and physical data More ❯

As a Data Engineer/Scientist at Actica, you will have the opportunity to design, build, and maintain data pipelines while developing advanced analytics solutions to unlock business problems for high-profile UK public sector organisations. Your expertise will enable organisations to maximise the value of their data assets through robust data … a key role in nationally critical projects that make a real difference to people's everyday lives. Locations: London, Guildford, Bristol, M4 corridor Hybrid working Actica recognises that data engineering, analytics, and data science are distinct but interconnected disciplines. Our data engineers focus on building and maintaining the data infrastructure that enables … analytics and data science work, while our data scientists and analysts focus on deriving insights and developing models. At Actica, we're at the forefront of the UK government's AI transformation agenda, seeking skilled data specialists to architect and implement advanced analytics solutions for critical public sector and defence organisations. As part of More ❯

thefoundation for delivering our full suite of capabilities. Job Description Employment Type: Full-Time Location: UK Job Overview We are looking for a skilled Database Designer/Senior Data Engineer to join our data engineering team. This role involves the development and maintenance of data solutions in the cloud environment. The ideal candidate will … have a strong background in data processing and a solid understanding of cloud data services. Requirements Key Responsibilities Design and implement modern data platforms in cloud such as AWS or Azure. Develop data pipelines and data streaming processes. Ensure data solutions are scalable, reliable, and efficient. Collaborate with … services. Proficiency in SQL, Python, or Scala. Experience with AWS RDS, AWS Glue, AWS Kinesis, AWS S3, Redis and/or Azure SQL Database, Azure Data Lake Storage , Azure Data Factory. Knowledge of data modelling , ETL processes, and data warehousing principles. Preferred Skills Strong problem-solving and analytical skills . More ❯

Azure Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data … Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data … commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) Azure Synapse Analytics Azure Data Lake Storage (Gen2) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing projects More ❯

Role: Contract Business Analyst Domain: Shipping, maritime & energy Project: Data warehouse & data lake implementation Location: London (Hybrid) Rate: £700/d (Inside IR35) Contract: 6 months (multi-year scope) X4 Technology are partnered with a global energy leader on an exciting contract opportunity for a detail-orientated contract Business Analyst. You'll support the development … to optimise vessel operations across LNG and Products fleets. You'll play a key role designing, building and implementing large-scale data warehouse and data lake platforms , shaping how vessel performance data is captured, modelled and visualised within the dashboard. Requirements for the Business Analyst - Data Platforms in Shipping & Energy Proven … BA experience on large-scale Data Warehouse or Data Lake platform implementations, particularly in SAP or Azure Strong analytical skills with the ability to interpret complex datasets Excellent stakeholder management and communication skills Familiarity with data visualisation tools (eg Power BI , Tableau ) Nice to have: Experience in maritime, logistics, or energy sectors; exposure More ❯

Role: Contract Business Analyst Domain: Shipping, maritime & energy Project: Data warehouse & data lake implementation Location: London (Hybrid) Rate: £700/d (Inside IR35) Contract: 6 months (multi-year scope) X4 Technology are partnered with a global energy leader on an exciting contract opportunity for a detail-orientated contract Business Analyst. You'll support the development … to optimise vessel operations across LNG and Products fleets. You'll play a key role designing, building and implementing large-scale data warehouse and data lake platforms , shaping how vessel performance data is captured, modelled and visualised within the dashboard. Requirements for the Business Analyst - Data Platforms in Shipping & Energy Proven … BA experience on large-scale Data Warehouse or Data Lake platform implementations, particularly in SAP or Azure Strong analytical skills with the ability to interpret complex datasets Excellent stakeholder management and communication skills Familiarity with data visualisation tools (eg Power BI , Tableau ) Nice to have: Experience in maritime, logistics, or energy sectors; exposure More ❯

An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be … a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯

An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be … a lot of stakeholder engagement, so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial and Finance, to help with their data presentation requirements and help More ❯

with GenAI consulting specialist? Do you have real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake, Data Engineering and GenAI experience? Do you have senior stakeholder engagement experience to support pre-sales and deliver consulting engagements? Do you like to solve the most … complex and high scale (billions+ records) data challenges in the world today? Do you like leading teams through high impact projects that use the latest data analytics technologies? Would you like a career path that enables you to progress with the rapid adoption of cloud computing? AWS Professional Services Public Sector ANZ are hiring a highly … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker, Amazon Quicksight and Amazon Bedrock. Solutions: Support pre-sales and deliver technical engagements with partners and customers. This includes participating in pre-sales visits More ❯

achieving their strategic goals and empower our people to make an impact and develop their own unique career path. About the team and your role Our Digital and Data Advisory practice, as part of our broader Business Transformation client offering, consists of three teams: Digital Finance team working with clients to understand how their finance functions work, assisting … throughout their digital transformation journey from defining a digital strategy and roadmap, creating a business case, selecting the right software, documenting user stories, to managing and assuring projects. Data analytics and insights team working with clients to help them understand their level of data analytics maturity and to develop a data analytics strategy that … Analysis Services (SSAS), SQL Server Data Tools (SSDT), SQL Server Reporting Services (SSRS), Azure Data Resources, Azure Data Factory, Azure Data Lake, Azure Data Bricks and Azure Analysis Services. Able to support clients and prospects in their evaluation of Business Intelligence solutions providing information and demonstrations to help them More ❯

Overview We're seeking a Senior Data Scientist to lead the development of advanced analytics and AI/ML solutions that unlock real value across our business. This is a contract role for 6 months . In this contract role, you'll work with proprietary and B2B research datasets to design, deliver, and scale data-driven … Research, and Technology, you'll help turn strategic ideas into working MVPs-ensuring high standards of methodology, quality, and business relevance throughout. You'll also help shape the data science environment by working alongside our tech teams to support a robust and flexible infrastructure, including sandbox environments for onboarding and evaluating new data sources. This is … analytics "products" could be refined and productionized in the future. Work with Tech colleagues to improve the Data Science workspace, including providing requirements for Data Lake, Data Pipeline, and Data Engineering teams. Expand on the tools and techniques already developed. Help us understand our customers (both internal and external) better so More ❯

Data Engineer (Python SQL ETL) London/WFH to £80k Are you a tech savvy Data Engineer with experience of working with sensitive patient/healthcare data? You could be progressing your career as a Data Engineer working on Tech for Good application for the healthcare sector that utilises AI and Machine … Learning techniques to help prevent patients from experiencing health crisis. As a Data Engineer you will take ownership of the healthcare data pipelines and platforms, focussing on implementing robust ETL processes and scalable data architectures, collaborating with various teams to deliver high quality data solutions. You'll develop and maintain data … managing data in Azure using tools such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics You have a good knowledge of Data Lake and Data Warehouse architectures You have experience implementing monitoring and logging for data pipelines You are collaborative, enjoy problem solving and are proactive in getting More ❯

maintain interactive Power BI dashboards and reports Extract, transform, and load (ETL) data from Salesforce , Simpro , Unleashed and other systems into the Microsoft Fabric Data Lake (OneLake) Build and manage data pipelines into Fabric using tools like Dataflows , Data Factory , or Synapse Pipelines Ensure seamless integration between Fabric Data Lake and Power BI semantic models Develop and optimize data models for performance, scalability, and usability Collaborate with business users to gather requirements and deliver self-service reporting solutions Maintain data quality, governance, and consistency across the reporting stack Support and maintain existing Power BI solutions, while also implementing new ones based on … including OneLake, Lakehouse , and data pipeline tools Hands-on experience extracting data from systems like Salesforce , Simpro , and ERP platforms into a data lake environment Strong DAX, Power Query (M), and SQL skills Familiarity with data modeling, ETL frameworks , and structured/unstructured data handling Knowledge of Power BI More ❯