18 of 18 Data Lake Jobs in the South West

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

Job Description - Data Architect () Data Architect - Job title: Data Architect Location: Filton/Frimley/Portsmouth Broad Oak/Scotstoun. We offer a range of hybrid and flexible working arrangements. Please speak to your recruiter about the options for this particular role Salary: Up to £72,000 depending on skills and experience What you … ll be doing: Design and implementation of the integration layer within the established Enterprise Integration & Data Warehouse (EIDW) platform Design and implementation of effective, robust data solutions Design and maintenance of conceptual, logical and physical data models Delivery and ownership of a Data Architecture strategy that underpins the Naval Ships strategy and … solutions Experience in Master Data Management and Data Governance Hands on experience working in Data Warehouse (normalised/dimensional) or Data Lake programs/projects primarily as a Data Architect or Data Modeller Strong knowledge in conventional data modelling techniques (conceptual/physical/logical More ❯

Are you a Data Engineer who would like to work with Microsoft Fabric supporting a companys digital transformation by … building robust and scalable data infrastructure? Our client will move from legacy to Microsoft Fabric with OneLake, Azure Data Factory and Azure Data Lake and you can be a key part of this move. THE OPPORTUNITY In this role of Data Engineer, youll ensure data is efficiently collected, transformed … and made available for analytics and decision-making across the business. To do this role, youll: Liaise with the business to understand data requirements and define data needs. Identify the data then design and maintain data pipelines using Microsoft Fabric (OneLake etc) and Azure Data Factory that integrate to other More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

throughout MO, allowing the organisation to maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing … and peer review of ETL code in Oracle ODI Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing, and governance Contributing to technical … improve interactions with our customers and business partners. This could be data transfer from third parties, ETL into the data warehouse or data lake, providing insights and metrics, or improving performance or processes. This is a dynamic team, with data engineers and analysts working closely alongside members of the business in More ❯

As a part of the client solutions team at Verisk Maplecroft you will be a part of the team charged with using technology to create, collate and deliver data analytics and intelligence to our clients in a geospatial context. We are primarily a Python/Django house with an Angular front end. We recently moved to AWS for … new workflows, pipelines, features and tools that give our clients the information they need to make the right decisions to create a more sustainable and resilient world. Geospatial data forms are a significant component of the data structures used within Verisk Maplecroft, and with an increasing availability of geospatial data in the modern era … and experience of geoservers, spatial projections, raster and vector manipulation within python and usage of GDAL Experience with AWS and data management tools, including data lake, data warehouse ETL, SQL based storage and PostgreSQL. Ability to design and implement data pipelines and data-related solutions, ideally within a cloud More ❯

Senior Data Engineer Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest … of science and software. What youll be doing: Following a successful product launch and securing Series A funding, theyre scaling fast and now looking for their very first Data Engineer. Youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the … design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. This role combines classic data engineering work with data management strategy, data lineage tracking, and storage infrastructure design; from cold archiving through More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Data Solutions Architect £90000-115000 GBP Bonus Hybrid WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Solution Architect £90,000 - £115,000 + Bonus London - Hybrid - Permanent A global leader in IT Solutions and Consulting is seeking a Lead Data Solution Architect to join their dynamic, remote-first architectural team. You … will lead the design and delivery of innovative cloud-based data solutions for enterprise clients across various sectors. Working alongside talented Data Engineers, Business Analysts, and QA Analysts, you'll drive architectural best practices and deliver high-quality data solutions. This is an opportunity to own technical delivery, influence client architecture, and work with … Architect , leading end-to-end delivery of complex data solutions. Extensive expertise in data architecture design , including event-driven architectures (Kafka) and Data Lake/Lakehouse platforms . Hands-on experience with cloud platforms like AWS, Azure, GCP, or Snowflake. Strong knowledge of data governance, compliance, and security standards (GDPR, CCPA More ❯

responsible for designing and managing BI and analytics solutions for the companies product suite. It would suit someone who has worked as a BI Developer, SQL Developer or Data Engineer, who has an understanding of data security and integrity. A key part of the role will be SQL development, and will also involve building and maintaining … a data warehouse. You will probably have experience across the following: Designing and building BI solutions … Writing and optimizing SQL queries Data warehousing A good understanding of data security ETL processes Experience with Azure and related tools (Fabric, Data Lake, Data Factory etc.) would be beneficial but not essential. The company operate a hybrid working policy and you would normally need to be in the office a More ❯

responsible for designing and managing BI and analytics solutions for the companies product suite. It would suit someone who has worked as a BI Developer, SQL Developer or Data Engineer, who has an understanding of data security and integrity. A key part of the role will be SQL development, and will also involve building and maintaining … a data warehouse. You will probably have experience across the following: Designing and building BI solutions … Writing and optimizing SQL queries Data warehousing A good understanding of data security ETL processes Experience with Azure and related tools (Fabric, Data Lake, Data Factory etc.) would be beneficial but not essential. The company operate a hybrid working policy and you would normally need to be in the office a More ❯

Data Analyst Exeter, Devon (hybrid minimum of 2 days in the office you must be based locally) Up to £45,000 per … year The Opportunity: My client operate in the sustainability sector and are going through a period of technology transition as they build there all new Azure data lake and are currently on the lookout for an ambitious Data Analyst on a permanent basis. In this role you are responsible for analysing complex data to support the delivery of both reporting and project-based workflows where you will use your knowledge of data to identify new opportunities to explore as well as providing feedback and support the wider Engineering and Development teams. My client are passionate about finding someone who is able to tell stories with data that More ❯

Job description The Data Program Manager required to have 15-20 yearsof experience in managing Data related projects, including at least 2 large transformation projects. The candidate should have a deep awareness of the data management life cycle, exceptional project management skills, and a solid grasp of benefits management are essential for … effectively managing and executing large/complex data-centric programs. Experience: Data Platform Modernization: Move legacy/on-premises applications, workloads, data lakes, lake houses, data warehouses, and data marts to cloud platforms Building platforms/applications that rely on the consolidation of disparate types of data from multiple source systems that need harmonization across dimension Data lifecycle management projects More ❯

eSC Cleared Data Engineer Bristol or London (Mostly working from home) Up to £745 per day (Umbrella, Inside IR35) Must hold live and transferrable Enhanced SC Security Clearance About the Role We're seeking an experienced Data Engineer to join a high-profile programme, working with cutting-edge cloud and data technologies. You'll … be instrumental in building, optimising, and maintaining scalable data pipelines and platforms that underpin mission-critical systems. If you thrive on solving complex data challenges, working with modern orchestration tools, and applying best practices in security and compliance, this role offers both technical depth and impact. Key Responsibilities Design & Optimise Pipelines - Build and refine ETL/… ELT workflows using Apache Airflow for orchestration. Data Ingestion - Create reliable ingestion processes from APIs and internal systems, leveraging tools such as Kafka, Spark, or AWS-native services. Cloud Data Platforms - Develop and maintain data lakes and warehouses (e.g., AWS S3, Redshift). Data Quality & Governance - Implement automated validation, testing, and monitoring More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … DNA sequencing tech in play, they’re solving incredibly complex problems at the intersection of science and software. What you’ll be doing: Coming in as the Senior Data Engineer, you’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform.You’ll be leading on … the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. You'll be collaborating closely with engineers and scientists, helping to bridge the gap between their experiments and actionable data. That might mean streaming data More ❯

Pro currently has an exciting opportunity for a motivated and detail-oriented individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion and analysis tools such as … Intrali, Quantemplate, or Matillion. The project focuses on the extraction, transformation, and loading (ETL) of data from various sources into data warehouses and data lakes. This is an ideal role for an aspiring Data Architect in the Insurance Industry. Pro operates a hybrid working policy, with time split between home and our … Gloucester or Liverpool office. This vacancy is also suitable for a fully remote individual, as we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing, and preparing datasets for analysis. Creation and management of both Risk and Claims data maps (models) and reconciliation of results. More ❯

Job Title: Computer Vision Engineer Location: Tunbridge Wells - Hybrid About us: VisionTrack is a multiple award winning IOT, high throughout/big data insurance telematics & video solution. Role: We are looking for developers with experience in computer vision applications to join one of our agile development teams. We try to avoid silos of knowledge so the role will … SignalR Python programming experience Previous experience in the development and use of Convolution Neural Networks (CNN’s) for machine vision and image analysis applications Experience with large-scale data sets Experience with open source machine learning platforms such as Keras/tensorflow or PyTorch Ability to develop using rapid prototyping techniques aimed at demonstrating applications quickly in a … first approach. TeamCity, Octopus Deploy Git, including GitFlow & Pull Requests/Peer Reviews. ReactJs, Jest, ESLint, Sinon, Npm, Webpack Working with Geospatial data. Azure Big Data technologies, DataLake, Sql Data Warehouse, Azure Databricks Media Decoding Academic background in a scientific or technical discipline with some formal computer vision/machine learning content. More ❯