12 of 12 Remote/Hybrid Data Lake Jobs in the North East

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

Description We're looking for a Senior Data Engineer with deep expertise in healthcare data to join a pioneering team building data products that enable world-leading research. Whether your experience comes from academia, healthcare, biotech, or a fast-growing health-tech startup … Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

Description We're looking for a Senior Data Engineer with deep expertise in healthcare data to join a pioneering team building data products that enable world-leading research. Whether your experience comes from academia, healthcare, biotech, or a fast-growing health-tech startup … Unix/Linux skills. Experience working with cloud platforms, ideally Microsoft Azure. Experience using technologies such as Spark, Databricks and data lake architectures. Knowledge of data storage and transformation formats such as Apache Parquet and Delta Lake. Experience with containerisation and orchestration technologies, including Docker ...

journey, we're consolidating our data capabilities onto a single Azure Databricks platform, leveraging technologies including Azure Data Factory, Delta Lake, Unity Catalog and Power BI to unlock new insights and drive innovation. Joining our Enterprise Data Team , you'll play … organisation. You'll be responsible for building and maintaining data pipelines using Azure Databricks, Azure Data Factory and Delta Lake, supporting the modernisation of legacy platforms while ensuring data quality, reliability and performance. The role will also involve implementing data governance ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … time streaming data pipelines with technologies like Kafka, Flink, Spark etc. Experience in Databricks is a plus. Experience in Data Lake/Big Data Analytics platform implementation with cloud based solution; AWS preferred. Proficient in Python programming and software engineering best practices. Expertise ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business‐specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands‐on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

looking for a Staff Software Engineer to help shape and build the shared engineering capabilities that underpin Our Future Health’s data platforms. This is an opportunity to combine hands-on software engineering with Staff level technical leadership , working on large-scale data systems and reusable … biggest health research programme of its kind, and our volunteer group is also more diverse than other, similar health research programmes. Technology and data are central to our mission. Our systems power web sites, clinics across the UK, secure analytics and research systems, and pipelines that process highly ...

Description We’re looking for a Data Engineer with a strong background in bioinformatics and genetics to help build the data pipelines supporting Our Future Health’s growing Clinical Research Recruitment Service. This is an opportunity to combine genetics, bioinformatics and modern data engineering … working with data at significant scale while contributing directly to research that could improve how diseases are prevented, detected and treated. Our Future Health is an ambitious collaboration between the public, charity and private sectors, designed to help people live healthier lives for longer through better prevention, earlier ...

This is an exciting contract opportunity for an SC Cleared Data Engineer tojoin an experienced team delivering a crtitical public sector engagement working at the forefront of data analytics and AI. This role offers the chance to take a key role in the design and delivery … Skills & Experiences Proven experience designing and implementing data solutions in Azure using Databricks as a core platform. Hands-on expertise in Delta Lake, Delta Live Tables and Databricks Workflows. Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks. Deep understanding ...

consistent delivery of such. Continue to drive "true" automation by converting manually triggered automation tools into robotically automated processes and/or data pipelines. Work with the IT Data Department to convert existing automations for data transfer into proper data pipelines, making … data tables available through the Data Lake. Create and maintain live reports for key metrics using Power BI, to replace Excel-based reports currently being produced both within the team and by managers across Finance Who we're looking for Process Automation Experience in office process ...

solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science … AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles ...

month in your local Office Skills Significant Architecture experience Government/Public client experience (SC cleared or at least SC eligible) Analytics & Reporting: Data warehousing, data lakes, business intelligence (BI) and analytics technologies, design patterns, tools and best practice. Translating business requirements into technical solutions with … principles, patterns, technical radars, practices and standards. AWS Solution expertise and relevant certification - EMR/Spark (Hadoop)/AWS/Data Modelling-Mapping/GitHub/GitLab Technologies Azure AWS Power BI #J-18808-Ljbffr ...