公开(公告)号：US12026096B2

公开(公告)日：2024-07-02

申请号：US17857481

申请日：2022-07-05

Applicant: NATIONAL APPLIED RESEARCH LABORATORIES

Inventor： Yu-Bin Fang ,  Shuen-Tai Wang ,  Chau-Yi Chou

IPC: G06F12/00 ,  G06F12/084 ,  G06N3/04

CPC classification number: G06F12/084 ,  G06N3/04 ,  G06F2212/254 ,  G06F2212/6042

Abstract: Disclosed are an on-demand shared data caching method, a computer program, and a computer readable medium applicable for distributed deep learning computing. The method includes a step of dynamically building a distributed shared memory cache space, in which a distributed shared memory deployment and data file access management module is added to a deep learning framework to build the distributed shared memory cache space by a memory set of a multiple of computing nodes of a cluster computer; and a distributed deep learning computing step, in which the computing node overrides a Dataset API of the deep learning framework to execute the distributed deep learning computing. When reading a data file, if the data file exists in the distributed shared memory cache space, then it will be accessed directly, or else it will be obtained from an original specified directory location and stored in the distributed shared memory cache space.