Distributed Training Method and System, Device and Storage Medium

    公开(公告)号:US20210406767A1

    公开(公告)日:2021-12-30

    申请号:US17142822

    申请日:2021-01-06

    Abstract: The present application discloses a distributed training method and system, a device and a storage medium, and relates to technical fields of deep learning and cloud computing. The method includes: sending, by a task information server, a first training request and information of an available first computing server to at least a first data server; sending, by the first data server, a first batch of training data to the first computing server, according to the first training request; performing, by the first computing server, model training according to the first batch of training data, sending model parameters to the first data server so as to be stored after the training is completed, and sending identification information of the first batch of training data to the task information server so as to be recorded; wherein the model parameters are not stored at any one of the computing servers.

    METHOD AND APPARATUS FOR GENERATING SHARED ENCODER

    公开(公告)号:US20210209417A1

    公开(公告)日:2021-07-08

    申请号:US17209576

    申请日:2021-03-23

    Abstract: A method and an apparatus for generating a shared encoder are provided, which belongs to a field of computer technology and deep learning. The method includes: sending by a master node a shared encoder training instruction to child nodes, so that each child node obtains training samples based on a type of a target shared encoder included in the training instruction; sending an initial parameter set of the target shared encoder to be trained to each child node after obtaining a confirmation message returned by each child node; obtaining an updated parameter set of the target shared encoder returned by each child node; determining a target parameter set corresponding to the target shared encoder based on a first preset rule and the updated parameter set of the target shared encoder returned by each child node.

    METHOD AND APPARATUS FOR RECALLING NEWS BASED ON ARTIFICAL INTELLIGENCE, DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20180349512A1

    公开(公告)日:2018-12-06

    申请号:US16000160

    申请日:2018-06-05

    Abstract: A method and apparatus for recalling news based on artificial intelligence, a device and a storage medium. The method comprises: building an index repository according to candidate news, the index repository including M search trees, each search tree being a complete binary tree including at least two layers, each non-leaf node in each search tree corresponding to a semantic index vector, each piece of candidate news corresponding to a leaf node in each search tree; when news needs to be recommended to the user, generating a user's semantic index vector according to the user's interest tag; with respect to each search tree, respectively according to semantic index vectors corresponding to non-leaf nodes therein and the user's semantic index vector, determining a path from a first layer of non-leaf nodes to a leaf node, and regarding candidate news corresponding to the leaf node on the path as a recall result.

    Session Recommendation Method, Device and Electronic Equipment

    公开(公告)号:US20220114218A1

    公开(公告)日:2022-04-14

    申请号:US17279377

    申请日:2020-06-09

    Abstract: A session recommendation method, a device and an electronic device are provided, related to the field of graph neural network technology. The session recommendation method includes: acquiring a session control sequence, and acquiring a first embedding vector matrix based on an embedding vector of each of items in the session control sequence; generating a position information sequence based on an arrangement sequence of the items in the session control sequence, and acquiring a second embedding vector matrix based on an embedding vector of each piece of position information in the position information sequence; determining a target embedding vector matrix based on the first embedding vector matrix and the second embedding vector matrix; and determining a recommended item, based on the target embedding vector matrix and through a Session-based Recommendation Graph Neural Network.

    CONVERSATION-BASED RECOMMENDING METHOD, CONVERSATION-BASED RECOMMENDING APPARATUS, AND DEVICE

    公开(公告)号:US20210374356A1

    公开(公告)日:2021-12-02

    申请号:US17399016

    申请日:2021-08-10

    Abstract: The disclosure discloses a conversation-based recommending method. A directed graph corresponding to a current conversation is obtained. The current conversation includes clicked items, the directed graph includes nodes and directed edges between the nodes, each node corresponds to a clicked item, and each directed edge indicates relationship data between the nodes. For each node of the directed graph, an attention weight is determined for each directed edge corresponding to the node based on a feature vector of the node and the relationship data for each node of the directed graph. A new feature vector of the node is determined based on the relationship data and the attention weight of each directed edge. A feature vector of the current conversation is determined based on the new feature vector of each node. An item is recommended based on the feature vector of the current conversation.

    METHOD FOR PROCESSING TASKS IN PARALLEL, DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20210255896A1

    公开(公告)日:2021-08-19

    申请号:US17076346

    申请日:2020-10-21

    Abstract: Embodiments of the present disclosure disclose a method for processing tasks in parallel, a device and a storage medium, and relate to a field of artificial intelligent technologies. The method includes: determining at least one parallel computing graph of a target task; determining a parallel computing graph and an operator scheduling scheme based on a hardware execution cost of each operator task of each of the at least one parallel computing graph in a cluster, in which the cluster includes a plurality of nodes for executing the plurality of operator tasks, and each parallel computing graph corresponds to at least one operator scheduling scheme; and scheduling and executing the plurality of operator tasks of the determined parallel computing graph in the cluster based on the determined parallel computing graph and the determined operator scheduling scheme.

Patent Agency Ranking