Method and apparatus for improving model based on pre-trained semantic model

    公开(公告)号:US11775766B2

    公开(公告)日:2023-10-03

    申请号:US17249718

    申请日:2021-03-10

    CPC classification number: G06F40/30 G06N3/045 G06N3/08

    Abstract: Embodiments of a method and an apparatus for improving a model based on a pre-trained semantic model are provided. The method may include: based on the pre-trained semantic model, obtaining an initial improved model, where semantic result information of an input vector is determined in the initial improved model based on a hash search method; and based on a model distillation method, training the initial improved model to obtain an improved model. Some embodiments can obtain the semantic result information of the input vector by performing the hash search method on the input vector, replace the original complex iterative calculation process of a semantic model, and obtain the improved model with few model parameters and high compression ratio.

Patent Agency Ranking