公开(公告)号：US11227122B1

公开(公告)日：2022-01-18

申请号：US16731345

申请日：2019-12-31

Applicant: Facebook, Inc.

Inventor： Prince Gill ,  Honglei Liu ,  Wenhai Yang ,  Kshitiz Malik ,  Nanshu Wang ,  David Reiss

IPC: G06F17/00 ,  G06F40/30 ,  G06N20/00 ,  G06N7/00 ,  G06F40/20

Abstract: Exemplary embodiments relate to methods, mediums, and systems for moving language models from a server to the client device. Such embodiments may be deployed in an environment where the server is not able to provide modeling services to the clients, such as an end-to-end encrypted (E2EE) environment. Several different techniques are described to address issues of size and complexity reduction, model architecture optimization, model training, battery power reduction, and latency reduction.