公开(公告)号：US12033049B2

公开(公告)日：2024-07-09

申请号：US18228645

申请日：2023-07-31

Applicant: Apple Inc.

Inventor： Edouard Godfrey ,  Gianpaolo Fasoli ,  Kuangyu Wang

IPC: G06F18/2415 ,  G06N20/00 ,  G06N20/20

CPC classification number: G06N20/20 ,  G06N20/00

Abstract: The subject technology receives assessment values determined by a first machine learning model deployed on a client electronic device, the assessment values being indicative of classifications of input data and the assessment values being associated with constraint data that comprises a probability distribution of the assessment values with respect to the classifications of the input data. The subject technology applies the assessment values determined by the first machine learning model to a second machine learning model to determine the classifications of the input data. The subject technology determines whether accuracies of the classifications determined by the second machine learning model conform with the probability distribution for corresponding assessment values determined by the first machine learning model. The subject technology retrains the first machine learning model when the accuracies of the classifications determined by the second machine learning model do not conform with the probability distribution.

公开(公告)号：US11715043B2

公开(公告)日：2023-08-01

申请号：US16805625

申请日：2020-02-28

Applicant: Apple Inc.

Inventor： Edouard Godfrey ,  Gianpaolo Fasoli ,  Kuangyu Wang

IPC: G06N20/20 ,  G06N20/00 ,  G06V10/00 ,  G06V10/70

CPC classification number: G06N20/20 ,  G06N20/00

Abstract: The subject technology receives assessment values determined by a first machine learning model deployed on a client electronic device, the assessment values being indicative of classifications of input data and the assessment values being associated with constraint data that comprises a probability distribution of the assessment values with respect to the classifications of the input data. The subject technology applies the assessment values determined by the first machine learning model to a second machine learning model to determine the classifications of the input data. The subject technology determines whether accuracies of the classifications determined by the second machine learning model conform with the probability distribution for corresponding assessment values determined by the first machine learning model. The subject technology retrains the first machine learning model when the accuracies of the classifications determined by the second machine learning model do not conform with the probability distribution.