公开(公告)号：US11816565B2

公开(公告)日：2023-11-14

申请号：US16792835

申请日：2020-02-17

Applicant: Apple Inc.

Inventor： Moussa Doumbouya ,  Xavier Suau Cuadros ,  Luca Zappella ,  Nicholas E. Apostoloff

IPC: G06N20/10 ,  G06N3/045 ,  G06N3/08

CPC classification number: G06N3/08 ,  G06N3/045 ,  G06N20/10

Abstract: Methods and apparatus are disclosed for interpreting a deep neural network (DNN) using a Semantic Coherence Analysis (SCA)-based interpretation technique. In embodiments, a multi-layered DNN that was trained for one task is analyzed using the SCA technique to select one layer in the DNN that produces salient features for another task. In embodiments, the DNN layers are tested with test samples labeled with a set of concept labels. The output features of a DNN layer are gathered and analyzed according to the concepts. In embodiments, the output is scored with a semantic coherence score, which indicates how well the layer separates the concepts, and one layer is selected from the DNN based on its semantic coherence score. In some embodiments, a support vector machine (SVM) or additional neural network may be added to the selected layer and trained to generate classification results based on the outputs of the selected layer.

公开(公告)号：US11500937B1

公开(公告)日：2022-11-15

申请号：US16043076

申请日：2018-07-23

Applicant: Apple Inc.

Inventor： Luca Zappella ,  Siddharth Khullar ,  Till M. Quack ,  Xavier Suau Cuadros

IPC: G06F16/00 ,  G06F16/9032 ,  G06N3/04 ,  G06F3/04847 ,  G06F16/51

Abstract: A system for selecting different aspects of data objects to be matched with similar aspects of other data objects. A user inputs a search data object and a value. A neural network computes features for the search object at multiple layers that correspond to different aspects of the object. A descriptor is generated for the search object from features output at a layer position of the neural network determined from the value. The descriptor is compared to corresponding descriptors for objects in a collection to select objects that include aspects similar to an aspect of the search object. The user can change the value to view different objects that include aspects similar to other aspects of the search object. Thus, the user can explore different aspects of an object to find objects that include aspects similar to the aspect of the object that the user is interested in.

公开(公告)号：US20210117778A1

公开(公告)日：2021-04-22

申请号：US16792835

申请日：2020-02-17

Applicant: Apple Inc.

Inventor： Moussa Doumbouya ,  Xavier Suau Cuadros ,  Luca Zappella ,  Nicholas E. Apostoloff

IPC: G06N3/08 ,  G06N3/04 ,  G06N20/10

Abstract: Methods and apparatus are disclosed for interpreting a deep neural network (DNN) using a Semantic Coherence Analysis (SCA)-based interpretation technique. In embodiments, a multi-layered DNN that was trained for one task is analyzed using the SCA technique to select one layer in the DNN that produces salient features for another task. In embodiments, the DNN layers are tested with test samples labeled with a set of concept labels. The output features of a DNN layer are gathered and analyzed according to the concepts. In embodiments, the output is scored with a semantic coherence score, which indicates how well the layer separates the concepts, and one layer is selected from the DNN based on its semantic coherence score. In some embodiments, a support vector machine (SVM) or additional neural network may be added to the selected layer and trained to generate classification results based on the outputs of the selected layer.