Invention Grant
- Patent Title: Efficient dropout inference for bayesian deep learning
-
Application No.: US16168015Application Date: 2018-10-23
-
Publication No.: US11410040B2Publication Date: 2022-08-09
- Inventor: Seungwoo Yoo , Heesoo Myeong , Hee-Seok Lee , Hyun-Mook Cho
- Applicant: QUALCOMM Incorporated
- Applicant Address: US CA San Diego
- Assignee: QUALCOMM Incorporated
- Current Assignee: QUALCOMM Incorporated
- Current Assignee Address: US CA San Diego
- Agency: Patterson & Sheridan, L.L.P.
- Main IPC: G06N3/04
- IPC: G06N3/04 ; G06N3/08 ; G06N7/00 ; G06N5/04

Abstract:
Certain aspects of the present disclosure are directed to methods and apparatus for deep learning in an artificial neural network. One example method generally includes receiving input data at an input to a layer of the neural network; replicating a group of neural processing units in the layer to form a superset of neural processing units, the superset comprising n instances of the group of neural processing units; processing the input data using the superset to generate output data for the layer; and determining an uncertainty of the output data. Processing the input data includes performing a dropout function by zeroing out one or more weights of a set of weights for each of the n instances of the superset of neural processing units and convolving, for each of the n instances in parallel, the input data with one or more non-zeroed out weights of the set of weights.
Information query