公开(公告)号：US20230083597A1

公开(公告)日：2023-03-16

申请号：US17807125

申请日：2022-06-15

Applicant: QUALCOMM Incorporated

Inventor： Suren Mohan ,  Ren Li ,  Prajakt Kulkarni ,  Aaron Douglass Lamb

IPC: G06N3/04

Abstract: Certain aspects of the present disclosure provide a processor, comprising: a configurable nonlinear activation function circuit configured to: determine, based on a selected nonlinear activation function, a set of parameters for the nonlinear activation function; and generate output data based on application of the set of parameters for the nonlinear activation function, wherein: the configurable nonlinear activation function circuit comprises at least one nonlinear approximator comprising at least two successive linear approximators, and each linear approximator of the at least two successive linear approximators is configured to approximate a linear function using one or more function parameters of the set of parameters.

公开(公告)号：US09417845B2

公开(公告)日：2016-08-16

申请号：US14195988

申请日：2014-03-04

Applicant: QUALCOMM Incorporated

Inventor： Aaron Douglass Lamb

IPC: G06F15/18 ,  G06F7/58 ,  G06N3/04 ,  G06N3/063

CPC classification number: G06F7/584 ,  G06N3/0472 ,  G06N3/049 ,  G06N3/063

Abstract: Certain aspects of the present disclosure provide methods and apparatus for producing programmable probability distribution function of pseudo-random numbers that can be utilized for filtering (dropping and passing) neuron spikes. The present disclosure provides a simpler, smaller, and lower-power circuit than that typically used. It can be programmed to produce any of a variety of non-uniformly distributed sequences of numbers. These sequences can approximate true probabilistic distributions, but maintain sufficient pseudo-randomness to still be considered random in a probabilistic sense. This circuit can be an integral part of a filter block within an ASIC chip emulating an artificial nervous system.

Abstract translation: 本公开的某些方面提供了用于产生可用于过滤（丢弃和传递）神经元峰值的伪随机数的可编程概率分布函数的方法和装置。 本公开提供了比通常使用的电路更简单，更小和更低功率的电路。 它可以被编程以产生各种不均匀分布的数字序列。 这些序列可以近似真实的概率分布，但是保持足够的伪随机性仍然在概率上被认为是随机的。 该电路可以是模拟人造神经系统的ASIC芯片内的滤波器块的组成部分。

公开(公告)号：US12131130B2

公开(公告)日：2024-10-29

申请号：US18105159

申请日：2023-02-02

Applicant: QUALCOMM Incorporated

Inventor： Rexford Alan Hill ,  Aaron Douglass Lamb ,  Michael Goldfarb ,  Amin Ansari ,  Christopher Lott

IPC: G06F7/544 ,  G06F5/06 ,  G06N3/063

CPC classification number: G06F7/5443 ,  G06F5/06 ,  G06N3/063

Abstract: A method of exploiting activation sparsity in deep neural networks is described. The method includes retrieving an activation tensor and a weight tensor where the activation tensor is a sparse activation tensor. The method also includes generating a compressed activation tensor comprising non-zero activations of the activation tensor, where the compressed activation tensor has fewer columns than the activation tensor. The method further includes processing the compressed activation tensor and the weight tensor to generate an output tensor.

公开(公告)号：US11669747B2

公开(公告)日：2023-06-06

申请号：US16667821

申请日：2019-10-29

Applicant: QUALCOMM Incorporated

Inventor： Rexford Alan Hill ,  Eric Wayne Mahurin ,  Aaron Douglass Lamb ,  Albert Danysh ,  Erich Plondke ,  David Hoyle

IPC: G06N5/00 ,  G06N5/01 ,  G06N3/08 ,  H03M7/24 ,  G06F17/17 ,  G06N3/048 ,  H03K19/21 ,  H03K19/20

CPC classification number: G06N5/01 ,  G06F17/17 ,  G06N3/048 ,  G06N3/08 ,  H03M7/24 ,  H03K19/20 ,  H03K19/21

Abstract: A method of constraining data represented in a deep neural network is described. The method includes determining an initial shifting specified to convert a fixed-point input value to a floating-point output value. The method also includes determining an additional shifting specified to constrain a dynamic range during converting of the fixed-point input value to the floating-point output value. The method further includes performing both the initial shifting and the additional shifting together to form a dynamic, range constrained, normalized floating-point output value.

公开(公告)号：US11275559B2

公开(公告)日：2022-03-15

申请号：US16920242

申请日：2020-07-02

Applicant: QUALCOMM Incorporated

Inventor： Aaron Douglass Lamb

IPC: G06F7/485 ,  G06F5/01

Abstract: Certain aspects of the present disclosure are directed to methods and apparatus for circular floating point addition. An example method generally includes obtaining a first floating point number represented by a first significand and a first exponent, obtaining a second floating point number represented by a second significand and second exponent, and adding the first floating point number and the second floating point number using a circular accumulator device.