公开(公告)号：US20190220742A1

公开(公告)日：2019-07-18

申请号：US16246884

申请日：2019-01-14

Applicant: MediaTek Inc.

Inventor： Yu-Ting Kuo ,  Chien-Hung Lin ,  Shao-Yu Wang ,  ShengJe Hung ,  Meng-Hsuan Cheng ,  Chi-Ta Wu ,  Henrry Andrian ,  Yi-Siou Chen ,  Tai-Lung Chen

IPC: G06N3/08

CPC classification number: G06N3/08

Abstract: An accelerator for neural network computing includes hardware engines and a buffer memory. The hardware engines include a convolution engine and at least a second engine. Each hardware engine includes circuitry to perform neural network operations. The buffer memory stores a first input tile and a second input tile of an input feature map. The second input tile overlaps with the first input tile in the buffer memory. The convolution engine is operative to retrieve the first input tile from the buffer memory, perform convolution operations on the first input tile to generate an intermediate tile of an intermediate feature map, and pass the intermediate tile to the second engine via the buffer memory.

公开(公告)号：US10977001B2

公开(公告)日：2021-04-13

申请号：US16250874

申请日：2019-01-17

Applicant: MediaTek Inc.

Inventor： Chien-Hung Lin ,  Pei-Kuei Tsung ,  Chi-Ming Chen ,  Meng-Hsuan Cheng ,  ShengJe Hung

IPC: G06F7/544 ,  G06N3/063 ,  G06N3/04 ,  G06N3/08

Abstract: A processing unit performs multiply-and-accumulate (MAC) operations on asymmetrically quantized data. The processing unit includes a MAC hardware unit to perform the MAC operations on a first data sequence and a second data sequence to generate an asymmetric MAC output. Both the first data sequence and the second data sequence are asymmetrically quantized. The processing unit further includes an accumulator hardware unit to accumulate the first data sequence concurrently with the MAC operations to generate an accumulated output. The processing unit further includes a multiply-and-add (MAD) hardware unit to multiply the accumulated output with a second offset to generate a multiplication output, and to add the multiplication output, the asymmetric MAC output and a pre-computed value calculated before runtime to generate a final output. The second offset indicates an amount of asymmetry of the second data sequence with respect to zero.

公开(公告)号：US11436483B2

公开(公告)日：2022-09-06

申请号：US16246884

申请日：2019-01-14

Applicant: MediaTek Inc.

Inventor： Yu-Ting Kuo ,  Chien-Hung Lin ,  Shao-Yu Wang ,  ShengJe Hung ,  Meng-Hsuan Cheng ,  Chi-Ta Wu ,  Henrry Andrian ,  Yi-Siou Chen ,  Tai-Lung Chen

IPC: G06N3/08 ,  G06N3/04 ,  G06N3/063 ,  G06F12/084 ,  G06F17/15

Abstract: An accelerator for neural network computing includes hardware engines and a buffer memory. The hardware engines include a convolution engine and at least a second engine. Each hardware engine includes circuitry to perform neural network operations. The buffer memory stores a first input tile and a second input tile of an input feature map. The second input tile overlaps with the first input tile in the buffer memory. The convolution engine is operative to retrieve the first input tile from the buffer memory, perform convolution operations on the first input tile to generate an intermediate tile of an intermediate feature map, and pass the intermediate tile to the second engine via the buffer memory.

公开(公告)号：US20190243610A1

公开(公告)日：2019-08-08

申请号：US16250874

申请日：2019-01-17

Applicant: MediaTek Inc.

Inventor： Chien-Hung Lin ,  Pei-Kuei Tsung ,  Chi-Ming Chen ,  Meng-Hsuan Cheng ,  ShengJe Hung

IPC: G06F7/544 ,  G06N3/063

CPC classification number: G06F7/5443 ,  G06N3/063

Abstract: A processing unit performs multiply-and-accumulate (MAC) operations on asymmetrically quantized data. The processing unit includes a MAC hardware unit to perform the MAC operations on a first data sequence and a second data sequence to generate an asymmetric MAC output. Both the first data sequence and the second data sequence are asymmetrically quantized. The processing unit further includes an accumulator hardware unit to accumulate the first data sequence concurrently with the MAC operations to generate an accumulated output. The processing unit further includes a multiply-and-add (MAD) hardware unit to multiply the accumulated output with a second offset to generate a multiplication output, and to add the multiplication output, the asymmetric MAC output and a pre-computed value calculated before runtime to generate a final output. The second offset indicates an amount of asymmetry of the second data sequence with respect to zero.