Optimization for artificial neural network model and neural processing unit

    公开(公告)号:US11710026B2

    公开(公告)日:2023-07-25

    申请号:US17989761

    申请日:2022-11-18

    Inventor: Lok Won Kim

    CPC classification number: G06N3/02 G06N5/04

    Abstract: A computer-implemented apparatus installed and executed in a computer to search an optimal design of a neural processing unit (NPU), a hardware accelerator used for driving a computer-implemented artificial neural network (ANN) is disclosed. The NPU comprises a plurality of blocks connected in a form of pipeline, and the number of the plurality blocks and the number of the layers within each block of the plurality blocks are in need of optimization to reduce hardware resources demand and electricity power consumption of the ANN while maintaining the inference accuracy of the ANN at an acceptable level. The computer-implemented apparatus searches for and then outputs an optimal L value and an optimal C value when a first set of candidate values for a number of layers L and a second set of candidate values for a number of channels C per each layer of the ANN is provided.

    SYSTEM CAPABLE OF DETECTING FAILURE OF COMPONENT OF SYSTEM AND METHOD THEREOF

    公开(公告)号:US20220206068A1

    公开(公告)日:2022-06-30

    申请号:US17562979

    申请日:2021-12-27

    Inventor: Lok Won Kim

    Abstract: This disclosure proposes an inventive system capable of testing a component in the system during runtime. The system may comprise: a substrate; a plurality of functional components, of the plurality of functional components being mounted onto the substrate and including a circuitry; a system bus formed with electrically conductive pattern onto the substrate thereby allowing the plurality of functional components to communicate with each other; one or more wrappers, each of the one or more wrappers connected to one of the plurality of functional components; and an in-system component tester (ICT) configured to: select, as a component under test (CUT), at least one functional component, in an idle state, of the plurality of the functional components; and test, via the one or more test wrappers, the at least one functional component selected as the CUT.

    Method and system for bit quantization of artificial neural network

    公开(公告)号:US11263513B2

    公开(公告)日:2022-03-01

    申请号:US17254039

    申请日:2020-02-21

    Inventor: Lok Won Kim

    Abstract: The present disclosure provides a bit quantization method of an artificial neural network. This method may include: (a) of selecting one parameter or one parameter group to be quantized in the artificial neural network; (b) a bit quantizing to reduce the data representation size for the selected parameter or parameter group to a unit of bits; (c) of determining whether the accuracy of the artificial neural network is equal to or greater than a predetermined target value; and (d) repeating steps (a) to (c) when the accuracy of the artificial neural network is equal to or greater than the target value.

Patent Agency Ranking