METHOD AND APPARATUS FOR DYNAMIC NORMALIZATION AND RELAY IN A NEURAL NETWORK

    公开(公告)号:US20220207359A1

    公开(公告)日:2022-06-30

    申请号:US17485406

    申请日:2021-09-25

    Abstract: Embodiments are generally directed to methods and apparatuses for dynamic normalization and relay in a neural network. An embodiment of an apparatus for dynamic normalization and relay in a neural network including a hyper normalization layer comprises: a compute engine to: generate a hidden state and a cell state for the hyper normalization layer based on an input feature map for the hyper normalization layer as well as a previous hidden state and a previous cell state; and normalize the input feature map in the hyper normalization layer with the hidden state and the cell state for the hyper normalization layer.

Patent Agency Ranking