RESIDUAL NORMALIZATION FOR IMPROVED NEURAL NETWORK CLASSIFICATIONS

    公开(公告)号:US20220405547A1

    公开(公告)日:2022-12-22

    申请号:US17807479

    申请日:2022-06-17

    Abstract: Certain aspects of the present disclosure provide techniques for residual normalization. A first tensor comprising a frequency dimension and a temporal dimension is accessed. A second tensor is generated by applying a frequency-based instance normalization operation to the first tensor, comprising, for each respective frequency bin in the frequency dimension, computing a respective frequency-specific mean of the first tensor. A third tensor is generated by: scaling the first tensor by a scale value, and aggregating the scaled first tensor and the second tensor. The third tensor is provided as input to a layer of a neural network.

Patent Agency Ranking