METHOD AND APPARATUS FOR ADAPTIVE ARTIFICIAL INTELLIGENCE DOWNSCALING FOR UPSCALING DURING VIDEO TELEPHONE CALL

    公开(公告)号:US20210390662A1

    公开(公告)日:2021-12-16

    申请号:US17330809

    申请日:2021-05-26

    Abstract: Provided is a method of adaptively performing artificial intelligence (AI) downscaling on an image during a video telephone call of a user terminal. The method includes obtaining, from an opposite user terminal, AI upscaling support information of the opposite user terminal that is a target of a video telephone call, determining whether the user terminal is to perform AI downscaling on an original image, based on the AI upscaling support information, based on determining that the user terminal is to perform AI downscaling on the original image, obtaining a first image by AI downscaling the original image using a downscaling deep neural network (DNN), generating image data by performing first encoding on the first image, and transmitting AI data including information related to the AI downscaling and the image data.

    ARTIFICIAL INTELLIGENCE (AI) ENCODING APPARATUS AND OPERATING METHOD THEREOF AND AI DECODING APPARATUS AND OPERATING METHOD THEREOF

    公开(公告)号:US20210142445A1

    公开(公告)日:2021-05-13

    申请号:US17091889

    申请日:2020-11-06

    Abstract: An artificial intelligence (AI) decoding apparatus obtains image data corresponding to a first image, which is AI-downscaled from an original image by an AI encoding apparatus by using a first deep neural network (DNN); reconstructs a second image corresponding to the first image, based on the image data; and obtain a third image, which is AI-upscaled from the second image, convolution is performed based on the second image and second parameters of a filter kernel included in a second DNN, wherein each of the second parameters is an integer value, and the second parameters are determined as values associated with first parameters of a filter kernel included in the first DNN. Embodiments use memory-efficient values with respect to filter kernels. Parameters used to obtain the memory-efficient integer values may be obtained via joint training between the first DNN and the second DNN.

    AI ENCODING APPARATUS AND OPERATION METHOD OF THE SAME, AND AI DECODING APPARATUS AND OPERATION METHOD OF THE SAME

    公开(公告)号:US20210134020A1

    公开(公告)日:2021-05-06

    申请号:US17147954

    申请日:2021-01-13

    Abstract: Provided is an artificial intelligence (AI) decoding apparatus including a memory storing one or more instructions; and a processor configured to execute the one or more instructions to, when an image is input to a second DNN including a plurality of layers, obtain first result values based on an operation between the image and a first filter kernel and obtain second result values based on an operation between the image and a second filter kernel, from a first layer including the first and second filter kernels from among the plurality of layers, perform normalization by transforming the first result values into first values by using a first scale factor, and, perform normalization by transforming the second result values into second values by using a second scale factor, transform the first values and the second values into integer values included in a preset range.

Patent Agency Ranking