-
公开(公告)号:US11477468B2
公开(公告)日:2022-10-18
申请号:US16760609
申请日:2018-10-30
Inventor: Joo-Young Lee , Seung-Hyun Cho , Youn-Hee Kim , Jin-Wuk Seok , Woong Lim , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N7/12 , H04N19/42 , H04N19/136 , G06N3/04 , G06N3/08
Abstract: A method and apparatus for image compression using a latent variable are provided. The multiple components of the latent variable may be sorted in order of importance. Through sorting, when the feature information of only some of the multiple components is used, the quality of a reconstructed image may be improved. In order to generate a latent variable, the components of which are sorted in order of importance, learning may be performed in various manners. Also, less important information may be eliminated from the latent variable, and processing, such as quantization, may be applied to the latent variable. Through elimination and processing, the amount of data for the latent variable may be reduced.
-
公开(公告)号:US11166014B2
公开(公告)日:2021-11-02
申请号:US16772443
申请日:2018-12-13
Inventor: Seung-Hyun Cho , Joo-Young Lee , Youn-Hee Kim , Jin-Wuk Seok , Woong Lim , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/105 , H04N19/159 , H04N19/176 , H04N19/85
Abstract: Disclosed herein are a method and apparatus for video decoding and a method and apparatus for video encoding. A prediction block for a target block is generated by predicting the target block using a prediction network, and a reconstructed block for the target block is generated based on the prediction block and a reconstructed residual block. The prediction network includes an intra-prediction network and an inter-prediction network and uses a spatial reference block and/or a temporal reference block when it performs prediction. For learning in the prediction network, a loss function is defined, and learning in the prediction network is performed based on the loss function.
-
3.
公开(公告)号:US11665363B2
公开(公告)日:2023-05-30
申请号:US17535926
申请日:2021-11-26
Inventor: Hyoung-Jin Kwon , Ji-Hoon Do , Dong-Hyun Kim , Youn-Hee Kim , Jong-Ho Kim , Joo-Young Lee , Se-Yoon Jeong , Jin-Soo Choi , Tae-Jin Lee , Jee-Hoon Kim , Dong-Gyu Sim , Seoung-Jun Oh , Min-Hun Lee , Yun-Gu Lee , Han-Sol Choi , Kwang-Hwan Kim
IPC: H04N19/503 , H04N19/11
CPC classification number: H04N19/503 , H04N19/11
Abstract: Disclosed herein are a method, apparatus, system, and computer-readable recording medium for image compression. An encoding apparatus performs preprocessing of feature map information, frame packing, frame classification, and encoding. A decoding apparatus performs decoding, frame depacking, and postprocessing in order to reconstruct feature map information. By encoding the feature map information, inter-prediction and intra-block prediction for a frame are performed. The encoding apparatus provides the decoding apparatus with a feature map information bitstream for reconstructing the feature map information along with an image information bitstream.
-
公开(公告)号:US11663476B2
公开(公告)日:2023-05-30
申请号:US16772557
申请日:2018-12-13
Inventor: Seung-Hyun Cho , Youn-Hee Kim , Jin-Wuk Seok , Joo-Young Lee , Woong Lim , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi , Je-Won Kang
IPC: G06V10/75 , G06N3/08 , G06N3/04 , G06V10/82 , G06F18/214
CPC classification number: G06V10/751 , G06F18/214 , G06N3/04 , G06N3/08 , G06V10/82
Abstract: Disclosed herein are a method and apparatus for compressing learning parameters for training of a deep-learning model and transmitting the compressed parameters in a distributed processing environment. Multiple electronic devices in the distributed processing system perform training of a neural network. By performing training, parameters are updated. The electronic device may share the updated parameter thereof with additional electronic devices. In order to efficiently share the parameter, the residual of the parameter is provided to the additional electronic devices. When the residual of the parameter is provided, the additional electronic devices update the parameter using the residual of the parameter.
-
公开(公告)号:US11412225B2
公开(公告)日:2022-08-09
申请号:US16585658
申请日:2019-09-27
Inventor: Joo-Young Lee , Seung-Hyun Cho , Seung-Kwon Beack , Hyunsuk Ko , Youn-Hee Kim , Jong-Ho Kim , Jin-Wuk Seok , Woong Lim , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/13 , H04N19/184 , H04N19/196 , H04N19/149
Abstract: Disclosed herein is a context-adaptive entropy model for end-to-end optimized image compression. The entropy model exploits two types of contexts. The two types of contexts are a bit-consuming context and a bit-free context, respectively, and these contexts are classified depending on the corresponding context requires the allocation of additional bits. Based on these contexts, the entropy model may more accurately estimate the distribution of each latent representation using a more generalized form of entropy models, thus improving compression performance.
-
公开(公告)号:US12190548B2
公开(公告)日:2025-01-07
申请号:US17482067
申请日:2021-09-22
Inventor: Ji-Hoon Do , Hyoung-Jin Kwon , Dong-Hyun Kim , Youn-Hee Kim , Joo-Young Lee , Se-Yoon Jeong , Jin-Soo Choi , Tae-Jin Lee , Jee-Hoon Kim , Dong-Gyu Sim , Seoung-Jun Oh , Min-Hun Lee , Yun-Gu Lee , Han-Sol Choi , Kwang-Hwan Kim
IPC: G06T9/00 , G06N3/02 , G06T3/4046 , G06V10/40
Abstract: There are provided an apparatus, method, system, and recording medium for performing selective encoding/decoding on feature information. An encoding apparatus generates residual feature information. The encoding apparatus transmits the residual feature information to a decoding apparatus through a residual feature map bitstream. The residual feature information is the difference between feature information extracted from an original image and feature information extracted from a reconstructed image. Feature information of the reconstructed image is generated using the reconstructed image. Reconstructed feature information is generated using the feature information of the reconstructed image and reconstructed residual feature information.
-
公开(公告)号:US12154302B2
公开(公告)日:2024-11-26
申请号:US17542002
申请日:2021-12-03
Inventor: Joo-Young Lee , Se-Yoon Jeong , Hyoung-Jin Kwon , Dong-Hyun Kim , Youn-Hee Kim , Jong-Ho Kim , Ji-Hoon Do , Jin-Soo Choi , Tae-Jin Lee
IPC: G06T9/00
Abstract: Disclosed herein are a method, an apparatus and a storage medium for image encoding/decoding using a binary mask. An encoding method includes generating a latent vector using an input image, generating a selected latent vector component set using a binary mask, and generating a main bitstream by performing entropy encoding on the selected latent vector component set. A decoding method includes generating a selected latent vector component set including one or more selected latent vector components by performing entropy decoding on a main bitstream and generating the latent vector in which the one or more selected latent vector components are relocated by relocating the selected latent vector component set in the latent vector.
-
8.
公开(公告)号:US11769276B2
公开(公告)日:2023-09-26
申请号:US17192480
申请日:2021-03-04
Inventor: Joo-Young Lee , Se-Yoon Jeong , Hyoung-Jin Kwon , Dong-Hyun Kim , Youn-Hee Kim , Jong-Ho Kim , Tae-Jin Lee , Jin-Soo Choi
IPC: G06T9/00 , G06T3/40 , G06V10/764 , G06V10/82 , G06V10/44
CPC classification number: G06T9/002 , G06T3/4046 , G06V10/454 , G06V10/764 , G06V10/82
Abstract: An encoding apparatus extracts features of an image by applying multiple padding operations and multiple downscaling operations to an image represented by data and transmits feature information indicating the features to a decoding apparatus. The multiple padding operations and the multiple downscaling operations are applied to the image in an order in which one padding operation is applied and thereafter one downscaling operation corresponding to the padding operation is applied. A decoding method receives feature information from an encoding apparatus, and generates a reconstructed image by applying multiple upscaling operations and multiple trimming operations to an image represented by the feature information. The multiple upscaling operations and the multiple trimming operations are applied to the image in an order in which one upscaling operation is applied and thereafter one trimming operation corresponding to the upscaling operation is applied.
-
公开(公告)号:US11205257B2
公开(公告)日:2021-12-21
申请号:US16697585
申请日:2019-11-27
Inventor: Se-Yoon Jeong , Dae-Yeol Lee , Seung-Hyun Cho , Hyunsuk Ko , Youn-Hee Kim , Jong-Ho Kim , Jin-Wuk Seok , Joo-Young Lee , Woong Lim , Hui-Yong Kim , Jin-Soo Choi
Abstract: Disclosed herein are a method and apparatus for measuring video quality based on a perceptually sensitive region. The quality of video may be measured based on a perceptually sensitive region and a change in the perceptually sensitive region. The perceptually sensitive region includes a spatial perceptually sensitive region, a temporal perceptually sensitive region, and a spatio-temporal perceptually sensitive region. Perceptual weights are applied to a detected perceptually sensitive region and a change in the detected perceptually sensitive region. Distortion is calculated based on the perceptually sensitive region and the change in the perceptually sensitive region, and a result of quality measurement for a video is generated based on the calculated distortion.
-
公开(公告)号:US10827173B2
公开(公告)日:2020-11-03
申请号:US16188587
申请日:2018-11-13
Inventor: Woong Lim , Seung-Hyun Cho , Joo-Young Lee , Youn-Hee Kim , Jin-Wuk Seok , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/124 , H04N19/70
Abstract: Disclosed herein are a video decoding method and apparatus and a video encoding method and apparatus. In quantization and dequantization, multiple quantization methods and multiple dequantization methods may be used. The multiple quantization methods include a variable-rate step quantization method and a fixed-rate step quantization method. The variable-rate step quantization method may be a quantization method in which an increment in a quantization step depending on an increase in a value of a quantization parameter by 1 is not fixed. The fixed-rate step quantization method may be a quantization method in which the increment in the quantization step depending on the increase of the value of the quantization parameter by 1 is fixed.
-
-
-
-
-
-
-
-
-