-
公开(公告)号:US11477468B2
公开(公告)日:2022-10-18
申请号:US16760609
申请日:2018-10-30
Inventor: Joo-Young Lee , Seung-Hyun Cho , Youn-Hee Kim , Jin-Wuk Seok , Woong Lim , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N7/12 , H04N19/42 , H04N19/136 , G06N3/04 , G06N3/08
Abstract: A method and apparatus for image compression using a latent variable are provided. The multiple components of the latent variable may be sorted in order of importance. Through sorting, when the feature information of only some of the multiple components is used, the quality of a reconstructed image may be improved. In order to generate a latent variable, the components of which are sorted in order of importance, learning may be performed in various manners. Also, less important information may be eliminated from the latent variable, and processing, such as quantization, may be applied to the latent variable. Through elimination and processing, the amount of data for the latent variable may be reduced.
-
公开(公告)号:US11166014B2
公开(公告)日:2021-11-02
申请号:US16772443
申请日:2018-12-13
Inventor: Seung-Hyun Cho , Joo-Young Lee , Youn-Hee Kim , Jin-Wuk Seok , Woong Lim , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/105 , H04N19/159 , H04N19/176 , H04N19/85
Abstract: Disclosed herein are a method and apparatus for video decoding and a method and apparatus for video encoding. A prediction block for a target block is generated by predicting the target block using a prediction network, and a reconstructed block for the target block is generated based on the prediction block and a reconstructed residual block. The prediction network includes an intra-prediction network and an inter-prediction network and uses a spatial reference block and/or a temporal reference block when it performs prediction. For learning in the prediction network, a loss function is defined, and learning in the prediction network is performed based on the loss function.
-
公开(公告)号:US12206894B2
公开(公告)日:2025-01-21
申请号:US17479811
申请日:2021-09-20
Inventor: Dong-Hyun Kim , Ji-Hoon Do , Youn-Hee Kim , Se-Yoon Jeong , Hyoung-Jin Kwon , Jong-Ho Kim , Joo-Young Lee , Jin-Soo Choi , Tae-Jin Lee
IPC: H04N19/593 , G06N3/04 , H04N19/11 , H04N19/136 , H04N19/176 , H04N19/184 , H04N19/436
Abstract: Disclosed herein are a method, an apparatus, and a storage medium for image encoding/decoding. An intra-prediction mode for the target block is derived, and intra-prediction for the target block that uses the derived intra-prediction mode is performed. The intra-prediction mode for the target block is derived using an artificial neural network, and an MPM list for the target block is derived using information about the target block, pieces of information about blocks adjacent to the target block, and the artificial neural network. The artificial neural network outputs one or more available intra-prediction modes. Further, the artificial neural network outputs match probabilities for one or more candidate intra-prediction modes, and each of the match probabilities for the candidate intra-prediction modes indicates a probability that the corresponding candidate intra-prediction mode matches the intra-prediction mode for the target block.
-
4.
公开(公告)号:US20210279912A1
公开(公告)日:2021-09-09
申请号:US17192480
申请日:2021-03-04
Inventor: Joo-Young Lee , Se-Yoon Jeong , Hyoung-Jin Kwon , Dong-Hyun Kim , Youn-Hee Kim , Jong-Ho Kim , Tae-Jin Lee , Jin-Soo Choi
Abstract: An encoding apparatus extracts features of an image by applying multiple padding operations and multiple downscaling operations to an image represented by data and transmits feature information indicating the features to a decoding apparatus. The multiple padding operations and the multiple downscaling operations are applied to the image in an order in which one padding operation is applied and thereafter one downscaling operation corresponding to the padding operation is applied. A decoding method receives feature information from an encoding apparatus, and generates a to reconstructed image by applying multiple upscaling operations and multiple trimming operations to an image represented by the feature information. The multiple upscaling operations and the multiple trimming operations are applied to the image in an order in which one upscaling operation is applied and thereafter one trimming operation corresponding to the upscaling operation is applied.
-
5.
公开(公告)号:US11019355B2
公开(公告)日:2021-05-25
申请号:US16374601
申请日:2019-04-03
Inventor: Seung-Hyun Cho , Je-Won Kang , Na-Young Kim , Jung-Kyung Lee , Joo-Young Lee , Hyunsuk Ko , Youn-Hee Kim , Jong-Ho Kim , Jin-Wuk Seok , Dae-Yeol Lee , Woong Lim , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/513 , G06N20/00 , H04N19/132 , H04N19/105
Abstract: An inter-prediction method and apparatus uses a reference frame generated based on deep learning. In the inter-prediction method and apparatus, a reference frame is selected, and a virtual reference frame is generated based on the selected reference frame. A reference picture list is configured to include the generated virtual reference frame, and inter prediction for a target block is performed based on the virtual reference frame. The virtual reference frame may be generated based on a deep-learning network architecture, and may be generated based on video interpolation and/or video extrapolation that use the selected reference frame.
-
6.
公开(公告)号:US11665363B2
公开(公告)日:2023-05-30
申请号:US17535926
申请日:2021-11-26
Inventor: Hyoung-Jin Kwon , Ji-Hoon Do , Dong-Hyun Kim , Youn-Hee Kim , Jong-Ho Kim , Joo-Young Lee , Se-Yoon Jeong , Jin-Soo Choi , Tae-Jin Lee , Jee-Hoon Kim , Dong-Gyu Sim , Seoung-Jun Oh , Min-Hun Lee , Yun-Gu Lee , Han-Sol Choi , Kwang-Hwan Kim
IPC: H04N19/503 , H04N19/11
CPC classification number: H04N19/503 , H04N19/11
Abstract: Disclosed herein are a method, apparatus, system, and computer-readable recording medium for image compression. An encoding apparatus performs preprocessing of feature map information, frame packing, frame classification, and encoding. A decoding apparatus performs decoding, frame depacking, and postprocessing in order to reconstruct feature map information. By encoding the feature map information, inter-prediction and intra-block prediction for a frame are performed. The encoding apparatus provides the decoding apparatus with a feature map information bitstream for reconstructing the feature map information along with an image information bitstream.
-
公开(公告)号:US11663476B2
公开(公告)日:2023-05-30
申请号:US16772557
申请日:2018-12-13
Inventor: Seung-Hyun Cho , Youn-Hee Kim , Jin-Wuk Seok , Joo-Young Lee , Woong Lim , Jong-Ho Kim , Dae-Yeol Lee , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi , Je-Won Kang
IPC: G06V10/75 , G06N3/08 , G06N3/04 , G06V10/82 , G06F18/214
CPC classification number: G06V10/751 , G06F18/214 , G06N3/04 , G06N3/08 , G06V10/82
Abstract: Disclosed herein are a method and apparatus for compressing learning parameters for training of a deep-learning model and transmitting the compressed parameters in a distributed processing environment. Multiple electronic devices in the distributed processing system perform training of a neural network. By performing training, parameters are updated. The electronic device may share the updated parameter thereof with additional electronic devices. In order to efficiently share the parameter, the residual of the parameter is provided to the additional electronic devices. When the residual of the parameter is provided, the additional electronic devices update the parameter using the residual of the parameter.
-
公开(公告)号:US11412225B2
公开(公告)日:2022-08-09
申请号:US16585658
申请日:2019-09-27
Inventor: Joo-Young Lee , Seung-Hyun Cho , Seung-Kwon Beack , Hyunsuk Ko , Youn-Hee Kim , Jong-Ho Kim , Jin-Wuk Seok , Woong Lim , Se-Yoon Jeong , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/13 , H04N19/184 , H04N19/196 , H04N19/149
Abstract: Disclosed herein is a context-adaptive entropy model for end-to-end optimized image compression. The entropy model exploits two types of contexts. The two types of contexts are a bit-consuming context and a bit-free context, respectively, and these contexts are classified depending on the corresponding context requires the allocation of additional bits. Based on these contexts, the entropy model may more accurately estimate the distribution of each latent representation using a more generalized form of entropy models, thus improving compression performance.
-
9.
公开(公告)号:US10484689B2
公开(公告)日:2019-11-19
申请号:US15015456
申请日:2016-02-04
Inventor: Jin-Wuk Seok , Myung-Seok Ki , Youn-Hee Kim , Hui-Yong Kim , Jin-Soo Choi
IPC: H04N19/147 , H04N19/103 , H04N19/176 , H04N19/15
Abstract: An apparatus and method perform rate-distortion optimization based on cost. The encoding apparatus selects an encoding mode to be used to encode a target block from among multiple modes and performs computation for rate-distortion optimization in the encoding mode. The encoding apparatus calculates a cost of at least one of the multiple modes in relation to the encoding of the target block, and selects the encoding mode from among the multiple modes, based on the cost.
-
10.
公开(公告)号:US12190548B2
公开(公告)日:2025-01-07
申请号:US17482067
申请日:2021-09-22
Inventor: Ji-Hoon Do , Hyoung-Jin Kwon , Dong-Hyun Kim , Youn-Hee Kim , Joo-Young Lee , Se-Yoon Jeong , Jin-Soo Choi , Tae-Jin Lee , Jee-Hoon Kim , Dong-Gyu Sim , Seoung-Jun Oh , Min-Hun Lee , Yun-Gu Lee , Han-Sol Choi , Kwang-Hwan Kim
IPC: G06T9/00 , G06N3/02 , G06T3/4046 , G06V10/40
Abstract: There are provided an apparatus, method, system, and recording medium for performing selective encoding/decoding on feature information. An encoding apparatus generates residual feature information. The encoding apparatus transmits the residual feature information to a decoding apparatus through a residual feature map bitstream. The residual feature information is the difference between feature information extracted from an original image and feature information extracted from a reconstructed image. Feature information of the reconstructed image is generated using the reconstructed image. Reconstructed feature information is generated using the feature information of the reconstructed image and reconstructed residual feature information.
-
-
-
-
-
-
-
-
-