公开(公告)号：US09860546B2

公开(公告)日：2018-01-02

申请号：US15363869

申请日：2016-11-29

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ,  KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Jong Ho Kim ,  Hui Yong Kim ,  Se Yoon Jeong ,  Sung Chang Lim ,  Ha Hyun Lee ,  Jin Ho Lee ,  Suk Hee Cho ,  Jin Soo Choi ,  Jin Woong Kim ,  Chie Teuk Ahn ,  Mun Churl Kim ,  Bum Shik Lee

IPC: H04N19/18 ,  H04N19/44 ,  H04N19/70 ,  H04N19/46 ,  H04N19/60 ,  H04N19/593 ,  H04N19/64

CPC classification number: H04N19/44 ,  H04N19/18 ,  H04N19/46 ,  H04N19/593 ,  H04N19/60 ,  H04N19/64 ,  H04N19/70

Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.

公开(公告)号：US09838722B2

公开(公告)日：2017-12-05

申请号：US15258627

申请日：2016-09-07

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY ,  KOREAN BROADCASTING SYSTEM

Inventor： Mun Churl Kim ,  Bum Shik Lee ,  Jae Il Kim ,  Chang Seob Park ,  Sang Jin Hahm ,  In Joon Cho ,  Keun Sik Lee ,  Byung Sun Kim

IPC: H04N19/103 ,  H04N19/61 ,  H04N19/122 ,  H04N19/13 ,  H04N19/124 ,  H04N19/159 ,  H04N19/80 ,  H04N19/86 ,  H04N19/176 ,  H04N19/14 ,  H04N19/117 ,  H04N19/172 ,  H04N19/174 ,  H04N19/182

CPC classification number: H04N19/86 ,  H04N19/103 ,  H04N19/117 ,  H04N19/122 ,  H04N19/124 ,  H04N19/13 ,  H04N19/14 ,  H04N19/159 ,  H04N19/172 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/61 ,  H04N19/80

Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.

公开(公告)号：US09838721B2

公开(公告)日：2017-12-05

申请号：US15258593

申请日：2016-09-07

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY ,  KOREAN BROADCASTING SYSTEM

Inventor： Mun Churl Kim ,  Bum Shik Lee ,  Jae Il Kim ,  Chang Seob Park ,  Sang Jin Hahm ,  In Joon Cho ,  Keun Sik Lee ,  Byung Sun Kim

IPC: H04N19/103 ,  H04N19/61 ,  H04N19/122 ,  H04N19/13 ,  H04N19/124 ,  H04N19/159 ,  H04N19/80 ,  H04N19/86 ,  H04N19/176 ,  H04N19/14 ,  H04N19/117 ,  H04N19/172 ,  H04N19/174 ,  H04N19/182

CPC classification number: H04N19/86 ,  H04N19/103 ,  H04N19/117 ,  H04N19/122 ,  H04N19/124 ,  H04N19/13 ,  H04N19/14 ,  H04N19/159 ,  H04N19/172 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/61 ,  H04N19/80

Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.

公开(公告)号：US09838720B2

公开(公告)日：2017-12-05

申请号：US15258518

申请日：2016-09-07

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY ,  KOREAN BROADCASTING SYSTEM

Inventor： Mun Churl Kim ,  Bum Shik Lee ,  Jae Il Kim ,  Chang Seob Park ,  Sang Jin Hahm ,  In Joon Cho ,  Keun Sik Lee ,  Byung Sun Kim

IPC: H04N19/103 ,  H04N19/61 ,  H04N19/122 ,  H04N19/13 ,  H04N19/124 ,  H04N19/159 ,  H04N19/80 ,  H04N19/86 ,  H04N19/176 ,  H04N19/14 ,  H04N19/117 ,  H04N19/172 ,  H04N19/174 ,  H04N19/182

CPC classification number: H04N19/86 ,  H04N19/103 ,  H04N19/117 ,  H04N19/122 ,  H04N19/124 ,  H04N19/13 ,  H04N19/14 ,  H04N19/159 ,  H04N19/172 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/61 ,  H04N19/80

Abstract: Disclosed are a method of encoding a division block in video encoding and a method of decoding a division block in video decoding. An input picture is divided into encoding unit blocks. The encoding unit blocks are divided into sub-blocks. The sub-blocks are encoded by selectively using at least one of intra prediction encoding and inter prediction encoding. A decoding process is performed through a reverse process of the encoding method. When pixel values of an encoding unit block are encoded in video encoding, the flexibility in selecting an encoding mode is increased and the efficiency of encoding is increased.

公开(公告)号：US09432697B2

公开(公告)日：2016-08-30

申请号：US15049854

申请日：2016-02-22

Applicant: Electronics and Telecommunications Research Institute ,  Kwangwoon University Industry-Academic Collaboration Foundation ,  University-Industry Cooperation Group of Kyung Hee University ,  Korea Advanced Institute of Science and Technology

Inventor： Sung-Chang Lim ,  Ha Hyun Lee ,  Hui Yong Kim ,  Se Yoon Jeong ,  Suk Hee Cho ,  Hae Chul Choi ,  Jong Ho Kim ,  Jin Ho Lee ,  Jin Soo Choi ,  Jin Woo Hong ,  Dong Gyu Sim ,  Seoung Jun Oh ,  Gwang Hoon Park ,  Mun Churl Kim ,  Neung Joo Hwang ,  Sea Nae Park

IPC: H04N7/26 ,  H04N19/625 ,  H04N19/50 ,  H04N19/124 ,  H04N19/176 ,  H04N19/60 ,  H04N19/12 ,  H04N19/14 ,  H04N19/18 ,  H04N19/182 ,  H04N19/107 ,  H04N19/11 ,  H04N19/119 ,  H04N19/122 ,  H04N19/13 ,  H04N19/139 ,  H04N19/159 ,  H04N19/44 ,  H04N19/52 ,  H04N19/55 ,  H04N19/593 ,  H04N19/615 ,  H04N19/91

CPC classification number: H04N19/122 ,  H04N19/107 ,  H04N19/11 ,  H04N19/119 ,  H04N19/12 ,  H04N19/124 ,  H04N19/13 ,  H04N19/139 ,  H04N19/14 ,  H04N19/159 ,  H04N19/176 ,  H04N19/18 ,  H04N19/182 ,  H04N19/44 ,  H04N19/50 ,  H04N19/52 ,  H04N19/55 ,  H04N19/593 ,  H04N19/60 ,  H04N19/615 ,  H04N19/625 ,  H04N19/91

Abstract: Provided is a video encoding apparatus, including a signal separator to separate a differential image block into a first domain and a second domain, based on a boundary line included in the differential image block, the differential image block indicating a difference between an original image and a prediction image with respect to the original image, a transform encoder to perform a transform encoding with respect to the first domain using a discrete cosine transform (DCT), a quantization unit to quantize an output of the transform encoding unit in a frequency domain, a space domain quantization unit to quantize the second domain in a space domain, and an entropy encoder to perform an entropy encoding using outputs of the quantization unit and the space domain quantization unit.

公开(公告)号：US11790500B2

公开(公告)日：2023-10-17

申请号：US17482433

申请日：2021-09-23

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Mun Churl Kim ,  Soo Ye Kim ,  Dae Eun Kim

IPC: G06T5/00 ,  G06F17/11 ,  G06N3/02 ,  G06N3/08 ,  G06T5/50

CPC classification number: G06T5/009 ,  G06F17/11 ,  G06N3/02 ,  G06N3/08 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20208

Abstract: In this invention, we propose a convolutional neural network (CNN) based architecture designed for the ITM to HDR consumer displays, called ITM-CNN, and its training strategy for enhancing the performance based on image decomposition using the guided filter. We demonstrate the benefits of decomposing the image by experimenting with various architectures and also compare the performance for different training strategies. To the best of our knowledge, this invention first presents the ITM problem using CNNs for HDR consumer displays, where the network is trained to restore lost details and local contrast. Our ITM-CNN can readily up-convert LDR images for direct viewing on an HDR consumer medium, and is a very powerful means to solve the lack of HDR video contents with legacy LDR videos.

公开(公告)号：US11627316B2

公开(公告)日：2023-04-11

申请号：US17376162

申请日：2021-07-15

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Mun Churl Kim

IPC: H04N11/02 ,  H04N19/117 ,  H04N19/82 ,  G06F17/15 ,  H04N19/176 ,  G06N3/04 ,  H04N19/124

Abstract: Disclosed according to one exemplary embodiment includes not limited to: a filtering unit configured to generate filtering information by filtering a residual image corresponding to a difference between an original image and a prediction image; an inverse filtering unit configured to generate inverse filtering information by inversely filtering the filtering information; an estimator configured to generate the prediction image based on the original image and reconstruction information; a CNN-based in-loop filter configured to receive the inverse filtering information and the prediction image and to output the reconstruction information; and an encoder configured to perform encoding based on the filtering information and information of the prediction image, and wherein the CNN-based in-loop filter is trained for each of the plurality of artefact sections according to an artefact value or for each of the plurality of quantization parameter sections according to a quantization parameter.

公开(公告)号：US11223839B2

公开(公告)日：2022-01-11

申请号：US16857758

申请日：2020-04-24

Applicant: Electronics and Telecommunications Research Institute ,  KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Jong Ho Kim ,  Hui Yong Kim ,  Se Yoon Jeong ,  Sung Chang Lim ,  Ha Hyun Lee ,  Jin Ho Lee ,  Suk Hee Cho ,  Jin Soo Choi ,  Jin Woong Kim ,  Chie Teuk Ahn ,  Mun Churl Kim ,  Bum Shik Lee

IPC: H04N19/593 ,  H04N19/60 ,  H04N19/18 ,  H04N19/44 ,  H04N19/70 ,  H04N19/46 ,  H04N19/64

Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.

公开(公告)号：US11057585B2

公开(公告)日：2021-07-06

申请号：US16960917

申请日：2018-12-12

Applicant: Korea Advanced Institute of Science and Technology

Inventor： Mun Churl Kim ,  Yong Woo Kim ,  Jae Seok Choi

IPC: H04N7/01 ,  H04N19/124 ,  G06N3/08 ,  G06T3/40 ,  G06T1/20 ,  G06N3/04

Abstract: Disclosed are an image processing method and device using a line-wise operation. The image processing device, according to one embodiment, comprises: a receiver for receiving two-dimensional pixel information; at least one first line buffer for outputting the two-dimensional pixel information into a line-wise data line; an operator for performing a convolution operation on the basis of the data line data; and at least one second line buffer for outputting the data line on which the operation has been performed.

公开(公告)号：US10560709B2

公开(公告)日：2020-02-11

申请号：US16134579

申请日：2018-09-18

Applicant: Electronics and Telecommunications Research Institute ,  KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Jong Ho Kim ,  Hui Yong Kim ,  Se Yoon Jeong ,  Sung Chang Lim ,  Ha Hyun Lee ,  Jin Ho Lee ,  Suk Hee Cho ,  Jin Soo Choi ,  Jin Woong Kim ,  Chie Teuk Ahn ,  Mun Churl Kim ,  Bum Shik Lee

IPC: H04N19/70 ,  H04N19/60 ,  H04N19/44 ,  H04N19/46 ,  H04N19/593 ,  H04N19/18 ,  H04N19/64

Abstract: Disclosed decoding method of the intra prediction mode comprises the steps of: determining whether an intra prediction mode of a present prediction unit is the same as a first candidate intra prediction mode or as a second candidate intra prediction mode on the basis of 1-bit information; and determining, among said first candidate intra prediction mode and said second candidate intra prediction mode, which candidate intra prediction mode is the same as the intra prediction mode of said present prediction unit on the basis of additional 1-bit information, if the intra prediction mode of the present prediction unit is the same as at least either the first candidate intra prediction mode or the second candidate intra prediction mode, and decoding the intra prediction mode of the present prediction unit.