公开(公告)号：US20220198628A1

公开(公告)日：2022-06-23

申请号：US17554827

申请日：2021-12-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh DINH ,  Kyonghwan JIN ,  Kwangpyo CHOI

IPC: G06T5/50 ,  G06V10/74 ,  G06T5/20 ,  G06V10/82 ,  G06V10/77 ,  H04N19/85 ,  G06N3/04

Abstract: An image processing apparatus, including a memory configured to store one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to: identify, in a previous frame, a prediction sample corresponding to a current sample of a current frame, generate a prediction frame for the current frame by changing a sample value of a collocated sample of the previous frame, wherein the collocated sample of the previous frame is collocated with the current sample, according to a sample value of the prediction sample, derive a weight by comparing a sample value of the current sample with the sample value of the prediction sample, apply the weight to a collocated sample of the prediction frame, wherein the collocated sample of the prediction frame is collocated with the current sample, to obtain a weighted prediction frame, and obtain a current output frame by processing the current frame and the weighted prediction frame through a neural network comprising a convolution layer.

公开(公告)号：US20210385502A1

公开(公告)日：2021-12-09

申请号：US17286743

申请日：2019-09-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh DINH ,  Youngo PARK ,  Kwangpyo CHOI

IPC: H04N19/85 ,  H04N19/132 ,  H04N19/184 ,  G06N3/02

Abstract: Proposed are a method and apparatus for evaluating the quality of an image, the method including obtaining blocks each having a predetermined size by splitting a target image for evaluating a quality and a reference image that is to be compared with the target image, determining sensitivity information and quality assessment information of each of the blocks by inputting the blocks to a video quality assessment network, and determining a final image quality assessment score of the target image by combining the pieces of quality assessment information of the blocks with each other, based on the pieces of sensitivity information of the blocks.

公开(公告)号：US20210377554A1

公开(公告)日：2021-12-02

申请号：US17333541

申请日：2021-05-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Youngo PARK ,  Chaeeun LEE ,  Kwangpyo CHOI

IPC: H04N19/44 ,  H04N19/124 ,  H04N19/85 ,  G06N3/04

Abstract: An artificial intelligence (AI) decoding apparatus includes at least one processor configured to execute one or more instructions to: obtain a second image corresponding to a first image by performing first decoding on image data included in a main bitstream, obtain AI upscaling activation flag information included in AI data of a sub-bitstream, determine whether to perform AI upscaling on the second image, based on the AI upscaling activation flag information, when it is determined that AI upscaling is to be performed on the second image, obtain a third image by performing AI upscaling on the second image, through an upscaling deep neural network (DNN) set according to upscaling DNN information, the upscaling DNN information selected from among a plurality of pieces of pre-stored upscaling DNN information based on at least a portion of the image data and/or at least a portion of AI sub-data.

公开(公告)号：US20210295468A1

公开(公告)日：2021-09-23

申请号：US17331162

申请日：2021-05-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo PARK ,  Kwangpyo CHOI ,  Yumi SOHN ,  Sungchan KIM ,  Myungjin EOM

IPC: G06T3/40 ,  G06N3/08 ,  H04N19/85 ,  G06T9/00

Abstract: Provided is a decoding apparatus including: a communication interface configured to receive Al encoding data generated as a result of artificial intelligence (Al) down-scaling and first encoding of an original image; a processor configured to divide the Al encoding data into image data and Al data; and an input/output (I/O) device, wherein the processor is further configured to: obtain a second image by performing first decoding on a first image obtained by performing Al down-scaling on the original image, based on the image data; and control the I/O device to transmit the second image and the Al data to an external apparatus. In some embodiments, the external apparatus performs an Al upscaling of the second image using the Al data, and displays the resulting third image.

公开(公告)号：US20210152799A1

公开(公告)日：2021-05-20

申请号：US17097320

申请日：2020-11-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu PARK ,  Junghye MIN ,  Kwangpyo CHOI ,  Kyungah KIM ,  Tejas NAIR ,  Yumi SOHN

IPC: H04N9/68 ,  G06T5/00 ,  G06N3/04 ,  H04N9/73

Abstract: A display apparatus and a controlling method thereof are disclosed. The display apparatus includes: a memory storing one or more instructions; and a processor configured to execute the stored one or more instructions to: obtain encoded data of a first digital image and artificial intelligence (AI) meta-information indicating a specification of a deep neural network (DNN), obtain a second digital image corresponding to the first digital image by decoding the encoded data, obtain a light signal converted from the second digital image according to a previously determined electro-optical transfer function (EOTF), and obtain a display signal by processing the light signal by using an opto-optical transfer function (OOTF) and a high dynamic range (HDR) DNN set according to the AI meta-information.

公开(公告)号：US20210150287A1

公开(公告)日：2021-05-20

申请号：US17100212

申请日：2020-11-20

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Sangwook BAEK ,  Minsu CHEON ,  Yongsup PARK ,  Jaeyeon PARK ,  Kwangpyo CHOI

IPC: G06K9/62 ,  H04N19/136 ,  H04N19/30 ,  G06N7/00

Abstract: An image providing apparatus configured to generate, by using a first artificial intelligence (AI) network, AI metadata including class information and at least one class map, in which the class information includes at least one class corresponding to a type of an object among a plurality of predefined objects included in a first image and the at least one class map indicates a region corresponding to each class in the first image, generate an encoded image by encoding the first image, and output the encoded image and the AI metadata through the output interface.

公开(公告)号：US20210056665A1

公开(公告)日：2021-02-25

申请号：US17080501

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo PARK ,  Yumi SOHN ,  Myungjin EOM ,  Kwangpyo CHOI

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US20210051331A1

公开(公告)日：2021-02-18

申请号：US16967041

申请日：2019-04-03

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Akhil KONDA ,  Anubhav SINGH ,  Sri Nitchith AKULA ,  Chirag Mahesh KUMAR PUJARA ,  Raj Narayana GADDE ,  Amith DSOUZA ,  Ramkumaar KK ,  Nishant SHARMA ,  Woongil CHOI ,  Kwangpyo CHOI

IPC: H04N19/14 ,  H04N19/117 ,  H04N19/15 ,  H04N19/17 ,  H04N19/46 ,  H04N19/597 ,  H04N21/234

Abstract: Provided are a method and an apparatus for determining an optimal rotation angle during compression of a spherical multimedia content where the processor may receive first multimedia content corresponding to the spherical multimedia content, generate a plurality of second multimedia contents based on the first multimedia content by rotating the first multimedia content to a plurality of rotation angles, perform an edge analysis on each of the plurality of the second multimedia contents, identify the number of edges aligned to one of a vertical axis or a horizontal axis based on the edge analysis, select second multimedia content with the maximum number of edges, and determine an optimal rotation angle.

公开(公告)号：US20210042882A1

公开(公告)日：2021-02-11

申请号：US17079773

申请日：2020-10-26

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok LEE ,  Sunyoung JEON ,  Kwangpyo CHOI ,  Minseok CHOI ,  Quockhanh DINH ,  Youngo PARK

IPC: G06T3/40 ,  G06T9/00 ,  G06N3/08 ,  H04N19/85 ,  G06N20/10

Abstract: An artificial intelligence (AI) decoding apparatus includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions, to obtain image data corresponding to a first image that is encoded, obtain a second image corresponding to the first image by decoding the obtained image data, determine whether to perform AI up-scaling of the obtained second image, based on the AI up-scaling of the obtained second image being determined to be performed, obtain a third image by performing the AI up-scaling of the obtained second image through an up-scaling deep neural network (DNN), and output the obtained third image, and based on the AI up-scaling of the obtained second image being determined to be not performed, output the obtained second image.

公开(公告)号：US20200219292A1

公开(公告)日：2020-07-09

申请号：US16821609

申请日：2020-03-17

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan KIM ,  Jongseok LEE ,  Sunyoung JEON ,  Kwangpyo CHOI ,  Minseok CHOI ,  Quockhanh DINH ,  Youngo PARK

IPC: G06T9/00 ,  G06T3/40

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.