公开(公告)号：US10825203B2

公开(公告)日：2020-11-03

申请号：US16570057

申请日：2019-09-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jaehwan Kim ,  Jongseok Lee ,  Sunyoung Jeon ,  Kwangpyo Choi ,  Minseok Choi ,  Quockhanh Dinh ,  Youngo Park

IPC: G06T9/00 ,  G06T3/40 ,  H04N19/85

Abstract: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

公开(公告)号：US10825140B1

公开(公告)日：2020-11-03

申请号：US16826851

申请日：2020-03-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Heechul Yang ,  Jongseok Lee ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/40 ,  G06N3/04 ,  G06F7/544

Abstract: Provided are methods and apparatus related to Artificial Intelligence (AI) downscaling and upscaling and techniques related to reducing artifact problems. Some embodiments include down-scaling an original image through a Deep Neural Network (DNN); generating, from the original image and based on frequency transform coefficients, artifact information representing a region in the first image including an artifact in the first image. Post-processing may be performed based on the artifact information to change pixels in the first image, thus reducing the effect of artifacts.

公开(公告)号：US10819993B2

公开(公告)日：2020-10-27

申请号：US16860563

申请日：2020-04-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu Park ,  Youngo Park ,  Jongseok Lee ,  Yumi Sohn ,  Myungjin Eom

IPC: H04N19/146 ,  H04N19/172 ,  H04N19/30 ,  H04N19/42 ,  H04N19/70

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US10817990B1

公开(公告)日：2020-10-27

申请号：US16850411

申请日：2020-04-16

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Heechul Yang ,  Jongseok Lee ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T3/40 ,  G06N3/04 ,  G06F7/544

Abstract: Provided are methods and apparatus related to Artificial Intelligence (AI) downscaling and upscaling and techniques related to reducing artifact problems. Some embodiments include down-scaling an original image through a Deep Neural Network (DNN); generating, from the original image and based on frequency transform coefficients, artifact information representing a region in the first image including an artifact in the first image. Post-processing may be performed based on the artifact information to change pixels in the first image, thus reducing the effect of artifacts.

公开(公告)号：US10817988B2

公开(公告)日：2020-10-27

申请号：US16824486

申请日：2020-03-19

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US10817987B2

公开(公告)日：2020-10-27

申请号：US16822665

申请日：2020-03-18

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Youngo Park ,  Yumi Sohn ,  Myungjin Eom ,  Kwangpyo Choi

IPC: G06T3/40 ,  H04L29/06 ,  H04N19/85

Abstract: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.

公开(公告)号：US20200177898A1

公开(公告)日：2020-06-04

申请号：US16743613

申请日：2020-01-15

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Pilkyu PARK ,  Youngo Park ,  Jongseok Lee ,  Yumi Sohn ,  Myungjin Eom

IPC: H04N19/30 ,  H04N19/146 ,  H04N19/70 ,  H04N19/42 ,  H04N19/172

Abstract: Provided is a computer-recordable recording medium having stored thereon a video file including artificial intelligence (AI) encoding data, wherein the AI encoding data includes: image data including encoding information of a low resolution image generated by AI down-scaling a high resolution image; and AI data about AI up-scaling of the low resolution image reconstructed according to the image data, wherein the AI data includes: AI target data indicating whether AI up-scaling is to be applied to at least one frame; and AI supplementary data about up-scaling deep neural network (DNN) information used for AI up-scaling of the at least one frame from among a plurality of pieces of pre-set default DNN configuration information, when AI up-scaling is applied to the at least one frame.

公开(公告)号：US12132931B2

公开(公告)日：2024-10-29

申请号：US17876043

申请日：2022-07-28

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok Lee ,  Youngo Park ,  Pilkyu Park ,  Yumi Sohn

IPC: H04N19/59 ,  G06N3/04 ,  G06T3/4046 ,  H04N19/172 ,  H04N19/61

CPC classification number: H04N19/59 ,  G06N3/04 ,  G06T3/4046 ,  H04N19/172 ,  H04N19/61

Abstract: Methods and apparatuses for image encoding and image decoding are provided. The image decoding method includes: obtaining deep neural network (DNN) update permission information indicating whether one or more pieces of DNN setting information are updated; based on the DNN update permission information indicating that the one or more pieces of the DNN setting information are updated, obtaining DNN update information necessary for determining one or more pieces of the DNN setting information that are updated; determining the one or more pieces of the updated DNN setting information according to the DNN update information; and obtaining a third image by performing artificial intelligence (AI) up-scaling on a second image according to the one or more pieces of the updated DNN setting information.

公开(公告)号：US12096131B2

公开(公告)日：2024-09-17

申请号：US17512338

申请日：2021-10-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Quockhanh Dinh ,  Kyonghwan Jin ,  Youngo Park ,  Kwangpyo Choi

IPC: G06T7/90 ,  G06F18/214 ,  G06F18/40 ,  G06N20/00 ,  G06T3/4015 ,  G06T3/4038 ,  G06T5/20 ,  G06T5/70 ,  H04N23/81 ,  H04N23/90

CPC classification number: H04N23/81 ,  G06F18/2148 ,  G06F18/40 ,  G06N20/00 ,  G06T3/4015 ,  G06T3/4038 ,  G06T5/20 ,  G06T5/70 ,  G06T7/90 ,  H04N23/90 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20182

Abstract: A method includes obtaining, by a second processor of the electronic device, from a first processor of the electronic device, a control signal for obtaining image data, loading any one learning model of at least one learning model into a memory, obtaining, by using the camera module, raw image data of the object, from light reflected from the object, the raw image data being configured to have a specified color array consisting of a plurality of colors with respect to a plurality of pixels, obtaining, by using the loaded any one learning model, a color data set with respect to the plurality of pixels from the obtained raw image data, the color data set including a plurality of pieces of color data classified according to the plurality of colors, and obtaining the noise-reduced image data of the object by using the obtained color data set.

公开(公告)号：US20240054602A1

公开(公告)日：2024-02-15

申请号：US17893754

申请日：2022-08-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jongseok Lee ,  Pilkyu Park ,  Kwangpyo Choi ,  Jaehwan Kim ,  Youngo Park ,  Chaeeun Lee

IPC: G06T3/40 ,  G06V10/77 ,  G06V10/56 ,  G06T7/00

CPC classification number: G06T3/4046 ,  G06V10/7715 ,  G06V10/56 ,  G06T7/0002 ,  G06T2207/30168 ,  G06T2207/20081

Abstract: An electronic apparatus includes: a display; and a processor configured to: obtain a first image, identify an application used to obtain the first image, select neural network setting information corresponding to the identified application from among a plurality of pieces of neural network setting information, obtain a second image by artificial intelligence (AI)-upscaling the first image by using an upscaling neural network to which the selected neural network setting information is applied, and output the obtained second image via the display.