公开(公告)号：US20240169651A1

公开(公告)日：2024-05-23

申请号：US18170589

申请日：2023-02-17

Applicant: Korea Advanced Institute of Science and Technology

Inventor： Junyong NOH ,  Sihun CHA ,  Kwanggyoon SEO ,  Amirsaman ASHTARI

IPC: G06T15/04 ,  G06T5/50 ,  G06T7/68 ,  G06T11/00 ,  G06T11/60 ,  G06V10/24 ,  G06V10/74

CPC classification number: G06T15/04 ,  G06T5/50 ,  G06T7/68 ,  G06T11/001 ,  G06T11/60 ,  G06V10/24 ,  G06V10/761 ,  G06T2207/20221

Abstract: There is provided an apparatus for generating a 3D object texture map. The apparatus may comprise: a memory; and a processor, wherein the processor is configured to: generate a partial texture image by mapping object information in an input image into a texture space; obtain a sampling image by inputting the partial texture image to a sampler network trained according to a curriculum for selecting at least one of a training partial texture image, an aligned partial image in which the training partial texture image is aligned in the texture space, or an augmented partial image augmented from the aligned partial image; obtain a blending mask and a refined image by inputting the sampling image to a refiner network; and generate a 3D object texture map by blending the sampling image and the refined image based on the blending mask.

公开(公告)号：US20230177693A1

公开(公告)日：2023-06-08

申请号：US17743448

申请日：2022-05-13

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong NOH ,  Jung Eun YOO ,  Kwanggyoon SEO ,  Sanghun PARK ,  Jaedong KIM ,  Dawon LEE

IPC: G06T7/11 ,  G06T15/20 ,  G06T7/62

CPC classification number: G06T7/11 ,  G06T15/205 ,  G06T7/62

Abstract: Provided is a method of framing a three dimensional (3D) target object for generation of a virtual camera layout. The method may include analyzing a reference video image to extract a framing rule for at least one reference object in the reference video image, generating a framing rule for at least one 3D target object using the framing rule for the at least one reference object in the reference video image, and using the framing rule for the at least one 3D target object for generation of a virtual camera layout.

公开(公告)号：US20230162387A1

公开(公告)日：2023-05-25

申请号：US17848813

申请日：2022-06-24

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong NOH ,  Hyunggoog SEO ,  Jaedong KIM ,  Kwanggyoon SEO ,  Bumki KIM

IPC: G06T7/73 ,  G06F3/01 ,  G06F3/0484 ,  G06F3/03

CPC classification number: G06T7/73 ,  G06F3/017 ,  G06F3/0484 ,  G06F3/03 ,  G06F3/012

Abstract: A method of assisting object registration in a smart home system including a plurality of objects is disclosed. The disclosed method may include allowing a user to select an object from among a plurality of objects, capturing a plurality of pointing gestures by allowing the user to perform the plurality of pointing gestures at the selected object, configuring a pointing ray using each of the plurality of captured pointing gestures, estimating a position of a nearest point extending from the plurality of pointing rays, and registering the estimated position of the nearest point as a position of the selected object.

公开(公告)号：US20240290356A1

公开(公告)日：2024-08-29

申请号：US18586642

申请日：2024-02-26

Applicant: Korea Advanced Institute of Science and Technology

Inventor： Junyong NOH ,  Dawon LEE ,  Jung Eun YOO ,  Kyungmin CHO ,  Bumki KIM ,  GyeongHun IM

IPC: G11B27/031 ,  G06V20/40 ,  G06V40/16 ,  G11B27/10

CPC classification number: G11B27/031 ,  G06V20/46 ,  G06V20/49 ,  G06V40/171 ,  G11B27/10

Abstract: Disclosed is an apparatus for generating a cross-edited video and a method of operating the apparatus. The method includes: obtaining a plurality of videos; sequentially generating video pieces such that one of the plurality of videos is played according to a timeline, based on a first transition reward that is based on a similarity between a video before a transition and a video after the transition in a specific frame and a continuous play time and on a second transition reward that is based on an elapsed time from a previous transition point; and generating a cross-edited video by connecting the video pieces.

公开(公告)号：US20230206528A1

公开(公告)日：2023-06-29

申请号：US17847472

申请日：2022-06-23

Applicant: KOREA ADVANCED INSTITUTE OF SCIENCE AND TECHNOLOGY

Inventor： Junyong NOH ,  Ha Young CHANG ,  Kwanggyoon SEO ,  Jung Eun YOO

IPC: G06T13/20 ,  G06T7/194

CPC classification number: G06T13/20 ,  G06T7/194 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: A method of training a deep neural network for generating a cinemagraph is disclosed. The method may include preparing a foreground layer input by using an input video, preparing a background layer input by using the input video, providing a foreground layer output and a background layer output from the DNN by inputting, to the DNN, the foreground layer input and the background layer input, providing an output video by synthesizing the foreground layer output with the background layer output, and updating intrinsic parameters of the DNN a plurality of times, based on the input video, the foreground layer input, the foreground layer output, the background layer output, and the output video.

公开(公告)号：US20230252707A1

公开(公告)日：2023-08-10

申请号：US17980817

申请日：2022-11-04

Applicant: Samsung Electronics Co., Ltd. ,  Korea Advanced Institute of Science and Technology

Inventor： Seokpyo HONG ,  Junyong NOH ,  Soojin CHOI ,  Chaelin KIM ,  Kyungmin CHO ,  Jiyeon KIM

IPC: G06T13/40

CPC classification number: G06T13/40

Abstract: An apparatus that transfers object motion in a source space to a target space is provided. The apparatus defines a mapping function from the source space to the target space based on feature points of the object-positioned source space, and feature points of the object-represented target space; determines a target root position corresponding to a root position of the object based on the mapping function; determines a target direction corresponding to a direction of the object, based on the mapping function; determines a target main joint corresponding to a main joint of the object based on the mapping function; determines a target sub-joint excluding the target main joint in the target space based on unique joint information of the object; and generates data representing the object motion in the target space by modifying a pose of the object in the target space to match the target main joint.

公开(公告)号：US20240221347A1

公开(公告)日：2024-07-04

申请号：US18398777

申请日：2023-12-28

Applicant: Korea Advanced Institute of Science and Technology

Inventor： Junyong NOH ,  Chang Wook SEO ,  Amirsaman ASHTARI ,  Sihun CHA ,  Cholmin KANG

IPC: G06V10/44 ,  G06V10/32 ,  G06V10/77 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82

CPC classification number: G06V10/44 ,  G06V10/32 ,  G06V10/7715 ,  G06V10/774 ,  G06V10/776 ,  G06V10/82

Abstract: Provided is a method of operating a device for extracting a style-based sketch and a method of training a neural network. Through a neural network for extracting a style-based sketch, a sketch obtained by imitating a style may be extracted by precisely detecting lines showing sketches from the color image and the reference image.

公开(公告)号：US20220245879A1

公开(公告)日：2022-08-04

申请号：US17333278

申请日：2021-05-28

Applicant: Samsung Electronics Co., Ltd. ,  Korea Advanced Institute of Science and Technology

Inventor： Junyong NOH ,  Kyungmin CHO ,  Chaelin KIM

IPC: G06T13/40 ,  G06T13/80 ,  G06N3/08 ,  G06F16/43

Abstract: A character animation motion control method and device are disclosed. A character animation playing method, including extracting first actions based on a state of a character, extracting second actions based on the state, selecting an action included in the first actions and the second actions, and updating the state based on the action.