公开(公告)号：US11386292B2

公开(公告)日：2022-07-12

申请号：US17016654

申请日：2020-09-10

Applicant: Korea Electronics Technology Institute

Inventor： Bo Eun Kim ,  Hye Dong Jung

IPC: G06K9/62 ,  G06F40/10

Abstract: A method and a system for automatically generating multiple captions of an image are provided. A method for training an auto image caption generation model according to an embodiment of the present disclosure includes: generating a caption attention map by using an image; converting the generated caption attention map into a latent variable by projecting the caption attention map onto a latent space; deriving a guide map by using the latent variable; and training to generate captions of an image by using the guide map and the image. Accordingly, a plurality of captions describing various characteristics of an image and including various expressions can be automatically generated.

公开(公告)号：US10726289B2

公开(公告)日：2020-07-28

申请号：US16043338

申请日：2018-07-24

Applicant: Korea Electronics Technology Institute

Inventor： Bo Eun Kim ,  Choong Sang Cho ,  Hye Dong Jung ,  Young Han Lee

IPC: G06K9/46 ,  G06T7/00 ,  G06N5/04 ,  G06N3/08 ,  G06F40/20 ,  G06F40/169 ,  G06N3/04 ,  G06N5/02

Abstract: A method and a system for automatic image caption generation are provided. The automatic image caption generation method according to an embodiment of the present disclosure includes: extracting a distinctive attribute from example captions of a learning image; training a first neural network for predicting a distinctive attribute from an image, by using a pair of the extracted distinctive attribute and the learning image; inferring a distinctive attribute by inputting the learning image to the trained first neural network; and training a second neural network for generating a caption of an image by using a pair of the inferred distinctive attribute and the learning image. Accordingly, a caption well indicating a feature of a given image is automatically generated, such that an image can be more exactly explained and a difference from other images can be clearly distinguished.

公开(公告)号：US12293488B2

公开(公告)日：2025-05-06

申请号：US18032825

申请日：2022-11-04

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Sa Im Shin ,  Bo Eun Kim ,  Han Mu Park ,  Chung Il Kim

IPC: G06T5/50 ,  G06T5/77 ,  G06T11/60

Abstract: The present invention relates to an image inpainting apparatus and an image inpainting method, the image inpainting apparatus including: a background inpainting part configured to generate a background-inpainted image by carrying out inpainting on a background with respect to an input image in which a region to be inpainted is set up; an object inpainting part configured to generate an object image by carrying out inpainting on an object; and an image overlapping part configured to generate an output image by causing the background-inpainted image and the object image, which are generated, to overlap each other.