公开(公告)号：US20200285894A1

公开(公告)日：2020-09-10

申请号：US16452005

申请日：2019-06-25

Applicant: Samsung Electronics Co., Ltd.

Inventor： Mostafa EL-KHAMY ,  Jungwon LEE ,  Yoo Jin CHOI ,  Haoyu REN

IPC: G06K9/62 ,  G06N3/08 ,  G06K9/46

Abstract: A method and apparatus for providing a rotational invariant neural network is herein disclosed. According to one embodiment, a method includes receiving a first input of an image in a first orientation and training a kernel to be symmetric such that an output corresponding to the first input is the same as an output corresponding to a second input of the image in a second orientation.

公开(公告)号：US20250069247A1

公开(公告)日：2025-02-27

申请号：US18943520

申请日：2024-11-11

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Haoyu REN ,  Mostafa EL-KHAMY ,  Jungwon LEE ,  Hai SU ,  Qingfeng LIU

IPC: G06T7/579 ,  G06T3/18 ,  G06T7/194

Abstract: Methods and systems for performing video prediction, including obtaining an input frame from among a plurality of frames included in an input video; extracting a first feature map by providing the input frame to a first plurality of feature extraction layers and a first strided convolutional layer included in an encoder; providing the first feature map and at least one neighboring first feature map corresponding to at least one neighboring frame to a first fusion module included in the encoder; fusing the first feature map with the at least one neighboring first feature map to generate a fused first feature map using the first fusion module; generating a prediction corresponding to the input frame based on the fused first feature map using a decoder; and performing a video prediction task using the prediction.

公开(公告)号：US20200327685A1

公开(公告)日：2020-10-15

申请号：US16574770

申请日：2019-09-18

Applicant: Samsung Electronics Co., Ltd.

Inventor： Haoyu REN ,  Mostafa El-Khamy ,  Jungwon Lee

IPC: G06T7/50 ,  G06K9/62 ,  G06N3/04

Abstract: A method and system for determining depth information of an image are herein provided. According to one embodiment, the method includes receiving an image input, classifying the input image into a depth range of a plurality of depth ranges, and determining a depth map of the image by applying depth estimation based on the depth range into which the input image is classified.

公开(公告)号：US20210312591A1

公开(公告)日：2021-10-07

申请号：US17133785

申请日：2020-12-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Haoyu REN ,  Amin KHERADMAND ,  Mostafa EL-KHAMY ,  Shuangquan WANG ,  Dongwoon BAI ,  Jungwon LEE

IPC: G06T3/40 ,  G06N3/08 ,  G06N3/04

Abstract: A method and apparatus are provided. The method includes generating a dataset for real-world super resolution (SR), training a first generative adversarial network (GAN), training a second GAN, and fusing an output of the first GAN and an output of the second GAN.

公开(公告)号：US20200294217A1

公开(公告)日：2020-09-17

申请号：US16887511

申请日：2020-05-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Mostafa EL-KHAMY ,  Haoyu REN ,  Jungwon LEE

IPC: G06T5/50 ,  G06T3/00 ,  G06K9/62 ,  G06K9/68 ,  G06T3/40

Abstract: A method and an apparatus are provided. The method includes receiving a video with a first plurality of frames having a first resolution; generating a plurality of warped frames from the first plurality of frames based on a first type of motion compensation; generating a second plurality of frames having a second resolution, wherein the second resolution is of higher resolution than the first resolution, wherein each of the second plurality of frames having the second resolution is derived from a subset of the plurality of warped frames using a convolutional network; and generating a third plurality of frames having the second resolution based on a second type of motion compensation, wherein each of the third plurality of frames having the second resolution is derived from a fusing a subset of the second plurality of frames.

公开(公告)号：US20220300819A1

公开(公告)日：2022-09-22

申请号：US17826606

申请日：2022-05-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Haoyu REN ,  Mostafa EL-KHAMY ,  Jungwon LEE

IPC: G06N3/08 ,  G06T5/00 ,  G06T3/40 ,  G06N3/04

Abstract: Apparatuses and methods of manufacturing same, systems, and methods are described. In one aspect, a method includes generating a convolutional neural network (CNN) by training a CNN having a plurality of convolutional layers, and performing cascade training on the trained CNN. The cascade training includes an iterative process of a plurality of stages, in which each stage includes inserting a residual block (ResBlock) and training the CNN with the inserted ResBlock.

公开(公告)号：US20180268284A1

公开(公告)日：2018-09-20

申请号：US15655557

申请日：2017-07-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Haoyu REN ,  Mostafa EL-KHAMY ,  Jungwon LEE

IPC: G06N3/04 ,  G06N3/08

CPC classification number: G06N3/04 ,  G06N3/0454 ,  G06N3/08 ,  G06N3/082

Abstract: Apparatuses and methods of manufacturing same, systems, and methods for generating a convolutional neural network (CNN) are described. In one aspect, a minimal CNN having, e.g., three or more layers is trained. Cascade training may be performed on the trained CNN to insert one or more intermediate layers until a training error is less than a threshold. When cascade training is complete, cascade network trimming of the CNN output from the cascade training may be performed to improve computational efficiency. To further reduce network parameters, convolutional filters may be replaced with dilated convolutional filters with the same receptive field, followed by additional training/fine-tuning.