知搜-全球专利检索

  1. Login
  2. Sign Up

Search Results

19 records (took 0.03 seconds)

    Apparatus and method for student-teacher transfer learning network using knowledge bridge
    2.
    发明授权
    Apparatus and method for student-teacher transfer learning network using knowledge bridge 有权

    公开(公告)号：US11195093B2

    公开(公告)日：2021-12-07

    申请号：US15867303

    申请日：2018-01-10

    Applicant: Samsung Electronics Co., Ltd.

    Inventor： Jaeyoung Kim ,  Mostafa El-Khamy ,  Jungwon Lee

    IPC: G06N3/08 ,  G06N7/00 ,  G06N3/04

    Abstract: An apparatus, a method, a method of manufacturing and apparatus, and a method of constructing an integrated circuit are provided. The apparatus includes a teacher network; a student network; a plurality of knowledge bridges between the teacher network and the student network, where each of the plurality of knowledge bridges provides a hint about a function being learned, and where a hint includes a mean square error or a probability; and a loss function device connected to the plurality of knowledge bridges and the student network. The method includes training a teacher network; providing hints to a student network by a plurality of knowledge bridges between the teacher network and the student network; and determining a loss function from outputs of the plurality of knowledge bridges and the student network.

    System and method for information highways in a hybrid feedforward-recurrent deep network
    3.
    发明授权
    System and method for information highways in a hybrid feedforward-recurrent deep network 有权

    公开(公告)号：US10599974B2

    公开(公告)日：2020-03-24

    申请号：US15343882

    申请日：2016-11-04

    Applicant: Samsung Electronics Co., Ltd.

    Inventor： Mostafa El-Khamy ,  Jungwon Lee ,  Jaeyoung Kim

    IPC: G06N3/04 ,  G06N3/063 ,  G06N3/08

    Abstract: An apparatus and a method. The apparatus includes a first recurrent network in a first layer; a second recurrent network in a second layer connected to the first recurrent network; a distant input gate connected to the second recurrent network; a first highway gate connected to the distant input gate and the second recurrent network; a first elementwise product projection gate connected to the distant input gate, the highway gate, and the second recurrent network; a second highway gate connected to the first recurrent network and the second recurrent network; and a second elementwise product projection gate connected to the first recurrent network, the second highway gate, and the second recurrent network.

    System and method for higher order long short-term memory (LSTM) network
    5.
    发明授权
    System and method for higher order long short-term memory (LSTM) network 有权

    公开(公告)号：US10241684B2

    公开(公告)日：2019-03-26

    申请号：US15480086

    申请日：2017-04-05

    Applicant: Samsung Electronics Co., Ltd.

    Inventor： Jaeyoung Kim ,  Inyup Kang ,  Mostafa El-Khamy ,  Jungwon Lee

    IPC: G06F3/06 ,  G06N3/04 ,  G06N3/08

    Abstract: A method and apparatus are provided. The method includes configuring a plurality of long short term memory (LSTM) networks, wherein each of the plurality of LSTM networks is at a different network layer, configuring a plurality of memory cells in a spatial domain of the plurality of LSTM networks, configuring the plurality of memory cells in a temporal domain of the plurality of LSTM networks, controlling an output of each of the plurality of LSTM networks based on highway connections to outputs from at least one previous layer and at least one previous time of the plurality of LSTM networks, and controlling the plurality of memory cells based on highway connections to memory cells from the at least one previous time.

Patent Agency Ranking