公开(公告)号：US20190188268A1

公开(公告)日：2019-06-20

申请号：US16193387

申请日：2018-11-16

Applicant: Google LLC

Inventor： Quoc V. Le ,  Minh-Thang Luong ,  Ilya Sutskever ,  Oriol Vinyals ,  Wojciech Zaremba

IPC: G06F17/28 ,  G06F17/27 ,  G10L15/16 ,  G06N3/04 ,  G06F7/10 ,  G06F7/02 ,  G10L15/02

CPC classification number: G06F17/2881 ,  G06F7/023 ,  G06F7/10 ,  G06F17/2735 ,  G06F17/2818 ,  G06F17/2827 ,  G06N3/0445 ,  G06N3/0454 ,  G10L15/02 ,  G10L15/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for neural translation systems with rare word processing. One of the methods is a method training a neural network translation system to track the source in source sentences of unknown words in target sentences, in a source language and a target language, respectively and includes deriving alignment data from a parallel corpus, the alignment data identifying, in each pair of source and target language sentences in the parallel corpus, aligned source and target words; annotating the sentences in the parallel corpus according to the alignment data and a rare word model to generate a training dataset of paired source and target language sentences; and training a neural network translation model on the training dataset.

公开(公告)号：US10281885B1

公开(公告)日：2019-05-07

申请号：US15600699

申请日：2017-05-19

Applicant: Google LLC

Inventor： Chung-Cheng Chiu ,  Navdeep Jaitly ,  Ilya Sutskever ,  Yuping Luo

IPC: G05B13/02 ,  G06N3/04 ,  G06F17/28 ,  G10L15/16

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a target sequence from a source sequence. In one aspect, the system includes a recurrent neural network configured to, at each time step, receive am input for the time step and process the input to generate a progress score and a set of output scores; and a subsystem configured to, at each time step, generate the recurrent neural network input and provide the input to the recurrent neural network; determine, from the progress score, whether or not to emit a new output at the time step; and, in response to determining to emit a new output, select an output using the output scores and emit the selected output as the output at a next position in the output order.