公开(公告)号：US20170140270A1

公开(公告)日：2017-05-18

申请号：US15349950

申请日：2016-11-11

Applicant: Google Inc.

Inventor： Volodymyr Mnih ,  Adrià Puigdomènech Badia ,  Alexander Benjamin Graves ,  Timothy James Alexander Harley ,  David Silver ,  Koray Kavukcuoglu

IPC: G06N3/08 ,  G06N3/04

CPC classification number: G06N3/08 ,  G06N3/04 ,  G06N3/0454

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for asynchronous deep reinforcement learning. One of the systems includes a plurality of workers, wherein each worker is configured to operate independently of each other worker, and wherein each worker is associated with a respective actor that interacts with a respective replica of the environment during the training of the deep neural network.

公开(公告)号：US20170228638A1

公开(公告)日：2017-08-10

申请号：US15424685

申请日：2017-02-03

Applicant: Google Inc.

Inventor： Ivo Danihelka ,  Gregory Duncan Wayne ,  Fu-min Wang ,  Edward Thomas Grefenstette ,  Jack William Rae ,  Alexander Benjamin Graves ,  Timothy Paul Lillicrap ,  Timothy James Alexander Harley ,  Jonathan James Hunt

IPC: G06N3/063 ,  G06N3/04 ,  G06N3/08

CPC classification number: G06N3/063 ,  G06N3/0445 ,  G06N3/082

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for augmenting neural networks with an external memory. One of the systems includes a sparse memory access subsystem that is configured to perform operations comprising generating a sparse set of reading weights that includes a respective reading weight for each of the plurality of locations in the external memory using the read key, reading data from the plurality of locations in the external memory in accordance with the sparse set of reading weights, generating a set of writing weights that includes a respective writing weight for each of the plurality of locations in the external memory, and writing the write vector to the plurality of locations in the external memory in accordance with the writing weights.

公开(公告)号：US20170169332A1

公开(公告)日：2017-06-15

申请号：US15374974

申请日：2016-12-09

Applicant: Google Inc.

Inventor： Alexander Benjamin Graves ,  Ivo Danihelka ,  Timothy James Alexander Harley ,  Malcolm Kevin Campbell Reynolds ,  Gregory Duncan Wayne

IPC: G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for augmenting neural networks with an external memory. One of the systems includes a memory interface subsystem that is configured to perform operations comprising determining a respective content-based weight for each of a plurality of locations in an external memory; determining a respective allocation weight for each of the plurality of locations in the external memory; determining a respective final writing weight for each of the plurality of locations in the external memory from the respective content-based weight for the location and the respective allocation weight for the location; and writing data defined by the write vector to the external memory in accordance with the final writing weights.