公开(公告)号：US20170228414A1

公开(公告)日：2017-08-10

申请号：US15424671

申请日：2017-02-03

Applicant: Google Inc.

Inventor： Noam M. Shazeer ,  Colin Hearne Evans ,  Christopher Robert Waterson ,  Ryan P. Doherty

IPC: G06F17/30 ,  G06F17/16 ,  G06N5/04

Abstract: Methods, and systems, including computer programs encoded on computer storage media for generating compressed representations from a co-occurrence matrix. A method includes obtaining a set of sub matrices of a co-occurrence matrix, where each row of the co-occurrence matrix corresponds to a feature from a first feature vocabulary and each column of the co-occurrence matrix corresponds to a feature from a second feature vocabulary; selecting a sub matrix, wherein the sub matrix is associated with a particular row block and column block of the co-occurrence matrix; assigning respective d-dimensional initial row and column embedding vectors to each row and column from the particular row and column blocks, respectively; and determining a final row embedding vector and a final column embedding vector by iteratively adjusting the initial row embedding vectors and the initial column embedding vectors using the co-occurrence matrix.