公开(公告)号：US20230093451A1

公开(公告)日：2023-03-23

申请号：US17947985

申请日：2022-09-19

Applicant: Google LLC

Inventor： Robert Dadashi-Tazehozi ,  Olivier Claude Pietquin ,  Léonard Hussenot Desenonges ,  Matthieu Florent Geist ,  Anton Raichuk ,  Damien Vincent ,  Sertan Girgin

IPC: G06N3/04 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for controlling agents. In particular, an agent can be controlled using a discretization neural network that generates a state-dependent discretization of an original action space and a policy neural network that is used to select an action from the state-dependent quantization rather than from the original action space.

公开(公告)号：US11036743B2

公开(公告)日：2021-06-15

申请号：US15162174

申请日：2016-05-23

Applicant: Google LLC

Inventor： Alexander Pak ,  Felix Raimundo ,  Sertan Girgin ,  Raphael Marinier ,  Vincent Simonet

IPC: G06F16/00 ,  G06F16/2457 ,  G06F16/40 ,  G06F16/70 ,  G06F16/248 ,  G06F16/28

Abstract: Methods, systems, and media for presenting content organized by category are provided. In some embodiments, the method comprises: receiving a request to present a page indicating content related to a first entity; identifying a first group of entities related to the first entity based at least in part on user interaction information; identifying a group of properties corresponding to the first entity; identifying, for each property, a second group of entities corresponding to the property; calculating, for each property, a score for the property; determining a subset of the properties in the group of properties based on the score of each property; identifying, for each property in the subset of properties, a group of content items corresponding to the property; determining a subset of content items from the group of content items; and causing a user interface indicating the subset of content items to be presented.