Reinforcement learning for concurrent actions

    公开(公告)号:US11580378B2

    公开(公告)日:2023-02-14

    申请号:US16188123

    申请日:2018-11-12

    IPC分类号: G06N3/08 G06N20/00 G06N7/00

    摘要: A computer-implemented method comprises instantiating a policy function approximator. The policy function approximator is configured to calculate a plurality of estimated action probabilities in dependence on a given state of the environment. Each of the plurality of estimated action probabilities corresponds to a respective one of a plurality of discrete actions performable by the reinforcement learning agent within the environment. An initial plurality of estimated action probabilities in dependence on a first state of the environment are calculated. Two or more of the plurality of discrete actions are concurrently performed within the environment when the environment is in the first state. In response to the concurrent performance, a reward value is received. In response to the received reward value being greater than a baseline reward value, the policy function approximator is updated, such that it is configured to calculate an updated plurality of estimated action probabilities.

    Texture compression
    43.
    发明授权

    公开(公告)号:US11568572B2

    公开(公告)日:2023-01-31

    申请号:US17189813

    申请日:2021-03-02

    摘要: A computer-implemented method comprises receiving a first compressed representation of a texture map in a first compression format, wherein the first compressed representation has been compressed using a first compressor, and receiving an array of compression parameters for a second compressor, the array of compression parameters including one or more respective compression parameters for each of a plurality of pixel regions of the texture map. The method further comprises decompressing the first compressed representation of the texture map to obtain the texture map, and compressing, using the second compressor, the texture map to a second compressed representation in a second compression format, comprising compressing each of said plurality of pixel regions of the texture map in accordance with the respective one or more compression parameters. The method further comprises storing the second compressed representation of the texture map to one or more memories accessible by a graphics processing unit, and selectively decompressing portions of the second compressed representation of the texture map using the graphical processing unit.

    User interface rendering and post processing during video game streaming

    公开(公告)号:US11565178B2

    公开(公告)日:2023-01-31

    申请号:US17646560

    申请日:2021-12-30

    发明人: Max Burke

    摘要: Systems and methods for conservation of bandwidth and improved user experience via enhanced streaming of video games. An example method includes receiving a request to remotely play a video game, the video game being executed by the system and streamed to a user device for presentation. The video game is executed, and rendered image frames are generated. Geometry data associated with the rendered image frames is generated, with the geometry data representing locations of geometric elements that form geometry utilized, by the video game, to generate the rendered image frames. The rendered image frames are encoded into a gameplay stream. A first stream comprising the encoded gameplay stream and a second stream comprising the geometry data are provided to the user device. The user device is configured to perform post-processing effects on the rendered image frames encoded in the gameplay stream prior to display on the user device.

    Friend recommendations for online video game players

    公开(公告)号:US11529562B2

    公开(公告)日:2022-12-20

    申请号:US16829530

    申请日:2020-03-25

    摘要: A game management system identifies gaming data associated with online game players and determines, based at least in part on the gaming data, other players to recommend as friends for playing an online game. Gaming data from online games other than the online game for which friend recommendations are to be made may be used to provide the friend recommendations. A subset of categories of the gaming data may be used to initially bin the plurality of players into separate bins. Similarity of players, with respect to their gaming data, or a subset thereof, within each bin may be determined. This similarity analysis may result in a similarity score corresponding to each pair of players within a bin. The similarity scores may be used to determine if two players are compatible from an online gaming standpoint and provide friend recommendations to players.

    ENHANCED SYSTEM FOR GENERATION OF FACIAL MODELS AND ANIMATION

    公开(公告)号:US20220398797A1

    公开(公告)日:2022-12-15

    申请号:US17344618

    申请日:2021-06-10

    发明人: Hau Nghiep Phan

    摘要: Systems and methods are provided for enhanced animation generation based on generative modeling. An example method includes training models based on faces and information associated with persons, each face being defined based on location information associated with facial features, and identity information for each person. The modeling system being trained to reconstruct expressions, textures, and models of persons.

    Interactive videogame verification using cryptographically protected transaction records

    公开(公告)号:US11528148B1

    公开(公告)日:2022-12-13

    申请号:US16786125

    申请日:2020-02-10

    发明人: Erez Maharshak

    摘要: An example method of performing interactive videogame verification using cryptographically protected transaction records includes: receiving, by a videogame server, from a first videogame client device, a first transaction record reflecting a first set of events associated with an interactive videogame session, wherein the first transaction record is cryptographically signed by a first private cryptographic key associated with the first videogame client device; receiving, from a second videogame client device, a second transaction record reflecting a second set of events associated with the interactive videogame session, wherein the second transaction record is cryptographically signed by a second private cryptographic key associated with the second videogame client device; and validating the first transaction record based on the second transaction record.

    DETECTING COLLUSION IN ONLINE GAMES

    公开(公告)号:US20220362677A1

    公开(公告)日:2022-11-17

    申请号:US17302837

    申请日:2021-05-13

    IPC分类号: A63F13/75 A63F13/35

    摘要: A collusion detection system may detect collusion between entities participating in online gaming. The collusion detection system may identify a plurality of entities associated with and opponents within an instance of an online game, determine social data associated with the plurality of entities, determine in-game behavior data associated with the plurality of entities, and determine, for one or more pairings of the plurality of entities, respective pairwise feature sets based at least in part on the social data and the in-game behavior data. The collusion detection system may then perform anomaly detection on the respective pairwise feature sets and, in response to the anomaly detection detecting one or more anomalous pairwise feature sets, output one or more suspect pairings of the plurality of entities corresponding to the one or more anomalous pairwise feature sets as suspected colluding pairings.