公开(公告)号：US10713840B2

公开(公告)日：2020-07-14

申请号：US15853667

申请日：2017-12-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Erik Beran

IPC: G06T17/05 ,  G06T19/20 ,  G06F3/01 ,  G06F3/0481 ,  G06T7/50 ,  G02B27/01 ,  G06T19/00 ,  A63F13/25 ,  A63F13/24 ,  A63F13/217 ,  A63F13/65 ,  G06T17/00 ,  A63F13/213 ,  A63F13/5255

Abstract: A method is provided, including the following method operations: using a robot having a plurality of sensors to acquire sensor data about a local environment; processing the sensor data to generate a spatial model of the local environment, the spatial model defining virtual surfaces that correspond to real surfaces in the local environment; further processing the sensor data to generate texture information that is associated to the virtual surfaces defined by the spatial model; tracking a location and orientation of a head-mounted display (HMD) in the local environment; using the spatial model, the texture information, and the tracked location and orientation of the HMD to render a view of a virtual space that corresponds to the local environment; presenting the view of the virtual environment through the HMD.

公开(公告)号：US20200162757A1

公开(公告)日：2020-05-21

申请号：US16749225

申请日：2020-01-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran ,  Todd Tokubo

IPC: H04N19/597 ,  H04N21/6373 ,  H04N21/2343 ,  H04N21/81

Abstract: Predictive pre-fetching of streams for 360 degree video is described. User view orientation metadata is obtained for a 360 degree video stream that includes data for a plurality of viewports. Data corresponding to one or more high-resolution frames for a particular one of the viewports is pre-fetched based on the user view orientation metadata and those frames are displayed. The high resolution frames are characterized by a higher resolution than for remaining viewports.

公开(公告)号：US20190102684A1

公开(公告)日：2019-04-04

申请号：US15724011

申请日：2017-10-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran ,  Michael Taylor ,  Masanori Omote

IPC: G06N5/02 ,  G06F11/34 ,  G05B23/02 ,  H04L29/08 ,  G06F15/18

Abstract: A method for building an artificial intelligence (AI) model. The method includes accessing data related to monitored behavior of a user. The data is classified, wherein the classes include an objective data class identifying data relevant to a group of users including the user, and a subjective data class identifying data that is specific to the user. Objective data is accessed and relates to monitored behavior of a plurality of users including the user. The method includes providing as a first set of inputs into a deep learning engine performing AI the objective data and the subjective data of the user, and a plurality of objective data of the plurality of users. The method includes determining a plurality of learned patterns predicting user behavior when responding to the first set of inputs. The method includes building a local AI model of the user including the plurality of learned patterns.

公开(公告)号：US20240062081A1

公开(公告)日：2024-02-22

申请号：US18497893

申请日：2023-10-30

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran ,  Michael Taylor ,  Masanori Omote

IPC: G06N5/025 ,  G06N3/008 ,  G06N3/08 ,  G06N3/04 ,  G06N5/02 ,  H04L67/50 ,  G06N20/00 ,  G05B23/02 ,  G06F11/34

CPC classification number: G06N5/025 ,  G06N3/008 ,  G06N3/08 ,  G06N3/04 ,  G06N5/02 ,  H04L67/535 ,  G06N20/00 ,  G05B23/0216 ,  G05B23/0294 ,  G06F11/3438

Abstract: A method for building an artificial intelligence (AI) model. The method includes accessing data related to monitored behavior of a user. The data is classified, wherein the classes include an objective data class identifying data relevant to a group of users including the user, and a subjective data class identifying data that is specific to the user. Objective data is accessed and relates to monitored behavior of a plurality of users including the user. The method includes providing as a first set of inputs into a deep learning engine performing AI the objective data and the subjective data of the user, and a plurality of objective data of the plurality of users. The method includes determining a plurality of learned patterns predicting user behavior when responding to the first set of inputs. The method includes building a local AI model of the user including the plurality of learned patterns.

公开(公告)号：US20220203248A1

公开(公告)日：2022-06-30

申请号：US17573587

申请日：2022-01-11

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Erik Beran ,  Michael Taylor ,  Ruxin Chen

IPC: A63F13/90 ,  B25J5/00 ,  H04N9/31 ,  B25J11/00 ,  B25J15/10 ,  B25J9/04 ,  B25J15/04 ,  A63F13/213 ,  B25J13/08 ,  G06F3/01 ,  G06F3/042 ,  G06F3/04817 ,  G06F3/16

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

公开(公告)号：US11219837B2

公开(公告)日：2022-01-11

申请号：US15721673

申请日：2017-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Erik Beran ,  Michael Taylor ,  Ruxin Chen

IPC: G06F3/00 ,  A63F13/90 ,  B25J5/00 ,  H04N9/31 ,  B25J11/00 ,  B25J15/10 ,  B25J9/04 ,  B25J15/04 ,  A63F13/213 ,  B25J13/08 ,  G06F3/01 ,  G06F3/042 ,  G06F3/0481 ,  G06F3/16

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

公开(公告)号：US20190197768A1

公开(公告)日：2019-06-27

申请号：US15853667

申请日：2017-12-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Erik Beran

IPC: G06T17/05 ,  G06T7/50 ,  G06T19/00 ,  G06F3/0481

Abstract: A method is provided, including the following method operations: using a robot having a plurality of sensors to acquire sensor data about a local environment; processing the sensor data to generate a spatial model of the local environment, the spatial model defining virtual surfaces that correspond to real surfaces in the local environment; further processing the sensor data to generate texture information that is associated to the virtual surfaces defined by the spatial model; tracking a location and orientation of a head-mounted display (HMD) in the local environment; using the spatial model, the texture information, and the tracked location and orientation of the HMD to render a view of a virtual space that corresponds to the local environment; presenting the view of the virtual environment through the HMD.

公开(公告)号：US11122380B2

公开(公告)日：2021-09-14

申请号：US15901848

申请日：2018-02-21

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran

IPC: H04S7/00 ,  H04R5/02 ,  H04R5/04 ,  G05D1/02 ,  H04R1/32 ,  H04S3/00 ,  B25J9/16 ,  H04R27/00

Abstract: Methods and systems are provided for providing one or more sound component to a viewer within a media presentation space by a robot having one or more speakers. A method includes an operation for establishing a connection to a media device that is presenting media content to the viewer, and an operation for capturing input from a plurality of sensors for obtaining a map of the media presentation space. The method additionally provides for identifying a position of the viewer and a speaker configuration in the media presentation space. The method allows the robot to move to a location based on the map of the media presentation space, the position of the viewer and the speaker configuration. Moreover, the method provides an operation for receiving one or more sound components for presentation to the user.

公开(公告)号：US10547704B2

公开(公告)日：2020-01-28

申请号：US15481324

申请日：2017-04-06

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran ,  Todd Tokubo

IPC: G06F15/16 ,  H04L29/08 ,  H04L29/06

Abstract: Predictive pre-fetching of streams for 360 degree video is described. User view orientation metadata is obtained for a 360 degree video stream that includes data for a plurality of viewports. Data corresponding to one or more high-resolution frames for a particular one of the viewports is pre-fetched based on the user view orientation metadata and those frames are displayed. The high resolution frames are characterized by a higher resolution than for remaining viewports.

公开(公告)号：US10245505B2

公开(公告)日：2019-04-02

申请号：US14209745

申请日：2014-03-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Erik Beran

IPC: A63F9/24 ,  A63F13/40 ,  A63F13/63 ,  G06T13/40

Abstract: User-generated recordings of skeletal animations are provided. Information is stored in a memory regarding a plurality of animated movements in memory. Each animated movement may be mapped to one or more skeletal-based body parts of a game character. A recording of a plurality of user movements may be captured over a period of time. One or more body parts of the user may be identified for each captured user movement. It may then be determined which skeletal-based body parts correspond to the identified body parts of the user. A custom animation may be generated that comprises a plurality of animated movements in which the determined skeletal-based body parts are mapped to the associated animated movement. The custom animation may be stored in memory and played during play of a game as designated by the user.