公开(公告)号：US10155166B1

公开(公告)日：2018-12-18

申请号：US15700005

申请日：2017-09-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Jeffrey Roger Stafford

IPC: A63F9/00 ,  A63F13/655 ,  A63F13/25 ,  G06F3/01

Abstract: A system is provided, including the following: a computing device that executes a video game and renders a primary video feed of the video game to a display device, the primary video feed providing a first view into a virtual space; a robot, including, a camera that captures images of a user, a projector, and, a controller that processes the images of the user to identify a gaze direction of the user; wherein when the gaze direction of the user changes from a first gaze direction that is directed towards the display device, to a second gaze direction that is directed away from the display device, the computing device generates a secondary video feed providing a second view into the virtual space; wherein the controller of the robot activates the projector to project the secondary video feed onto the projection surface in the local environment.

公开(公告)号：US10067736B2

公开(公告)日：2018-09-04

申请号：US15394313

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Michael Taylor ,  Dennis Dale Castleman

IPC: G06F17/00 ,  G06F3/16

Abstract: Disclosed are systems, methods, and non-transitory computer-readable storage media for altering and combining real and simulated audio streams. For example, a system can determine a location of a first unmanned aerial vehicle (UAV). The system can then determine a location of an object and can receive an audio stream associated with the object. The system can then determine a distance between the location of the first UAV and the location of the object. The system can adjust the audio stream volume according to the distance. The system can then send the audio stream to a listener.

公开(公告)号：US20180095461A1

公开(公告)日：2018-04-05

申请号：US15393875

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Michael Taylor ,  Dennis Dale Castleman ,  Glenn Black ,  Javier Fernandez Rico

IPC: G05D1/00 ,  G06T19/00 ,  B64C39/02

CPC classification number: B64C39/024 ,  A63F13/00 ,  A63H27/12 ,  A63H30/04 ,  B64C2201/18 ,  G01S1/00 ,  G01S5/0268 ,  G01S19/48

Abstract: Systems and methods for unmanned aerial vehicle (UAV) positional anchors. Signals may be broadcast via a signal interface of an anchor in a defined space which also includes a UAV. The UAV is at one location within the defined space, and the anchor is at another location within the defined space. A virtual environment may be generated that corresponds to the defined space. The virtual environment may include at least one virtual element, and a location of the virtual element within the virtual environment may be based on the location of the anchor within the defined space. A visual indication may be generated when the UAV is detected within a predetermined distance from the location of the anchor. In some embodiments, a visual element may be generated to augment the anchor where a location of the visual element is based on a location of the anchor within the defined space. The visual element may be changed when the UAV is flown to the location of the anchor within the defined space.

公开(公告)号：US20180095433A1

公开(公告)日：2018-04-05

申请号：US15394329

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Javier Fernandez Rico ,  Glenn Black ,  Michael Taylor ,  Andrew Stephen Young

IPC: G05B13/04 ,  B64C39/02 ,  G05D1/00

CPC classification number: G05D1/0044 ,  B64C39/024 ,  B64C2201/042 ,  B64C2201/066 ,  B64C2201/146 ,  F41G3/26 ,  G06K9/0063

Abstract: A system can determine that a simulated (e.g., virtual) weapon has hit a UAV. This can include determining a simulated position of the simulated weapon and the relative position of the UAV. The system can then determine an area of effect for the weapon and determine if the UAV was hit. The system can determine what components of the UAV were hit and to what degree. The system can then determine a simulated condition such as a damaged engine or wing. The system can then receive input for controlling the UAV and combine the input with the simulated condition to generate a control signal for the UAV. The control signal can include decreasing the power to a motor.

公开(公告)号：US20170358141A1

公开(公告)日：2017-12-14

申请号：US15619395

申请日：2017-06-09

Applicant: Sony Interactive Entertainment Inc.

Inventor： Jeffrey Roger Stafford ,  Michael Taylor

IPC: G06T19/00 ,  G06F3/0482 ,  A63F13/537 ,  G06T7/246 ,  H04N5/232 ,  G06T11/60 ,  G06T17/05 ,  G06F3/01

CPC classification number: G06T19/006 ,  A63F13/537 ,  A63F2300/6081 ,  A63F2300/66 ,  A63F2300/8082 ,  G02B27/017 ,  G02B2027/0118 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/013 ,  G06F3/0482 ,  G06F3/04842 ,  G06F2203/04806 ,  G06T7/246 ,  G06T11/60 ,  G06T17/05 ,  H04N5/23296

Abstract: Methods and systems for presenting an object on to a screen of a head mounted display (HMD) include receiving an image of a real-world environment in proximity of a user wearing the HMD. The image is received from one or more forward facing cameras of the HMD and processed for rendering on a screen of the HMD by a processor within the HMD. A gaze direction of the user wearing the HMD, is detected using one or more gaze detecting cameras of the HMD that are directed toward one or each eye of the user. Images captured by the forward facing cameras are analyzed to identify an object captured in the real-world environment that is in line with the gaze direction of the user, wherein the image of the object is rendered at a first virtual distance that causes the object to appear out-of-focus when presented to the user. A signal is generated to adjust a zoom factor for lens of the one or more forward facing cameras so as to cause the object to be brought into focus. The adjustment of the zoom factor causes the image of the object to be presented on the screen of the HMD at a second virtual distance that allows the object to be discernible by the user.

公开(公告)号：US20250047954A1

公开(公告)日：2025-02-06

申请号：US18363700

申请日：2023-08-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Coimbatore Ravi Madhavan ,  Richard Olabode

IPC: H04N21/81 ,  A63F13/86 ,  H04N21/233 ,  H04N21/239

Abstract: System, process and device configurations are provided for generating game commentary streams. Game commentary streams can include gameplay video data with voice data of multiplayer game users synchronized to one or more game events and game states in recorded gameplay. Game commentary streams may allow for selection of game play content from the perspective of a selected user and to obtain voice data of the user and one or more other users during the game session. Methods for generating a commentary stream can include receiving game commentary data from users of a multiplayer electronic game including voice data detected during the game session and generating the commentary stream to include gameplay data for the game session and selected game commentary data. User requests may be received and the commentary stream may be output for recorded game play from the perspective of one or more users of the game session.

公开(公告)号：US20240424390A1

公开(公告)日：2024-12-26

申请号：US18340208

申请日：2023-06-23

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Yasunori Matsui ,  Yurika Kondo ,  Mihee Kang

IPC: A63F13/428 ,  G06F3/01

Abstract: A machine learning-based model is configured to make inferences about computer game actions to execute based on dynamic, varying player gestures and to translate those game actions into input sequence macros. In some instances, the button sequence mapping for the macros can even dynamically change based on game state so that different macros for the same computer game action might be inferred by the model depending on game state.

公开(公告)号：US20240264718A1

公开(公告)日：2024-08-08

申请号：US18166413

申请日：2023-02-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Warren Benedetto ,  Michael Taylor ,  Jon Webb

IPC: G06F3/0482 ,  G06F3/04845 ,  G06T11/00 ,  G10L15/18

CPC classification number: G06F3/0482 ,  G06F3/04845 ,  G06T11/00 ,  G10L15/18 ,  G06T2200/24

Abstract: A method including generating an image using an image generation artificial intelligence system configured for implementing latent diffusion, wherein the image is decoded from a latent space representation. The method including receiving selection of a portion of the image. The method including receiving commentary of a user corresponding to the portion of the image. The method including generating a text prompt to modify the portion of the image based on the commentary. The method including encoding the portion of the image using latent diffusion based on the text prompt. The method including modifying the latent space representation of the image using latent diffusion to generate a modified image, wherein the text prompt and the encoded portion of the image are provided as input to the image generation artificial intelligence system.

公开(公告)号：US20240198240A1

公开(公告)日：2024-06-20

申请号：US18589404

申请日：2024-02-27

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Erik Beran ,  Michael Taylor ,  Ruxin Chen

IPC: A63F13/90 ,  A63F13/213 ,  B25J5/00 ,  B25J9/04 ,  B25J11/00 ,  B25J13/08 ,  B25J15/04 ,  B25J15/10 ,  G06F3/01 ,  G06F3/042 ,  G06F3/04817 ,  G06F3/16 ,  H04N9/31

CPC classification number: A63F13/90 ,  A63F13/213 ,  B25J5/007 ,  B25J9/046 ,  B25J11/0005 ,  B25J11/003 ,  B25J11/008 ,  B25J13/08 ,  B25J15/04 ,  B25J15/10 ,  G06F3/017 ,  G06F3/0425 ,  G06F3/04817 ,  G06F3/167 ,  H04N9/3173 ,  H04N9/3182 ,  H04N9/3185 ,  H04N9/3194

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

公开(公告)号：US20230344880A1

公开(公告)日：2023-10-26

申请号：US17728270

申请日：2022-04-25

Applicant: Sony Interactive Entertainment Inc.

Inventor： Glenn Black ,  Celeste Bean ,  Michael Taylor

IPC: H04L65/1089 ,  G06F3/16 ,  G10L15/22 ,  G06F40/20

CPC classification number: H04L65/1089 ,  G06F3/165 ,  G10L15/22 ,  G06F40/20 ,  G10L2015/228

Abstract: Alerts can be generated to inform a prime user to unblock another user, whose audio and/or video the prime user has blocked, owing to an emerging context that may be of interest to the prime user. The prime user can be informed of such a context and provided the ability to selectively view the blocked user's comments so the full context can be understood. This aims to help protect the prime user who may have been the subject of harassment from the blocked user originally causing the blocked user to be muted or otherwise blocked in the first place.