公开(公告)号：US10692174B2

公开(公告)日：2020-06-23

申请号：US16728833

申请日：2019-12-27

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Michael Taylor ,  Dennis Dale Castleman

IPC: G06T3/40 ,  G06T17/05 ,  G06T7/70

Abstract: Systems and methods for unmanned aerial vehicle (UAV) course profiling are provided. A plurality of images may be captured by a UAV flying along a course at a first location. A profile may be constructed for the course based on the images captured by the UAV. The constructed course profile is transmitted over a communication network to a virtual reality system at a second location. The virtual reality system may generate a virtual environment corresponding to the course based on the constructed course profile, and a second UAV at the second location may fly along the virtual course.

公开(公告)号：US10679511B2

公开(公告)日：2020-06-09

申请号：US15394267

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Megumi Kikuchi ,  Michael Taylor ,  Dennis Dale Castleman ,  Andrew Stephen Young

IPC: G08G5/00 ,  G08G5/04 ,  B64C39/02 ,  B64D45/04 ,  G05D1/10 ,  G01C21/16

Abstract: A collision avoidance system for an unmanned aerial vehicle (UAV) receives physical space data for a flight area and creates a virtual world model to represent the flight area by mapping the physical space data with a physics engine. The automatic collision avoidance system creates a virtual UAV model to represent the UAV in the virtual world model. The automatic collision avoidance system receives flight data for the UAV and determines a current position of the virtual UAV model within the virtual world model. The automatic collision avoidance system determines a predicted trajectory of the virtual UAV model within the virtual world model, and determines whether the predicted trajectory will result in a collision of the virtual UAV model with the virtual world model. The automatic collision avoidance system performs evasive actions by the UAV, in response to determining that the predicted trajectory will result in a collision.

公开(公告)号：US20200171380A1

公开(公告)日：2020-06-04

申请号：US16780858

申请日：2020-02-03

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: A63F13/26 ,  A63F13/5378 ,  A63F13/35 ,  A63F13/213 ,  G06T19/00 ,  G06T7/579

Abstract: “Feature points” in “point clouds” that are visible to multiple respective cameras (i.e., aspects of objects imaged by the cameras) are reported via wired and/or wireless communication paths to a compositing processor which can determine whether a particular feature point “moved” a certain amount relative to another image. In this way, the compositing processor can determine, e.g., using triangulation and recognition of common features, how much movement occurred and where any particular camera was positioned when a latter image from that camera is captured. Thus, “overlap” of feature points in multiple images is used so that the system can close the loop to generate a SLAM map. The compositing processor, which may be implemented by a server or other device, generates the SLAM map by merging feature point data from multiple imaging devices.

公开(公告)号：US10540746B2

公开(公告)日：2020-01-21

申请号：US16526819

申请日：2019-07-30

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Michael Taylor ,  Dennis Dale Castleman

IPC: G06T3/40 ,  G06T17/05 ,  G06T7/70

Abstract: Systems and methods for unmanned aerial vehicle (UAV) course profiling are provided. A plurality of images may be captured by a UAV flying along a course at a first location. A profile may be constructed for the course based on the images captured by the UAV. The constructed course profile is transmitted over a communication network to a virtual reality system at a second location. The virtual reality system may generate a virtual environment corresponding to the course based on the constructed course profile, and a second UAV at the second location may fly along the virtual course.

公开(公告)号：US20190391637A1

公开(公告)日：2019-12-26

申请号：US16018966

申请日：2018-06-26

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Glenn Black ,  Javier Fernandez Rico

IPC: G06F3/01 ,  G06T19/00 ,  A63F13/87

Abstract: Player-to-player eye contact is used to establish a private chat channel in an augmented reality (AR) or virtual reality (VR) setting. Since maintaining eye contact requires agreement from both parties, it allows both players an equal amount of control when performing the mutual action. Eye tracking may be used for determining whether mutual eye contact has been established. In the case of AR, “inside out” eye tracking can be used, whereas in a VR setting only inside eye tracking need be used. Techniques are described to confirm and establish a channel once eye contact has been held.

公开(公告)号：US10410320B2

公开(公告)日：2019-09-10

申请号：US15394511

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Michael Taylor ,  Dennis Dale Castleman

IPC: G06T3/40 ,  G06T7/70 ,  G06T17/05

Abstract: Systems and methods for unmanned aerial vehicle (UAV) course profiling are provided. A plurality of images may be captured by a UAV flying along a course at a first location. A profile may be constructed for the course based on the images captured by the UAV. The constructed course profile is transmitted over a communication network to a virtual reality system at a second location. The virtual reality system may generate a virtual environment corresponding to the course based on the constructed course profile, and a second UAV at the second location may fly along the virtual course.

公开(公告)号：US20190118091A1

公开(公告)日：2019-04-25

申请号：US16224775

申请日：2018-12-18

Applicant: Sony Interactive Entertainment Inc.

Inventor： Michael Taylor ,  Jeffrey Roger Stafford

IPC: A63F13/655 ,  G06F3/01 ,  A63F13/25 ,  A63F13/98 ,  A63F13/428 ,  A63F13/65 ,  A63F13/26 ,  A63F13/213

CPC classification number: A63F13/655 ,  A63F13/213 ,  A63F13/25 ,  A63F13/26 ,  A63F13/428 ,  A63F13/65 ,  A63F13/98 ,  G06F3/013 ,  G09G2354/00

Abstract: A robot, including: a controller that communicates with a computing device, wherein the computing device executes a video game and renders a primary video feed of the video game to a display device, the primary video feed providing a first view into a virtual space that is defined by the executing video game; a camera that captures images of a local environment in which the robot is disposed; a projector; wherein the controller processes the images of the local environment to identify a projection surface in the local environment; wherein the computing device generates a secondary video feed of the video game and transmits the secondary video feed of the video game to the robot, the secondary video feed providing a second view into the virtual space; wherein the controller of the robot activates the projector to project the secondary video feed onto the projection surface in the local environment.

公开(公告)号：US20190099681A1

公开(公告)日：2019-04-04

申请号：US15721673

申请日：2017-09-29

Applicant: Sony Interactive Entertainment Inc.

Inventor： Javier Fernandez Rico ,  Erik Beran ,  Michael Taylor ,  Ruxin Chen

IPC: A63F13/90 ,  G06F3/042 ,  A63F13/213 ,  B25J13/08 ,  G06F3/01 ,  G06F3/0481 ,  G06F3/16

Abstract: Methods and systems are provided for providing real world assistance by a robot utility and interface device (RUID) are provided. A method provides for identifying a position of a user in a physical environment and a surface within the physical environment for projecting an interactive interface. The method also provides for moving to a location within the physical environment based on the position of the user and the surface for projecting the interactive interface. Moreover, the method provides for capturing a plurality of images of the interactive interface while the interactive interface is being interacted with by the use and for determining a selection of an input option made by the user.

公开(公告)号：US20180096611A1

公开(公告)日：2018-04-05

申请号：US15394267

申请日：2016-12-29

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Megumi Kikuchi ,  Michael Taylor ,  Dennis Dale Castleman ,  Andrew Stephen Young

IPC: G08G5/04 ,  G05D1/00 ,  B64C39/02 ,  G05D1/08 ,  G05B17/02

CPC classification number: G08G5/045 ,  B64C39/024 ,  B64C2201/141 ,  B64D45/04 ,  G01C21/16 ,  G05D1/101 ,  G08G5/0021 ,  G08G5/0069 ,  G08G5/0086

Abstract: A collision avoidance system for an unmanned aerial vehicle (UAV) receives physical space data for a flight area and creates a virtual world model to represent the flight area by mapping the physical space data with a physics engine. The automatic collision avoidance system creates a virtual UAV model to represent the UAV in the virtual world model. The automatic collision avoidance system receives flight data for the UAV and determines a current position of the virtual UAV model within the virtual world model. The automatic collision avoidance system determines a predicted trajectory of the virtual UAV model within the virtual world model, and determines whether the predicted trajectory will result in a collision of the virtual UAV model with the virtual world model. The automatic collision avoidance system performs evasive actions by the UAV, in response to determining that the predicted trajectory will result in a collision.