公开(公告)号：US10902617B2

公开(公告)日：2021-01-26

申请号：US16283145

申请日：2019-02-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sharwin Winesh Raghoebardajal

IPC: A63F13/22 ,  A63F13/24 ,  G06T7/246 ,  A63F13/213 ,  A63F13/323 ,  G06F3/01 ,  A63F13/211

Abstract: A data processing device includes a camera to capture successive images of an optically detectable indicator of a second data processing device; a location detector configured to detect a location of the data processing device; a data receiver to receive location information from the second data processing device; and a processor to detect a mapping between the image location, in images captured by the camera, of the optically detectable indicator of the second data processing device, the communicated location of the second data processing device and the detected location of the data processing device.

公开(公告)号：US20200316462A1

公开(公告)日：2020-10-08

申请号：US16604797

申请日：2018-04-26

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Sharwin Winesh Raghoebardajal ,  Simon Mark Benson

IPC: A63F13/26 ,  H04N13/344 ,  H04N13/15 ,  H04N13/128 ,  H04N13/271 ,  G06T19/00 ,  A63F13/213

Abstract: A system for displaying a mobile device screen comprises a head mounted display for displaying a first content to a user, a video camera mounted on the head mounted display, the video camera operable to capture a video image of a scene in front of the user, a region detection processor operable to detect a region of the captured video image comprising a mobile device screen, and an image processor operable to replace a corresponding region of the displayed first content in the head mounted display with the detected region of the captured video image comprising the mobile device screen.

公开(公告)号：US20190304101A1

公开(公告)日：2019-10-03

申请号：US16283145

申请日：2019-02-22

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sharwin Winesh Raghoebardajal

IPC: G06T7/246

Abstract: A data processing device comprises a camera to capture successive images of an optically detectable indicator of a second data processing device; a location detector configured to detect a location of the data processing device; a data receiver to receive location information from the second data processing device; and a processor to detect a mapping between the image location, in images captured by the camera, of the optically detectable indicator of the second data processing device, the communicated location of the second data processing device and the detected location of the data processing device.

公开(公告)号：US20240181351A1

公开(公告)日：2024-06-06

申请号：US18514085

申请日：2023-11-20

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sharwin Winesh Raghoebardajal ,  Jose Rubio

IPC: A63F13/655 ,  A63F13/52 ,  G06F3/03 ,  G06T7/73

CPC classification number: A63F13/655 ,  A63F13/52 ,  G06F3/0304 ,  G06T7/74

Abstract: A mapping and localisation apparatus includes: a communication processor configured to receive data relating to one or more first images of an environment captured by one or more first cameras of a first mobile electronic device; and receive data relating to one or more second images of the environment captured by one or more second cameras of one or more second mobile electronic devices; a mapping processor configured to process the data relating to the one or more first images to generate a three dimensional map of the environment; and a position processor configured to determine a position of the or each second mobile electronic device at least in part based on the generated map and the received data relating to the one or more second images.

公开(公告)号：US20200349378A1

公开(公告)日：2020-11-05

申请号：US16864413

申请日：2020-05-01

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sharwin Winesh Raghoebardajal ,  Kenzo Nishikawa

IPC: G06K9/32 ,  G02B27/01 ,  G06K9/20 ,  G06K9/00 ,  G06T19/00

Abstract: A data processing device comprises an analyser to analyse successive images captured by a camera and to detect an optically detectable marker in the captured images, a first location detector to detect a location of the optically detectable marker with respect to a location of the camera according to a first detection mode and to generate a first detection result, a second location detector to detect the location of the optically detectable marker with respect to the location of the camera according to a second detection mode different to the first detection mode and to generate a second detection result, and a processor to select at least one of the first detection result and the second detection result and to generate data indicative of the location of the optically detectable marker with respect to the location of the camera based on the selection.

公开(公告)号：US20200311403A1

公开(公告)日：2020-10-01

申请号：US16828375

申请日：2020-03-24

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sharwin Winesh Raghoebardajal

IPC: G06K9/00 ,  G02B27/00 ,  G02B27/01

Abstract: A system for tracking motion of a user includes one or more peripherals associated with the user, a first camera operable to be mounted upon the user's head, a second camera operable to capture images of the user and the first camera, a first tracking unit operable to determine the position of the one or more peripherals in images captured by the first camera, a second tracking unit operable to determine the position of the first camera and the one or more peripherals in images captured by the second camera, a location generating unit operable to identify the location of the one or more peripherals and the first camera in dependence upon the respective determinations by the first and second tracking units, a tracking validation unit operable to compare the locations of at least one peripheral as determined using the first and second tracking units and determine whether a difference in the locations exceeds a threshold value, and a location output unit operable to output location information for at least the one or more peripherals as identified by the location generating unit, where the location output unit is operable to output location information based upon information from the first tracking unit and information from the second tracking unit in varying contributions in dependence upon the difference in compared locations.

公开(公告)号：US20200238164A1

公开(公告)日：2020-07-30

申请号：US16751990

申请日：2020-01-24

Applicant: Sony Interactive Entertainment Inc.

Inventor： Sharwin Winesh Raghoebardajal

IPC: A63F13/213 ,  H04N5/235 ,  G06F3/039 ,  G06T7/73 ,  H04N5/225

Abstract: A system for tracking one or more peripherals operable by a user in a real environment includes: a camera, mountable upon the user, operable to capture images of the real environment, a feature identification unit operable to identify features in images belonging to a first set of images captured by the camera, a peripheral identification unit operable to identify the image position of one or more peripherals in one or more images belonging to a second set of images captured by the camera, and a position determining unit operable to generate first position information for the camera in the real environment in dependence upon one or more of the identified features, and to generate respective second position information for the one or more peripherals relative to the camera in dependence upon the identified image position of the one or more peripherals. The first set of images and the second set of images captured by the camera are interleaved such that groups of one or more images from each set are captured in turn, and the position determining unit is operable to generate third position information identifying the position of the one or more peripherals in the real environment by combining the second position information corresponding to a given group of images in the second set of images with a function of the first position information corresponding to a group of images in the first set of images preceding the given group of images and the first position information corresponding to a group of images in the first set of images following the given group of images.