公开(公告)号：US10536684B2

公开(公告)日：2020-01-14

申请号：US15371433

申请日：2016-12-07

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: H04N13/00 ,  H04N13/128 ,  H04N13/15

Abstract: A camera based depth mapping system. Depth information is coded with colors to make a laser-generated 3D depth map easier to interpret. In the event that the laser illumination is not sufficient, the depth information can have a low signal to noise ratio, i.e., the depth map can be noisy. Color noise reduction techniques are used to alleviate this problem.

公开(公告)号：US20190227166A1

公开(公告)日：2019-07-25

申请号：US15875263

申请日：2018-01-19

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S17/02 ,  H04R1/40 ,  H04R3/00 ,  G01S5/20 ,  G01S5/22 ,  G01S17/10

Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.

公开(公告)号：US20180231641A1

公开(公告)日：2018-08-16

申请号：US15432674

申请日：2017-02-14

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: G01S7/481 ,  G01S17/89 ,  G02B26/08 ,  G01S17/08

CPC classification number: G01S7/4817 ,  G01S7/4816 ,  G01S17/08 ,  G01S17/10 ,  G01S17/89 ,  G02B26/0833

Abstract: A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.

公开(公告)号：US09984690B1

公开(公告)日：2018-05-29

申请号：US15672522

申请日：2017-08-09

Applicant: SONY CORPORATION ,  SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: H03F99/00 ,  G10L15/26 ,  G10L15/08 ,  G10L15/22 ,  G06F3/16 ,  G01S3/80 ,  G01S15/42 ,  G01S13/46 ,  G01S17/02

CPC classification number: G10L15/265 ,  G01S3/8006 ,  G01S15/42 ,  G01S17/023 ,  G01S2013/468 ,  G06F3/167 ,  G10L15/08 ,  G10L15/22 ,  G10L2015/223 ,  H03G3/3005

Abstract: Range to a human speaker is determined using a laser-based time of flight (ToF) system, with the range then being used to adjust the gain of a microphone receiving the speaker's voice. If desired, an acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking, and the direction of the sound is then used to focus the area of laser illumination.

公开(公告)号：US20170219822A1

公开(公告)日：2017-08-03

申请号：US15501372

申请日：2015-10-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Morio Usami

IPC: G02B27/01 ,  G08B21/02

CPC classification number: G02B27/0101 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0167 ,  G02B2027/0187 ,  G02B2027/0192 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/147 ,  G08B21/02 ,  G09G3/002 ,  G09G3/20 ,  G09G5/00 ,  G09G5/377 ,  G09G2370/16 ,  H04N5/64 ,  H04N13/239

Abstract: In a head-mounted display for blocking out an outside world from a user's vision when worn by the user to present a video, an outside world measurement section measures outside world information. A notification information detection section detects whether or not the information measured by the outside world measurement section contains any notification information to be notified to the user. A notification section notifies the user when the notification information detection section detects notification information.

公开(公告)号：US11639995B2

公开(公告)日：2023-05-02

申请号：US15672456

申请日：2017-08-09

Applicant: SONY CORPORATION ,  SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S15/42 ,  G01S15/86 ,  G01S15/87 ,  G01S3/80 ,  G01S7/521 ,  G01S15/46

Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.

公开(公告)号：US10979687B2

公开(公告)日：2021-04-13

申请号：US15477369

申请日：2017-04-03

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: H04N13/128 ,  G06T3/40 ,  H04N13/122 ,  H04N13/156 ,  H04N13/271 ,  H04N5/33

Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.

公开(公告)号：US10914947B2

公开(公告)日：2021-02-09

申请号：US16218722

申请日：2018-12-13

Applicant: Sony Interactive Entertainment Inc.

Inventor： Morio Usami

IPC: G02B27/14 ,  G09G5/00 ,  G02B27/01 ,  G09G3/20 ,  G09G5/377 ,  G06F3/147 ,  G06F3/01 ,  G09G3/00 ,  G06F3/0346 ,  G08B21/02 ,  H04N5/64 ,  H04N13/239

Abstract: Methods and apparatus providing a head-mounted display to be worn by the user and presenting a video to the user through the head-mounted display; measuring outside world information via an outside world measurement section of the head mounted display; detecting, via a notification information detection section, whether or not the information measured by the outside world measurement section contains any notification information to be notified to the user, including that the notification information detection section detects at least one reference position, which is set by the user as notification information; and notifying the user, via a notification section, when the notification information detection section detects notification information by way of displaying a video of the at least one reference position to the user in the head-mounted display.

公开(公告)号：US10698109B2

公开(公告)日：2020-06-30

申请号：US15875263

申请日：2018-01-19

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S17/02 ,  G01S17/10 ,  G01S5/20 ,  G01S5/22 ,  H04R1/40 ,  H04R3/00 ,  G01S17/86 ,  G01S5/16 ,  G01S5/28 ,  G01S15/93 ,  G01S17/08 ,  G01S17/89 ,  G01S15/86

Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.

公开(公告)号：US10484667B2

公开(公告)日：2019-11-19

申请号：US15798914

申请日：2017-10-31

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/271 ,  G01S17/89 ,  G06T7/55 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488 ,  H04N13/128 ,  H04N13/25 ,  G06T5/50 ,  G06T7/593

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.