公开(公告)号：US20200053346A1

公开(公告)日：2020-02-13

申请号：US16653985

申请日：2019-10-15

Applicant: SONY CORPORATION ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/271 ,  G01S17/89 ,  G06T7/55 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488 ,  H04N13/128 ,  H04N13/25 ,  G06T5/50 ,  G06T7/593

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US10451714B2

公开(公告)日：2019-10-22

申请号：US15370197

申请日：2016-12-06

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: G01S7/497 ,  G01S17/08 ,  H04B10/114 ,  G01S17/87 ,  G01S17/89 ,  G01S7/484

Abstract: Multiple camera systems which use laser illumination for ranging benefit from a heartbeat to synchronize the timing of the individual lasers to eliminate collisions of multiple simultaneous laser emissions. An optical micromesh system provides for the dynamic entry and egress of mobile and stationary nodes. The optical communication between nodes may be controlled using time domain multiplexing (TDM) to avoid cross talk and communication collision due to overlapping laser illumination. By using an optical, laser based micromesh network, laser ranging can be used to dynamically map node location.

公开(公告)号：US20180288385A1

公开(公告)日：2018-10-04

申请号：US15477369

申请日：2017-04-03

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: H04N13/00 ,  H04N13/02 ,  G06T3/40

Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.

公开(公告)号：US12050316B2

公开(公告)日：2024-07-30

申请号：US17144206

申请日：2021-01-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Morio Usami

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/147 ,  G08B21/02 ,  G09G3/00 ,  G09G3/20 ,  G09G5/00 ,  G09G5/377 ,  H04N5/64 ,  H04N13/239

CPC classification number: G02B27/0101 ,  G02B27/017 ,  G06F3/011 ,  G06F3/0346 ,  G06F3/147 ,  G08B21/02 ,  G09G3/002 ,  G09G3/20 ,  G09G5/00 ,  G09G5/377 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0141 ,  G02B2027/0167 ,  G02B2027/0187 ,  G02B2027/0192 ,  G09G2370/16 ,  H04N5/64 ,  H04N13/239

Abstract: Methods and apparatus include providing a head-mounted display to be worn by the user and presenting a video to the user through the head-mounted display; measuring outside world information; detecting whether or not the outside world information contains any notification information to be notified to the user, including detection of at least one reference position, which is set by the user as notification information; and notifying the user when notification information is detected.

公开(公告)号：US11337024B2

公开(公告)日：2022-05-17

申请号：US17251656

申请日：2018-06-21

Applicant: SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Morio Usami ,  Shinichi Honda

IPC: H04R5/02 ,  H04S7/00 ,  G06F3/16 ,  G06V40/10

Abstract: A captured image obtaining unit 50 of an output control device 10 obtains a captured image such as a polarization image from an imaging device 12. A space information obtaining unit 54 obtains a normal line and a position of a surface of an actual object in a space and a sound absorption coefficient at the surface. A correction coefficient obtaining unit 56 calculates energy of sound reaching a listener including sound reflected at the actual object and obtains a correction coefficient to be given to a level of a sound signal on the basis of the sound energy. An output unit 60 adjusts the sound signals by using the correction coefficient 62 and outputs the adjusted sound signals to speakers 16a and 16b.

公开(公告)号：US20210132378A1

公开(公告)日：2021-05-06

申请号：US17144206

申请日：2021-01-08

Applicant: Sony Interactive Entertainment Inc.

Inventor： Morio Usami

IPC: G02B27/01 ,  G09G3/20 ,  G09G5/00 ,  G09G5/377 ,  G06F3/147 ,  G06F3/01 ,  G09G3/00 ,  G06F3/0346 ,  G08B21/02

Abstract: Methods and apparatus include providing a head-mounted display to be worn by the user and presenting a video to the user through the head-mounted display; measuring outside world information; detecting whether or not the outside world information contains any notification information to be notified to the user, including detection of at least one reference position, which is set by the user as notification information; and notifying the user when notification information is detected.

公开(公告)号：US10979695B2

公开(公告)日：2021-04-13

申请号：US16653985

申请日：2019-10-15

Applicant: SONY CORPORATION ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/271 ,  G01S17/89 ,  G06T7/55 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488 ,  H04N13/128 ,  H04N13/25 ,  G06T5/50 ,  G06T7/593

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US20190132573A1

公开(公告)日：2019-05-02

申请号：US15798914

申请日：2017-10-31

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/02 ,  G01S17/89 ,  G06T7/55 ,  H04N13/00 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US10185146B2

公开(公告)日：2019-01-22

申请号：US15501372

申请日：2015-10-28

Applicant: Sony Interactive Entertainment Inc.

Inventor： Morio Usami

IPC: G02B27/14 ,  G09G5/00 ,  G02B27/01 ,  G09G3/20 ,  G09G5/377 ,  G08B21/02 ,  G06F3/147 ,  G06F3/01 ,  G09G3/00 ,  H04N5/64 ,  H04N13/239

Abstract: In a head-mounted display for blocking out an outside world from a user's vision when worn by the user to present a video, an outside world measurement section measures outside world information. A notification information detection section detects whether or not the information measured by the outside world measurement section contains any notification information to be notified to the user. A notification section notifies the user when the notification information detection section detects notification information.

公开(公告)号：US10795022B2

公开(公告)日：2020-10-06

申请号：US15590497

申请日：2017-05-09

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kissei Matsumoto ,  Kazuyuki Shikama ,  Bibhudendu Mohapatra ,  Keith Resch

IPC: G01S17/89 ,  H04N13/128 ,  G06F16/95 ,  G01S17/87 ,  G01S17/10 ,  G06T17/00 ,  G06K9/00 ,  H04N13/254 ,  G06K9/62 ,  H04N13/271

Abstract: Machine learning is applied to both 2D images from an infrared imager imaging laser reflections from an object and to the 3D depth map of the object that is generated using the 2D images and time of flight (TOF) information. In this way, the 3D depth map accuracy can be improved without increasing laser power or using high resolution imagers.