公开(公告)号：US12222420B2

公开(公告)日：2025-02-11

申请号：US18192349

申请日：2023-03-29

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S15/86 ,  G01S3/80 ,  G01S7/521 ,  G01S15/42 ,  G01S15/87 ,  G01S15/46

Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.

公开(公告)号：US10536684B2

公开(公告)日：2020-01-14

申请号：US15371433

申请日：2016-12-07

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: H04N13/00 ,  H04N13/128 ,  H04N13/15

Abstract: A camera based depth mapping system. Depth information is coded with colors to make a laser-generated 3D depth map easier to interpret. In the event that the laser illumination is not sufficient, the depth information can have a low signal to noise ratio, i.e., the depth map can be noisy. Color noise reduction techniques are used to alleviate this problem.

公开(公告)号：US20190227166A1

公开(公告)日：2019-07-25

申请号：US15875263

申请日：2018-01-19

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S17/02 ,  H04R1/40 ,  H04R3/00 ,  G01S5/20 ,  G01S5/22 ,  G01S17/10

Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.

公开(公告)号：US20180231641A1

公开(公告)日：2018-08-16

申请号：US15432674

申请日：2017-02-14

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: G01S7/481 ,  G01S17/89 ,  G02B26/08 ,  G01S17/08

CPC classification number: G01S7/4817 ,  G01S7/4816 ,  G01S17/08 ,  G01S17/10 ,  G01S17/89 ,  G02B26/0833

Abstract: A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.

公开(公告)号：US09984690B1

公开(公告)日：2018-05-29

申请号：US15672522

申请日：2017-08-09

Applicant: SONY CORPORATION ,  SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: H03F99/00 ,  G10L15/26 ,  G10L15/08 ,  G10L15/22 ,  G06F3/16 ,  G01S3/80 ,  G01S15/42 ,  G01S13/46 ,  G01S17/02

CPC classification number: G10L15/265 ,  G01S3/8006 ,  G01S15/42 ,  G01S17/023 ,  G01S2013/468 ,  G06F3/167 ,  G10L15/08 ,  G10L15/22 ,  G10L2015/223 ,  H03G3/3005

Abstract: Range to a human speaker is determined using a laser-based time of flight (ToF) system, with the range then being used to adjust the gain of a microphone receiving the speaker's voice. If desired, an acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking, and the direction of the sound is then used to focus the area of laser illumination.

公开(公告)号：US10979695B2

公开(公告)日：2021-04-13

申请号：US16653985

申请日：2019-10-15

Applicant: SONY CORPORATION ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/271 ,  G01S17/89 ,  G06T7/55 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488 ,  H04N13/128 ,  H04N13/25 ,  G06T5/50 ,  G06T7/593

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US20190132573A1

公开(公告)日：2019-05-02

申请号：US15798914

申请日：2017-10-31

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/02 ,  G01S17/89 ,  G06T7/55 ,  H04N13/00 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US20200053346A1

公开(公告)日：2020-02-13

申请号：US16653985

申请日：2019-10-15

Applicant: SONY CORPORATION ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/271 ,  G01S17/89 ,  G06T7/55 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488 ,  H04N13/128 ,  H04N13/25 ,  G06T5/50 ,  G06T7/593

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US10451714B2

公开(公告)日：2019-10-22

申请号：US15370197

申请日：2016-12-06

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: G01S7/497 ,  G01S17/08 ,  H04B10/114 ,  G01S17/87 ,  G01S17/89 ,  G01S7/484

Abstract: Multiple camera systems which use laser illumination for ranging benefit from a heartbeat to synchronize the timing of the individual lasers to eliminate collisions of multiple simultaneous laser emissions. An optical micromesh system provides for the dynamic entry and egress of mobile and stationary nodes. The optical communication between nodes may be controlled using time domain multiplexing (TDM) to avoid cross talk and communication collision due to overlapping laser illumination. By using an optical, laser based micromesh network, laser ranging can be used to dynamically map node location.

公开(公告)号：US20180288385A1

公开(公告)日：2018-10-04

申请号：US15477369

申请日：2017-04-03

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: H04N13/00 ,  H04N13/02 ,  G06T3/40

Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.