公开(公告)号：US12222420B2

公开(公告)日：2025-02-11

申请号：US18192349

申请日：2023-03-29

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S15/86 ,  G01S3/80 ,  G01S7/521 ,  G01S15/42 ,  G01S15/87 ,  G01S15/46

Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.

公开(公告)号：US10536684B2

公开(公告)日：2020-01-14

申请号：US15371433

申请日：2016-12-07

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: H04N13/00 ,  H04N13/128 ,  H04N13/15

Abstract: A camera based depth mapping system. Depth information is coded with colors to make a laser-generated 3D depth map easier to interpret. In the event that the laser illumination is not sufficient, the depth information can have a low signal to noise ratio, i.e., the depth map can be noisy. Color noise reduction techniques are used to alleviate this problem.

公开(公告)号：US20190227166A1

公开(公告)日：2019-07-25

申请号：US15875263

申请日：2018-01-19

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S17/02 ,  H04R1/40 ,  H04R3/00 ,  G01S5/20 ,  G01S5/22 ,  G01S17/10

Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.

公开(公告)号：US20180231641A1

公开(公告)日：2018-08-16

申请号：US15432674

申请日：2017-02-14

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Jose Omar Gonzalez Hernandez ,  William Clay ,  Pablo Antonio Espinosa ,  Fred Ansfield ,  Bibhudendu Mohapatra ,  Keith Resch ,  Morio Usami

IPC: G01S7/481 ,  G01S17/89 ,  G02B26/08 ,  G01S17/08

CPC classification number: G01S7/4817 ,  G01S7/4816 ,  G01S17/08 ,  G01S17/10 ,  G01S17/89 ,  G02B26/0833

Abstract: A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.

公开(公告)号：US09984690B1

公开(公告)日：2018-05-29

申请号：US15672522

申请日：2017-08-09

Applicant: SONY CORPORATION ,  SONY INTERACTIVE ENTERTAINMENT INC.

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: H03F99/00 ,  G10L15/26 ,  G10L15/08 ,  G10L15/22 ,  G06F3/16 ,  G01S3/80 ,  G01S15/42 ,  G01S13/46 ,  G01S17/02

CPC classification number: G10L15/265 ,  G01S3/8006 ,  G01S15/42 ,  G01S17/023 ,  G01S2013/468 ,  G06F3/167 ,  G10L15/08 ,  G10L15/22 ,  G10L2015/223 ,  H03G3/3005

Abstract: Range to a human speaker is determined using a laser-based time of flight (ToF) system, with the range then being used to adjust the gain of a microphone receiving the speaker's voice. If desired, an acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking, and the direction of the sound is then used to focus the area of laser illumination.

公开(公告)号：US10979695B2

公开(公告)日：2021-04-13

申请号：US16653985

申请日：2019-10-15

Applicant: SONY CORPORATION ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/271 ,  G01S17/89 ,  G06T7/55 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488 ,  H04N13/128 ,  H04N13/25 ,  G06T5/50 ,  G06T7/593

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US10567871B1

公开(公告)日：2020-02-18

申请号：US16123188

申请日：2018-09-06

Applicant: Sony Corporation

Inventor： James R. Milne ,  Allison Joi Burgueno ,  Gregory Peter Carlsson ,  Keith Resch

IPC: H04R1/34 ,  H04S7/00 ,  H04R5/02 ,  H04R5/04 ,  H04R1/40 ,  H04R3/00

Abstract: A networked speaker system automatically moves a speaker in one or more of the horizontal planes, the vertical plane, and elevation (z-dimension) to maintain the axis of the sound cone directed toward a listener as a listener moves about a space. In addition, or alternatively, the speaker can be moved to optimize sound performance when multiple speakers are activated.

公开(公告)号：US20190132573A1

公开(公告)日：2019-05-02

申请号：US15798914

申请日：2017-10-31

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Peter Shintani ,  Morio Usami ,  Kazuyuki Shikama ,  Keith Resch

IPC: H04N13/02 ,  G01S17/89 ,  G06T7/55 ,  H04N13/00 ,  G06T15/20 ,  G06F3/01 ,  G06F3/0488

Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.

公开(公告)号：US20160105754A1

公开(公告)日：2016-04-14

申请号：US14974413

申请日：2015-12-18

Applicant: Sony Corporation

Inventor： Gregory Peter Carlsson ,  Keith Resch ,  Oscar Manuel Vega

IPC: H04R27/00 ,  H04R3/12

CPC classification number: H04R27/00 ,  H04N21/44227 ,  H04R3/12 ,  H04R2227/003 ,  H04R2227/005 ,  H04R2420/03 ,  H04R2420/07 ,  H04S7/301 ,  H04S7/303 ,  H04S7/308

Abstract: In a multi-speaker audio system for, e.g., a home entertainment system or other entertainment system, each networked-speaker (wired or wireless) is activated or deactivated as appropriate such that audio play follows a user as the user moves around the home.

公开(公告)号：US20230236318A1

公开(公告)日：2023-07-27

申请号：US18192349

申请日：2023-03-29

Applicant: Sony Corporation

Inventor： Peter Shintani ,  Morio Usami ,  Keith Resch

IPC: G01S15/86 ,  G01S15/87 ,  G01S15/42 ,  G01S3/80 ,  G01S7/521

CPC classification number: G01S15/86 ,  G01S15/876 ,  G01S15/42 ,  G01S3/8006 ,  G01S7/521 ,  G01S2015/465

Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.