-
公开(公告)号:US10536684B2
公开(公告)日:2020-01-14
申请号:US15371433
申请日:2016-12-07
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
IPC: H04N13/00 , H04N13/128 , H04N13/15
Abstract: A camera based depth mapping system. Depth information is coded with colors to make a laser-generated 3D depth map easier to interpret. In the event that the laser illumination is not sufficient, the depth information can have a low signal to noise ratio, i.e., the depth map can be noisy. Color noise reduction techniques are used to alleviate this problem.
-
公开(公告)号:US20190227166A1
公开(公告)日:2019-07-25
申请号:US15875263
申请日:2018-01-19
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Keith Resch
Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.
-
公开(公告)号:US20180231641A1
公开(公告)日:2018-08-16
申请号:US15432674
申请日:2017-02-14
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
CPC classification number: G01S7/4817 , G01S7/4816 , G01S17/08 , G01S17/10 , G01S17/89 , G02B26/0833
Abstract: A micro mirror assembly widens the field of view (FOV) of a 3D depth map sensor, alleviating the limitation of limited laser illumination power and limitations on the resolution of the available imaging device.
-
公开(公告)号:US09984690B1
公开(公告)日:2018-05-29
申请号:US15672522
申请日:2017-08-09
Applicant: SONY CORPORATION , SONY INTERACTIVE ENTERTAINMENT INC.
Inventor: Peter Shintani , Morio Usami , Keith Resch
IPC: H03F99/00 , G10L15/26 , G10L15/08 , G10L15/22 , G06F3/16 , G01S3/80 , G01S15/42 , G01S13/46 , G01S17/02
CPC classification number: G10L15/265 , G01S3/8006 , G01S15/42 , G01S17/023 , G01S2013/468 , G06F3/167 , G10L15/08 , G10L15/22 , G10L2015/223 , H03G3/3005
Abstract: Range to a human speaker is determined using a laser-based time of flight (ToF) system, with the range then being used to adjust the gain of a microphone receiving the speaker's voice. If desired, an acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking, and the direction of the sound is then used to focus the area of laser illumination.
-
公开(公告)号:US11639995B2
公开(公告)日:2023-05-02
申请号:US15672456
申请日:2017-08-09
Applicant: SONY CORPORATION , SONY INTERACTIVE ENTERTAINMENT INC.
Inventor: Peter Shintani , Morio Usami , Keith Resch
Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.
-
公开(公告)号:US10979687B2
公开(公告)日:2021-04-13
申请号:US15477369
申请日:2017-04-03
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
IPC: H04N13/128 , G06T3/40 , H04N13/122 , H04N13/156 , H04N13/271 , H04N5/33
Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.
-
公开(公告)号:US10698109B2
公开(公告)日:2020-06-30
申请号:US15875263
申请日:2018-01-19
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Keith Resch
IPC: G01S17/02 , G01S17/10 , G01S5/20 , G01S5/22 , H04R1/40 , H04R3/00 , G01S17/86 , G01S5/16 , G01S5/28 , G01S15/93 , G01S17/08 , G01S17/89 , G01S15/86
Abstract: Multiple independently movable devices are located upon a platform. On the platform is a directional microphone array. Each of the movable devices is assigned a unique audio signature, which may be a pulse train of chirps or a pseudo random signal or some other audio sequence that is unique to the respective device. Each movable device announces itself with its unique audio signature, and the platform's directional microphone system determines the location from which the unique audio signature comes from. For range, a difference between the time of flight (TOF) of the light relative to the sound signature is used. As another technique a unique audio signature may be an audio water mark concealed in normal audio which may be emitted by the movable device. The watermark provides the identifying information of each movable device.
-
公开(公告)号:US10484667B2
公开(公告)日:2019-11-19
申请号:US15798914
申请日:2017-10-31
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Kazuyuki Shikama , Keith Resch
IPC: H04N13/271 , G01S17/89 , G06T7/55 , G06T15/20 , G06F3/01 , G06F3/0488 , H04N13/128 , H04N13/25 , G06T5/50 , G06T7/593
Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.
-
公开(公告)号:US10178370B2
公开(公告)日:2019-01-08
申请号:US15383683
申请日:2016-12-19
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
IPC: H04N13/156 , H04N13/204 , H04N13/271 , G01B11/00 , H04N5/33
Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resulting 3D depth maps from multiple cameras at potentially arbitrary locations can be aggregated to create a more accurate 3D depth map of the area covered by all the individual cameras. Each device/camera may be assigned a unique identification such as a unique number and a mechanism to identify, either electronically or visually, devices in its field of view. Using this information, the relative locations of the cameras can be calculated for purposes of aggregating the multiple depth maps.
-
公开(公告)号:US20180252815A1
公开(公告)日:2018-09-06
申请号:US15590497
申请日:2017-05-09
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Kissei Matsumoto , Kazuyuki Shikama , Bibhudendu Mohapatra , Keith Resch
Abstract: Machine learning is applied to both 2D images from an infrared imager imaging laser reflections from an object and to the 3D depth map of the object that is generated using the 2D images and time of flight (TOF) information. In this way, the 3D depth map accuracy can be improved without increasing laser power or using high resolution imagers.
-
-
-
-
-
-
-
-
-