-
公开(公告)号:US20200053346A1
公开(公告)日:2020-02-13
申请号:US16653985
申请日:2019-10-15
Applicant: SONY CORPORATION , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Kazuyuki Shikama , Keith Resch
IPC: H04N13/271 , G01S17/89 , G06T7/55 , G06T15/20 , G06F3/01 , G06F3/0488 , H04N13/128 , H04N13/25 , G06T5/50 , G06T7/593
Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.
-
公开(公告)号:US10451714B2
公开(公告)日:2019-10-22
申请号:US15370197
申请日:2016-12-06
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
Abstract: Multiple camera systems which use laser illumination for ranging benefit from a heartbeat to synchronize the timing of the individual lasers to eliminate collisions of multiple simultaneous laser emissions. An optical micromesh system provides for the dynamic entry and egress of mobile and stationary nodes. The optical communication between nodes may be controlled using time domain multiplexing (TDM) to avoid cross talk and communication collision due to overlapping laser illumination. By using an optical, laser based micromesh network, laser ranging can be used to dynamically map node location.
-
公开(公告)号:US20180288385A1
公开(公告)日:2018-10-04
申请号:US15477369
申请日:2017-04-03
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
Abstract: Each of plural devices includes a laser emitter and a camera for detecting reflections of laser light emitted by the device, so that plural of the devices can generate their own depth maps showing images within the field of view of their cameras. The resolution of each depth map may be improved by accessing a data store of prior images of objects and combining the prior images using super-resolution with current images of the depth maps.
-
公开(公告)号:US10979695B2
公开(公告)日:2021-04-13
申请号:US16653985
申请日:2019-10-15
Applicant: SONY CORPORATION , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Kazuyuki Shikama , Keith Resch
IPC: H04N13/271 , G01S17/89 , G06T7/55 , G06T15/20 , G06F3/01 , G06F3/0488 , H04N13/128 , H04N13/25 , G06T5/50 , G06T7/593
Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.
-
公开(公告)号:US20190132573A1
公开(公告)日:2019-05-02
申请号:US15798914
申请日:2017-10-31
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Kazuyuki Shikama , Keith Resch
Abstract: Parallax views of objects are used to generate 3D depth maps of the objects using time of flight (TOF) information. In this way, the deleterious effects of multipath interference can be reduced to improve 3D depth map accuracy without using computationally intensive algorithms.
-
公开(公告)号:US10795022B2
公开(公告)日:2020-10-06
申请号:US15590497
申请日:2017-05-09
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Kissei Matsumoto , Kazuyuki Shikama , Bibhudendu Mohapatra , Keith Resch
IPC: G01S17/89 , H04N13/128 , G06F16/95 , G01S17/87 , G01S17/10 , G06T17/00 , G06K9/00 , H04N13/254 , G06K9/62 , H04N13/271
Abstract: Machine learning is applied to both 2D images from an infrared imager imaging laser reflections from an object and to the 3D depth map of the object that is generated using the 2D images and time of flight (TOF) information. In this way, the 3D depth map accuracy can be improved without increasing laser power or using high resolution imagers.
-
公开(公告)号:US10181089B2
公开(公告)日:2019-01-15
申请号:US15383392
申请日:2016-12-19
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
Abstract: To reduce the random noise in a depth map that is rendered using colors to convey the various depths, pattern recognition may be used to selectively apply noise reduction or to modulate the strength of the noise reduction. In this way, the potential adverse effect on the detail/sharpness of the image can be ameliorated. For example, in an image of a person, the skin does not have any sharp edges so noise reduction can be applied to such an image with little adverse consequence, whereas noise reduction applied to the image of a person's eye can cause loss of the detail of the iris, eyelashes, etc. Using pattern recognition on objects in the image, the appropriate level of noise reduction can be applied across an image while minimizing blurring/loss of detail.
-
公开(公告)号:US20180173990A1
公开(公告)日:2018-06-21
申请号:US15383392
申请日:2016-12-19
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
CPC classification number: G06T5/002 , G06K9/00362 , G06K9/00597 , G06K9/40 , G06T2200/04 , G06T2207/10028
Abstract: To reduce the random noise in a depth map that is rendered using colors to convey the various depths, pattern recognition may be used to selectively apply noise reduction or to modulate the strength of the noise reduction. In this way, the potential adverse effect on the detail/sharpness of the image can be ameliorated. For example, in an image of a person, the skin does not have any sharp edges so noise reduction can be applied to such an image with little adverse consequence, whereas noise reduction applied to the image of a person's eye can cause loss of the detail of the iris, eyelashes, etc. Using pattern recognition on objects in the image, the appropriate level of noise reduction can be applied across an image while minimizing blurring/loss of detail.
-
公开(公告)号:US20180160094A1
公开(公告)日:2018-06-07
申请号:US15371433
申请日:2016-12-07
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Jose Omar Gonzalez Hernandez , William Clay , Pablo Antonio Espinosa , Fred Ansfield , Bibhudendu Mohapatra , Keith Resch , Morio Usami
IPC: H04N13/00
CPC classification number: H04N13/128 , G06T5/002 , G06T7/521 , G06T2207/10024 , G06T2207/10028 , H04N13/15
Abstract: A camera based depth mapping system. Depth information is coded with colors to make a laser-generated 3D depth map easier to interpret. In the event that the laser illumination is not sufficient, the depth information can have a low signal to noise ratio, i.e., the depth map can be noisy. Color noise reduction techniques are used to alleviate this problem.
-
公开(公告)号:US12222420B2
公开(公告)日:2025-02-11
申请号:US18192349
申请日:2023-03-29
Applicant: Sony Corporation , Sony Interactive Entertainment Inc.
Inventor: Peter Shintani , Morio Usami , Keith Resch
Abstract: An acoustic-based Direction of Arrival (DoA) system uses acoustic information to determine the direction of incoming sound, such as a person talking. The direction of the sound is then used to focus a laser-based time of flight (ToF) system to narrow the area of laser illumination, improving the signal to noise ratio because laser illumination is focused on the direction of the sound. The DoA system also provides elevation information pertaining to the source of the sound, to further narrow the required field of view of the laser ToF system.
-
-
-
-
-
-
-
-
-