-
公开(公告)号：US11676330B2
公开(公告)日：2023-06-13
申请号：US17688023
申请日：2022-03-07
摘要： A 3D conversation system can facilitate 3D conversations in an augmented reality environment, allowing conversation participants to appear as if they are face-to-face. The 3D conversation system can accomplish this with a pipeline of data processing stages, which can include calibrate, capture, tag and filter, compress, decompress, reconstruct, render, and display stages. Generally, the pipeline can capture images of the sending user, create intermediate representations, transform the representations to convert from the orientation the images were taken from to a viewpoint of the receiving user, and output images of the sending user, from the viewpoint of the receiving user, in synchronization with audio captured from the sending user. Such a 3D conversation can take place between two or more sender/receiving systems and, in some implementations can be mediated by one or more server systems. In various configurations, stages of the pipeline can be customized based on a conversation context.
-
公开(公告)号：US11967014B2
公开(公告)日：2024-04-23
申请号：US18311276
申请日：2023-05-03
摘要： A 3D conversation system can facilitate 3D conversations in an augmented reality environment, allowing conversation participants to appear as if they are face-to-face. The 3D conversation system can accomplish this with a pipeline of data processing stages, which can include calibrate, capture, tag and filter, compress, decompress, reconstruct, render, and display stages. Generally, the pipeline can capture images of the sending user, create intermediate representations, transform the representations to convert from the orientation the images were taken from to a viewpoint of the receiving user, and output images of the sending user, from the viewpoint of the receiving user, in synchronization with audio captured from the sending user. Such a 3D conversation can take place between two or more sender/receiving systems and, in some implementations can be mediated by one or more server systems. In various configurations, stages of the pipeline can be customized based on a conversation context.
-
公开(公告)号：US11539935B2
公开(公告)日：2022-12-27
申请号：US17110233
申请日：2020-12-02
发明人： Andrew Garrod Bosworth , Timo Juhani Ahonen , Brian Keith Cabral , Ryan Cairns , Andrea Colaco , Jonathan Huang , Michael Fredrick Cohen
IPC分类号： H04N13/282 , H04N13/156 , H04N13/243 , H04N13/00 , H04N13/117 , H04N13/366 , H04N13/398 , H04N7/14
摘要： In one embodiment, a computing system may receive, from a second computing system, video streams of a scene, the video streams including at least a first image and a second image that are simultaneously captured by a first camera and a second camera of the second computing system, respectively. The system may determine, using a sensor system, a viewpoint of a viewer with respect to a display region of a monoscopic display associated with the first computing system. The system may generate an output image of the scene by blending, according to blending proportions computed using the viewpoint of the viewer, corresponding portions of the first image and the second image. The system may display the output image in the display region of the monoscopic display.
-
公开(公告)号：US20220375124A1
公开(公告)日：2022-11-24
申请号：US17878500
申请日：2022-08-01
IPC分类号： G06T7/73 , G06F3/01 , G06F3/04815 , G06T19/00 , G06V40/19
摘要： A method for using a virtual camera location to display image data to one device from another device associated with a plurality of cameras. The method includes receiving image data from a plurality of cameras associated with a second user device associated with a second user. The method further includes establishing a virtual camera location different from positions of the plurality of cameras. The method further includes providing an image using the image data on a first user display of a first user device based at least on a viewpoint of the virtual camera location.
-
公开(公告)号：US11461962B1
公开(公告)日：2022-10-04
申请号：US17360758
申请日：2021-06-28
发明人： Albert Parra Pozo , Joseph Virskus , Ganesh Venkatesh , Kai Li , Shen-Chi Chen , Amit Kumar , Rakesh Ranjan , Brian Keith Cabral , Samuel Alan Johnson , Wei Ye , Michael Alexander Snower , Yash Patel
摘要： A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.
-
公开(公告)号：US12099327B2
公开(公告)日：2024-09-24
申请号：US17360693
申请日：2021-06-28
发明人： Albert Parra Pozo , Joseph Virskus , Ganesh Venkatesh , Kai Li , Shen-Chi Chen , Amit Kumar , Rakesh Ranjan , Brian Keith Cabral , Samuel Alan Johnson , Wei Ye , Michael Alexander Snower , Yash Patel
IPC分类号： G03H1/00 , G06N20/00 , G06T7/194 , G06T7/521 , G06T7/55 , G06T17/20 , G06T19/00 , G06V40/16 , H04M3/56 , H04N19/597 , G03H1/02
CPC分类号： G03H1/0005 , G06N20/00 , G06T7/194 , G06T7/521 , G06T7/55 , G06T17/20 , G06T19/006 , G06V40/176 , H04M3/567 , H04M3/568 , H04N19/597 , G03H2001/0088 , G03H2001/0204 , H04M2203/359
摘要： A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.
-
公开(公告)号：US20240252050A1
公开(公告)日：2024-08-01
申请号：US18495388
申请日：2023-10-26
CPC分类号： A61B5/024 , A61B5/163 , G02B27/0172 , G06F3/013 , G06V10/141 , G06V10/56
摘要： The various implementations described herein include methods and systems for monitoring biometric information. In one aspect, a method includes (i) capturing, via an inward-facing camera of an artificial-reality headset, a plurality of images of a region of a face of the user, the region including an eye of the user, where (a) a first image of the plurality of images includes a first position of a pupil in the eye, and (b) a second image of the plurality of images includes a second position of the pupil in the eye, the second position different than the first position; and (ii) determining heart rate information based on the plurality of images.
-
-
-
-
-
-
搜索结果
7 条记录 (耗时 0.023 秒)
