-
公开(公告)号:US11461962B1
公开(公告)日:2022-10-04
申请号:US17360758
申请日:2021-06-28
发明人: Albert Parra Pozo , Joseph Virskus , Ganesh Venkatesh , Kai Li , Shen-Chi Chen , Amit Kumar , Rakesh Ranjan , Brian Keith Cabral , Samuel Alan Johnson , Wei Ye , Michael Alexander Snower , Yash Patel
摘要: A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.
-
公开(公告)号:US12099327B2
公开(公告)日:2024-09-24
申请号:US17360693
申请日:2021-06-28
发明人: Albert Parra Pozo , Joseph Virskus , Ganesh Venkatesh , Kai Li , Shen-Chi Chen , Amit Kumar , Rakesh Ranjan , Brian Keith Cabral , Samuel Alan Johnson , Wei Ye , Michael Alexander Snower , Yash Patel
IPC分类号: G03H1/00 , G06N20/00 , G06T7/194 , G06T7/521 , G06T7/55 , G06T17/20 , G06T19/00 , G06V40/16 , H04M3/56 , H04N19/597 , G03H1/02
CPC分类号: G03H1/0005 , G06N20/00 , G06T7/194 , G06T7/521 , G06T7/55 , G06T17/20 , G06T19/006 , G06V40/176 , H04M3/567 , H04M3/568 , H04N19/597 , G03H2001/0088 , G03H2001/0204 , H04M2203/359
摘要: A holographic calling system can capture and encode holographic data at a sender-side of a holographic calling pipeline and decode and present the holographic data as a 3D representation of a sender at a receiver-side of the holographic calling pipeline. The holographic calling pipeline can include stages to capture audio, color images, and depth images; densify the depth images to have a depth value for each pixel while generating parts masks and a body model; use the masks to segment the images into parts needed for hologram generation; convert depth images into a 3D mesh; paint the 3D mesh with color data; perform torso disocclusion; perform face reconstruction; and perform audio synchronization. In various implementations, different of these stages can be performed sender-side or receiver side. The holographic calling pipeline also includes sender-side compression, transmission over a communication channel, and receiver-side decompression and hologram output.
-