Processing system for streaming volumetric video to a client device

    公开(公告)号:US12155809B2

    公开(公告)日:2024-11-26

    申请号:US16446815

    申请日:2019-06-20

    Abstract: A network processing system obtains a viewport of a client device for volumetric video and a two-dimensional (2D) subframe of a frame of volumetric video is obtained associated with the viewport. Viewports may be obtained from the client device or be predicted. 2D subframes and reduced resolution versions of frames can be transmitted to the client device. A client device may request volumetric video from the network processing system and provides a viewport to the network processing system. The client device may obtain from the network processing system reduced resolution versions of volumetric video frames and 2D subframes in accordance with the viewport. The client device may determine whether a current viewport matches the viewport associated with the obtained 2D subframe and provides a display based on either that subframe (upon a match) or a 2D perspective of the reduced resolution frame associated with the current viewport (if no match).

    METHOD OF DETERMINING OCCLUSION BASED VISIBILITY FOR VOLUMETRIC VIDEO STREAMING

    公开(公告)号:US20220408072A1

    公开(公告)日:2022-12-22

    申请号:US17895668

    申请日:2022-08-25

    Abstract: Aspects of the subject disclosure may include, for example, a device, that includes a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including receiving a manifest for a point cloud, wherein the point cloud is partitioned into a plurality of cells; determining an occlusion level for a cell of the plurality of cells with respect to a predicted viewport; reducing a point density for the cell provided in the manifest based on the occlusion level, thereby determining a reduced point density; and requesting delivery of points in the cell, based on the reduced point density. Other embodiments are disclosed.

    SYSTEM AND METHOD FOR STREAMING VISIBLE PORTIONS OF VOLUMETRIC VIDEO

    公开(公告)号:US20220377308A1

    公开(公告)日:2022-11-24

    申请号:US17879235

    申请日:2022-08-02

    Abstract: Aspects of the subject disclosure may include, for example, a device having a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising predicting a viewpoint within a volumetric video based on a movement input provided by a viewer, resulting in a predicted viewpoint at a future time, retrieving a cell occupancy bitmap for a point cloud of the volumetric video for the future time, determining visible cells based on the cell occupancy bitmap and the predicted viewpoint, where the visible cells are not obscured by points in other cells, and retrieving points of the point cloud that are within the visible cells prior to the future time.

    SYSTEM AND METHOD FOR SEGMENTING IMMERSIVE VIDEO

    公开(公告)号:US20220312037A1

    公开(公告)日:2022-09-29

    申请号:US17842359

    申请日:2022-06-16

    Abstract: Aspects of the subject disclosure may include, for example, identifying a field of view (FoV) within a first frame of a video that occupies a sub-portion of the frame. A size is determined by subdividing a portion of the video according to a tiling scenario. Tiles overlapping the FoV are detected, and an updated size is determined based on an encoded version of the tiles and compared to a reference size. Responsive to the updated size being less than the reference size, the reference size is adjusted to the updated size, the tiling scenario is adjusted according to an adjusted tiling scenario, and the determining of the size is repeated based on the adjusted tiling scenario. Responsive to the updated size not being less than the reference size, a preferred tiling scenario is identified based on the adjusted tiling scenario for tiling the video. Other embodiments are disclosed.

    System and method for digital content development using a natural language interface

    公开(公告)号:US11367447B2

    公开(公告)日:2022-06-21

    申请号:US16896748

    申请日:2020-06-09

    Abstract: Aspects of the subject disclosure may include, for example, obtaining a natural language instruction, interpreting the instruction to obtain a machine interpretation, and analyzing the machine interpretation to obtain an intent of the natural language instruction. An actionable command adapted to cause a digital manipulation tool to digitally manipulate a content item is determined according to the intent of the natural language instruction. The actionable command is provided to the digital manipulation tool to obtain the manipulated content item. Other embodiments are disclosed.

    METHOD OF DETERMINING OCCLUSION BASED VISIBILITY FOR VOLUMETRIC VIDEO STREAMING

    公开(公告)号:US20210235057A1

    公开(公告)日:2021-07-29

    申请号:US16825645

    申请日:2020-03-20

    Abstract: Aspects of the subject disclosure may include, for example, a device, that includes a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including receiving a manifest for a point cloud, wherein the point cloud is partitioned into a plurality of cells; determining an occlusion level for a cell of the plurality of cells with respect to a predicted viewport; reducing a point density for the cell provided in the manifest based on the occlusion level, thereby determining a reduced point density; and requesting delivery of points in the cell, based on the reduced point density. Other embodiments are disclosed.

    SYSTEM AND METHOD FOR STREAMING VISIBLE PORTIONS OF VOLUMETRIC VIDEO

    公开(公告)号:US20210051308A1

    公开(公告)日:2021-02-18

    申请号:US16540511

    申请日:2019-08-14

    Abstract: Aspects of the subject disclosure may include, for example, a device having a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, the operations comprising: predicting a viewpoint within a volumetric video based on movement input by a viewer, resulting in a predicted viewpoint, wherein a point cloud of the volumetric video is segmented into cells, and wherein at least some of the cells are visible to the viewer at a future time of playback based on the predicted viewpoint; retrieving a cell occupancy bitmap for the point cloud for the future time of playback; determining visible cells based on the cell occupancy bitmap and the predicted viewpoint; receiving the visible cells for the future time of playback; and rendering and displaying the point cloud within the visible cells during playback at the future time. Other embodiments are disclosed.

Patent Agency Ranking