Abstract:
Methods, systems, and devices for computer graphics are described. A device may perform a shadow rendering operation in an object-space shading pipeline for a set of potentially visible surfaces. The device may represent the potentially visible surfaces in an atlas. The device may determine a set of world-space coordinates corresponding to the one or more potentially visible surfaces and may store the set of world-space coordinates in a geometry buffer (G-buffer). The device may determine a number of shadow factors associated with the potentially visible surfaces based on a transformation of the world-space coordinates stored in the G-buffer and a set of depth values associated with each shadow caster present in a scene. The device may store the shadow factors in an atlas shadow mask and perform a shading of the potentially visible surfaces in the atlas based on the atlas shadow mask.
Abstract:
An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.
Abstract:
Disclosed are a system, apparatus, and method for 3D object segmentation within an environment. Image frames are obtained from one or more depth cameras or at different times and planar segments are extracted from data obtained from the image frames. Candidate segments that comprise a non-planar object surface are identified from the extracted planar segments. In one aspect, certain extracted planar segments are identified as comprising a non-planar object surface, and are referred to as candidate segments. Confidence of preexisting candidate segments are adjusted in response to determining correspondence with a candidate segment. In one aspect, one or more preexisting candidate segments are determined to comprise a surface of a preexisting non-planar object hypothesis. Confidence in the non-planar object hypothesis is updated in response to determining correspondence with a candidate segment.
Abstract:
Systems, apparatus and methods for triggering a depth sensor and/or limiting bandwidth and/or maintaining privacy are presented. By limiting use of a depth sensor to times when an optical image alone is insufficient, mobile device power is saved. Furthermore, by reducing a size of an optical image to only the portion of the image needed to detect an object, bandwidth is saved and privacy is maintained by not communicating unneeded or undesired information.
Abstract:
A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.
Abstract:
Graphics processing in a client device includes receiving, as part of a vector streaming split rendering process, a bit stream encoding a sequence of shading atlases of the process. Each shading atlas includes blocks. The client decodes a particular shading atlas of the sequence of shading atlases, and determines that a particular block of the particular shading atlas was unsuccessfully decoded. The client identifies a stored block of a prior shading atlas of the sequence of shading atlases as a successfully decoded earlier version of the particular block. The client renders the particular shading atlas using the stored block instead of the particular block.
Abstract:
An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.
Abstract:
Aspects of the present disclosure provide a method for compressing a point cloud. The method includes determining a sub-division technique for the volume based on one or more numbers derived from a distribution of points in the volume, dividing the volume into a number of sub-volumes according to the sub-division technique, and determining whether each sub-volume of the sub-volumes is occupied by at least one point. The method includes generating a bit sequence for the volume comprising a control code that is based on the sub-division technique and an occupancy indicator that indicates whether or not each sub-volume is occupied by at least one point.
Abstract:
Example in-band delay measurement techniques are described. An example first computing device transmits, to a second computing device, a first data packet, the first data packet including a first time indicator and at least one header extension element. The at least one header extension element includes a header extension element header, the header extension element header having a length of at least one byte. The first computing device receives, from the second computing device, a second data packet, the second data packet including a second time indicator. The first computing device determines a data packet delay associated with the first data packet based on the first time indicator and the second time indicator and transmits an indication of the data packet delay to at least one of the second computing device or a third computing device.
Abstract:
The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.