Decoding of patch temporal alignment for mesh compression

    公开(公告)号:US12125250B2

    公开(公告)日:2024-10-22

    申请号:US17954961

    申请日:2022-09-28

    IPC分类号: G06T9/00 G06T15/04 G06T17/20

    CPC分类号: G06T9/001 G06T15/04 G06T17/20

    摘要: Processing circuitry decodes a texture map in 2D from a bitstream carrying a 3D mesh frame. The 3D mesh frame represents a surface of an object with polygons and is partitioned into patches. The texture map includes transformed patches with transformed UV coordinates that are transformed from original UV coordinates of the patches according to remap transform parameters. The processing circuitry decodes the remap transform parameters associated with the patches and generates a recovered texture map from the texture map according to the remap transform parameters. At least a first recovered pixel in the recovered texture map is assigned with a texture value at a first transformed position in the texture map, the first transformed position in the texture map is determined according to a pixel position of the first recovered pixel and first remap transform parameters associated with a first patch that the first recovered pixel belongs to.

    Conditional recolor for video based point cloud coding

    公开(公告)号:US11979606B2

    公开(公告)日:2024-05-07

    申请号:US17495301

    申请日:2021-10-06

    摘要: Methods and apparatuses of encoding a video stream using video point cloud coding include obtaining a source point cloud; generating a geometry map and a texture map based on the source point cloud; generating a reconstructed geometry map and a reconstructed texture map using lossy coding without using recoloring, wherein a resolution of the reconstructed geometry map is same as a resolution of the reconstructed texture map; obtaining a point of the source point cloud corresponding to a geometry pixel of the geometry map and a texture pixel of the texture map; selecting a color of the texture pixel based on a color of the obtained point; and generating an encoded video stream based on the selected color, the geometry map, and the texture map.

    2D atlas adaptive sampling in 3D mesh compression

    公开(公告)号:US11924434B2

    公开(公告)日:2024-03-05

    申请号:US17903634

    申请日:2022-09-06

    摘要: Aspects of the disclosure provide methods and apparatuses for mesh coding (e.g., compression and decompression). In some examples, an apparatus for mesh coding includes processing circuitry. The processing circuitry decodes a plurality of initial maps in two-dimension from a bitstream carrying a three-dimensional (3D) mesh frame. The processing circuitry determines at least two sampling rates associated with different portions of the plurality of initial maps and recovers from the plurality of initial maps and based on the at least two sampling rates associated with the different portions of the plurality of initial maps to obtain a plurality of recovered maps. A first portion of the plurality of initial maps is recovered based on a first sampling rate, and a second portion of the plurality of initial maps is recovered based on a second sampling rate. The processing circuitry reconstructs the 3D mesh frame based on the plurality of recovered maps.

    MESH OPTIMIZATION USING NOVEL SEGMENTATION
    5.
    发明公开

    公开(公告)号:US20240062470A1

    公开(公告)日:2024-02-22

    申请号:US18315125

    申请日:2023-05-10

    IPC分类号: G06T17/20 G06T7/11

    摘要: A method and apparatus that renders a mesh from one or more virtual camera views of an object, the one or more virtual camera views being projections of the mesh onto a plurality of 2D planes; inputs the one or more virtual camera views into a fully-convolutional model for real-time segmentation; generates one or more 2D pixel-wise masks based on the fully-convolutional model, the 2D pixel-wise masks being associated with one or more segmented elements; performs remeshing and mesh optimization using the one or more 2D pixel-wise masks; and generates an output mesh based on the remeshing and mesh optimization.

    VERTEX PREDICTION BASED ON DECODED NEIGHBORS

    公开(公告)号:US20230412842A1

    公开(公告)日:2023-12-21

    申请号:US18312265

    申请日:2023-05-04

    摘要: A method and apparatus comprising computer code configured to cause a processor or processors to obtain volumetric data of at least one three-dimensional (3D) visual content, derive a first layer of a mesh including a plurality of first vertices from at least one frame of the volumetric data, determine displacement vectors from ones of the plurality of vertices of the first layer to respective ones of a plurality of second vertices of a second layer of the mesh, a total quantity of the plurality of second vertices is greater than a total quantity of the plurality of first vertices, and signal the volumetric data based on the displacement vectors.