Compression and Signaling of Displacements in Dynamic Mesh Compression

    公开(公告)号:US20250022182A1

    公开(公告)日:2025-01-16

    申请号:US18770285

    申请日:2024-07-11

    Applicant: Apple Inc.

    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional dynamic mesh. The three-dimensional dynamic mesh is compressed and signaled using a base-mesh sub-bitstream and a displacement sub-bitstream. The displacement sub-bitstream comprises displacement information to be applied at sub-division points of the base mesh to recreate the three-dimensional dynamic mesh at a given moment in time. A separate data unit type is used to signal the displacement sub-bitstream that allows for efficient signaling of sub-blocks that are only partially occupied or empty. Also, a separate patch type may be used in an atlas bitstream to signal the displacement data units. A complimentary decoder decodes a compressed bitstream for the three-dimensional dynamic mesh, encoded such as by the encoder.

    Mesh Compression Texture Coordinate Signaling and Decoding

    公开(公告)号:US20240153150A1

    公开(公告)日:2024-05-09

    申请号:US18494686

    申请日:2023-10-25

    Applicant: Apple Inc.

    CPC classification number: G06T9/001 H04N19/184

    Abstract: A system comprises an encoder configured to compress and encode data for three-dimensional visual volumetric content. To compress the 3D visual volumetric content, a compressed mesh is generated as well as compressed attribute information. Also, texture coordinates indicating a mapping between the vertices of the mesh and the attributes are signaled. However, in some situations a resolution used for the texture coordinates and a resolution used for the attributes may differ, in which case the respective resolutions are signaled. A decoder determines how to adjust the texture coordinate to attribute value mapping to account for the differing resolutions.

    Video-based point cloud compression with variable patch scaling

    公开(公告)号:US11889116B2

    公开(公告)日:2024-01-30

    申请号:US18046861

    申请日:2022-10-14

    Applicant: Apple Inc.

    CPC classification number: H04N19/597 H04N19/124 H04N19/30 H04N19/46

    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

    Point cloud compression using a space filling curve for level of detail generation

    公开(公告)号:US11754685B2

    公开(公告)日:2023-09-12

    申请号:US17935009

    申请日:2022-09-23

    Applicant: Apple Inc.

    CPC classification number: G01S7/4861 G01S17/42 H03M7/3062 G01S17/89

    Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.

    Encoding and Decoding Visual Content Including Polygonal Meshes

    公开(公告)号:US20230076939A1

    公开(公告)日:2023-03-09

    申请号:US17942032

    申请日:2022-09-09

    Applicant: Apple Inc.

    Abstract: In an example method, a system obtains first data representing a plurality of polygons of a polygon mesh, and performs several operations for each of the polygons, including (i) determining a number of sample points for that polygon, where the number of sample points is determined based on at least one of an area of that polygon or an area of the polygon mesh, (ii) determining a distribution of the sample points for that polygon, and (iii) sampling the polygon mesh in accordance with the determined number of sample points and the determined distribution of sample points, where sampling the polygon mesh includes determining one or more characteristics of the polygon mesh at each of the sample points. The system also outputs second data representing the one or more characteristics of the polygon mesh at one or more of the sample points.

Patent Agency Ranking