公开(公告)号：US11948339B2

公开(公告)日：2024-04-02

申请号：US17832816

申请日：2022-06-06

Applicant: Apple Inc.

Inventor： Khaled Mammou

IPC: G06T9/00 ,  G06T17/20

CPC classification number: G06T9/001 ,  G06T17/20

Abstract: According to an example method, a system receives first data representing a polygon mesh. The polygon mesh includes a plurality of interconnected vertices forming a plurality of triangles. The system generates second data representing the polygon mesh. Generating the second data includes traversing the vertices of the polygon mesh according to a traversal order, partitioning the plurality of triangles into a set of ordered triangle groups in accordance with the traversal order, and encoding, in the second data, the set of ordered triangle groups. The system outputs the second data. A position each of the vertices in the transversal order is determined based on (i) a number of previously encoded triangles that are incident to that vertex, and/or (ii) a sum of one or more angles formed by the previously encoded triangles that are incident to that vertex.

公开(公告)号：US11948338B1

公开(公告)日：2024-04-02

申请号：US17691754

申请日：2022-03-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Maneli Noorkami ,  Afshin Taghavi Nasrabadi

IPC: G06T9/00 ,  G06T3/40 ,  G06T3/4023 ,  G06T15/10 ,  G06T17/20

CPC classification number: G06T9/001 ,  G06T3/4023 ,  G06T15/10 ,  G06T17/205 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2210/08

Abstract: An encoder encodes three-dimensional (3D) volumetric content, such as immersive media, using video encoded attribute patch images packed into a 2D atlas to communicate the attribute values for the 3D volumetric content. The encoder also uses mesh-encoded sub-meshes to communicate geometry information for portions of the 3D object or scene corresponding to the attribute patch images packed into the 2D atlas. The encoder applies decimation operations to the sub-meshes to simplify the sub-meshes before mesh encoding the sub-meshes. A distortion analysis is performed to bound the level to which the sub-meshes are simplified at the encoder. Mesh simplification at the encoder reduces the number of vertices and edges included in the sub-meshes which simplifies rendering at a decoder receiving the encoded 3D volumetric content.

公开(公告)号：US11935272B2

公开(公告)日：2024-03-19

申请号：US17937381

申请日：2022-09-30

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet

IPC: G06T9/40 ,  G06T7/50 ,  G06T17/00 ,  H04N19/186 ,  H04N19/44 ,  H04N19/593 ,  H04N19/90 ,  H04N19/91 ,  H04N19/96

CPC classification number: G06T9/40 ,  G06T3/4007 ,  G06T7/50 ,  G06T17/005 ,  H04N19/186 ,  H04N19/45 ,  H04N19/593 ,  H04N19/90 ,  H04N19/91 ,  H04N19/96 ,  G06T2207/10028

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.

公开(公告)号：US20240078738A1

公开(公告)日：2024-03-07

申请号：US18507377

申请日：2023-11-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Deepak S. Tolani ,  Alexandros Tourapis

IPC: G06T15/04 ,  G06T9/00 ,  G06T11/40 ,  G06T15/08 ,  G06T17/20

CPC classification number: G06T15/04 ,  G06T9/00 ,  G06T11/40 ,  G06T15/08 ,  G06T17/20

Abstract: A system compresses and decompresses attribute information for visual volumetric content, such as a mesh representation. Attribute values are included in the visual volumetric representation, wherein at least some of the attribute values include unitary vectors, such as surface normal vectors or surface tangent vectors having a magnitude of one unit. In order to compress the attribute information the three-dimensional unit vectors are mapped into two dimensional parametric coordinates for a planar representation of a unit sphere. To reduce negative effects on compression due to distortion or discontinuities in the planar representation, mappings for compressing respective unit vectors are adaptively selected.

公开(公告)号：US11887345B2

公开(公告)日：2024-01-30

申请号：US17225081

申请日：2021-04-07

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  David Flynn ,  Alexandros Tourapis

IPC: G06T9/40

CPC classification number: G06T9/40

Abstract: A system receives encoded data regarding a points in a point cloud. The data includes a prediction tree having a nodes generated based on spatial information regarding the points and properties of a sensor system that obtained the spatial information. A value of each node represents first spatial coordinates of a respective one of the points according to a first coordinate system, and the value of at least a first node in the prediction tree is determined based on ancestor nodes of the first node and the properties of the sensor system. The system decodes the data to determine first data, including the first spatial coordinates of at least some of the points, and quantization parameters associated with the first spatial coordinates. The system determines second data based on the first data, including second spatial coordinates of at least some of the points according to a second coordinate system.

公开(公告)号：US20230401751A1

公开(公告)日：2023-12-14

申请号：US18452345

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06T9/00 ,  G06T3/40 ,  G06T5/00 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172 ,  G06T17/20

CPC classification number: G06T9/00 ,  G06T3/4038 ,  G06T3/4007 ,  G06T5/002 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172 ,  G06T17/20 ,  G06T2207/20024

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US20230319310A1

公开(公告)日：2023-10-05

申请号：US18328954

申请日：2023-06-05

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  David W. Singer ,  Fabrice A. Robinet

IPC: H04N19/597 ,  H04N19/467 ,  H04N21/81 ,  H04N19/20 ,  G06T7/10

CPC classification number: H04N19/597 ,  H04N19/467 ,  H04N21/8193 ,  H04N19/20 ,  G06T7/10

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

公开(公告)号：US11683525B2

公开(公告)日：2023-06-20

申请号：US17523826

申请日：2021-11-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/85 ,  H04N19/463

CPC classification number: H04N19/597 ,  H04N19/463 ,  H04N19/85

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US11676309B2

公开(公告)日：2023-06-13

申请号：US17466601

申请日：2021-09-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Fabrice A. Robinet ,  David W. Singer

IPC: G06T9/00 ,  G06T3/00

CPC classification number: G06T9/00 ,  G06T3/005 ,  G06T9/001

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US20230005188A1

公开(公告)日：2023-01-05

申请号：US17822651

申请日：2022-08-26

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Fabrice A. Robinet ,  Jungsun Kim ,  Khaled Mammou ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.