-
公开(公告)号:US11533494B2
公开(公告)日:2022-12-20
申请号:US17187439
申请日:2021-02-26
Applicant: Apple Inc.
Inventor: Khaled Mammou , Valery G. Valentin , Fabrice A. Robinet , Alexandros Tourapis , Yeping Su , Jungsun Kim
IPC: H04N19/20 , H04N19/597 , H04N19/46 , H04N19/174 , G06T7/11 , G06T7/246 , H04N19/176 , H04N19/86 , H04N19/70
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.
-
公开(公告)号:US11508094B2
公开(公告)日:2022-11-22
申请号:US17163188
申请日:2021-01-29
Applicant: Apple Inc.
Inventor: Khaled Mammou , Valery G. Valentin , Fabrice A. Robinet , Alexandros Tourapis , Yeping Su , Jungsun Kim
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.
-
公开(公告)号:US11252441B2
公开(公告)日:2022-02-15
申请号:US17163204
申请日:2021-01-29
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Jungsun Kim , Valery G. Valentin , Fabrice A. Robinet , Yeping Su , Khaled Mammou
IPC: H04N19/91 , H04N19/20 , H04N19/124 , G06T9/00 , H04N19/13
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
-
公开(公告)号:US20210256735A1
公开(公告)日:2021-08-19
申请号:US17306863
申请日:2021-05-03
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Khaled Mammou , Yeping Su , Jungsun Kim , Valery G. Valentin , David W. Singer , Fabrice A. Robinet , Hsi-Jung Wu
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.
-
公开(公告)号:US20210211703A1
公开(公告)日:2021-07-08
申请号:US17143882
申请日:2021-01-07
Applicant: Apple Inc.
Inventor: Jungsun Kim , Alexandros Tourapis , Khaled Mammou
Abstract: In an example method, points that represent three-dimensional visual volumetric content are received, and patches are determined, where each patch corresponds to a respective portion of the visual volumetric content. A patch image representing a set of points corresponding to the patch projected onto a respective patch plane is generated for each patch. The patch images are packed into image frames, and the image frames are encoded. An occupancy map corresponding to the image frames is generated. The occupancy map indicates, for each image frame: locations of the patch images in the image frame, and depth information of sets of points corresponding to the patch images in the image frame. The depth information indicates, for each patch image, depths of the set of points corresponding to the patch image in a direction perpendicular to a patch plane of the patch image.
-
公开(公告)号:US11010928B2
公开(公告)日:2021-05-18
申请号:US16380920
申请日:2019-04-10
Applicant: Apple Inc.
Inventor: Khaled Mammou , Jungsun Kim , Valery G. Valentin , Fabrice A. Robinet , Yeping Su , Alexandros Tourapis
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.
-
公开(公告)号:US20210105493A1
公开(公告)日:2021-04-08
申请号:US17062446
申请日:2020-10-02
Applicant: Apple Inc.
Inventor: Khaled Mammou , David Flynn , Alexandros Tourapis , Jungsun Kim
IPC: H04N19/20 , H04N19/119 , H04N19/124 , H04N19/136 , H04N19/176 , H04N19/50 , H04N19/61
Abstract: An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.
-
公开(公告)号:US20210090301A1
公开(公告)日:2021-03-25
申请号:US17030264
申请日:2020-09-23
Applicant: Apple Inc.
Inventor: Khaled Mammou , Alexandros Tourapis , Jungsun Kim
IPC: G06T9/00 , G06T3/40 , G06T5/00 , G06T17/20 , H04N19/20 , H04N19/597 , H04N19/80 , H04N19/172
Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.
-
公开(公告)号:US10911787B2
公开(公告)日:2021-02-02
申请号:US16508202
申请日:2019-07-10
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Jungsun Kim , Valery G. Valentin , Fabrice A. Robinet , Yeping Su , Khaled Mammou
IPC: H04N19/91 , H04N19/20 , H04N19/124 , G06T9/00 , H04N19/13
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
-
公开(公告)号:US10909726B2
公开(公告)日:2021-02-02
申请号:US16380928
申请日:2019-04-10
Applicant: Apple Inc.
Inventor: Khaled Mammou , Valery G. Valentin , Fabrice A. Robinet , Alexandros Tourapis , Yeping Su , Jungsun Kim
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.
-
-
-
-
-
-
-
-
-