-
公开(公告)号:US20210211703A1
公开(公告)日:2021-07-08
申请号:US17143882
申请日:2021-01-07
Applicant: Apple Inc.
Inventor: Jungsun Kim , Alexandros Tourapis , Khaled Mammou
Abstract: In an example method, points that represent three-dimensional visual volumetric content are received, and patches are determined, where each patch corresponds to a respective portion of the visual volumetric content. A patch image representing a set of points corresponding to the patch projected onto a respective patch plane is generated for each patch. The patch images are packed into image frames, and the image frames are encoded. An occupancy map corresponding to the image frames is generated. The occupancy map indicates, for each image frame: locations of the patch images in the image frame, and depth information of sets of points corresponding to the patch images in the image frame. The depth information indicates, for each patch image, depths of the set of points corresponding to the patch image in a direction perpendicular to a patch plane of the patch image.
-
公开(公告)号:US11010928B2
公开(公告)日:2021-05-18
申请号:US16380920
申请日:2019-04-10
Applicant: Apple Inc.
Inventor: Khaled Mammou , Jungsun Kim , Valery G. Valentin , Fabrice A. Robinet , Yeping Su , Alexandros Tourapis
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.
-
公开(公告)号:US20210105493A1
公开(公告)日:2021-04-08
申请号:US17062446
申请日:2020-10-02
Applicant: Apple Inc.
Inventor: Khaled Mammou , David Flynn , Alexandros Tourapis , Jungsun Kim
IPC: H04N19/20 , H04N19/119 , H04N19/124 , H04N19/136 , H04N19/176 , H04N19/50 , H04N19/61
Abstract: An encoder is configured to compress point cloud information using a blocks of nodes determined from a prediction tree. A prediction tree is generated for a point cloud. Segments of the prediction tree are identified. The segments are divided into blocks that are predicted by predecessor blocks within the segments. The blocks of the prediction tree may then be encoded and may be provided for transmission to a decoder that can regenerate the point cloud from the blocks of the prediction tree.
-
公开(公告)号:US20210090301A1
公开(公告)日:2021-03-25
申请号:US17030264
申请日:2020-09-23
Applicant: Apple Inc.
Inventor: Khaled Mammou , Alexandros Tourapis , Jungsun Kim
IPC: G06T9/00 , G06T3/40 , G06T5/00 , G06T17/20 , H04N19/20 , H04N19/597 , H04N19/80 , H04N19/172
Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.
-
公开(公告)号:US10911787B2
公开(公告)日:2021-02-02
申请号:US16508202
申请日:2019-07-10
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Jungsun Kim , Valery G. Valentin , Fabrice A. Robinet , Yeping Su , Khaled Mammou
IPC: H04N19/91 , H04N19/20 , H04N19/124 , G06T9/00 , H04N19/13
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. To compress the attribute information, multiple levels of detail are generated based on an ordering of the points according to a space filling curve and attribute values are predicted. The attribute values may be predicted simultaneously while points are being assigned to different levels of detail. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, attribute correction values may take into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.
-
公开(公告)号:US10909726B2
公开(公告)日:2021-02-02
申请号:US16380928
申请日:2019-04-10
Applicant: Apple Inc.
Inventor: Khaled Mammou , Valery G. Valentin , Fabrice A. Robinet , Alexandros Tourapis , Yeping Su , Jungsun Kim
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.
-
公开(公告)号:US20200217937A1
公开(公告)日:2020-07-09
申请号:US16736703
申请日:2020-01-07
Applicant: Apple Inc.
Inventor: Khaled Mammou , Alexandros Tourapis , Jungsun Kim
IPC: G01S7/4861 , G01S17/42
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.
-
公开(公告)号:US20200111236A1
公开(公告)日:2020-04-09
申请号:US16592711
申请日:2019-10-03
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Valery G. Valentin , Fabrice A. Robinet , Khaled Mammou , Jungsun Kim , Yeping Su
IPC: G06T9/00
Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. In order to improve computing efficiency and/or repeatability, fixed-point number representations are used when determining predicted attribute values and attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file using fixed-point number representations.
-
公开(公告)号:US20250054197A1
公开(公告)日:2025-02-13
申请号:US18806983
申请日:2024-08-16
Applicant: Apple Inc.
Inventor: Alexandros Tourapis , Fabrice A. Robinet , Jungsun Kim , Khaled Mammou , Valery G. Valentin , Yeping Su
IPC: G06T9/00 , H04N19/597
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. The encoder is also configured to determine quantized minimum depths and/or maximum depths patch images in the image frames, wherein depth information is signaled relative to the quantized minimum depth.
-
公开(公告)号:US20240412419A1
公开(公告)日:2024-12-12
申请号:US18807049
申请日:2024-08-16
Applicant: Apple Inc.
Inventor: Khaled Mammou , Yeping Su , Alexandros Tourapis , Jungsun Kim , Valery G. Valentin , Fabrice A. Robinet
IPC: G06T9/00 , G01S17/89 , G06F16/901 , G06T17/00
Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.
-
-
-
-
-
-
-
-
-