公开(公告)号：US20210097722A1

公开(公告)日：2021-04-01

申请号：US16586785

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su

IPC: G06T9/00

Abstract: Attributes for point cloud compression may be predicted according to a space filling curve. An order for selecting points of a point cloud to be compressed in order to predict attributes of the points may be determined according to values of a space filling curve applied to spatial information for the points. A point of the point cloud may be selected according to the determined ordering. A prediction technique may be performed with respect to the selected point based on a set of neighboring points in the point cloud also selected according to the ordering. Predicted attribute values and correction values may be determined for the predicted values. The correction values may be encoded as part of a compressed version of the point cloud.

公开(公告)号：US10861196B2

公开(公告)日：2020-12-08

申请号：US16130949

申请日：2018-09-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet

IPC: G06T9/40 ,  G06T7/50 ,  G06T3/40 ,  H04N19/44 ,  H04N19/96 ,  H04N19/90 ,  H04N19/91 ,  H04N19/186 ,  G06T17/00 ,  H04N19/593

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.

公开(公告)号：US20200275125A1

公开(公告)日：2020-08-27

申请号：US16872280

申请日：2020-05-11

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Andrea Cremaschi ,  Alexandros Tourapis

IPC: H04N19/597 ,  G06T17/00 ,  H04N19/119 ,  H04N19/167 ,  H04N19/182 ,  H04N19/59 ,  H04N19/132

Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.

公开(公告)号：US20200021847A1

公开(公告)日：2020-01-16

申请号：US16510706

申请日：2019-07-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.

公开(公告)号：US20200007867A1

公开(公告)日：2020-01-02

申请号：US16459485

申请日：2019-07-01

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Khaled Mammou ,  Valery G. Valentin ,  Yeping Su

IPC: H04N19/14 ,  H04N19/184 ,  H04N19/172 ,  H04N19/124 ,  H04N19/80 ,  H04N19/117

Abstract: A system comprises an encoder configured to compress images, such as image frames comprising attribute information and/or spatial for a point cloud and/or an occupancy map for the point cloud. Also, a system includes a decoder configured to decompress compressed image frames, such as image frames comprising compressed attribute and/or spatial information for the point cloud or an occupancy map for the point cloud. Additionally, the encoder may map N-bit data to M-bit code words, where M is less than N. Alternatively the encoder may map N-bit data to M-bit code words, where M is greater than N. In a similar manner, a decoder may map the M-bit code words back to the N-bit data.

公开(公告)号：US20190394496A1

公开(公告)日：2019-12-26

申请号：US16449171

申请日：2019-06-21

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Khaled Mammou

IPC: H04N19/96 ,  H04N19/91 ,  H04N19/176 ,  G06T9/00

Abstract: An encoder is configured to compress point cloud geometry information using an octree geometric compression technique that utilizes a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process, wherein encoding contexts are selected based, at least in part, on neighborhood configurations. In a similar manner, a decoder is configured to decode compressed point cloud geometry information utilizing a binary arithmetic encoder, a look-ahead table, a cache, and a context selection process.

公开(公告)号：US20190311501A1

公开(公告)日：2019-10-10

申请号：US16380930

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin ,  Yeping Su

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, multiple levels of detail are generated based on spatial information. Also, attribute values are predicted based on the level of details. A decoder follows a similar prediction process based on level of details. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud compressed using level of detail attribute compression. In some embodiments, an update operation is performed to smooth attribute correction values taking into account an influence factor of respective points in a given level of detail on attributes in other levels of detail.

公开(公告)号：US20190311500A1

公开(公告)日：2019-10-10

申请号：US16380928

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: G06T9/00 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder may be configured to further compress points omitted from the image based representation. Also, in some embodiments, a decoder may be configured to decode points compressed outside of an image based representation or in a separate image based representation.

公开(公告)号：US20190156519A1

公开(公告)日：2019-05-23

申请号：US16198634

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/20 ,  G06T7/50

CPC classification number: G06T9/00 ,  G06T5/006 ,  G06T7/20 ,  G06T7/50 ,  G06T19/20 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2219/2012 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.