公开(公告)号：US11869223B2

公开(公告)日：2024-01-09

申请号：US17791692

申请日：2021-01-08

Applicant: APPLE INC.

Inventor： David Flynn ,  Khaled Mammou ,  Fabrice A. Robinet

IPC: G06T9/40 ,  G06T17/00

CPC classification number: G06T9/40 ,  G06T17/005 ,  G06T2210/56

Abstract: An example method includes receiving (502) a plurality of points that represent a point cloud; representing a position of the point in each dimension of a three-dimensional space as a sequence of bits (504), where the position of the point is encoded according to a tree data structure; partitioning (506) at least one of the sequences of bits into a first portion of bits and a second portion of bits; quantizing (508) each of the second portions of bits according to a quantization step size, where the quantization step size is determined according to an exponential function having a quantization parameter value as an input and the quantization step size as an output; and generating (510) a data structure representing the point cloud and including the quantized second portions of bits.

公开(公告)号：US11748916B2

公开(公告)日：2023-09-05

申请号：US17804477

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin

IPC: G06T9/00 ,  H04N19/597

CPC classification number: G06T9/001 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

公开(公告)号：US11727603B2

公开(公告)日：2023-08-15

申请号：US17318273

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Alexandros Tourapis

IPC: G06T9/00 ,  G06T7/50

CPC classification number: G06T9/00 ,  G06T7/50 ,  G06T2207/10012 ,  G06T2207/10028

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.

公开(公告)号：US11663744B2

公开(公告)日：2023-05-30

申请号：US17306863

申请日：2021-05-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T3/40 ,  H03M7/30 ,  G06T17/20

CPC classification number: G06T9/00 ,  G06T3/40 ,  G06T17/20 ,  H03M7/6005 ,  H03M7/6011

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US20230099049A1

公开(公告)日：2023-03-30

申请号：US17937381

申请日：2022-09-30

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet

IPC: G06T9/40 ,  G06T7/50 ,  G06T3/40 ,  H04N19/44 ,  H04N19/96 ,  H04N19/90 ,  H04N19/91 ,  H04N19/186 ,  G06T17/00 ,  H04N19/593

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.

公开(公告)号：US20230053544A1

公开(公告)日：2023-02-23

申请号：US17791692

申请日：2021-01-08

Applicant: APPLE INC.

Inventor： David Flynn ,  Khaled Mammou ,  Fabrice A. Robinet

IPC: G06T9/40 ,  G06T17/00

Abstract: An example method includes receiving (502) a plurality of points that represent a point cloud; representing a position of the point in each dimension of a three-dimensional space as a sequence of bits (504), where the position of the point is encoded according to a tree data structure; partitioning (506) at least one of the sequences of bits into a first portion of bits and a second portion of bits; quantizing (508) each of the second portions of bits according to a quantization step size, where the quantization step size is determined according to an exponential function having a quantization parameter value as an input and the quantization step size as an output; and generating (510) a data structure representing the point cloud and including the quantized second portions of bits.

公开(公告)号：US20230046917A1

公开(公告)日：2023-02-16

申请号：US17791635

申请日：2021-01-08

Applicant: APPLE INC.

Inventor： David Flynn ,  Khaled Mammou ,  Fabrice A. Robinet

IPC: H04N19/597 ,  H04N19/96 ,  H04N19/124 ,  H04N19/167 ,  H04N19/182 ,  G06T15/00

Abstract: An example device includes one or more processors, and memory storing instructions that when executed by the processors, cause the processors to receive points that represent a point cloud in three-dimensional space, and generate a data structure representing the point cloud. Generating the data structure includes encoding a position of each point in each dimension as a sequence of bits according to a tree data structure; partitioning each of the sequences into two or more portions according to a scaling depth; determining that a subset of the points is spatially isolated from a remainder of the points; quantizing each of the portions associated with the subset of the points according to a first quantization step size; quantizing each of the portions associated with the remainder of the points according to a second quantization step size; and including the quantized portions in the data structure.

公开(公告)号：US11461935B2

公开(公告)日：2022-10-04

申请号：US17112532

申请日：2020-12-04

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet

IPC: G06T9/40 ,  G06T7/50 ,  G06T3/40 ,  H04N19/44 ,  H04N19/96 ,  H04N19/90 ,  H04N19/91 ,  H04N19/186 ,  G06T17/00 ,  H04N19/593

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information for the point cloud. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values used to correct predicted attribute values are included in the compressed attribute information file. Attribute values are predicted based, at least in part, on attribute values of neighboring points and distances between a particular point for whom an attribute value is being predicted and the neighboring points. The predicted attribute values are compared to attribute values of a point cloud prior to compression to determine attribute correction values. A decoder follows a similar prediction process as an encoder and corrects predicted values using attribute correction values included in a compressed attribute information file.

公开(公告)号：US11386524B2

公开(公告)日：2022-07-12

申请号：US16586872

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Yeping Su ,  David W. Singer ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T3/40 ,  G06T5/00 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US11361471B2

公开(公告)日：2022-06-14

申请号：US15931349

申请日：2020-05-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/50 ,  G06T9/00 ,  G06T7/70 ,  G06T7/20 ,  A01C3/02 ,  G08B1/00 ,  G09B1/00 ,  G06T1/00 ,  G11B7/002

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.