公开(公告)号：US20240144541A1

公开(公告)日：2024-05-02

申请号：US18494679

申请日：2023-10-25

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou

IPC: G06T9/00

CPC classification number: G06T9/001

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines displacements to be applied to sub-division locations of a base mesh. The displacement values may be signaled in their own sub-bitstream, e.g., a dedicated displacement data sub-bitstream, or may be signaled, at least in part, in an atlas data sub-bitstream that includes patch data. In some embodiments, the displacements may also be signaled, at least in part, in a video sub-bitstream or in a base-mesh sub-bitstream.

公开(公告)号：US11748916B2

公开(公告)日：2023-09-05

申请号：US17804477

申请日：2022-05-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim ,  Fabrice A. Robinet ,  Valery G. Valentin

IPC: G06T9/00 ,  H04N19/597

CPC classification number: G06T9/001 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

公开(公告)号：US11727603B2

公开(公告)日：2023-08-15

申请号：US17318273

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Yeping Su ,  Alexandros Tourapis

IPC: G06T9/00 ,  G06T7/50

CPC classification number: G06T9/00 ,  G06T7/50 ,  G06T2207/10012 ,  G06T2207/10028

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute for the point cloud. To compress the attribute information, attribute values are predicted using one of a plurality of prediction strategies, wherein a selected prediction strategy is selected based at least in part on attribute variability of points in a neighborhood of points. A decoder follows a similar prediction process. Also, attribute correction values may be determined to correct predicted attribute values and may be used by a decoder to decompress a point cloud, wherein the decoder applies the same prediction strategy applied at the encoder.

公开(公告)号：US11663744B2

公开(公告)日：2023-05-30

申请号：US17306863

申请日：2021-05-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T3/40 ,  H03M7/30 ,  G06T17/20

CPC classification number: G06T9/00 ,  G06T3/40 ,  G06T17/20 ,  H03M7/6005 ,  H03M7/6011

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US11562507B2

公开(公告)日：2023-01-24

申请号：US17031787

申请日：2020-09-24

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Chao Cao ,  Marius Preda

IPC: G06V30/00 ,  G06T9/00 ,  G06T5/00 ,  G06T7/73 ,  H04N19/137 ,  H04N19/80 ,  H04N19/172 ,  H04N19/60

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder generates time-consistent patches for multiple version of the point cloud at multiple moments in time and uses the time-consistent patches to generate image based representations of the point cloud at the multiple moments in time.

公开(公告)号：US11454710B2

公开(公告)日：2022-09-27

申请号：US16736703

申请日：2020-01-07

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G01S7/4861 ,  G01S17/42 ,  H03M7/30

Abstract: A system comprises an encoder configured to compress attribute information for a point cloud and/or a decoder configured to decompress compressed attribute information. Attribute values for at least one starting point are included in a compressed attribute information file and attribute correction values are included in the compressed attribute information file. An order for the points is determined based on a space filling curve, wherein an encoder and a decoder determine a same order for the points based on the space filling curve. Levels of detail are determined by sampling the ordered points according to different sampling parameters, and attribute values are predicted for the points in the levels of detail using the determined order. The encoder determines attribute correction values based on a comparison of the predicted values to an original value prior to compression. The decoder corrects the predicted attribute values based on received attribute correction values.

公开(公告)号：US11450030B2

公开(公告)日：2022-09-20

申请号：US17030264

申请日：2020-09-23

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06V20/00 ,  G06T9/00 ,  G06T3/40 ,  G06T5/00 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172 ,  G06T17/20

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US11386524B2

公开(公告)日：2022-07-12

申请号：US16586872

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Yeping Su ,  David W. Singer ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T3/40 ,  G06T5/00 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US11367224B2

公开(公告)日：2022-06-21

申请号：US16591530

申请日：2019-10-02

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim ,  Fabrice A Robinet ,  Valery G. Valentin

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Various compression strategies may be used to encode an occupancy map and related block-to-patch information indicating which portions of the image frame correspond to which packed patches. Packed image frames comprising patches and padding, along with an encoded occupancy map and related block-to-patch information are sent to a decoder. The decoder is configured to generate a decompressed point cloud based on the packed image frames, compressed occupancy map, and related block-to-patch information.

公开(公告)号：US20220070493A1

公开(公告)日：2022-03-03

申请号：US17523826

申请日：2021-11-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/85 ,  H04N19/463

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.