公开(公告)号：US20200219290A1

公开(公告)日：2020-07-09

申请号：US16736765

申请日：2020-01-07

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou

IPC: G06T9/00 ,  H04N19/597

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding. Auxiliary information is signaled for use in identifying patches in an image frame. The auxiliary information may be signaled using a syntax that includes a header portion and data portion, which may enable temporal prediction and timing information to be signaled.

公开(公告)号：US20200014953A1

公开(公告)日：2020-01-09

申请号：US16503933

申请日：2019-07-05

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/463 ,  H04N19/85

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US20190313110A1

公开(公告)日：2019-10-10

申请号：US16380922

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Valery G. Valentin ,  Fabrice A. Robinet ,  Alexandros Tourapis ,  Yeping Su ,  Jungsun Kim

IPC: H04N19/20 ,  H04N19/597 ,  H04N19/176 ,  H04N19/70 ,  H04N19/46 ,  H04N19/86 ,  H04N19/91

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder generates an occupancy map and may also encode the occupancy map as an image based representation. In some embodiments, a video encoder encodes image based representations of spatial information for the points of the point cloud, image based representations of attribute values for points of the point cloud, and an image based representation of an occupancy map for the spatial and attribute images.

公开(公告)号：US20190311502A1

公开(公告)日：2019-10-10

申请号：US16380931

申请日：2019-04-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G06F16/901 ,  G06T17/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.

公开(公告)号：US12198389B2

公开(公告)日：2025-01-14

申请号：US18452345

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06V10/00 ,  G06T3/4007 ,  G06T3/4038 ,  G06T5/70 ,  G06T9/00 ,  G06T17/20 ,  H04N19/172 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US20230401755A1

公开(公告)日：2023-12-14

申请号：US18303411

申请日：2023-04-19

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Dimitri Podborski

IPC: G06T9/00

CPC classification number: G06T9/001

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also, the sub-meshes may be grouped into patches, patch-groups, and/or tiles. Different encoding parameters may be used for such different coding units (e.g., patches, patch-groups and/or tiles). However, the encoding parameters are adjusted for vertices that are shared between coding units to avoid introduction of artefacts. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US11783508B2

公开(公告)日：2023-10-10

申请号：US17933065

申请日：2022-09-16

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim

IPC: G06V10/00 ,  G06T9/00 ,  G06T3/40 ,  G06T5/00 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  H04N19/172 ,  G06T17/20

CPC classification number: G06T9/00 ,  G06T3/4007 ,  G06T3/4038 ,  G06T5/002 ,  G06T17/20 ,  H04N19/172 ,  H04N19/20 ,  H04N19/597 ,  H04N19/80 ,  G06T2207/20024

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh using a video encoding technique. To compress the three-dimensional mesh, the encoder determines sub-meshes and for each sub-mesh: texture patches and geometry patches. Also the encoder determines patch connectivity information and patch texture coordinates for the texture patches and geometry patches. The texture patches and geometry patches are packed into video image frames and encoded using a video codec. Additionally, the encoder determines boundary stitching information for the sub-meshes. A decoder receives a bit stream as generated by the encoder and reconstructs the three-dimensional mesh.

公开(公告)号：US20230290011A1

公开(公告)日：2023-09-14

申请号：US18166209

申请日：2023-02-08

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Dimitri Podborski ,  Khaled Mammou ,  David Flynn

IPC: G06T9/00 ,  G06T17/20

CPC classification number: G06T9/001 ,  G06T17/205

Abstract: A video dynamic mesh coding (v-DMC) decoding system, includes a de-multiplexer that receives and demultiplexes an encoded v-DMC bitstream into: a parameter set and mesh data, geometry, atlas data, and attribute video substreams. The decoding system also includes: a mesh data substream decoder; a video decoder that decodes the geometry data substream; an atlas data substream decoder; a mesh subdivision component that subdivides the one or more base meshes into one or more resampled base meshes based upon the decoded atlas data; a displacement decoder that outputs one or more displacements to verticies of the one or more resampled base meshes; a mesh position refinement component that applies the one or more displacements to the one or more resampled base meshes and outputs one or more resultant meshes; and a video decoder that decodes the attribute video substream into one or more texture images.

公开(公告)号：US11711544B2

公开(公告)日：2023-07-25

申请号：US16912617

申请日：2020-06-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Khaled Mammou ,  David W. Singer ,  Fabrice A. Robinet

IPC: H04N19/597 ,  H04N19/467 ,  H04N21/81 ,  H04N19/20 ,  G06T7/10

CPC classification number: H04N19/597 ,  G06T7/10 ,  H04N19/20 ,  H04N19/467 ,  H04N21/8193

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. Additionally, an encoder is configured to signal and/or a decoder is configured to receive a supplementary message comprising volumetric tiling information that maps portions of 2D image representations to objects in the point. In some embodiments, characteristics of the object may additionally be signaled using the supplementary message or additional supplementary messages.

公开(公告)号：US11647226B2

公开(公告)日：2023-05-09

申请号：US17319019

申请日：2021-05-12

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou ,  Fabrice A. Robinet ,  Yeping Su ,  David W. Singer

IPC: H04N19/597 ,  H04N19/17 ,  G06T9/00

CPC classification number: H04N19/597 ,  H04N19/17 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.