公开(公告)号：US20200099942A1

公开(公告)日：2020-03-26

申请号：US16583153

申请日：2019-09-25

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  Khaled Mammou ,  Jungsun Kim ,  David W. Singer ,  Fabrice A. Robinet ,  Guy Cote ,  Jim C. Chou ,  Hsi-Jung Wu

IPC: H04N19/186 ,  H04N19/124 ,  H04N19/176 ,  H04N19/159

Abstract: Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.

公开(公告)号：US20190156520A1

公开(公告)日：2019-05-23

申请号：US16198635

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/70 ,  G06T7/20 ,  G06T7/50

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

公开(公告)号：US20190075320A1

公开(公告)日：2019-03-07

申请号：US16121501

申请日：2018-09-04

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Fabrice A. Robinet ,  Andrea Cremaschi ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/59

CPC classification number: H04N19/597 ,  G06T17/00 ,  G06T2210/56 ,  H04N19/119 ,  H04N19/132 ,  H04N19/167 ,  H04N19/182 ,  H04N19/59

Abstract: A system comprises an encoder configured to compress a point cloud comprising a plurality of points each point comprising spatial information for the point. The encoder is configured to sub-sample the points and determine subdivision locations for the subsampled points. Also, the encoder is configured to determine, for respective subdivision location, if a point is to be included, not included, or relocated relative to the subdivision location. The encoder encodes spatial information for the sub-sampled points and encodes subdivision location point inclusion/relocation information to generate a compressed point cloud. A decoder recreates an original or near replica of an original point cloud based on the spatial information and the subdivision location inclusion/relocation information included in the compressed point cloud.

公开(公告)号：US12256098B1

公开(公告)日：2025-03-18

申请号：US17691691

申请日：2022-03-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Afshin Taghavi Nasrabadi ,  Maneli Noorkami ,  Fabrice A. Robinet

IPC: H04N19/597 ,  G06T17/20 ,  H04N19/176 ,  H04N19/182

Abstract: A decoding computing device receives a bit stream for compressed 3D volumetric content. The bit stream includes video encoded image frames comprising packed attribute patch images and depth maps for the 3D volumetric content. Instead of generating a mesh having a vertex for each depth value signaled in the depth map, the decoder performs a real-time mesh simplification process to reduce a resolution of the mesh, such that the mesh resolution is reduced without exceeding an error threshold, which may be dynamically determined. Additionally, the decoder may perform a re-meshing of particular regions of the mesh for the 3D volumetric content to avoid cracks or gaps.

公开(公告)号：US12175716B2

公开(公告)日：2024-12-24

申请号：US18545925

申请日：2023-12-19

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  David Flynn ,  Alexandros Tourapis

IPC: G06T9/40

Abstract: A system receives encoded data regarding a points in a point cloud. The data includes a prediction tree having a nodes generated based on spatial information regarding the points and properties of a sensor system that obtained the spatial information. A value of each node represents first spatial coordinates of a respective one of the points according to a first coordinate system, and the value of at least a first node in the prediction tree is determined based on ancestor nodes of the first node and the properties of the sensor system. The system decodes the data to determine first data, including the first spatial coordinates of at least some of the points, and quantization parameters associated with the first spatial coordinates. The system determines second data based on the first data, including second spatial coordinates of at least some of the points according to a second coordinate system.

公开(公告)号：US12100183B2

公开(公告)日：2024-09-24

申请号：US18052803

申请日：2022-11-04

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Alexandros Tourapis ,  Jungsun Kim ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T9/00 ,  G01S17/89 ,  G06F16/901 ,  G06T17/00

CPC classification number: G06T9/001 ,  G01S17/89 ,  G06F16/9027 ,  G06T17/00 ,  G06T2210/36

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. A point cloud attribute transfer algorithm may be used to determine distortion between an original point cloud and a reconstructed point cloud. Additionally, the point cloud attribute transfer algorithm may be used to select attribute values for a reconstructed point cloud such that distortion between an original point cloud and a reconstructed version of the original point cloud is minimized.

公开(公告)号：US20240153150A1

公开(公告)日：2024-05-09

申请号：US18494686

申请日：2023-10-25

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Alexandros Tourapis ,  Khaled Mammou

IPC: G06T9/00 ,  H04N19/184

CPC classification number: G06T9/001 ,  H04N19/184

Abstract: A system comprises an encoder configured to compress and encode data for three-dimensional visual volumetric content. To compress the 3D visual volumetric content, a compressed mesh is generated as well as compressed attribute information. Also, texture coordinates indicating a mapping between the vertices of the mesh and the attributes are signaled. However, in some situations a resolution used for the texture coordinates and a resolution used for the attributes may differ, in which case the respective resolutions are signaled. A decoder determines how to adjust the texture coordinate to attribute value mapping to account for the differing resolutions.

公开(公告)号：US11915373B1

公开(公告)日：2024-02-27

申请号：US17663794

申请日：2022-05-17

Applicant: Apple Inc.

Inventor： Khaled Mammou

IPC: G06T17/20 ,  G06T15/04

CPC classification number: G06T17/20 ,  G06T15/04

Abstract: A system comprises a prediction module configured to predict an attribute value, such as a texture coordinate, for a vertex of a triangle in a two-dimensional (2D) attribute representation based on known positions of vertices of a corresponding triangle in a three-dimensional (3D) geometric representation. In some embodiments, the prediction module adaptively selects a prediction technique between multiple available prediction techniques based on availability of vertices information in the 3D geometric representation and in the 2D attribute representation and further based on compression efficiency and distortion minimization. The prediction module enables compression of attribute information being signaled for volumetric visual content, such as a mesh with texture.

公开(公告)号：US11889116B2

公开(公告)日：2024-01-30

申请号：US18046861

申请日：2022-10-14

Applicant: Apple Inc.

Inventor： Jungsun Kim ,  Khaled Mammou ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/124 ,  H04N19/30 ,  H04N19/46

CPC classification number: H04N19/597 ,  H04N19/124 ,  H04N19/30 ,  H04N19/46

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

公开(公告)号：US20240022765A1

公开(公告)日：2024-01-18

申请号：US18352973

申请日：2023-07-14

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Dimitri Podborski ,  Jungsun Kim ,  Khaled Mammou

IPC: H04N19/597 ,  H04N19/159 ,  H04N19/169 ,  H04N19/70

CPC classification number: H04N19/597 ,  H04N19/159 ,  H04N19/188 ,  H04N19/70

Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional mesh. To compress the three-dimensional mesh, the encoder determines a compressed base mesh bit stream and a compressed motion bitstream. A network abstraction layer syntax defined for the compressed base mesh bit stream and the compressed motion bitstream, allows for various parameters to be defined and applied to both bit streams, such as timing information and faceIDs for faces of polygons of the mesh.