公开(公告)号：US11979572B2

公开(公告)日：2024-05-07

申请号：US17234596

申请日：2021-04-19

Applicant: Apple Inc.

Inventor： Krishnakanth Rapaka ,  Jaehong Chon ,  Alexandros Tourapis ,  David W. Singer

IPC: H04N19/124 ,  H04N19/172 ,  H04N19/186 ,  H04N19/82

CPC classification number: H04N19/124 ,  H04N19/172 ,  H04N19/186 ,  H04N19/82

Abstract: Improved video coding and decoding techniques are described, including techniques to derive quantization step sizes adaptively with quantization step size table templates. Quantization techniques described provide finer-grained control over quantization with a more flexible quantization step size especially at higher degrees of quantization. This may result in improved overall compression quality. Other coding parameters, such as in-loop filtering parameters, may be derived based on the more flexible quantization parameters.

公开(公告)号：US11663744B2

公开(公告)日：2023-05-30

申请号：US17306863

申请日：2021-05-03

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T3/40 ,  H03M7/30 ,  G06T17/20

CPC classification number: G06T9/00 ,  G06T3/40 ,  G06T17/20 ,  H03M7/6005 ,  H03M7/6011

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US20220353543A1

公开(公告)日：2022-11-03

申请号：US17867644

申请日：2022-07-18

Applicant: Apple Inc.

Inventor： Hye-Yeon Cheong ,  David W. Singer ,  Alexandros Tourapis

IPC: H04N19/82 ,  H04N19/107 ,  H04N19/137 ,  H04N19/182 ,  H04N19/186

Abstract: A system comprises an encoder configured to compress video data using an in-loop noise generation process that generates noise in the compression loop at a sub-image portion level of granularity, such as at a block level. The encoder includes noise model and/or noise model input parameter information in an encoded bit stream. Also, a system includes a decoder configured to receive such a bit stream and decompress the video using an in-loop noise generation process that generates noise in the decompression loop at a sub-image portion level of granularity.

公开(公告)号：US11386524B2

公开(公告)日：2022-07-12

申请号：US16586872

申请日：2019-09-27

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Alexandros Tourapis ,  Jungsun Kim ,  Yeping Su ,  David W. Singer ,  Valery G. Valentin ,  Fabrice A. Robinet

IPC: G06T3/40 ,  G06T5/00 ,  G06T9/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. The encoder is configured to convert a point cloud into an image based representation. The encoder packs patch images into an image frame and fills empty spaces in the image frame with a padding, wherein pixel values for the padding are determined based on neighboring pixels values such that the padding is smoothed in the image frame. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud.

公开(公告)号：US11361471B2

公开(公告)日：2022-06-14

申请号：US15931349

申请日：2020-05-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/50 ,  G06T9/00 ,  G06T7/70 ,  G06T7/20 ,  A01C3/02 ,  G08B1/00 ,  G09B1/00 ,  G06T1/00 ,  G11B7/002

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

公开(公告)号：US20220070493A1

公开(公告)日：2022-03-03

申请号：US17523826

申请日：2021-11-10

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/85 ,  H04N19/463

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US11017566B1

公开(公告)日：2021-05-25

申请号：US16459483

申请日：2019-07-01

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T3/40 ,  H03M7/30 ,  G06T17/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A processing/filtering element utilizes occupancy map information and/or auxiliary patch information to determine relationships between patches in image frames and adjusts encoding/decoding and/or filtering or pre/post-processing parameters based on the determined relationships.

公开(公告)号：US20210136370A1

公开(公告)日：2021-05-06

申请号：US16834611

申请日：2020-03-30

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  David W. Singer ,  Dominik Mehlem ,  Krishnakanth Rapaka

IPC: H04N19/119 ,  H04N19/159 ,  H04N19/139 ,  H04N19/176 ,  H04N19/573 ,  H04N19/543

Abstract: Techniques for coding and decoding video may include predicting picture regions defined by a time-varying tessellation and/or by a tessellation that varies spatially within a picture. These techniques improve decoded video quality, for example, by reducing block-based visual artifacts. Tessellation patterns may be irregular spatially to prevent alignment of some prediction region boundaries within a picture. Tessellation patterns may vary over time based on a spatial offset value, and the spatial offset value may be determined via a modulo function. Tessellation patterns may include overlapped shapes, for example when used in conjunction with overlapped block motion compensation.

公开(公告)号：US20210012536A1

公开(公告)日：2021-01-14

申请号：US17032711

申请日：2020-09-25

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/20 ,  G06T7/50 ,  H04N19/172

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. The encoder is configured project the point cloud on to patch planes to compress the point cloud, and supports multiple layered patch planes. For example, some point clouds may have a depth, and points at different depths may be assigned to different layered patch planes.

公开(公告)号：US10785275B2

公开(公告)日：2020-09-22

申请号：US16529687

申请日：2019-08-01

Applicant: Apple Inc.

Inventor： Eric Carlson ,  Kevin Calhoun ,  David W. Singer

IPC: H04L29/06 ,  H04N21/2343 ,  H04N21/235 ,  H04N21/431 ,  H04N21/435 ,  H04N21/443 ,  H04N21/658 ,  H04N21/84 ,  G06F16/958 ,  G06F16/957 ,  G06F16/70

Abstract: A method and apparatus for presenting timed media represented by data in a markup language (e.g., HTML) including examining a tag or metadata which is capable of specifying more than one form or representation of timed media, such as different versions of a video encoded according to different video codec standards.