公开(公告)号：US20200273208A1

公开(公告)日：2020-08-27

申请号：US15931349

申请日：2020-05-13

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06T7/70 ,  G06T7/50 ,  G06T7/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A block/sub-block organization scheme is used to encode blocks and sub-blocks of an occupancy map used in compressing the point cloud. Binary values are assigned to blocks/sub-blocks based on whether they contain patches projected on the point cloud. A traversal path is chosen that takes advantage of run-length encoding strategies to reduce a size of an encoded occupancy map. Also, auxiliary information is used to further improve occupancy map compression.

公开(公告)号：US10607373B2

公开(公告)日：2020-03-31

申请号：US16198630

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T7/00 ,  G06T9/00 ,  G06K9/62 ,  G06T5/00 ,  G06T19/20

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.

公开(公告)号：US20200014953A1

公开(公告)日：2020-01-09

申请号：US16503933

申请日：2019-07-05

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  Jungsun Kim ,  Valery G. Valentin ,  David W. Singer ,  Fabrice A. Robinet ,  Hsi-Jung Wu ,  Alexandros Tourapis

IPC: H04N19/597 ,  H04N19/463 ,  H04N19/85

Abstract: A system comprises an encoder configured to compress attribute and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, an encoder performs downscaling of an image frame prior to video encoding and a decoder performs upscaling of an image frame subsequent to video decoding.

公开(公告)号：US20190200031A1

公开(公告)日：2019-06-27

申请号：US16293487

申请日：2019-03-05

Applicant: Apple Inc.

Inventor： David W. Singer

IPC: H04N19/46 ,  H04N19/177 ,  H04N19/70 ,  H04N19/114

CPC classification number: H04N19/46 ,  H04N19/114 ,  H04N19/177 ,  H04N19/70

Abstract: A new file format for coded video data is provided. A decoder may identify patterns in the coded video data in order to make the decoding process and/or display of data more efficient. Such patterns may be predefined and stored at the decoder, may be defined by each encoder and exchanged during terminal initialization, or may be transmitted and/or stored with the associated video data. Initialization information associated with the fragments of video data may also provide for carouseling initialization updates such that the initialization fragments may indicate either that the initialization information should be updated or that the decoder should be re-initialized. Additionally, media files or segments may be broken into fragments and each segment may have an index to provide for random access to the media data of the segment.

公开(公告)号：US20190156518A1

公开(公告)日：2019-05-23

申请号：US16198630

申请日：2018-11-21

Applicant: Apple Inc.

Inventor： Khaled Mammou ,  Yeping Su ,  David W. Singer ,  Alexandros Tourapis ,  Fabrice A. Robinet ,  Hsi-Jung Wu

IPC: G06T9/00 ,  G06K9/62 ,  G06T5/00 ,  G06T19/20 ,  G06T7/00

Abstract: A system comprises an encoder configured to compress attribute information and/or spatial for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. A closed-loop color conversion process is used to improve compression while taking into consideration distortion introduced throughout the point cloud compression process.

公开(公告)号：US20170134731A1

公开(公告)日：2017-05-11

申请号：US15349989

申请日：2016-11-11

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  David W. Singer ,  Hsi-Jung Wu ,  Yeping Su

IPC: H04N19/154 ,  H04N19/124 ,  H04N19/51 ,  H04N19/15 ,  H04N19/105 ,  H04N19/61 ,  H04N19/13

CPC classification number: H04N19/154 ,  H04N1/646 ,  H04N9/646 ,  H04N9/67 ,  H04N19/105 ,  H04N19/124 ,  H04N19/13 ,  H04N19/15 ,  H04N19/17 ,  H04N19/186 ,  H04N19/51 ,  H04N19/61

Abstract: Techniques for selecting a luminance value for color space conversion are disclosed. Techniques include determining values for Cb and Cr from values for R′, G′, and B′; producing a reconstructed Cb* value and a reconstructed Cr* value by processing the Cb and Cr values; and determining a plurality of Y′ value options from the values for Cb* and Cr*. A Y′ output value may be selected based on the plurality of Y′ value options.

公开(公告)号：US20160105675A1

公开(公告)日：2016-04-14

申请号：US14687316

申请日：2015-04-15

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  David W. Singer ,  Krasimir D. Kolarov ,  Steven E. Saunders ,  Guy Cote ,  Sorin Cismas

IPC: H04N19/156 ,  H04N19/172 ,  H04N19/105 ,  H04N19/154

CPC classification number: H04N19/156 ,  H04N19/105 ,  H04N19/12 ,  H04N19/147 ,  H04N19/154 ,  H04N19/172 ,  H04N19/196 ,  H04N19/44 ,  H04N19/46

Abstract: In a coding system, an encoder codes video data according to a predetermined protocol, which, when decoded causes an associated decoder to perform a predetermined sequence of decoding operations. The encoder may perform local decodes of the coded video data, both in the manner dictated by the coding protocol that is at work and also by one or more alternative decoding operations. The encoder may estimate relative performance of the alternative decoding operations as compared to a decoding operation that is mandated by the coding protocol. The encoder may provide identifiers in metadata that is associated with the coded video data to identify such levels of distortion and/or levels of resources conserved. A decoder may refer to such identifiers when determining when to engage alternative decoding operations as may be warranted under resource conservation policies.

Abstract translation: 在编码系统中，编码器根据预定的协议对视频数据进行编码，当预定协议被解码时，相关解码器执行预定的解码操作序列。 编码器可以以由正在工作的编码协议所指定的方式以及通过一个或多个替代解码操作来执行编码视频数据的本地解码。 与由编码协议强制的解码操作相比，编码器可以估计替代解码操作的相对性能。 编码器可以提供与编码的视频数据相关联的元数据中的标识符，以识别所保存的资源的失真和/或资源级别。 当确定什么时候参与在资源节约策略下可能需要的替代解码操作时，解码器可以参考这样的标识符。

公开(公告)号：US11936867B2

公开(公告)日：2024-03-19

申请号：US17234596

申请日：2021-04-19

Applicant: Apple Inc.

Inventor： Krishnakanth Rapaka ,  Jaehong Chon ,  Alexandros Tourapis ,  David W. Singer

IPC: H04N19/124 ,  H04N19/172 ,  H04N19/186 ,  H04N19/82

CPC classification number: H04N19/124 ,  H04N19/172 ,  H04N19/186 ,  H04N19/82

Abstract: Improved video coding and decoding techniques are described, including techniques to derive quantization step sizes adaptively with quantization step size table templates. Quantization techniques described provide finer-grained control over quantization with a more flexible quantization step size especially at higher degrees of quantization. This may result in improved overall compression quality. Other coding parameters, such as in-loop filtering parameters, may be derived based on the more flexible quantization parameters.

公开(公告)号：US11863738B2

公开(公告)日：2024-01-02

申请号：US17540356

申请日：2021-12-02

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Jungsun Kim ,  Krishnakanth Rapaka ,  David W. Singer

IPC: H04N19/105 ,  H04N19/172 ,  H04N19/174 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70

CPC classification number: H04N19/105 ,  H04N19/172 ,  H04N19/174 ,  H04N19/184 ,  H04N19/513 ,  H04N19/70

Abstract: Techniques for encoding video with motion compensation include a compressed bitstream syntax that includes a list of all motion prediction reference frames without distinguishing between short-term reference frame and long-term reference frames. The list of reference frames may be provided in a slice header and may apply to encoded data video data within the corresponding slice. The list may be prefaced with a single number indicating the total number of reference frames. In an aspect delta POC reference numbers may be encoded with a flag indicating the sign of the delta POC when the absolute value of the POC is not equal to zero. In another aspect, a flag may be encoded for every reference frame indicating if POC information should be used when scaling prediction references, and a weighting parameter may be included when POC information should be used.

公开(公告)号：US11711527B2

公开(公告)日：2023-07-25

申请号：US17404452

申请日：2021-08-17

Applicant: Apple Inc.

Inventor： Alexandros Tourapis ,  Yeping Su ,  David W. Singer ,  Hsi-Jung Wu

IPC: H04N19/186 ,  H04N19/189 ,  H04N9/64 ,  H04N11/20 ,  H04N19/70 ,  H04N19/46 ,  H04N19/117 ,  H04N19/132 ,  H04N19/154 ,  H04N19/59 ,  H04N9/67 ,  H04N19/82 ,  H04N19/147 ,  H04N19/80 ,  H04N19/85 ,  H04N19/44

CPC classification number: H04N19/186 ,  H04N9/64 ,  H04N9/67 ,  H04N11/20 ,  H04N19/117 ,  H04N19/132 ,  H04N19/147 ,  H04N19/154 ,  H04N19/189 ,  H04N19/44 ,  H04N19/46 ,  H04N19/59 ,  H04N19/70 ,  H04N19/80 ,  H04N19/82 ,  H04N19/85

Abstract: A method of adaptive chroma downsampling is presented. The method comprises converting a source image to a converted image in an output color format, applying a plurality of downsample filters to the converted image and estimating a distortion for each filter chose the filter that produces the minimum distortion. The distortion estimation includes applying an upsample filter, and a pixel is output based on the chosen filter. Methods for closed loop conversions are also presented.