公开(公告)号：US20180332305A1

公开(公告)日：2018-11-15

申请号：US15772818

申请日：2017-09-30

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Chia-Ying Li ,  Shen-Kai Chang ,  Chi-Cheng Ju

IPC: H04N19/597 ,  H04N19/70 ,  H04N19/184 ,  H04N19/91

CPC classification number: H04N19/597 ,  G06K9/36 ,  H04N19/184 ,  H04N19/70 ,  H04N19/91

Abstract: A video encoding method includes: setting a 360-degree Virtual Reality (360 VR) projection layout of projection faces, wherein the projection faces have a plurality of triangular projection faces located at a plurality of positions in the 360 VR projection layout, respectively; encoding a frame having a 360-degree image content represented by the projection faces arranged in the 360 VR projection layout to generate a bitstream; and for each position included in at least a portion of the positions, signaling at least one syntax element via the bitstream, wherein the at least one syntax element is set to indicate at least one of an index of a triangular projection view filled into a corresponding triangular projection face located at the position and a rotation angle of content rotation applied to the triangular projection view filled into the corresponding triangular projection face located at the position.

公开(公告)号：US20180262774A1

公开(公告)日：2018-09-13

申请号：US15911185

申请日：2018-03-05

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: H04N19/597 ,  G06T3/60 ,  H04N19/172

CPC classification number: H04N19/597 ,  G06T3/60 ,  G06T2200/04 ,  H04N19/172 ,  H04N19/577

Abstract: A video processing method includes: receiving a first input frame with a 360-degree Virtual Reality (360 VR) projection format; applying first content-oriented rotation to the first input frame to generate a first content-rotated frame; encoding the first content-rotated frame to generate a first part of a bitstream, including generating a first reconstructed frame and storing a reference frame derived from the first reconstructed frame; receiving a second input frame with the 360 VR projection format; applying second content-oriented rotation to the second input frame to generate a second content-rotated frame; configuring content re-rotation according to the first content-oriented rotation and the second content-oriented rotation; applying the content re-rotation to the reference frame to generate a re-rotated reference frame; and encoding, by a video encoder, the second content-rotated frame to generate a second part of the bitstream, including using the re-rotated reference frame for predictive coding of the second content-rotated frame.

公开(公告)号：US09930361B2

公开(公告)日：2018-03-27

申请号：US15268642

申请日：2016-09-19

Applicant: MEDIATEK INC.

Inventor： Fang-Yi Hsieh ,  Jian-Liang Lin

IPC: H04N19/59 ,  H04N19/159 ,  H04N19/172 ,  H04N19/132 ,  H04N19/152 ,  H04N19/156 ,  H04N19/177 ,  H04N19/44 ,  H04N19/105 ,  H04N19/11 ,  H04N19/117 ,  H04N19/139 ,  H04N19/43

CPC classification number: H04N19/59 ,  H04N19/105 ,  H04N19/11 ,  H04N19/117 ,  H04N19/132 ,  H04N19/139 ,  H04N19/152 ,  H04N19/156 ,  H04N19/159 ,  H04N19/172 ,  H04N19/177 ,  H04N19/43 ,  H04N19/44

Abstract: An apparatus for dynamically adjusting video decoding complexity includes a decoding resolution control circuit and an adaptive spatial resolution decoder. The decoding resolution control circuit is arranged to dynamically determine whether at least one portion of multiple frames should be decoded in accordance with a specific resolution differing from an original resolution of the frames. In addition, the adaptive spatial resolution decoder is arranged to decode the frames according to whether the at least one portion of the frames should be decoded in accordance with the specific resolution. In particular, the apparatus further includes a system capability analyzing circuit arranged to analyze system capability of at least a portion of the apparatus, in order to generate analyzing results for being sent to the decoding resolution control circuit. An associated method is also provided.

公开(公告)号：US20180041764A1

公开(公告)日：2018-02-08

申请号：US15671070

申请日：2017-08-07

Applicant: MediaTek Inc.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Shen-Kai Chang

IPC: H04N19/174 ,  H04N19/426

CPC classification number: H04N19/174 ,  G06T11/60 ,  G06T2207/20021 ,  G06T2207/20108 ,  H04N5/23238 ,  H04N19/105 ,  H04N19/176 ,  H04N19/30 ,  H04N19/426 ,  H04N19/46 ,  H04N19/52 ,  H04N19/597 ,  H04N19/70

Abstract: For omnidirectional video such as 360-degree Virtual Reality (360VR) video, a video system that support independent decoding of different views of the omnidirectional video is provided. A decoder for such a system can extract a specified part of a bitstream to decode a desired perspective/face/view of an omnidirectional image without decoding the entire image while suffering minimal or no loss in coding efficiency.

公开(公告)号：US09843820B2

公开(公告)日：2017-12-12

申请号：US14412203

申请日：2013-07-05

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC: H04N19/597 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/513

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/513

Abstract: A method and apparatus for three-dimensional video coding or multi-view video coding are disclosed. Embodiments according to the present invention derive a unified disparity vector from depth information for Inter mode and Skip/Direct mode. The unified disparity vector is derived from a subset of depth samples in an associated depth block corresponding to the current block using a unified derivation method. The unified derivation method is applied in Inter mode, Skip mode, or Direct mode when a disparity vector derived from depth data is required for encoding or decoding. The unified disparity vector can also be applied to derive a disparity vector for locating a corresponding block, and thus an inter-view motion vector candidate can be determined for Skip mode or Direct mode.

公开(公告)号：US09736498B2

公开(公告)日：2017-08-15

申请号：US14433318

申请日：2013-09-25

Applicant: MediaTek Inc.

Inventor： Jian-Liang Lin ,  Yi-Wen Chen

IPC: H04N19/597 ,  H04N19/52 ,  H04N19/573 ,  H04N19/176 ,  H04N13/00

CPC classification number: H04N19/597 ,  H04N13/161 ,  H04N19/176 ,  H04N19/52 ,  H04N19/573

Abstract: A method and apparatus for three-dimensional video coding and multi-view video coding are disclosed. Embodiments according to the present invention derive a unified disparity vector (DV) based on neighboring blocks of the current block or depth information associated with the current block and locate a single corresponding block in a reference view according to the unified DV. An inter-view motion vector prediction (MVP) candidate is then derived for both list0 and list1 from the single corresponding block. List0 and list1 MVs of the inter-view MVP candidate are derived from the single corresponding block located according to the unified DV.

公开(公告)号：US20150281733A1

公开(公告)日：2015-10-01

申请号：US14433303

申请日：2013-08-29

Applicant: MEDIATEK INC.

Inventor： Chih-Ming Fu ,  Yi-Wen Chen ,  Jian-Liang Lin ,  Yu-Wen Huang

IPC: H04N19/597 ,  H04N19/105 ,  H04N19/139 ,  H04N19/513 ,  H04N19/187

CPC classification number: H04N19/597 ,  H04N19/105 ,  H04N19/139 ,  H04N19/187 ,  H04N19/30 ,  H04N19/513 ,  H04N19/70

Abstract: A method and apparatus for three-dimensional and scalable video coding are disclosed. Embodiments according to the present invention determine a motion information set associated with the video data, wherein at least part of the motion information set is made available or unavailable conditionally depending on the video data type. The video data type may correspond to depth data, texture data, a view associated with the video data in three-dimensional video coding, or a layer associated with the video data in scalable video coding. The motion information set is then provided for coding or decoding of the video data, other video data, or both. At least a flag may be used to indicate whether part of the motion information set is available or unavailable. Alternatively, a coding profile for the video data may be used to determine whether the motion information is available or not based on the video data type.

Abstract translation: 公开了一种用于三维和可缩放视频编码的方法和装置。 根据本发明的实施例确定与视频数据相关联的运动信息集，其中运动信息集的至少一部分根据视频数据类型有条件地可用或不可用。 视频数据类型可以对应于深度数据，纹理数据，与三维视频编码中的视频数据相关联的视图，或者与可分级视频编码中的视频数据相关联的层。 然后提供运动信息集用于视频数据，其他视频数据或两者的编码或解码。 至少可以使用标志来指示运动信息集的部分是可用还是不可用。 或者，视频数据的编码简档可以用于基于视频数据类型来确定运动信息是否可用。

公开(公告)号：US20150189321A1

公开(公告)日：2015-07-02

申请号：US14538200

申请日：2014-11-11

Applicant: MEDIATEK INC.

Inventor： Yi-Wen Chen ,  Jian-Liang Lin ,  Tzu-Der Chuang ,  Yu-Lin Chang

IPC: H04N19/597 ,  H04N19/13 ,  H04N19/176 ,  H04N19/70 ,  H04N19/139

CPC classification number: H04N19/597 ,  H04N19/70 ,  H04N19/91

Abstract: A method for improved binarization and entropy coding process of syntax related to depth coding is disclosed. In one embodiment, a first value associated with the current depth block is bypass coded, where the first value corresponds to the residual magnitude of a block coded by an Intra or Inter SDC mode, the delta magnitude of a block coded by a DMM mode, or a residual sign of a block coded by the Inter SDC mode. In another embodiment, a first bin of a binary codeword is coded using arithmetic coding and the rest bins of the binary codeword are coded using bypass coding. The codeword corresponds to the residual magnitude of a block coded by the Intra or Inter SDC mode, or the delta DC magnitude of a block coded by the DMM mode.

Abstract translation: 公开了一种用于改进与深度编码相关的语法的二值化和熵编码处理的方法。 在一个实施例中，与当前深度块相关联的第一值被旁路编码，其中第一值对应于通过内部或内部SDC模式编码的块的剩余幅度，由DMM模式编码的块的增量幅度， 或通过Inter SDC模式编码的块的残余符号。 在另一个实施例中，使用算术编码对二进制码字的第一个二进制编码，并且使用旁路编码对二进制码字的其余的存储体进行编码。 码字对应于通过帧间或间隔SDC模式编码的块的剩余幅度或由DMM模式编码的块的增量DC幅度。

公开(公告)号：US11589041B2

公开(公告)日：2023-02-21

申请号：US17526678

申请日：2021-11-15

Applicant: MEDIATEK INC.

Inventor： Yu-Wen Huang ,  Yu-Chen Sun ,  Tzu-Der Chuang ,  Jian-Liang Lin ,  Ching-Yeh Chen

IPC: H04N19/117 ,  G06N3/04 ,  G06T5/00 ,  H04N19/182 ,  H04N19/50 ,  H04N19/82 ,  H04N19/86 ,  G06N3/084 ,  G06N3/088 ,  H04N19/91 ,  G06N3/08

Abstract: A method and apparatus of video coding incorporating Deep Neural Network are disclosed. A target signal is processed using DNN (Deep Neural Network), where the target signal provided to DNN input corresponds to the reconstructed residual, output from the prediction process, the reconstruction process, one or more filtering processes, or a combination of them. The output data from DNN output is provided for the encoding process or the decoding process. The DNN can be used to restore pixel values of the target signal or to predict a sign of one or more residual pixels between the target signal and an original signal. An absolute value of one or more residual pixels can be signalled in the video bitstream and used with the sign to reduce residual error of the target signal.

公开(公告)号：US11405630B2

公开(公告)日：2022-08-02

申请号：US17372515

申请日：2021-07-11

Applicant: MEDIATEK INC.

Inventor： Ya-Hsuan Lee ,  Jian-Liang Lin

IPC: H04N19/00 ,  H04N19/44 ,  H04N19/169 ,  H04N19/186 ,  H04N19/132

Abstract: A video decoding method includes decoding a part of a bitstream to generate a decoded frame, wherein the decoded frame is a projection-based frame that includes a plurality of projection faces packed in a projection layout with M projection face columns and N projection face rows, M and N are positive integers, and at least a portion of a 360-degree content of a sphere is mapped to the plurality of projection faces via projection. Regarding the decoded frame, a picture width excluding guard band samples is equal to an integer multiple of M, and a picture height excluding guard band samples is equal to an integer multiple of N.