公开(公告)号：US10715832B2

公开(公告)日：2020-07-14

申请号：US16299320

申请日：2019-03-12

Applicant: MEDIATEK INC.

Inventor： Cheng-Hsuan Shih ,  Jian-Liang Lin

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/119 ,  H04N19/96

Abstract: Methods and apparatus of processing 360-degree virtual reality (VR360) pictures are disclosed. According to one method, if a leaf coding unit contains one or more face edges, the leaf processing unit is split into sub-processing units along the face edges without the need to signal the partition. In another method, if the quadtree (QT) of binary tree (BT) partition depth for a processing unit has not reached the maximum QT or BT depth, the processing unit is split. If the processing unit contains a horizontal face edge, QT or horizontal BT partition is applied. If the processing unit contains a vertical face edge, QT or vertical BT partition is applied.

公开(公告)号：US20200213570A1

公开(公告)日：2020-07-02

申请号：US16729514

申请日：2019-12-30

Applicant: MEDIATEK INC.

Inventor： Cheng-Hsuan Shih ,  Ya-Hsuan Lee ,  Jian-Liang Lin

IPC: H04N13/139 ,  H04N19/597 ,  H04N19/132 ,  H04N19/167 ,  H04N19/186

Abstract: A video processing method includes: receiving a part of a bitstream; decoding the part of the bitstream to generate a reconstructed projection-based frame with at least one projection face and at least one padding region packed in a projection layout of a 360-degree Virtual Reality (360 VR) projection; obtaining chroma sampling position information that is signaled via the bitstream; and performing a blending process for generating a blended chroma sample value at a target chroma sample position by blending a first chroma sample value obtained for a first chroma sample position in the at least one projection face and a second chroma sample value obtained for a second chroma sample position in the at least one padding region. At least one of the target chroma sample position, the first chroma sample position and the second chroma sample position is determined according to the chroma sampling position information.

公开(公告)号：US10593012B2

公开(公告)日：2020-03-17

申请号：US15927028

申请日：2018-03-20

Applicant: MEDIATEK INC.

Inventor： Ya-Hsuan Lee ,  Hung-Chih Lin ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: G06T3/00

Abstract: A video processing method includes receiving an omnidirectional content corresponding to a sphere, generating a projection-based frame according to at least the omnidirectional content and a segmented sphere projection (SSP) format, and encoding, by a video encoder, the projection-based frame to generate a part of a bitstream. The projection-based frame has a 360-degree content represented by a first circular projection face, a second circular projection face, and at least one rectangular projection face packed in an SSP layout. A north polar region of the sphere is mapped onto the first circular projection face. A south polar region of the sphere is mapped onto the second circular projection face. At least one non-polar ring-shaped segment between the north polar region and the south polar region of the sphere is mapped onto said at least one rectangular projection face.

公开(公告)号：US10528842B2

公开(公告)日：2020-01-07

申请号：US15424899

申请日：2017-02-06

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Yu-Wen Huang

IPC: G06K9/46 ,  G06K9/62 ,  G06K9/00 ,  G06T5/20 ,  G06T5/00

Abstract: An image processing method applied to an image processing system. The image processing method comprises: (a) computing an image intensity distribution of an input image; (b) performing atmospheric light estimation to the input image; (c) performing transmission estimation according to a result of the step (a) to the input image, to generate a transmission estimation parameter; and (d) recovering scene radiance of the input image according to a result generated by the step (b) and the transmission estimation parameter. At least one of the steps (a)-(c) are performed to data corresponding to only partial pixels of the input image.

公开(公告)号：US10511835B2

公开(公告)日：2019-12-17

申请号：US15754721

申请日：2016-09-02

Applicant: MEDIATEK INC.

Inventor： Tzu-Der Chuang ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Jian-Liang Lin ,  Yu-Chen Sun ,  Yu-Ting Shen

IPC: H04N19/105 ,  H04N19/52 ,  H04N19/176 ,  H04N19/567 ,  H04N19/57

Abstract: Method and apparatus of video coding using decoder derived motion information based on bilateral matching or template matching are disclosed. According to one method, an initial motion vector (MV) index is signalled in a video bitstream at an encoder side or determined from the video bitstream at a decoder side. A selected MV is then derived using bilateral matching, template matching or both to refine an initial MV associated with the initial MV index. In another method, when both MVs for list 0 and list 1 exist in template matching, the smallest-cost MV between the two MVs may be used for uni-prediction template matching if the cost is lower than the bi-prediction template matching. According to yet another method, the refinement of the MV search is dependent on the block size. According to yet another method, merge candidate MV pair is always used for bilateral matching or template matching.

公开(公告)号：US10462484B2

公开(公告)日：2019-10-29

申请号：US15772818

申请日：2017-09-30

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Chia-Ying Li ,  Shen-Kai Chang ,  Chi-Cheng Ju

IPC: H04N19/597 ,  H04N19/184 ,  H04N19/91 ,  H04N19/70 ,  G06K9/36

Abstract: A video encoding method includes: setting a 360-degree Virtual Reality (360 VR) projection layout of projection faces, wherein the projection faces have a plurality of triangular projection faces located at a plurality of positions in the 360 VR projection layout, respectively; encoding a frame having a 360-degree image content represented by the projection faces arranged in the 360 VR projection layout to generate a bitstream; and for each position included in at least a portion of the positions, signaling at least one syntax element via the bitstream, wherein the at least one syntax element is set to indicate at least one of an index of a triangular projection view filled into a corresponding triangular projection face located at the position and a rotation angle of content rotation applied to the triangular projection view filled into the corresponding triangular projection face located at the position.

公开(公告)号：US20190272617A1

公开(公告)日：2019-09-05

申请号：US16285215

申请日：2019-02-26

Applicant: MEDIATEK INC.

Inventor： Ya-Hsuan Lee ,  Jian-Liang Lin

IPC: G06T3/00

Abstract: A cube-based projection method includes generating pixels of different square projection faces associated with a cube-based projection of a 360-degree image content of a sphere. Pixels of a first square projection face are generated by utilizing a first mapping function set. Pixels of a second square projection face are generated by utilizing a second mapping function set. The different square projection faces include the first square projection face and the second square projection face. The second mapping function set is not identical to the first mapping function set.

公开(公告)号：US20190251660A1

公开(公告)日：2019-08-15

申请号：US16392644

申请日：2019-04-24

Applicant: MEDIATEK INC.

Inventor： Hung-Chih Lin ,  Chao-Chih Huang ,  Chia-Ying Li ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: G06T3/40 ,  H04N19/00 ,  G06T9/00 ,  H04N19/85 ,  G06T19/00 ,  H04N19/597 ,  G06T15/10 ,  H04N19/70

Abstract: A video processing method includes receiving a bitstream, processing the bitstream to obtain at least one syntax element from the bitstream, and decoding the bitstream to generate a current decoded frame having a rotated 360-degree image/video content represented in a 360-degree Virtual Reality (360 VR) projection format. The at least one syntax element signaled via the bitstream indicates rotation information of content-oriented rotation that is involved in generating the rotated 360-degree image/video content, and includes a first syntax element. When the content-oriented rotation is enabled, the first syntax element indicates a rotation degree along a specific rotation axis.

公开(公告)号：US10356386B2

公开(公告)日：2019-07-16

申请号：US15766829

申请日：2018-04-03

Applicant: MEDIATEK INC.

Inventor： Ya-Hsuan Lee ,  Peng Wang ,  Jian-Liang Lin ,  Shen-Kai Chang

IPC: H04N13/161 ,  G06T3/00 ,  H04N13/111

Abstract: A video processing method includes obtaining projection face(s) from an omnidirectional content of a sphere, and obtaining a re-sampled projection face by re-sampling at least a portion of a projection face of the projection face(s) through non-uniform mapping. The omnidirectional content of the sphere is mapped onto the projection face(s) via a 360-degree Virtual Reality (360 VR) projection. The projection face has a first source region and a second source region. The re-sampled projection face has a first re-sampled region and a second re-sampled region. The first re-sampled region is derived from re-sampling the first source region with a first sampling density. The second re-sampled region is derived from re-sampling the second source region with a second sampling density that is different from the first sampling density.

公开(公告)号：US20190088001A1

公开(公告)日：2019-03-21

申请号：US15769750

申请日：2017-09-30

Applicant: MEDIATEK INC.

Inventor： Jian-Liang Lin ,  Hung-Chih Lin ,  Chia-Ying Li ,  Shen-Kai Chang ,  Chi-Cheng Ju ,  Chao-Chih Huang ,  Hui Ouyang

IPC: G06T15/04 ,  G06T3/00 ,  G06T15/08

Abstract: A projection-based frame is generated according to an omnidirectional video frame and an octahedron projection layout. The projection-based frame has a 360-degree image content represented by triangular projection faces assembled in the octahedron projection layout. A 360-degree image content of a viewing sphere is mapped onto the triangular projection faces via an octahedron projection of the viewing sphere. One side of a first triangular projection face has contact with one side of a second triangular projection face, one side of a third triangular projection face has contact with another side of the second triangular projection face. One image content continuity boundary exists between one side of the first triangular projection face and one side of the second triangular projection face, and another image content continuity boundary exists between one side of the third triangular projection face and another side of the second triangular projection face.