公开(公告)号：US20220148299A1

公开(公告)日：2022-05-12

申请号：US17438687

申请日：2019-07-19

Applicant: Google LLC

Inventor： Mikael Pierre Bonnevie ,  Aaron Maschinot ,  Aaron Sarna ,  Shuchao Bi ,  Jingbin Wang ,  Michael Spencer Krainin ,  Wenchao Tong ,  Dilip Krishnan ,  Haifeng Gong ,  Ce Liu ,  Hossein Talebi ,  Raanan Sayag ,  Piotr Teterwak

IPC: G06V10/82 ,  G06N3/04 ,  G06T7/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating realistic extensions of images. In one aspect, a method comprises providing an input that comprises a provided image to a generative neural network having a plurality of generative neural network parameters. The generative neural network processes the input in accordance with trained values of the plurality of generative neural network parameters to generate an extended image. The extended image has (i) more rows, more columns, or both than the provided image, and (ii) is predicted to be a realistic extension of the provided image. The generative neural network is trained using an adversarial loss objective function.

公开(公告)号：US11042754B2

公开(公告)日：2021-06-22

申请号：US16475361

申请日：2017-08-03

Applicant: Google LLC

Inventor： Yi Shen ,  Xiangrong Chen ,  Min-hsuan Tsai ,  Yun Shi ,  Tianpeng Jin ,  Zheng Sun ,  Weilong Yang ,  Jingbin Wang

IPC: G06K9/00 ,  G11B27/031 ,  G06T7/20 ,  G06T7/90 ,  G06F16/738 ,  G06F16/783 ,  G06K9/62

Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.

公开(公告)号：US12118036B2

公开(公告)日：2024-10-15

申请号：US17352067

申请日：2021-06-18

Applicant: Google LLC

Inventor： Yi Shen ,  Xiangrong Chen ,  Min-hsuan Tsai ,  Yun Shi ,  Tianpeng Jin ,  Zheng Sun ,  Weilong Yang ,  Jingbin Wang ,  Carolyn Au ,  James Futrell

IPC: G06F16/738 ,  G06F16/783 ,  G06F18/22 ,  G06T7/20 ,  G06T7/90 ,  G06V20/40 ,  G11B27/031

CPC classification number: G06F16/739 ,  G06F16/7837 ,  G06F16/785 ,  G06F16/786 ,  G06F18/22 ,  G06T7/20 ,  G06T7/90 ,  G06V20/47 ,  G11B27/031 ,  G06T2207/10016

Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.

公开(公告)号：US20210312186A1

公开(公告)日：2021-10-07

申请号：US17352067

申请日：2021-06-18

Applicant: Google LLC

Inventor： Yi Shen ,  Xiangrong Chen ,  Min-hsuan Tsai ,  Yun Shi ,  Tianpeng Jin ,  Zheng Sun ,  Weilong Yang ,  Jingbin Wang

IPC: G06K9/00 ,  G06T7/90 ,  G06F16/738 ,  G06F16/783 ,  G06K9/62 ,  G06T7/20 ,  G11B27/031

Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.

公开(公告)号：US12236676B2

公开(公告)日：2025-02-25

申请号：US17438687

申请日：2019-07-19

Applicant: Google LLC

Inventor： Mikael Pierre Bonnevie ,  Aaron Maschinot ,  Aaron Sarna ,  Shuchao Bi ,  Jingbin Wang ,  Michael Spencer Krainin ,  Wenchao Tong ,  Dilip Krishnan ,  Haifeng Gong ,  Ce Liu ,  Hossein Talebi ,  Raanan Sayag ,  Piotr Teterwak

IPC: G06K9/00 ,  G06N3/045 ,  G06T7/10 ,  G06V10/82

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating realistic extensions of images. In one aspect, a method comprises providing an input that comprises a provided image to a generative neural network having a plurality of generative neural network parameters. The generative neural network processes the input in accordance with trained values of the plurality of generative neural network parameters to generate an extended image. The extended image has (i) more rows, more columns, or both than the provided image, and (ii) is predicted to be a realistic extension of the provided image. The generative neural network is trained using an adversarial loss objective function.

公开(公告)号：US20210117691A1

公开(公告)日：2021-04-22

申请号：US16475361

申请日：2017-08-03

Applicant: Google LLC

Inventor： Yi Shen ,  Xiangrong Chen ,  Min-hsuan Tsai ,  Yun Shi ,  Tianpeng Jin ,  Zheng Sun ,  Weilong Yang ,  Jingbin Wang

IPC: G06K9/00 ,  G11B27/031 ,  G06T7/20 ,  G06T7/90 ,  G06K9/62 ,  G06F16/738 ,  G06F16/783

Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.