公开(公告)号：US20210029340A1

公开(公告)日：2021-01-28

申请号：US16940717

申请日：2020-07-28

Applicant: Google LLC

Inventor： Wanmin Wu ,  Samuel Kvaalen ,  Ivan Janatra ,  Changchang Wu

IPC: H04N13/122 ,  H04N13/178 ,  G06T15/00

Abstract: Methods, systems, and media for rendering immersive video content with foveated meshes are provided. In some embodiments, the method comprises: receiving a video content item; determining, using a hardware processor, whether the video content item meets at least one criterion; in response to determining that the video content item meets the at least one criterion, generating, using the hardware processor, a foveated mesh in accordance with a foveation ratio parameter on which frames of the video content item are to be projected, wherein the foveated mesh has a non-uniform position map that increases pixel density in a central portion of each frame of the video content item in comparison with peripheral portions of each frame of the video content item; and storing the video content item in a file format that includes the generated foveated mesh, wherein the immersive video content is rendered by applying the video content item as a texture to the generated foveated mesh.

公开(公告)号：US20220321858A1

公开(公告)日：2022-10-06

申请号：US17848861

申请日：2022-06-24

Applicant: Google LLC

Inventor： Wanmin Wu ,  Samuel Kvaalen ,  Ivan Janatra ,  Changchang Wu

IPC: H04N13/122 ,  H04N13/178 ,  G06T15/00

Abstract: Methods, systems, and media for rendering immersive video content with foveated meshes are provided. In some embodiments, the method comprises: receiving a video content item; determining, using a hardware processor, whether the video content item meets at least one criterion; in response to determining that the video content item meets the at least one criterion, generating, using the hardware processor, a foveated mesh in accordance with a foveation ratio parameter on which frames of the video content item are to be projected, wherein the foveated mesh has a non-uniform position map that increases pixel density in a central portion of each frame of the video content item in comparison with peripheral portions of each frame of the video content item; and storing the video content item in a file format that includes the generated foveated mesh, wherein the immersive video content is rendered by applying the video content item as a texture to the generated foveated mesh.

公开(公告)号：US10375381B2

公开(公告)日：2019-08-06

申请号：US15843366

申请日：2017-12-15

Applicant: GOOGLE LLC

Inventor： Carlos Hernandez Esteban ,  Robert Anderson ,  Changchang Wu ,  Michael Krainin

IPC: H04N13/243 ,  H04N13/344 ,  G02B27/01 ,  H04N13/366 ,  G06T15/20 ,  H04N13/211 ,  H04N13/221 ,  H04N13/111 ,  H04N13/161 ,  H04N13/296 ,  H04N13/239

Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.

公开(公告)号：US20180160106A1

公开(公告)日：2018-06-07

申请号：US15843366

申请日：2017-12-15

Applicant: GOOGLE LLC

Inventor： Carlos Hernandez Esteban ,  Robert Anderson ,  Changchang Wu ,  Michael Krainin

IPC: G02B27/01 ,  G06T15/20

CPC classification number: H04N13/344 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/011 ,  G02B2027/0134 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06T15/205 ,  H04N13/111 ,  H04N13/161 ,  H04N13/211 ,  H04N13/221 ,  H04N13/239 ,  H04N13/243 ,  H04N13/296 ,  H04N13/366

Abstract: Systems and methods are described include defining, at a computing device, a set of images based on captured images, projecting, at the computing device, a portion of the set of images from a planar perspective image plane onto a spherical image plane by recasting a plurality of viewing rays associated with the portion of the set of images from a plurality of viewpoints arranged around a curved path to a viewpoint, determining, at the computing device, a periphery boundary corresponding to the viewpoint and generating updated images by removing pixels that are outside of the periphery boundary, and providing, for display, the updated images within the bounds of the periphery boundary.

公开(公告)号：US11375170B2

公开(公告)日：2022-06-28

申请号：US16940717

申请日：2020-07-28

Applicant: Google LLC

Inventor： Wanmin Wu ,  Samuel Kvaalen ,  Ivan Janatra ,  Changchang Wu

IPC: H04N13/122 ,  H04N13/178 ,  G06T15/00 ,  H04N13/00

Abstract: Methods, systems, and media for rendering immersive video content with foveated meshes are provided. In some embodiments, the method comprises: receiving a video content item; determining, using a hardware processor, whether the video content item meets at least one criterion; in response to determining that the video content item meets the at least one criterion, generating, using the hardware processor, a foveated mesh in accordance with a foveation ratio parameter on which frames of the video content item are to be projected, wherein the foveated mesh has a non-uniform position map that increases pixel density in a central portion of each frame of the video content item in comparison with peripheral portions of each frame of the video content item; and storing the video content item in a file format that includes the generated foveated mesh, wherein the immersive video content is rendered by applying the video content item as a texture to the generated foveated mesh.