Temporal foveated rendering using motion estimation

    公开(公告)号:US10169843B1

    公开(公告)日:2019-01-01

    申请号:US15818072

    申请日:2017-11-20

    摘要: A processing system selectively renders pixels or blocks of pixels of an image and leaves some pixels or blocks of pixels unrendered to conserve resources. The processing system generates a motion vector field to identify regions of an image having moving areas. The processing system uses a rendering processor to identify as regions of interest those units having little to no motion, based on the motion vector field, and a large amount of edge activity, and to minimize the probability of unrendered pixels, or “holes”, in these regions. To avoid noticeable patterns, the rendering processor applies a probability map to determine the possible locations of holes, assigning to each unit a probability indicating the percentage of pixels within the unit that will be holes, and assigning a lower probability to units identified as regions of interest.

    Exploiting Camera Depth Information for Video Encoding
    9.
    发明申请
    Exploiting Camera Depth Information for Video Encoding 审中-公开
    利用摄像机深度信息进行视频编码

    公开(公告)号:US20150092856A1

    公开(公告)日:2015-04-02

    申请号:US14043427

    申请日:2013-10-01

    摘要: The present disclosure is directed a system and method for exploiting camera and depth information associated with rendered video frames, such as those rendered by a server operating as part of a cloud gaming service, to more efficiently encode the rendered video frames for transmission over a network. The method and system of the present disclosure can be used in a server operating in a cloud gaming service to improve, for example, the amount of latency, downstream bandwidth, and/or computational processing power associated with playing a video game over its service. The method and system of the present disclosure can be further used in other applications where camera and depth information of a rendered or captured video frame is available.

    摘要翻译: 本公开涉及一种用于利用与渲染的视频帧相关联的相机和深度信息的系统和方法,诸如由作为云游戏服务的一部分操作的服务器呈现的那些视频帧,以更有效地对所渲染的视频帧进行编码以在网络上传输 。 本公开的方法和系统可以用于在云游戏服务中操作的服务器中,以改善例如与通过其服务播放视频游戏相关的等待时间,下行带宽和/或计算处理能力的量。 本公开的方法和系统可以进一步用于其中可用于渲染或捕获的视频帧的相机和深度信息的其他应用中。