公开(公告)号：US20200066024A1

公开(公告)日：2020-02-27

申请号：US16674669

申请日：2019-11-05

Applicant: QUALCOMM Incorporated

Inventor： Mehrad Tavakoli ,  Moinul Khan ,  Martin Renschler ,  Mriganka Mondal

IPC: G06T15/00 ,  G06F3/01 ,  G06T3/00 ,  G06K9/00

Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.

公开(公告)号：US20180329465A1

公开(公告)日：2018-11-15

申请号：US15592664

申请日：2017-05-11

Applicant: QUALCOMM INCORPORATED

Inventor： MEHRAD TAVAKOLI ,  Idreas Mir ,  Moinul Khan ,  Ronald Alton ,  Gheorghe Cascaval ,  Rajiv Vijayakumar ,  Mriganka Mondal ,  Maurice Ribble ,  Martin Renschler

IPC: G06F1/20 ,  G06F1/32 ,  G06F1/26 ,  G06F11/34

CPC classification number: G06F1/206 ,  G06F1/163 ,  G06F1/266 ,  G06F1/3215 ,  G06F1/3218 ,  G06F1/3234 ,  G06F3/012 ,  G06F11/3495

Abstract: Disclosed are methods and systems for intelligent adjustment of an immersive multimedia workload in a portable computing device (“PCD”), such as a virtual reality (“VR”) or augmented reality (“AR”) workload. An exemplary embodiment monitors one or more performance indicators comprising a motion to photon latency associated with the immersive multimedia workload. Performance parameters associated with thermally aggressive processing components are adjusted to reduce demand for power while ensuring that the motion to photon latency is and/or remains optimized. Performance parameters that may be adjusted include, but are not limited to including, eye buffer resolution, eye buffer MSAA, timewarp CAC, eye buffer FPS, display FPS, timewarp output resolution, textures LOD, 6DOF camera FPS, and fovea size.

公开(公告)号：US10957093B2

公开(公告)日：2021-03-23

申请号：US16674669

申请日：2019-11-05

Applicant: QUALCOMM Incorporated

Inventor： Mehrad Tavakoli ,  Moinul Khan ,  Martin Renschler ,  Mriganka Mondal

IPC: G06T15/00 ,  G06F3/01 ,  G06T3/00 ,  G06K9/00

Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.

公开(公告)号：US20140002730A1

公开(公告)日：2014-01-02

申请号：US13929614

申请日：2013-06-27

Applicant: QUALCOMM Incorporated

Inventor： Steven S. Thomson ,  Mriganka Mondal ,  Nishant Hariharan ,  Edoardo Regini

IPC: H04N7/01

CPC classification number: H04N7/0127 ,  G06F1/3206 ,  G06F1/3265 ,  Y02D10/153

Abstract: The present disclosure provides for systems, methods, and apparatus for image processing. These systems, methods, and apparatus may compare a current frame to at least one previous frame to determine an amount of difference. The amount of difference between the current frame and the at least one previous frame may be compared to a threshold value. Additionally, the frame rate may be adjusted based on the comparison of the amount of difference between the current frame and the at least one previous frame and the threshold value. Another example may determine an amount of perceivable difference between a current frame and at least one previous frame and adjust a frame rate based on the determined amount of perceivable difference between the current frame and the at least one previous frame.

Abstract translation: 本公开提供了用于图像处理的系统，方法和装置。 这些系统，方法和装置可将当前帧与至少一个先前帧进行比较，以确定差异量。 可以将当前帧与至少一个先前帧之间的差异量与阈值进行比较。 另外，可以基于当前帧与至少一个先前帧和阈值之间的差的量的比较来调整帧速率。 另一示例可以确定当前帧与至少一个先前帧之间的可感知差异的量，并且基于所确定的当前帧和至少一个先前帧之间的可感知差值来调整帧速率。

公开(公告)号：US09378536B2

公开(公告)日：2016-06-28

申请号：US14266685

申请日：2014-04-30

Applicant: QUALCOMM INCORPORATED

Inventor： Hee Jun Park ,  Young Hoon Kang ,  Mriganka Mondal

IPC: G06F1/32 ,  G06T1/20

CPC classification number: G06T1/20 ,  G06F1/3206 ,  G06F1/3228 ,  G06F1/324 ,  G06F1/3296 ,  G09G2330/021 ,  G09G2360/06 ,  Y02D10/126 ,  Y02D10/172

Abstract: Systems, methods, and computer programs are disclosed for minimizing power consumption in graphics frame processing. One such method comprises: initiating graphics frame processing to be cooperatively performed by a central processing unit (CPU) and a graphics processing unit (GPU); receiving CPU activity data and GPU activity data; determining a set of available dynamic clock and voltage/frequency scaling (DCVS) levels for the GPU and the CPU; and selecting from the set of available DCVS levels an optimal combination of a GPU DCVS level and a CPU DCVS level, based on the CPU and GPU activity data, which minimizes a combined power consumption of the CPU and the GPU during the graphics frame processing.

Abstract translation: 公开了用于使图形帧处理中的功率消耗最小化的系统，方法和计算机程序。 一种这样的方法包括：启动由中央处理单元（CPU）和图形处理单元（GPU）协同执行的图形帧处理; 接收CPU活动数据和GPU活动数据; 确定用于GPU和CPU的一组可用动态时钟和电压/频率缩放（DCVS）电平; 以及基于CPU和GPU活动数据，从可用DCVS级别中选择GPU DCVS级别和CPU DCVS级别的最佳组合，其在图形帧处理期间最小化CPU和GPU的组合功耗。

公开(公告)号：US10482648B2

公开(公告)日：2019-11-19

申请号：US15377488

申请日：2016-12-13

Applicant: QUALCOMM Incorporated

Inventor： Mehrad Tavakoli ,  Moinul Khan ,  Martin Renschler ,  Mriganka Mondal

IPC: G06T15/00 ,  G06F3/01 ,  G06K9/00 ,  G06T3/00

Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.

公开(公告)号：US20180165792A1

公开(公告)日：2018-06-14

申请号：US15377488

申请日：2016-12-13

Applicant: QUALCOMM Incorporated

Inventor： Mehrad Tavakoli ,  Moinul Khan ,  Martin Renschler ,  Mriganka Mondal

IPC: G06T3/40 ,  G06F3/01 ,  G06K9/46 ,  G06K9/62 ,  G06T15/00

CPC classification number: G06T15/00 ,  G06F3/013 ,  G06K9/00597 ,  G06T3/0012 ,  G06T2210/36

Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.