公开(公告)号：US20210056661A1

公开(公告)日：2021-02-25

申请号：US16987983

申请日：2020-08-07

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin HOLMES ,  Jonathan WICKS

IPC: G06T1/20 ,  G06T7/20

Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

公开(公告)号：US20190391641A1

公开(公告)日：2019-12-26

申请号：US16406515

申请日：2019-05-08

Applicant: QUALCOMM Incorporated

Inventor： Robert VANREENEN ,  Jonathan WICKS ,  Tate HORNBECK ,  Samuel Benjamin HOLMES

IPC: G06F3/01 ,  G06T3/40 ,  G06T1/20 ,  G06T5/00 ,  G06T5/20

Abstract: Example techniques are described for generating graphics content by obtaining a rendering command for a frame of the graphics content, obtaining an eye position of a user after obtaining the rendering command, determining a foveation parameter for a region of the graphics content based on the eye position; and rendering a tile, of the frame, corresponding to the region of the graphics content using the foveation parameter and the rendering command.

公开(公告)号：US20220327658A1

公开(公告)日：2022-10-13

申请号：US17229242

申请日：2021-04-13

Applicant: QUALCOMM Incorporated

Inventor： Jonathan Scott TINKHAM ,  Jonathan WICKS ,  Samuel Benjamin HOLMES ,  Robert VANREENEN

IPC: G06T3/20 ,  G06T1/60 ,  G06T1/20 ,  G06T7/37

Abstract: The present disclosure relates to methods and devices for graphics processing including an apparatus, e.g., a GPU. The apparatus may process at least one frame including frame content associated with a grid including a plurality of grid sections, each of a plurality of portions of the frame content being aligned with at least a portion of at least one of the plurality of grid sections. The apparatus may also shift the frame content with respect to the grid, such that at least one portion of the plurality of portions of the frame content is aligned with at least a portion of at least one distinct grid section of the plurality of grid sections. Additionally, the apparatus may store the shifted frame content including the at least one portion of the frame content that is aligned with at least a portion of the at least one distinct grid section.

公开(公告)号：US20200226813A1

公开(公告)日：2020-07-16

申请号：US16834752

申请日：2020-03-30

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin HOLMES ,  Tate HORNBECK ,  Robert VANREENEN

IPC: G06T15/00 ,  G06F3/01 ,  G06T1/20

Abstract: A method, a computer-readable medium, and an apparatus are provided. The apparatus may be configured to receive information indicative of a fovea region. The apparatus may be configured to identify, based on the information indicative of the fovea region, high priority bins and low priority bins. The apparatus may be configured to determine a rendering time allotment for the frame. The apparatus may be configured to determine that the rendering time allotment for the frame will be exceeded, based on an amount of time used to render the high priority bins and the low priority bins. The apparatus may be configured to render, based on the determination that the rendering time allotment for the frame will be exceeded, at least one of the low priority bins at a first quality instead of a second quality.

公开(公告)号：US20200090396A1

公开(公告)日：2020-03-19

申请号：US16130910

申请日：2018-09-13

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin HOLMES ,  Tate HORNBECK ,  Robert VANREENEN

IPC: G06T15/00 ,  G06T1/20 ,  G06F3/01

Abstract: A method, a computer-readable medium, and an apparatus are provided. The apparatus may be configured to receive information indicative of a fovea region. The apparatus may be configured to identify, based on the information indicative of the fovea region, high priority bins and low priority bins. The apparatus may be configured to determine a rendering time allotment for the frame. The apparatus may be configured to determine that the rendering time allotment for the frame will be exceeded, based on an amount of time used to render the high priority bins and the low priority bins. The apparatus may be configured to render, based on the determination that the rendering time allotment for the frame will be exceeded, at least one of the low priority bins at a first quality instead of a second quality.

公开(公告)号：US20250022436A1

公开(公告)日：2025-01-16

申请号：US18713543

申请日：2022-12-15

Applicant: QUALCOMM Incorporated

Inventor： Jonathan WICKS ,  Chun WANG ,  Samuel Benjamin HOLMES ,  Mark STERNBERG ,  Prashant NUKALA

IPC: G09G5/02 ,  G09G5/377

Abstract: Aspects presented herein relate to methods and devices for display processing including an apparatus, e.g., a DPU. The apparatus may obtain an indication of associated with a plurality of pixels corresponding to a plurality of color channels. The apparatus may also divide each of the plurality of color channels. The apparatus may also select at least one first color channel of the plurality of divided color channels. Further, the apparatus may scale each of the pixels associated with the at least one first color channel. The apparatus may also blend, based on each of the plurality of scaled pixels, all of the plurality of pixels associated with the at least one first color channel. The apparatus may also transmit, based on all of the plurality of blended pixels, an indication of the plurality of pixels associated with the at least one first color channel.

公开(公告)号：US20230360227A1

公开(公告)日：2023-11-09

申请号：US17739820

申请日：2022-05-09

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin HOLMES ,  Jonathan WICKS ,  Arjun CHOPRA ,  Martin RENSCHLER

IPC: G06T7/20 ,  G06T19/00

CPC classification number: G06T7/20 ,  G06T19/006

Abstract: Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.

公开(公告)号：US20220383454A1

公开(公告)日：2022-12-01

申请号：US17331530

申请日：2021-05-26

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin HOLMES ,  Jonathan WICKS

IPC: G06T5/00 ,  G09G5/377 ,  G06T5/50

Abstract: A frame processor may generate a mask based on one or more static regions of a first set of frames of a plurality of previous frame and adjust the mask to at least one of determine alpha data or conceal distorted content associated with the one or more static regions of the first set of frames. The distorted content may be caused by extrapolation of a frame from a second set of frames of the plurality of previous frames. The frame processor may generate a composite frame based on application of at least one of the mask or the alpha data to a previous frame of the plurality of frames, and application of the previous frame based on the at least one of the mask or the alpha data to the frame extrapolated from the second set of frames of the plurality of previous frames.

公开(公告)号：US20230162329A1

公开(公告)日：2023-05-25

申请号：US18094252

申请日：2023-01-06

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin HOLMES ,  Jonathan WICKS

IPC: G06T5/00 ,  G06T5/50 ,  G09G5/377

CPC classification number: G06T5/002 ,  G06T5/50 ,  G09G5/377

Abstract: A frame processor may generate a mask based on one or more static regions of a first set of frames of a plurality of previous frame and adjust the mask to at least one of determine alpha data or conceal distorted content associated with the one or more static regions of the first set of frames. The distorted content may be caused by extrapolation of a frame from a second set of frames of the plurality of previous frames. The frame processor may generate a composite frame based on application of at least one of the mask or the alpha data to a previous frame of the plurality of frames, and application of the previous frame based on the at least one of the mask or the alpha data to the frame extrapolated from the second set of frames of the plurality of previous frames.

公开(公告)号：US20220138961A1

公开(公告)日：2022-05-05

申请号：US17087528

申请日：2020-11-02

Applicant: QUALCOMM Incorporated

Inventor： Jonathan WICKS ,  Samuel Benjamin HOLMES

IPC: G06T7/215 ,  G06T7/246 ,  G06T15/00 ,  G06T19/00

Abstract: The present disclosure relates to methods and devices for image or frame processing including an apparatus, e.g., a GPU. In some aspects, the apparatus may identify a discontinuity between at least one first region of a first frame and at least one second region of a second frame, the at least one first region corresponding to the at least one second region. The apparatus may also determine whether the discontinuity between the at least one first region and the at least one second region is greater than or equal to a motion estimation threshold. The apparatus may also skip a motion estimation for the at least one first region and the at least one second region when the discontinuity between the at least one first region and the at least one second region is greater than or equal to the motion estimation threshold.