公开(公告)号：US20140176575A1

公开(公告)日：2014-06-26

申请号：US14015955

申请日：2013-08-30

Applicant: NVIDIA Corporation

Inventor： Morgan McGuire ,  Michael Thomas Mara ,  David Patrick Luebke ,  Jacopo Pantaleoni

IPC: G06T1/20

CPC classification number: G06T1/20 ,  G06T11/40 ,  G06T15/005 ,  G06T15/06

Abstract: A system, method, and computer program product are provided for tiled deferred shading. In operation, a plurality of photons associated with at least one scene are identified. Further, a plurality of screen-space tiles associated with the at least one scene are identified. Additionally, each of the plurality of screen-space tiles capable of being affected by a projection of an effect sphere for each of the plurality of photons are identified. Furthermore, at least a subset of photons associated with each of the screen-space tiles from which to compute shading are selected. Moreover, shading for the at least one scene is computed utilizing the selected at least a subset of photons.

Abstract translation: 提供了平铺延迟着色的系统，方法和计算机程序产品。 在操作中，识别与至少一个场景相关联的多个光子。 此外，识别与至少一个场景相关联的多个屏幕空间瓦片。 此外，识别能够受到多个光子中的每一个的效应球体的投影影响的多个屏幕空间瓦片中的每一个。 此外，选择与从其计算阴影的每个屏幕空间瓦片相关联的光子的至少一个子集。 此外，利用所选择的至少一个光子集来计算至少一个场景的阴影。

公开(公告)号：US11892629B2

公开(公告)日：2024-02-06

申请号：US17670337

申请日：2022-02-11

Applicant: NVIDIA Corporation

Inventor： Jonghyun Kim ,  Ward Lopes ,  David Patrick Luebke ,  Manu Gopakumar

IPC: G02B27/01 ,  G03H1/22 ,  G02B7/04 ,  G06F3/01 ,  G06T19/00

CPC classification number: G02B27/0103 ,  G02B7/04 ,  G02B27/0172 ,  G03H1/2294 ,  G06F3/013 ,  G06T19/006 ,  G02B2027/0174 ,  G02B2027/0178 ,  G03H2223/16 ,  G03H2223/19 ,  G03H2223/22

Abstract: Virtual reality (VR) displays are computer displays that present images or video in a manner that simulates a real experience for the viewer. In many cases, VR displays are implemented as head-mounted displays (HMDs) which provide a display in the line of sight of the user. Because current HMDs are composed of a display panel and magnifying lens with a gap therebetween, proper functioning of the HMDs limits their design to a box-like form factor, thereby negatively impacting both comfort and aesthetics. The present disclosure provides a different configuration for a VR display which allows for improved comfort and aesthetics, including specifically at least one coherent light source, at least one pupil replicating waveguide coupled to the at least one coherent light source to receive light therefrom, and at least one spatial light modulator coupled to the at least one pupil replicating waveguide to modulate the light.

公开(公告)号：US20230110206A1

公开(公告)日：2023-04-13

申请号：US18079772

申请日：2022-12-12

Applicant: NVIDIA Corporation

Inventor： Tero Tapani Karras ,  Samuli Matias Laine ,  David Patrick Luebke ,  Jaakko T. Lehtinen ,  Miika Samuli Aittala ,  Timo Oskari Aila ,  Ming-Yu Liu ,  Arun Mohanray Mallya ,  Ting-Chun Wang

IPC: G06N3/08 ,  G06T9/00 ,  H04N19/20 ,  H04N7/15 ,  G06T7/73 ,  G06V40/16 ,  G06T5/00

Abstract: A latent code defined in an input space is processed by the mapping neural network to produce an intermediate latent code defined in an intermediate latent space. The intermediate latent code may be used as appearance vector that is processed by the synthesis neural network to generate an image. The appearance vector is a compressed encoding of data, such as video frames including a person's face, audio, and other data. Captured images may be converted into appearance vectors at a local device and transmitted to a remote device using much less bandwidth compared with transmitting the captured images. A synthesis neural network at the remote device reconstructs the images for display.

公开(公告)号：US10948985B2

公开(公告)日：2021-03-16

申请号：US16365941

申请日：2019-03-27

Applicant: NVIDIA Corporation

Inventor： Thomas Hastings Greer ,  Josef Bo Spjut ,  David Patrick Luebke

IPC: G06F3/01 ,  G06T1/20 ,  H04N13/332 ,  H04N13/383

Abstract: Perceived clarity of an image presented by a display can be improved using an image stabilization technique to stabilize the image relative to a user's retina. During an illumination period, stabilization actuators are controlled to move a display panel or adjust optical components in the path of light associated with the image to shift the location of the image on the user's retina in response to head or eye movement detected by the system. In some embodiments, a display is configured to illuminate an image, and at least one stabilization actuator is configured to stabilize the image in a retina space associated with a user. Changes in the retina space can be detected by one or more sensors configured to detect a head position of the user and/or an orientation of the user's retina. The image is stabilized in retina space using the stabilization actuators.

公开(公告)号：US10922876B2

公开(公告)日：2021-02-16

申请号：US16733149

申请日：2020-01-02

Applicant: NVIDIA Corporation

Inventor： Qi Sun ,  Anjul Patney ,  Omer Shapira ,  Morgan McGuire ,  Aaron Eliot Lefohn ,  David Patrick Luebke

IPC: G06T19/00 ,  G06F3/01 ,  G06T15/20 ,  G06T19/20

Abstract: A method, computer readable medium, and system are disclosed for redirecting a user's movement through a physical space while the user views a virtual environment. A temporary visual suppression event is detected when a user's eyes move relative to the user's head while viewing a virtual scene displayed on a display device, an orientation of the virtual scene relative to the user is modified to direct the user to physically move along a planned path through a virtual environment corresponding to the virtual scene, and the virtual scene is displayed on the display device according to the modified orientation.

公开(公告)号：USRE47984E1

公开(公告)日：2020-05-12

申请号：US15469606

申请日：2017-03-27

Applicant: NVIDIA Corporation

Inventor： David Patrick Luebke ,  Douglas Lanman ,  Thomas F. Fox ,  Gerrit Slavenburg

IPC: G09G5/00 ,  G02B27/01

Abstract: In embodiments of the invention, an apparatus may include a display comprising a plurality of pixels. The apparatus may further include a computer system coupled with the display and operable to instruct the display to display a deconvolved image corresponding to a target image, wherein when the display displays the deconvolved image while located within a near-eye range of an observer, the target image may be perceived in focus by the observer.

公开(公告)号：US20190295311A1

公开(公告)日：2019-09-26

申请号：US16439564

申请日：2019-06-12

Applicant: NVIDIA Corporation

Inventor： David Patrick Luebke ,  Alessandro Dal Corso ,  Marco Salvi ,  Craig Eugene Kolb ,  Samuli Matias Laine

IPC: G06T15/06

Abstract: A method, computer readable medium, and system are disclosed for performing stable ray tracing. The method includes the steps of identifying a plurality of old hit points used in a previously rendered frame, re-projecting the plurality of old hit points within a current frame to create a plurality of samples within a screen space of the current frame, adjusting the plurality of samples within the screen space of the current frame, based on one or more criteria, for each of the plurality of samples, tracing a ray from the sample toward a corresponding old hit point for the sample to determine a current hit point corresponding to the sample for the current frame, where the current hit point may include the corresponding old hit point for the sample or an updated hit point for the sample, shading at least a portion of the plurality of current hit points to obtain a color for each of the plurality of samples within the screen space of the current frame, and reconstructing a final color for a plurality of pixels in the screen space of the current frame, utilizing the color for each of the plurality of samples within the screen space of the current frame.

公开(公告)号：US20190079287A1

公开(公告)日：2019-03-14

申请号：US16186271

申请日：2018-11-09

Applicant: NVIDIA Corporation

Inventor： Jonghyun Kim ,  Kaan Aksit ,  Ward Lopes ,  David Patrick Luebke

IPC: G02B27/01 ,  G02B5/32 ,  G02B5/10 ,  G02B27/14 ,  G02B6/00

CPC classification number: G02B27/0103 ,  G02B5/10 ,  G02B5/32 ,  G02B6/00 ,  G02B27/0172 ,  G02B27/141 ,  G02B2027/013 ,  G02B2027/0174 ,  G02B2027/0178

Abstract: A display method and system are disclosed for virtual/augmented reality. The method includes the steps of generating an image by a projection engine and projecting light rays defining the image onto a diffuser holographic optical element (DHOE) located between an observer and a concave mirror element, where a concave surface of the concave mirror element faces the observer. The light rays are projected onto the DHOE at a reference angle that causes the light rays to be diffused to the concave surface of the concave mirror element and the diffused light rays are reflected back to the observer such that the observer perceives a virtual image that appears to the observer at a position behind the concave mirror element and further from the observer than the concave mirror element.

公开(公告)号：US09594247B2

公开(公告)日：2017-03-14

申请号：US14134637

申请日：2013-12-19

Applicant: NVIDIA Corporation

Inventor： Andrew Stephen Maimone ,  Douglas Robert Lanman ,  David Patrick Luebke

IPC: G02B27/09 ,  G02B27/01 ,  G02B27/22

CPC classification number: G02B27/0101 ,  G02B2027/0123 ,  G02B2027/014 ,  G02B2027/015

Abstract: A system, method, and computer program product are provided for implementing a pinlight see-through near-eye display. Light cones configured to substantially fill a field-of-view corresponding to a pupil are generated by an array of pinlights positioned between a near focus plane and the pupil. Overlap regions where two of more light cones intersect at a display layer positioned between the array of pinlights and the pupil are determined. The two or more light cones are modulated based on the overlap regions to produce a target image at or beyond the near focus plane.

Abstract translation: 提供了一种系统，方法和计算机程序产品，用于实现光线透视近眼显示。 配置为基本上填充与瞳孔相对应的视场的光锥由位于近焦点平面和瞳孔之间的灯光阵列产生。 确定两个多个光锥在位于灯光阵列和瞳孔之间的显示层处相交的重叠区域。 基于重叠区域来调制两个或更多个光锥以在近焦点平面处或之外产生目标图像。

公开(公告)号：US20160307482A1

公开(公告)日：2016-10-20

申请号：US15130886

申请日：2016-04-15

Applicant: NVIDIA Corporation

Inventor： Fu-Chung Huang ,  David Patrick Luebke ,  Jan Kautz ,  Dawid Stanislaw Pajak

IPC: G09G3/00 ,  G06T15/04 ,  G09G3/36 ,  G06T15/80 ,  G06T15/00 ,  G09G3/34

CPC classification number: G09G3/002 ,  G09G3/001 ,  G09G3/2003 ,  G09G3/2074 ,  G09G3/3406 ,  G09G3/3433 ,  G09G3/36 ,  G09G5/363 ,  G09G5/397 ,  G09G2300/023 ,  G09G2300/0426 ,  G09G2340/0407 ,  G09G2360/08

Abstract: A method, computer readable medium, and system are disclosed for generating mixed-primary data for display. The method includes the steps of receiving a source image that includes a plurality of pixels, dividing the source image into a plurality of blocks, analyzing the source image based on an image decomposition algorithm, encoding chroma information and modulation information to generate a video signal, and transmitting the video signal to a mixed-primary display. The chroma information and modulation information correspond with two or more mixed-primary color components and are generated by the image decomposition algorithm to minimize error between a reproduced image and the source image. The two or more mixed-primary colors selected for each block of the source image are not limited to any particular set of colors and each mixed-primary color component may be selected from any color capable of being reproduced by the mixed-primary display.

Abstract translation: 公开了一种用于生成用于显示的混合主数据的方法，计算机可读介质和系统。 该方法包括以下步骤：接收包括多个像素的源图像，将源图像划分为多个块，基于图像分解算法分析源图像，对色度信息和调制信息进行编码以产生视频信号， 并将视频信号发送到混合主显示器。 色度信息和调制信息与两个或更多个混合原色分量相对应，并且由图像分解算法产生，以最小化再现图像与源图像之间的误差。 为源图像的每个块选择的两个或多个混合原色不限于任何特定的颜色集合，并且可以从能够由混合主显示器再现的任何颜色中选择每个混合原色分量。