公开(公告)号：US20200265636A1

公开(公告)日：2020-08-20

申请号：US16802400

申请日：2020-02-26

申请人： INTEL CORPORATION

发明人： Brent E. INSKO ,  Prasoonkumar SURTI

IPC分类号： G06T15/40 ,  G06T15/00 ,  H04N13/279

摘要： An apparatus and method are described for performing an early depth test on graphics data. For example, one embodiment of a graphics processing apparatus comprises: early depth test circuitry to perform an early depth test on blocks of pixels to determine whether all pixels in the block of pixels can be resolved by the early depth test; a plurality of execution circuits to execute pixel shading operations on the blocks of pixels; and a scheduler circuit to schedule the blocks of pixels for the pixel shading operations, the scheduler circuit to prioritize the blocks of pixels in accordance with the determination as to whether all pixels in the block of pixels can be resolved by the early depth test.

公开(公告)号：US10719939B2

公开(公告)日：2020-07-21

申请号：US15428104

申请日：2017-02-08

申请人： Fyusion, Inc.

发明人： Stefan Johannes Josef Holzer ,  Yuheng Ren ,  Abhishek Kar ,  Alexander Jay Bruen Trevor ,  Krunal Ketan Chande ,  Martin Josef Nikolaus Saelzle ,  Radu Bogdan Rusu

IPC分类号： G06T15/00 ,  G06T7/174 ,  H04N13/282 ,  H04N13/243 ,  H04N5/265 ,  H04N5/232 ,  G06F16/532 ,  H04N13/279 ,  G06F3/01 ,  G06F16/583 ,  G06F16/738 ,  G06T3/40 ,  G06F16/783 ,  G06K9/00

摘要： Various embodiments describe systems and processes for generating AR/VR content. In one aspect, a method for generating a three-dimensional (3D) projection of an object is provided. A sequence of images along a camera translation may be obtained using a single lens camera. Each image contains at least a portion of overlapping subject matter, which includes the object. The object is semantically segmented from the sequence of images using a trained neural network to form a sequence of segmented object images, which are then refined using fine-grained segmentation. On-the-fly interpolation parameters are computed and stereoscopic pairs are generated for points along the camera translation from the refined sequence of segmented object images for displaying the object as a 3D projection in a virtual reality or augmented reality environment. Segmented image indices are then mapped to a rotation range for display in the virtual reality or augmented reality environment.

公开(公告)号：US10701347B2

公开(公告)日：2020-06-30

申请号：US16722269

申请日：2019-12-20

申请人： zSpace, Inc.

发明人： David A. Chavez ,  Jonathan J. Hosenpud ,  Clifford S. Champion ,  Alexandre R. Lelievre ,  Arthur L. Berman ,  Kevin S. Yamada

IPC分类号： H04N13/279 ,  G06F16/58 ,  G06F3/01 ,  G06T15/20

摘要： Systems and methods for replacing a 2D image with an equivalent 3D image within a web page. Content of a 2D image displayed within a web page may be identified and 3D images may be identified as possible replacements of the 2D image. The 3D images may be ranked based on sets of ranking criteria. A 3D image with a highest-ranking value may be selected based on a ranking of the 3D images. The selected 3D image may be integrated into the web page, thereby replacing the 2D image with the selected 3D image. Further, a user input manipulating the 3D image within the web page may be received. The user input may include movement of a view point of a user relative to a display displaying the web page and/or detection of a beam projected from an end of a user input device intersecting with the 3D image.

公开(公告)号：US20200169713A1

公开(公告)日：2020-05-28

申请号：US16691433

申请日：2019-11-21

申请人： CANON KABUSHIKI KAISHA

发明人： Naoki Umemura

IPC分类号： H04N13/117 ,  H04N13/282 ,  H04N13/279

摘要： An image processing apparatus includes data acquisition units configured to acquire data that is based on first image capturing from a plurality of directions, and on second image capturing from a plurality of directions, a modification unit configured to modify at least one of position information and time information about the data acquired by the second data acquisition unit in association with at least one of position information and time information about the data acquired by the first data acquisition unit, and a generation unit configured to generate a virtual viewpoint image that contains an image of an object captured in the first image capturing and an image of an object captured in the second image capturing, based on the data acquired by the first data acquisition unit, the data acquired by the second data acquisition unit, and the information modified by the modification unit.

公开(公告)号：US20200168000A1

公开(公告)日：2020-05-28

申请号：US16199220

申请日：2018-11-25

申请人： Nick Cherukuri

发明人： Nick Cherukuri

IPC分类号： G06T19/00 ,  H04N13/279 ,  H04N13/122 ,  H04N13/204 ,  G06F3/01 ,  G06F3/03 ,  G02B27/01

摘要： An augmented reality eyewear device to operate augmented reality applications and provides a wide-angle field view, is disclosed. The eyewear device comprises a frame which is associated with a processor, a sensor assembly, a camera assembly, and a user interface control assembly coupled to the processor. The sensor assembly coupled to the processor comprises at least two inertial measurement unit (IMU) sensor to transmit raw IMU data of at least one IMU sensor and an android connected IMU data of at least one IMU sensor. The camera assembly coupled to the processor comprises at least two wide angle cameras synchronized with one another is configured to transmit camera feed data from the camera assembly to the processor. The processor is configured to dually synchronize raw IMU Data and android connected IMU data with the camera feed data providing a seamless display of 3D content of the augmented reality applications.

公开(公告)号：US10666932B2

公开(公告)日：2020-05-26

申请号：US15475061

申请日：2017-03-30

申请人： THALES

发明人： Philippe Coni ,  Aude Gueguen ,  Matthieu Grossetete

IPC分类号： H04N13/363 ,  H04N13/279 ,  H04N13/334 ,  G02B27/01 ,  H04N13/341 ,  G02B30/23 ,  G02B30/24 ,  H04N13/365 ,  H04N13/324 ,  H04N13/344 ,  B64D43/00

摘要： The general field of the invention is that of monochromatic stereoscopic image projectors including two light sources that illuminate two imagers, the radiation of the two light sources having a spectral distribution centred on a central wavelength, the first imager and the second imager being connected to a generator of stereoscopic image pairs. The image projector includes a dichroic separating filter that transmits the portion of the spectrum below the central wavelength and that reflects the portion of the spectrum above this central wavelength. The first light source and the second light source are arranged symmetrically on either side of the dichroic separating filter. The image projector operates cyclically, each cycle including two alternations. Each alternation consists in changing the emission source and in switching to the two displays the left and right images emitted by the generator of image pairs.

公开(公告)号：US20200162712A1

公开(公告)日：2020-05-21

申请号：US16515175

申请日：2019-07-18

申请人： Foundation for Research and Business, Seoul National University of Science and Technology

发明人： Ji Hoon YUN

IPC分类号： H04N13/111 ,  H04N13/264 ,  H04N13/279 ,  H04N13/156 ,  H04N13/194

摘要： Provided is a method for creating a virtual reality content, storing the virtual reality content in a transmission buffer, and after that, managing the transmission buffer. A server creates the virtual reality content based on user's motion information, stores the virtual reality content in the transmission buffer and is allowed to modify the virtual reality content stored in the transmission buffer based on subsequently received user's motion information, so that the most recent user's motion information can be appropriately reflected in the virtual reality content. It is possible to provide a more immersive virtual reality service.

公开(公告)号：US10659768B2

公开(公告)日：2020-05-19

申请号：US15444601

申请日：2017-02-28

申请人： Mitsubishi Electric Research Laboratories, Inc. ,  Mitsubishi Electric Corporation

发明人： Chen Feng ,  Yuichi Taguchi ,  Esra Cansizoglu ,  Srikumar Ramalingam ,  Khalid Yousif ,  Haruyuki Iwama

IPC分类号： H04N13/279 ,  H04N13/204 ,  G06T7/579 ,  G06T7/246

摘要： A system for reconstructing a three-dimensional (3D) model of a scene including a point cloud having points identified by 3D coordinates includes at least one sensor to acquire a set of images of the scene from different poses defining viewpoints of the images and a memory to store the set of images and the 3D model of the scene. The system also includes a processor operatively connected to the memory and coupled with stored instructions to transform the images from the set of images to produce a set of virtual images of the scene viewed from virtual viewpoints; compare at least some features from the images and the virtual images to determine the viewpoint of each image in the set of images; and update 3D coordinates of at least one point in the model of the scene to match coordinates of intersections of ray back-projections from pixels of at least two images corresponding to the point according to the viewpoints of the two images.

公开(公告)号：US20200154095A1

公开(公告)日：2020-05-14

申请号：US16680318

申请日：2019-11-11

申请人： Open Space Labs, Inc.

发明人： Michael Ben Fleischman ,  Philip DeCamp ,  Jeevan James Kalanithi

IPC分类号： H04N13/279 ,  H04N13/282 ,  G06K9/00 ,  H04N5/232

摘要： A spatial indexing system receives a video that is a sequence of frames depicting an environment, such as a floor of a construction site, and performs a spatial indexing process to automatically identify the spatial locations at which each of the images were captured. The spatial indexing system also generates an immersive model of the environment and provides a visualization interface that allows a user to view each of the images at its corresponding location within the model.

公开(公告)号：US20200151426A1

公开(公告)日：2020-05-14

申请号：US16744520

申请日：2020-01-16

申请人： Airbus Operations GmbH

发明人： Carsten Kohlmeier-Beckmann

IPC分类号： G06K9/00 ,  H04N5/247 ,  G09G5/14 ,  H04N13/279 ,  G06F3/01 ,  G06F3/03 ,  G09G5/00

摘要： A virtual window device, particularly for use in an airplane, includes a bezel, or a frame, with a display arranged within the bezel, or within the frame; a distance sensor unit configured to produce at least one first distance signal indicating a first distance to an object; a first camera unit configured to capture a live video of a real scene; and a computing unit configured to select, based at least on the at least one first distance signal, a section of the live video of the real scene captured by the first camera unit; wherein the computing unit is further configured to control the display to display the selected section.