Artificial reality system having multi-bank, multi-port distributed shared memory

    公开(公告)号:US11409671B2

    公开(公告)日:2022-08-09

    申请号:US16720635

    申请日:2019-12-19

    摘要: This disclosure describes various examples of a system which uses a multi-bank, multi-port shared memory system that may be implemented as part of a system on a chip. The shared memory system may have particular applicability in the context of an artificial reality system, and may be designed to have distributed or varied latency for one or more memory banks and/or one or more components or subsystems within the system on a chip. The described shared memory system may be logically a single entity, but physically may have multiple memory banks, each accessible by any of a number of components or subsystems. In some examples, the memory system may enable concurrent, common, and/or shared access to memory without requiring, in some situations, full locking or arbitration.

    Interaction with artificial reality based on physical objects

    公开(公告)号:US11409364B2

    公开(公告)日:2022-08-09

    申请号:US16892987

    申请日:2020-06-04

    摘要: Disclosed herein are related to a system and a method for controlling a virtual reality based on a physical object. In one aspect, a shape of a hand of a user corresponding to a surface or a structure of a physical object is detected. In one aspect, according to the detected shape of the hand, an interactive feature for the surface or the structure of the physical object is generated in a virtual reality or augmented reality application. In one aspect, a user interaction with the interactive feature is detected. In one aspect, an action of the virtual reality or augmented reality application is initiated, in response to detecting the user interaction with the interactive feature.

    Display devices with wavelength-dependent reflectors for eye tracking

    公开(公告)号:US11409116B1

    公开(公告)日:2022-08-09

    申请号:US17246347

    申请日:2021-04-30

    IPC分类号: G02B27/01 G06F3/01

    摘要: An eye-tracking system includes two mirrors. A first mirror is positioned to transmit light, received at a first incident angle, reflected off an eye of a user toward a second mirror. The first mirror is also positioned to reflect the light, reflected from the second mirror, at a second incident angle. The second mirror is inclined from the first mirror so that the light transmitted through the first mirror is reflected by the second mirror toward the first mirror at a first reflection angle. The light reflected by the second mirror is reflected by the first mirror toward the second mirror at a second reflection angle greater than the first reflection angle. The eye-tracking system also includes one or more sensors positioned to detect the light reflected by the first mirror and the second mirror for determining a gaze direction of the eye of the user.

    Geometric phase lens alignment in an augmented reality head mounted display

    公开(公告)号:US11409109B1

    公开(公告)日:2022-08-09

    申请号:US16898864

    申请日:2020-06-11

    摘要: A HMD includes a display block. The display block combines light from a local area with image light to form an augmented scene. The display block also provides the augmented scene to an eyebox corresponding a location of a user's eye. The display block includes a waveguide display, a focusing assembly and a compensation assembly. The waveguide display emits the image light. The focusing assembly includes a focusing geometric phase lens and presents the augmented scene at a focal distance. The compensation assembly includes a compensation geometric phase lens that has an axis of orientation orthogonal to an axis of orientation of the focusing geometric phase lens. The compensation assembly compensates the optical power of the focusing assembly.

    Offloading Visual Frames to a Gateway Device

    公开(公告)号:US20220247970A1

    公开(公告)日:2022-08-04

    申请号:US17694277

    申请日:2022-03-14

    摘要: Implementations offload visual frames from a client device to a gateway or edge device for processing. The client device can receive streaming visual frames and a request to process the visual frames using a data service. The client device can offload visual frames to a gateway or edge device preloaded with a resource that corresponds to the requested data service. After the gateway or edge device processes the visual frames using the resource, the processed visual frames can be returned to the client device. In implementations, the offload device and client device are situated in a network such that a latency for the offload communications supports real-time video display. A gateway device manager can locate a gateway connected to the client device, and resources can be deployed (or the gateway can be prepopulated) so that the device can perform gateway services and edge processing services for the client device.

    MIXTURE OF VOLUMETRIC PRIMITIVES FOR EFFICIENT NEURAL RENDERING

    公开(公告)号:US20220245910A1

    公开(公告)日:2022-08-04

    申请号:US17554992

    申请日:2021-12-17

    IPC分类号: G06T19/20 G06T17/20 G06T15/06

    摘要: A method for training a real-time, modeling for animating an avatar for a subject is provided. The method includes collecting multiple images of a subject. The method also includes selecting a plurality of vertex positions in a guide mesh, indicative of a volumetric primitive enveloping the subject, determining a geometric attribute for the volumetric primitive including a position, a rotation, and a scale factor of the volumetric primitive, determining a payload attribute for each of the volumetric primitive, the payload attribute including a color value and an opacity value for each voxel in a voxel grid defining the volumetric primitive, determining a loss factor for each point in the volumetric primitive based on the geometric attribute, the payload attribute and a ground truth value, and updating a three-dimensional model for the subject. A system and a non-transitory, computer-readable medium storing instructions to perform the above method are also provided.