POSE ESTIMATION IN EXTENDED REALITY SYSTEMS

    公开(公告)号:US20220059159A1

    公开(公告)日:2022-02-24

    申请号:US17518485

    申请日:2021-11-03

    Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

    METHODS AND APPARATUS FOR HANDLING OCCLUSIONS IN SPLIT RENDERING

    公开(公告)号:US20210312701A1

    公开(公告)日:2021-10-07

    申请号:US17061179

    申请日:2020-10-01

    Abstract: The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.

    EDGE-AWARE VOLUMETRIC DEPTH MAP FUSION
    16.
    发明申请
    EDGE-AWARE VOLUMETRIC DEPTH MAP FUSION 审中-公开
    边缘体积深度地图融合

    公开(公告)号:US20160140769A1

    公开(公告)日:2016-05-19

    申请号:US14543570

    申请日:2014-11-17

    Inventor: Gerhard REITMAYR

    Abstract: Disclosed is a method and apparatus for reducing artifacts in a three-dimensional model of a surface reconstructed based on a plurality of range images. In one embodiment, the functions implemented include: detecting edges in one or more range images; computing a signed distance function for each range image; truncating the signed distance function to obtain a truncated signed distance function for each range image; and reducing a negative ramp length of the truncated signed distance function in one or more areas around the detected edges.

    Abstract translation: 公开了一种用于减少基于多个范围图像重建的表面的三维模型中的伪影的方法和装置。 在一个实施例中,所实现的功能包括:检测一个或多个范围图像中的边缘; 计算每个范围图像的带符号距离函数; 截断有符号距离函数,以获得每个范围图像的截断符号距离函数; 并且减少所检测的边缘周围的一个或多个区域中截断的有符号距离函数的负斜坡长度。

    OBJECT SEGMENTATION AND FEATURE TRACKING
    17.
    发明公开

    公开(公告)号:US20230342943A1

    公开(公告)日:2023-10-26

    申请号:US18343591

    申请日:2023-06-28

    CPC classification number: G06T7/174 G06T2207/20084

    Abstract: Examples are described for processing images to mask dynamic objects out of images to improve feature tracking between images. A device receives an image of an environment captured by an image sensor. The image depicts at least a static portion of the environment and a dynamic object in the environment. The device identifies a portion of the image that includes a depiction of the dynamic object. For example, the device can detect a bounding box around the dynamic object, or can detect which pixels in the image correspond to the dynamic object. The device generates a masked image at least by masking the portion of the image. The device identifies features in the masked image, and uses the features from the masked image for feature tracking from other images of the environment, masked or otherwise. The device can use this feature tracking for mapping, localization, and/or relocation.

    KEYPOINT DETECTION AND FEATURE DESCRIPTOR COMPUTATION

    公开(公告)号:US20230095621A1

    公开(公告)日:2023-03-30

    申请号:US17484601

    申请日:2021-09-24

    Abstract: Systems and techniques are described herein for processing frames. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a process can include obtaining feature information associated with a feature in a current frame, wherein the feature information is based on one or more previous frames; determining an estimated pose of the apparatus associated with the current frame; obtaining a distance associated with the feature in the current frame; and determining an estimated scale of the feature in the current frame based on the feature information associated with the feature, the estimated pose, and the distance associated with the feature.

    AUDIO CONTROL FOR EXTENDED-REALITY SHARED SPACE

    公开(公告)号:US20220303666A1

    公开(公告)日:2022-09-22

    申请号:US17835561

    申请日:2022-06-08

    Abstract: Methods, systems, computer-readable media, and apparatuses for audio signal processing are presented. Some configurations include determining that first audio activity in at least one microphone signal is voice activity; determining whether the voice activity is voice activity of a participant in an application session active on a device; based at least on a result of the determining whether the voice activity is voice activity of a participant in the application session, generating an antinoise signal to cancel the first audio activity; and by a loudspeaker, producing an acoustic signal that is based on the antinoise signal. Applications relating to shared virtual spaces are described.

    ENHANCING THREE-DIMENSIONAL MODELS USING MULTI-VIEW REFINEMENT

    公开(公告)号:US20220230406A1

    公开(公告)日:2022-07-21

    申请号:US17153773

    申请日:2021-01-20

    Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using multi-view image data. An example method can include determining, based on a first image of a target, first 3D mesh parameters for the target corresponding to a first coordinate frame; determining, based on a second image of the target, second 3D mesh parameters for the target corresponding to a second coordinate frame; determining third 3D mesh parameters for the target in a third coordinate frame, the third 3D mesh parameters being based on the first and second 3D mesh parameters and relative rotation and translation parameters of image sensors that captured the first and second images; determining a loss associated with the third 3D mesh parameters, the loss being based on the first and second 3D mesh parameters and the relative rotation and translation parameters; determining 3D mesh parameters based on the loss and third 3D mesh parameters.

Patent Agency Ranking