DETECTING OBJECT SURFACES IN EXTENDED REALITY ENVIRONMENTS

    公开(公告)号:US20220122326A1

    公开(公告)日:2022-04-21

    申请号:US17071977

    申请日:2020-10-15

    Abstract: Techniques and systems are provided for detecting object surfaces in extended reality environments. In some examples, a system obtains image data associated with a portion of a scene within a field of view (FOV) of a device. The portion of the scene includes at least one object. The system determines, based on the image data, a depth map of the portion of the scene. The system also determines, using the depth map, one or more planes within the portion of the scene. The system then generates, using the one or more planes, at least one planar region with boundaries corresponding to boundaries of a surface of the at least one object. The system also generates a three-dimensional representation of the portion of the scene using the at least one planar region and updates a three-dimensional representation of the scene using the three-dimensional representation of the portion of the scene.

    OBJECT SCANNING USING PLANAR SEGMENTATION

    公开(公告)号:US20220058871A1

    公开(公告)日:2022-02-24

    申请号:US16998975

    申请日:2020-08-20

    Abstract: Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.

    LINE SEGMENT TRACKING IN COMPUTER VISION APPLICATIONS
    24.
    发明申请
    LINE SEGMENT TRACKING IN COMPUTER VISION APPLICATIONS 审中-公开
    计算机视觉应用中的线段跟踪

    公开(公告)号:US20150269436A1

    公开(公告)日:2015-09-24

    申请号:US14657821

    申请日:2015-03-13

    CPC classification number: G06K9/00624 G06T7/246 G06T2207/30244

    Abstract: Techniques are disclosed for tracking objects in computer vision (CV) applications, involving identifying line segments in an image and using iterative approach of computing and analyzing spatial and angular distribution of different sets of line segments to identify a set of line segments with relatively high spatial and/or angular distribution, which can reduce the likelihood of error in tracking. Some techniques may further employ a quality check of the selected line segments. An estimation of a device's pose (translation and orientation) may be calculated from tracked line segments.

    Abstract translation: 公开了用于跟踪计算机视觉(CV)应用中的对象的技术,涉及识别图像中的线段,并且使用迭代方法来计算和分析不同组线段的空间和角度分布,以识别具有相对较高空间的线段 和/或角度分布,这可以降低跟踪误差的可能性。 一些技术可以进一步采用所选线段的质量检查。 可以从跟踪的线段计算设备姿态(平移和定向)的估计。

    MODELING OBJECTS FROM MONOCULAR CAMERA OUTPUTS

    公开(公告)号:US20220277489A1

    公开(公告)日:2022-09-01

    申请号:US17189105

    申请日:2021-03-01

    Abstract: Systems and techniques are provided for modeling three-dimensional (3D) meshes using images. An example method can include receiving, via a neural network system, an image of a target and metadata associated with the image and/or a device that captured the image; determining, based on the image and metadata, first 3D mesh parameters of a first 3D mesh of the target, the first 3D mesh parameters and first 3D mesh corresponding to a first reference frame associated with the image and/or the device; and determining, based on the first 3D mesh parameters, second 3D mesh parameters for a second 3D mesh of the target, the second 3D mesh parameters and second 3D mesh corresponding to a second reference frame, the second reference frame including a 3D coordinate system of a real-world scene where the target is located.

    FEATURE PROCESSING IN EXTENDED REALITY SYSTEMS

    公开(公告)号:US20220245832A1

    公开(公告)日:2022-08-04

    申请号:US17166957

    申请日:2021-02-03

    Abstract: Systems and techniques are described herein for processing images. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a first processor receives an image of an environment captured by an image sensor, identifies features depicted in the image, and generates descriptors for the features. The first processor sends the descriptors to a second processor, which may be more powerful than the first processor. The second processor receives the descriptors. The second processor associates the plurality of features with a map of the environment based on at least a subset of the plurality of descriptors. For example, the second processor can track at least a subset of the features based on at least a subset of the descriptors and based on feature information from one or more additional images of the environment.

    OBJECT SEGMENTATION AND FEATURE TRACKING

    公开(公告)号:US20220198677A1

    公开(公告)日:2022-06-23

    申请号:US17127568

    申请日:2020-12-18

    Abstract: Examples are described for processing images to mask dynamic objects out of images to improve feature tracking between images. A device receives an image of an environment captured by an image sensor. The image depicts at least a static portion of the environment and a dynamic object in the environment. The device identifies a portion of the image that includes a depiction of the dynamic object. For example, the device can detect a bounding box around the dynamic object, or can detect which pixels in the image correspond to the dynamic object. The device generates a masked image at least by masking the portion of the image. The device identifies features in the masked image, and uses the features from the masked image for feature tracking from other images of the environment, masked or otherwise. The device can use this feature tracking for mapping, localization, and/or relocation.

    POSE ESTIMATION IN EXTENDED REALITY SYSTEMS

    公开(公告)号:US20210125664A1

    公开(公告)日:2021-04-29

    申请号:US16667754

    申请日:2019-10-29

    Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

Patent Agency Ranking