公开(公告)号：US20240386650A1

公开(公告)日：2024-11-21

申请号：US18509113

申请日：2023-11-14

Applicant: QUALCOMM Incorporated

Inventor： Farhad GHAZVINIAN ZANJANI ,  Leyla MIRVAKHABOVA ,  Yinhao ZHU ,  Hong CAI ,  Fatih Murat PORIKLI

IPC: G06T15/06 ,  G06T7/10 ,  G06T7/50 ,  G06T15/10 ,  G06T17/20

Abstract: Systems and techniques are provided for processing image data corresponding to a scene. A process can include generating a planar distance map including a planar distance value for each pixel of at least one image corresponding to the scene. Planar segmentation is performed based on the planar distance map, a normal map corresponding to the at least one image, and positional encoding information of the planar distance map. A triangular mesh fragment is initialized based on sampling points from each planar segment of a plurality of planar segments from the planar segmentation. Ray-triangle intersections are determined based on performing ray casting for a reconstructed planar mesh including a plurality of triangular mesh fragments each corresponding to a different image. A planar reconstruction and segmentation machine learning network is optimized for the scene, based on training the planar reconstruction and segmentation machine learning network using one or more loss functions.