公开(公告)号：US20250165060A1

公开(公告)日：2025-05-22

申请号：US18819197

申请日：2024-08-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Shijia Zhang ,  Wenjun Jiang ,  Xun Chen

IPC: G06F3/01 ,  G02B27/00 ,  G02B27/01 ,  G06T19/00

Abstract: In one embodiment, a method includes accessing video captured by one or more cameras of a head-mounted device (HMD) worn by a user and determining, from the accessed video, multiple environmental feature maps and multiple corresponding environmental embeddings representing an environment of the user captured in the accessed video. The method further includes fusing, by multiple trained environmental transformer models, the environmental embeddings to create a fused environmental embedding; determining a head pose of the user coincident with the accessed video; and predicting, by a trained decoder and based on the fused environmental embedding and the determined head pose of the user, a body pose of the user.