公开(公告)号：US11151780B2

公开(公告)日：2021-10-19

申请号：US17044270

申请日：2019-05-13

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yue Dong ,  Guojun Chen ,  Xin Tong

IPC: G06T15/60 ,  G06T15/80 ,  G06T17/20 ,  G06T15/50 ,  G06N3/04

Abstract: In accordance with implementations of the subject matter described herein, there is provided a solution of lighting estimation. In the solution, an input image about a real object and a depth map corresponding to the input image are obtained. A geometric structure of the scene in the input image is determined based on the depth map. Shading and shadow information on the real object caused by a light source in the scene is determined based on the determined geometric structure of the scene. Then, a lighting condition in the scene caused by the light source is determined based on the input image and the shading and shadow information. The virtual object rendered using the lighting condition obtained according to the solution can exhibit a realistic effect consistent with the real object.

公开(公告)号：US20230072701A1

公开(公告)日：2023-03-09

申请号：US17942776

申请日：2022-09-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Guojun Chen ,  Yue Dong ,  Xin TONG ,  Yingnan Ju ,  Pingchao Yu

IPC: G06T19/00 ,  G06F1/16 ,  G06F3/01

Abstract: Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing deice is configured to acquire an image of an environment where the wearable computing deice is located. The image is adjusted based on a cement parameter used w hen the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing deice can obtain more real and accurate emblem light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.

公开(公告)号：US11164366B2

公开(公告)日：2021-11-02

申请号：US16479547

申请日：2018-01-16

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Guojun Chen ,  Yue Dong ,  Xin Tong

IPC: G06T15/50 ,  G06T19/00 ,  G06T19/20 ,  H04N5/232 ,  H04N5/235 ,  G06T15/04

Abstract: Implementations of the subject matter described herein relate to mixed reality rendering of objects. According to the embodiments of the subject matter described herein, while rendering an object, a wearable computing device takes lighting conditions in the real world into account, thereby increasing the reality of the rendered object. In particular, the wearable computing device acquires environment lighting information of an object to be rendered and renders the object to a user based on the environment lighting information. In this way, the object rendered by the wearable computing device can be more real and accurate. The user will thus have a better interaction experience.

公开(公告)号：US20210090338A1

公开(公告)日：2021-03-25

申请号：US16635485

申请日：2018-06-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Guojun Chen ,  Yue Dong ,  Xin Tong ,  Yingnan Ju ,  Chaos Yu

IPC: G06T19/00 ,  G06F3/01 ,  G06F1/16

Abstract: Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object, a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing device is configured to acquire an image of an environment where the wearable computing device is located. The image is adjusted based on a camera parameter used when the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing device can obtain more real and accurate ambient light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.

公开(公告)号：US11727654B2

公开(公告)日：2023-08-15

申请号：US17942776

申请日：2022-09-12

Applicant: Microsoft Technology Licensing, LLC

Inventor： Guojun Chen ,  Yue Dong ,  Xin Tong ,  Yingnan Ju ,  Pingchao Yu

IPC: G06T19/00 ,  G06F1/16 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F1/163 ,  G06F3/011

Abstract: Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing deice is configured to acquire an image of an environment where the wearable computing deice is located. The image is adjusted based on a cement parameter used when the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing deice can obtain more real and accurate emblem light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.

公开(公告)号：US11461978B2

公开(公告)日：2022-10-04

申请号：US16635485

申请日：2018-06-21

Applicant: Microsoft Technology Licensing, LLC

Inventor： Guojun Chen ,  Yue Dong ,  Xin Tong ,  Yingnan Ju ,  Pingchao Yu

IPC: G06T19/00 ,  G06F1/16 ,  G06F3/01

Abstract: Implementations of the subject matter described herein relate to mixed reality object rendering based on ambient light conditions. According to the embodiments of the subject matter described herein, while rendering an object, a wearable computing device acquires light conditions of the real world, thereby increasing the reality of the rendered object. In particular, the wearable computing device is configured to acquire an image of an environment where the wearable computing device is located. The image is adjusted based on a camera parameter used when the image is captured. Subsequently, ambient light information is determined based on the adjusted image. In this way, the wearable computing device can obtain more real and accurate ambient light information, so as to render to the user an object with enhanced reality. Accordingly, the user can have a better interaction experience.