-
公开(公告)号:US20230177778A1
公开(公告)日:2023-06-08
申请号:US17643233
申请日:2021-12-08
Applicant: GOOGLE LLC
Inventor: Sazzadur Rahman , Konstantine Nicholas John Tsotsos , João Manuel de Castro Afonso , José Carlos Maranhão Pascoal , Ivo Duarte , Nuno Cruces
CPC classification number: G06T19/006 , G06T15/04
Abstract: A split-architecture for rendering and warping world-locked AR elements, such as graphics in a navigation application, for display on augmented reality (AR) glasses is disclosed. The split-architecture can help to alleviate a resource burden on the AR glasses by performing the more complex processes associated with the rendering and warping on a computing device, while performing the less complex processes associated with the rendering and warping on the AR glasses. The AR glasses and the computing device are coupled via wireless communication, and the disclosed systems and methods address the large and variable latencies associated with the wireless communication that could otherwise make splitting these processes impractical.
-
公开(公告)号:US12158981B2
公开(公告)日:2024-12-03
申请号:US17468923
申请日:2021-09-08
Applicant: GOOGLE LLC
Inventor: Chao X. Guo , Fei Han , Sazzadur Rahman , Luca Ballan , Junyang Lu
IPC: G06F3/01 , G01C19/5776 , G01C25/00 , G06T7/80 , H04N17/00
Abstract: Systems and techniques for persistent calibration of an electronic device configured to implement an extended reality (XR) system involve estimating and validating visual-inertial odometry (VIO) calibration parameters during an active XR session of the electronic device. Validating the estimated VIO calibration parameters involves performing a strict calibration qualification of the estimated VIO calibration parameters using a thresholding module, machine learning module, or both. An initial calibration qualification is performed concurrently with the strict calibration qualification based on VIO performance. If the estimated VIO calibration parameters pass the strict calibration qualification and initial calibration qualification, they are stored for use to calibrate the device in future XR sessions. Persistent calibration of time alignment between the inertial management unit and the image sensor of the electronic device is also performed during active XR sessions upon detection of time alignment issues.
-
公开(公告)号:US11694409B1
公开(公告)日:2023-07-04
申请号:US17643233
申请日:2021-12-08
Applicant: GOOGLE LLC
Inventor: Sazzadur Rahman , Konstantine Nicholas John Tsotsos , João Manuel de Castro Afonso , José Carlos Maranhão Pascoal , Ivo Duarte , Nuno Cruces
CPC classification number: G06T19/006 , G06T15/04
Abstract: A split-architecture for rendering and warping world-locked AR elements, such as graphics in a navigation application, for display on augmented reality (AR) glasses is disclosed. The split-architecture can help to alleviate a resource burden on the AR glasses by performing the more complex processes associated with the rendering and warping on a computing device, while performing the less complex processes associated with the rendering and warping on the AR glasses. The AR glasses and the computing device are coupled via wireless communication, and the disclosed systems and methods address the large and variable latencies associated with the wireless communication that could otherwise make splitting these processes impractical.
-
公开(公告)号:US11681358B1
公开(公告)日:2023-06-20
申请号:US17643711
申请日:2021-12-10
Applicant: GOOGLE LLC
Inventor: Sazzadur Rahman , Konstantine Nicholas John Tsotsos , João Manuel de Castro Afonso , José Carlos Maranhão Pascoal , Ivo Duarte , Nuno Cruces
CPC classification number: G06F3/012 , G02B27/0093 , G02B27/017 , G02B27/0179 , G06T19/006 , G02B2027/0178 , G02B2027/0187
Abstract: A method includes projecting an augmented reality (AR) user interface (UI) at a first position on a surface of a head-mounted display (HMD) device through which a view of a real-world scene is seen by a viewer, and detecting a motion of the HMD device corresponding to a head motion of the viewer. The method further includes, in response to the motion of the HMD device, moving the projected AR UI across the surface of the HMD device to a second position, the movement of the projected AR UI spatially and or temporally lagging the head motion.
-
公开(公告)号:US20230185365A1
公开(公告)日:2023-06-15
申请号:US17643711
申请日:2021-12-10
Applicant: GOOGLE LLC
Inventor: Sazzadur Rahman , Konstantine Nicholas John Tsotsos , João Manuel de Castro Afonso , José Carlos Maranhão Pascoal , Ivo Duarte , Nuno Cruces
CPC classification number: G06F3/012 , G02B27/0093 , G02B27/0179 , G02B27/017 , G06T19/006 , G02B2027/0178 , G02B2027/0187
Abstract: A method includes projecting an augmented reality (AR) user interface (UI) at a first position on a surface of a head-mounted display (HMD) device through which a view of a real-world scene is seen by a viewer, and detecting a motion of the HMD device corresponding to a head motion of the viewer. The method further includes, in response to the motion of the HMD device, moving the projected AR UI across the surface of the HMD device to a second position, the movement of the projected AR UI spatially and or temporally lagging the head motion.
-
公开(公告)号:US20220075447A1
公开(公告)日:2022-03-10
申请号:US17468923
申请日:2021-09-08
Applicant: GOOGLE LLC
Inventor: Chao X. Guo , Fei Han , Sazzadur Rahman , Luca Ballan , Junyang Lu
IPC: G06F3/01 , G06T7/80 , G01C19/5776 , H04N17/00 , G01C25/00
Abstract: Systems and techniques for persistent calibration of an electronic device configured to implement an extended reality (XR) system involve estimating and validating visual-inertial odometry (VIO) calibration parameters during an active XR session of the electronic device. Validating the estimated VIO calibration parameters involves performing a strict calibration qualification of the estimated VIO calibration parameters using a thresholding module, machine learning module, or both. An initial calibration qualification is performed concurrently with the strict calibration qualification based on VIO performance. If the estimated VIO calibration parameters pass the strict calibration qualification and initial calibration qualification, they are stored for use to calibrate the device in future XR sessions. Persistent calibration of time alignment between the inertial management unit and the image sensor of the electronic device is also performed during active XR sessions upon detection of time alignment issues.
-
-
-
-
-