公开(公告)号：US11340460B2

公开(公告)日：2022-05-24

申请号：US16949027

申请日：2020-10-09

Applicant: Google LLC

Inventor： Ian Muldoon ,  Clayton Kimber ,  Jeremy Swerdlow ,  Srivatsan Ravindran

IPC: G02B27/01 ,  G06F3/0346 ,  G06T19/00

Abstract: A system for tracking a position and an orientation of an external device such as a smart watch or a handheld controller relative to a head mounted display (HMD) device is provided. A combination of active markers and passive markers on the external device may be detected by a point tracking camera of the HMD to collect position data for the external device relative to the HMD. Acceleration and/or orientation data of the external device relative to the HMD may be collected from an inertial measurement unit(s) (IMU(s)) of the external device and/or the HMD. The fusion of the position data with the data collected by the IMU(s) may allow for tracking of the external device relative to the HMD.

公开(公告)号：US20210356743A1

公开(公告)日：2021-11-18

申请号：US16949027

申请日：2020-10-09

Applicant: Google LLC

Inventor： Ian Muldoon ,  Clayton Kimber ,  Jeremy Swerdlow ,  Srivatsan Ravindran

IPC: G02B27/01 ,  G06T19/00 ,  G06F3/0346

Abstract: A system for tracking a position and an orientation of an external device such as a smart watch or a handheld controller relative to a head mounted display (HMD) device is provided. A combination of active markers and passive markers on the external device may be detected by a point tracking camera of the HMD to collect position data for the external device relative to the HMD. Acceleration and/or orientation data of the external device relative to the HMD may be collected from an inertial measurement unit(s) (IMU(s)) of the external device and/or the HMD. The fusion of the position data with the data collected by the IMU(s) may allow for tracking of the external device relative to the HMD.

公开(公告)号：US20220011580A1

公开(公告)日：2022-01-13

申请号：US17448768

申请日：2021-09-24

Applicant: Google LLC

Inventor： Ian Muldoon ,  Clayton Kimber ,  Jeremy Swerdlow ,  Srivatsan Ravindran

IPC: G02B27/01 ,  G06F3/0346 ,  G06T19/00

Abstract: A system for tracking a position and an orientation of an external device such as a smart watch or a handheld controller relative to a head mounted display (HMD) device is provided. A combination of active markers and passive markers on the external device may be detected by a point tracking camera of the HMD to collect position data for the external device relative to the HMD. Acceleration and/or orientation data of the external device relative to the HMD may be collected from an inertial measurement unit(s) (IMU(s)) of the external device and/or the HMD. The fusion of the position data with the data collected by the IMU(s) may allow for tracking of the external device relative to the HMD.

公开(公告)号：US20230418369A1

公开(公告)日：2023-12-28

申请号：US18035970

申请日：2020-12-30

Applicant: GOOGLE LLC

Inventor： Steven Benjamin Goldberg ,  Qiyue John Zhang ,  Dongeek Shin ,  Clayton Kimber

IPC: G06F3/01 ,  G01S5/02

CPC classification number: G06F3/012 ,  G01S5/02585 ,  G01S5/0294 ,  G01S5/0278

Abstract: A wearable device, such as a head-wearable display (HWD), identifies a device pose based on a combination of angle-of-arrival (AOA) data generated by, for example, an ultra-wideband (UWB) positioning module, and inertial data generated by an inertial measurement unit (IMU). The HWD fuses the AOA data with the inertial data using data integration techniques such as one or more of stochastic estimation (e.g., a Kalman filter), a machine learning model, and the like, or any combination thereof. A computer device associated with the HWD can employ the fused data to identify a pose of the HWD (e.g., a six degree of freedom (6 DoF) pose) and can use the identified pose to modify virtual reality or augmented reality content implemented by the computer device, thereby providing an immersive and enjoyable experience for a user.

公开(公告)号：US11567329B2

公开(公告)日：2023-01-31

申请号：US17448768

申请日：2021-09-24

Applicant: Google LLC

Inventor： Ian Muldoon ,  Clayton Kimber ,  Jeremy Swerdlow ,  Srivatsan Ravindran

IPC: G02B27/01 ,  G06F3/0346 ,  G06T19/00

Abstract: A system for tracking a position and an orientation of an external device such as a smart watch or a handheld controller relative to a head mounted display (HMD) device is provided. A combination of active markers and passive markers on the external device may be detected by a point tracking camera of the HMD to collect position data for the external device relative to the HMD. Acceleration and/or orientation data of the external device relative to the HMD may be collected from an inertial measurement unit(s) (IMU(s)) of the external device and/or the HMD. The fusion of the position data with the data collected by the IMU(s) may allow for tracking of the external device relative to the HMD.

公开(公告)号：US11308832B2

公开(公告)日：2022-04-19

申请号：US16767339

申请日：2019-10-02

Applicant: Google LLC

Inventor： Matthew Valente ,  Konstantin Gromov ,  Kyle Skelton ,  John Fitch ,  Clayton Kimber ,  Ozan Cakmakci ,  Adrian Wong

IPC: G09G5/10 ,  G09G3/02 ,  G02B27/01

Abstract: A head mounted display (HMD) system includes a display for emitting light toward an eye-ward side of the system and which allows both ambient light and emitted light to reach an eye of a user. The system provides augmented reality (AR) based viewing and includes a rotatable substrate supporting a set of light emitting elements (301). Each light emitting element is oriented toward a world side of the HMD system. A rotatable reflective surface is positioned on the world side of the set of the light emitting elements. The reflective surface reflects emitted light toward a user eye. A motor, coupled to the rotatable substrate and the rotatable reflective surface, rotates these elements about a common axis and a display driver selectively activates the light emitting elements during this rotation in accordance with an illumination sequence so as to provide an image.