-
公开(公告)号：US11328475B2
公开(公告)日：2022-05-10
申请号：US17072825
申请日：2020-10-16
Applicant: Magic Leap, Inc.
Inventor： Yu-Hsiang Huang , Evan Gregory Levine , Igor Napolskikh , Dominik Michael Kasper , Manel Quim Sanchez Nicuesa , Sergiu Sima , Benjamin Langmann , Ashwin Swaminathan , Martin Georg Zahnert , Blazej Marek Czuprynski , Joao Antonio Pereira Faro , Christoph Tobler , Omid Ghasemalizadeh
Abstract: Examples of the disclosure describe systems and methods for presenting virtual content on a wearable head device. In some embodiments, a state of a wearable head device is determined by minimizing a total error based on a reduced weight associated with a reprojection error. A view reflecting the determined state of the wearable head device is presented via a display of the wearable head device. In some embodiments, a wearable head device calculates a first preintegration term and second preintegration term based on the image data received via a sensor of the wearable head device and the inertial data received via a first IMU and a second IMU of the wearable head device. The wearable head device estimates a position of the device based on the first and second preintegration terms, and the wearable head device presents the virtual content based on the position of the device.
-
公开(公告)号：US20220132056A1
公开(公告)日：2022-04-28
申请号：US17428948
申请日：2020-02-07
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Alexander Ilic , Miguel Andres Granados Velasquez , Javier Victorio Gomez Gonzalez
Abstract: A wearable display system including multiple cameras and a processor is disclosed. A greyscale camera and a color camera can be arranged to provide a central view field associated with both cameras and a peripheral view field associated with one of the two cameras. One or more of the two cameras may be a plenoptic camera. The wearable display system may acquire light field information using the at least one plenoptic camera and create a world model using the first light field information and first depth information stereoscopically determined from images acquired by the greyscale camera and the color camera. The wearable display system can track head pose using the at least one plenoptic camera and the world model. The wearable display system can track objects in the central view field and the peripheral view fields using the one or two plenoptic cameras, when the objects satisfy a depth criterion.
-
公开(公告)号：US20210409626A1
公开(公告)日：2021-12-30
申请号：US17293014
申请日：2019-10-30
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Alexander llic , Erik Fonseka
Abstract: An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The augmented reality system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object and selectively output imaging information for that region. The region may be updated dynamically as the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an augmented reality scene can be developed. The amount of data may be further reduced by configuring the image sensor to output indications of pixels for which the measured intensity of incident light changes.
-
公开(公告)号：US20240333866A1
公开(公告)日：2024-10-03
申请号：US18735634
申请日：2024-06-06
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Alexander Ilic , Erik Fonseka
Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system. The AR system may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may have pixels configured to output events indicating changes in sensed IR light. Those pixels may be sensitive to IR light of the same frequency source as an active IR light source, and may be part of an eye tracking camera, oriented toward a user's eye. Changes in IR light may be used to determine the location of the user's pupil, which may be used in rendering virtual objects. The events may be generated and processed at a high rate, enabling the system to render the virtual object based on the user's gaze so that the virtual object will appear more realistic to the user.
-
公开(公告)号：US20240288934A1
公开(公告)日：2024-08-29
申请号：US18655518
申请日：2024-05-06
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Alexander Ilic
CPC classification number: G06F3/012 , G02B27/0093 , G02B27/0101 , G02B27/017 , G02B27/0179 , G02B27/281 , G06T7/292 , G06T19/006 , G02B2027/0138 , G02B2027/0187 , G06T2207/10012 , G06T2207/10028 , G06T2207/30201
Abstract: A wearable display system for a cross reality (XR) system may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR function being performed. For tracking an object, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. The object may be tracked based on asynchronously acquired events indicating changes within the patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. The tracked object may be a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and of the wearer's head.
-
Patent Agency Ranking
公开(公告)号：US20240143068A1
公开(公告)日：2024-05-02
申请号：US18477529
申请日：2023-09-28
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Alexander IIic
IPC: G06F3/01 , G06T7/593 , G06V10/20 , H04N25/531 , H04N25/705 , H04N25/75
CPC classification number: G06F3/011 , G06T7/593 , G06V10/20 , H04N25/531 , H04N25/705 , H04N25/75 , H04N13/106
Abstract: A high-resolution image sensor suitable for use in an augmented reality (AR) system to provide low latency image analysis with low power consumption. The AR system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object, selectively output imaging information for that region, and synchronously output high-resolution image frames. The region may be updated dynamically as the image sensor and/or the object moves. The image sensor may output the high-resolution image frames less frequently than the region being updated when the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an AR scene can be developed.
-
公开(公告)号：US20240137664A1
公开(公告)日：2024-04-25
申请号：US18403673
申请日：2024-01-03
Applicant: Magic Leap, Inc.
Inventor： Martin Georg Zahnert , Alexander Ilic , Erik Fonseka
IPC: H04N25/50 , G06T11/00 , H04N25/702
CPC classification number: H04N25/50 , G06T11/00 , H04N25/702
Abstract: An image sensor suitable for use in an augmented reality system to provide low latency image analysis with low power consumption. The augmented reality system can be compact, and may be small enough to be packaged within a wearable device such as a set of goggles or mounted on a frame resembling ordinary eyeglasses. The image sensor may receive information about a region of an imaging array associated with a movable object and selectively output imaging information for that region. The region may be updated dynamically as the image sensor and/or the object moves. Such an image sensor provides a small amount of data from which object information used in rendering an augmented reality scene can be developed. The amount of data may be further reduced by configuring the image sensor to output indications of pixels for which the measured intensity of incident light changes.
-
公开(公告)号：US11885871B2
公开(公告)日：2024-01-30
申请号：US17058586
申请日：2019-05-24
Applicant: Magic Leap, Inc.
Inventor： Alexander Ilic , Martin Georg Zahnert , Koon Keong Shee
IPC: G01S13/58 , G01S13/536 , G02B27/01 , G06V20/64 , G06F18/25
CPC classification number: G01S13/536 , G01S13/582 , G01S13/587 , G01S13/588 , G02B27/0172 , G06F18/25 , G06V20/653
Abstract: An augmented reality device has a radar system that generates radar maps of locations of real world objects. An inertial measurement unit detects measurement values such as acceleration, gravitational force and inclination ranges. The values from the measurement unit drift over time. The radar maps are processed to determine fingerprints and the fingerprints are combined with the values from the measurement unit to store a pose estimate. Pose estimates at different times are compared to determine drift of the measurement unit. A measurement unit filter is adjusted to correct for the drift.
-
公开(公告)号：US20220244532A1
公开(公告)日：2022-08-04
申请号：US17725410
申请日：2022-04-20
Applicant: Magic Leap, Inc.
Inventor： Alexander Ilic , Martin Georg Zahnert
Abstract: Systems and methods for synthesizing an image of the face by a head-mounted display (HMD), such as an augmented reality device, are disclosed. The HMD may be able to observe only a portion of the face with an inward-facing imaging system, e.g., the periocular region. The systems and methods described herein can generate a mapping of a conformation of the portion of the face that is not imaged based at least partly on a conformation of the portion of the face that is imaged. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.
-
公开(公告)号：US11347051B2
公开(公告)日：2022-05-31
申请号：US16943588
申请日：2020-07-30
Applicant: Magic Leap, Inc.
Inventor： Alexander Ilic , Martin Georg Zahnert
Abstract: Systems and methods for synthesizing an image of the face by a head-mounted display (HMD), such as an augmented reality device, are disclosed. The HMD may be able to observe only a portion of the face with an inward-facing imaging system, e.g., the periocular region. The systems and methods described herein can generate a mapping of a conformation of the portion of the face that is not imaged based at least partly on a conformation of the portion of the face that is imaged. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.
-
-
-
-
-
-
-
-
-
Search Results
37
records
(took 0.027 seconds)
