公开(公告)号：US11315333B2

公开(公告)日：2022-04-26

申请号：US17080174

申请日：2020-10-26

申请人： Magic Leap, Inc.

发明人： Patrik Goorts ,  Steven Maesen ,  Daniel Stephen Speelman ,  Robert David Berkebile ,  Steven Robb Dobos

IPC分类号： G06T19/00 ,  G06T5/00 ,  H04N13/344 ,  G06T17/20

摘要： Image processing techniques for rendering holographic images are described. Image data captured from cameras can be converted into a triangle mesh. The triangle mesh may be processed by determining the location of edges, normals, and edge distances in the mesh. Mesh and edge smoothing can be performed on the mesh to reduce noise and jagged edges. Additional mesh cleanup and simplification can be performed to reduce the number of vertices and triangles and enhance the qualify of the mesh. Data from the resulting mesh can be transmitted to a receiving device where the mesh data is used to reproduce a holographic image of the image data captured by the depth sensors.

公开(公告)号：US20210125413A1

公开(公告)日：2021-04-29

申请号：US17080174

申请日：2020-10-26

申请人： Magic Leap, Inc.

发明人： Patrik Goorts ,  Steven Maesen ,  Daniel Stephen Speelman ,  Robert David Berkebile ,  Steven Robb Dobos

IPC分类号： G06T19/00 ,  G06T17/20 ,  H04N13/344 ,  G06T5/00

摘要： Image processing techniques for rendering holographic images are described. Image data captured from cameras can be converted into a triangle mesh. The triangle mesh may be processed by determining the location of edges, normals, and edge distances in the mesh. Mesh and edge smoothing can be performed on the mesh to reduce noise and jagged edges. Additional mesh cleanup and simplification can be performed to reduce the number of vertices and triangles and enhance the qualify of the mesh. Data from the resulting mesh can be transmitted to a receiving device where the mesh data is used to reproduce a holographic image of the image data captured by the depth sensors.

公开(公告)号：US11494995B2

公开(公告)日：2022-11-08

申请号：US17083808

申请日：2020-10-29

申请人： MAGIC LEAP, INC.

发明人： Robert David Berkebile

IPC分类号： G06T19/00 ,  G06T17/20

摘要： Disclosed are methods, systems, and computer program products for mixed-reality systems. These methods or systems determine a three-dimensional model for at least a portion of a physical environment in which a user is located; and present, by a spatial computing system, a mixed-reality representation to the user. In addition, these methods or systems determine a first object model for a first object in the mixed-reality representation and update, by the spatial computing system, the mixed-reality representation into an updated mixed-reality representation that reflects an interaction pertaining to the first object.

公开(公告)号：US20220230402A1

公开(公告)日：2022-07-21

申请号：US17706764

申请日：2022-03-29

申请人： Magic Leap, Inc.

发明人： Patrik Goorts ,  Steven Maesen ,  Daniel Stephen Speelman ,  Robert David Berkebile ,  Steven Robb Dobos

IPC分类号： G06T19/00 ,  G06T5/00 ,  H04N13/344 ,  G06T17/20

摘要： Image processing techniques for rendering holographic images are described. Image data captured from cameras can be converted into a triangle mesh. The triangle mesh may be processed by determining the location of edges, normals, and edge distances in the mesh. Mesh and edge smoothing can be performed on the mesh to reduce noise and jagged edges. Additional mesh cleanup and simplification can be performed to reduce the number of vertices and triangles and enhance the qualify of the mesh. Data from the resulting mesh can be transmitted to a receiving device where the mesh data is used to reproduce a holographic image of the image data captured by the depth sensors.

公开(公告)号：US12112574B2

公开(公告)日：2024-10-08

申请号：US17211502

申请日：2021-03-24

申请人： MAGIC LEAP, INC.

发明人： Robert David Berkebile

IPC分类号： G06V40/20 ,  G02B27/01 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/70 ,  G06T19/00 ,  G06V10/25 ,  G06V10/44 ,  G06V20/10 ,  G06V20/20 ,  G06V40/18

CPC分类号： G06V40/20 ,  G02B27/0172 ,  G06F3/04812 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/70 ,  G06T19/006 ,  G06V10/25 ,  G06V10/44 ,  G06V20/10 ,  G06V20/20 ,  G06V40/18

摘要： An apparatus for providing a virtual or augmented reality experience, includes: a screen, wherein the screen is at least partially transparent for allowing a user of the apparatus to view an object in an environment surrounding the user; a surface detector configured to detect a surface of the object; an object identifier configured to obtain an orientation and/or an elevation of the surface of the object, and to make an identification for the object based on the orientation and/or the elevation of the surface of the object; and a graphic generator configured to generate an identifier indicating the identification for the object for display by the screen, wherein the screen is configured to display the identifier.

公开(公告)号：US11727652B2

公开(公告)日：2023-08-15

申请号：US17706764

申请日：2022-03-29

申请人： Magic Leap, Inc.

发明人： Patrik Goorts ,  Steven Maesen ,  Daniel Stephen Speelman ,  Robert David Berkebile ,  Steven Robb Dobos

IPC分类号： G06T19/00 ,  G06T5/00 ,  H04N13/344 ,  G06T17/20

CPC分类号： G06T19/006 ,  G06T5/002 ,  G06T17/20 ,  H04N13/344

摘要： Image processing techniques for rendering holographic images are described. Image data captured from cameras can be converted into a triangle mesh. The triangle mesh may be processed by determining the location of edges, normals, and edge distances in the mesh. Mesh and edge smoothing can be performed on the mesh to reduce noise and jagged edges. Additional mesh cleanup and simplification can be performed to reduce the number of vertices and triangles and enhance the qualify of the mesh. Data from the resulting mesh can be transmitted to a receiving device where the mesh data is used to reproduce a holographic image of the image data captured by the depth sensors.