-
公开(公告)号：US12175162B2
公开(公告)日：2024-12-24
申请号：US16984406
申请日：2020-08-04
Applicant: Apple Inc.
Inventor： Angela Blechschmidt , Daniel Ulbricht , Omar Elafifi
Abstract: Implementations disclosed herein provide systems and methods that determine relationships between objects based on an original semantic mesh of vertices and faces that represent the 3D geometry of a physical environment. Such an original semantic mesh may be generated and used to provide input to a machine learning model that estimates relationships between the objects in the physical environment. For example, the machine learning model may output a graph of nodes and edges indicating that a vase is on top of a table or that a particular instance of a vase, V1, is on top of a particular instance of a table, T1.
-
公开(公告)号：US20230394773A1
公开(公告)日：2023-12-07
申请号：US18330652
申请日：2023-06-07
Applicant: Apple Inc.
Inventor： Angela Blechschmidt , Gefen Kohavi , Daniel Ulbricht
CPC classification number: G06T19/006 , G06T2200/24 , G06T15/10
Abstract: Generating a virtual representation of an interaction includes determining a potential user interaction with a physical object in a physical environment, determining an object type associated with the physical object, and obtaining an object-centric affordance region for the object type, wherein the object-centric affordance region indicates, for each of one or more regions of the object type, a likelihood of user contact. The object-centric affordance region is mapped to a geometry of the physical object to obtain an instance-specific affordance region, is used to render the virtual representation of the interaction with the physical object.
-
公开(公告)号：US10824864B2
公开(公告)日：2020-11-03
申请号：US16360732
申请日：2019-03-21
Applicant: Apple Inc.
Inventor： Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
公开(公告)号：US20240212201A1
公开(公告)日：2024-06-27
申请号：US18384986
申请日：2023-10-30
Applicant: Apple Inc.
Inventor： Eshan Verma , Angela Blechschmidt , Gefen Kohavi , Zhihao Zhu
CPC classification number: G06T7/73 , G06F3/013 , G06T19/006 , G06T2207/30196 , G06T2219/004
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a user location within a physical environment. For example, an example process may include obtaining an object relationship model representing positional relationships between objects of a set of objects within a physical environment. The process may further include obtaining sensor data of the physical environment. The process may further include detecting an interaction of a user with an object of the set of objects within the physical environment based on the sensor data. The process may further include determining a location of the user within the physical environment based on a location associated with the object in the physical environment.
-
公开(公告)号：US11783558B1
公开(公告)日：2023-10-10
申请号：US17678544
申请日：2022-02-23
Applicant: Apple Inc.
Inventor： Angela Blechschmidt , Daniel Ulbricht , Alexander S. Polichroniadis
CPC classification number: G06T19/20 , G06T7/70 , G06T17/00 , G06V20/70 , G06T2207/10028 , G06T2210/61 , G06T2219/2004
Abstract: Various implementations disclosed herein include devices, systems, and methods that uses object relationships represented in the scene graph to adjust the position of objects. For example, an example process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on sensor data obtained during a scanning process, detecting positions of a set of objects in the physical environment based on the 3D representation, generating a scene graph for the 3D representation of the physical environment based on the detected positions of the set of objects, wherein the scene graph represents the set of objects and relationships between the objects, and determining a refined 3D representation of the physical environment by refining the position of at least one object in the set of objects based on the scene graph and an alignment rule associated with a relationship in the scene graph.
-
Patent Agency Ranking
公开(公告)号：US11710283B2
公开(公告)日：2023-07-25
申请号：US17508010
申请日：2021-10-22
Applicant: Apple Inc.
Inventor： Eshan Verma , Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Chen-Yu Lee , Tanmay Batra
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Various implementations disclosed herein include devices, systems, and methods that enable faster and more efficient real-time physical object recognition, information retrieval, and updating of a CGR environment. In some implementations, the CGR environment is provided at a first device based on a classification of the physical object, image or video data including the physical object is transmitted by the first device to a second device, and the CGR environment is updated by the first device based on a response associated with the physical object received from the second device.
-
公开(公告)号：US11295529B2
公开(公告)日：2022-04-05
申请号：US17149949
申请日：2021-01-15
Applicant: Apple Inc.
Inventor： Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
IPC: G06T19/00 , G06F3/01 , A63F13/825 , G02B27/01 , A63F13/212 , G06F3/03
Abstract: In one implementation, a method of including a person in a CGR experience or excluding the person from the CGR experience is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes, while presenting a CGR experience, capturing an image of scene; detecting, in the image of the scene, a person; and determining an identity of the person. The method includes determining, based on the identity of the person, whether to include the person in the CGR experience or exclude the person from the CGR experience. The method includes presenting the CGR experience based on the determination.
-
公开(公告)号：US11132546B2
公开(公告)日：2021-09-28
申请号：US17032213
申请日：2020-09-25
Applicant: Apple Inc.
Inventor： Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
公开(公告)号：US11100720B2
公开(公告)日：2021-08-24
申请号：US17031676
申请日：2020-09-24
Applicant: Apple Inc.
Inventor： Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
Abstract: In one implementation, a method of generating a depth map is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes generating, based on a first image and a second image, a first depth map of the second image. The method includes generating, based on the first depth map of the second image and pixel values of the second image, a second depth map of the second image.
-
公开(公告)号：US20250068781A1
公开(公告)日：2025-02-27
申请号：US18945802
申请日：2024-11-13
Applicant: APPLE INC.
Inventor： Angela Blechschmidt , Daniel Ulbricht , Omar Elafifi
Abstract: Implementations disclosed herein provide systems and methods that determine relationships between objects based on an original semantic mesh of vertices and faces that represent the 3D geometry of a physical environment. Such an original semantic mesh may be generated and used to provide input to a machine learning model that estimates relationships between the objects in the physical environment. For example, the machine learning model may output a graph of nodes and edges indicating that a vase is on top of a table or that a particular instance of a vase, V1, is on top of a particular instance of a table, T1.
-
-
-
-
-
-
-
-
-
Search Results
36
records
(took 0.017 seconds)
