-
公开(公告)号:US10824864B2
公开(公告)日:2020-11-03
申请号:US16360732
申请日:2019-03-21
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
公开(公告)号:US11972607B2
公开(公告)日:2024-04-30
申请号:US18111541
申请日:2023-02-18
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar Kc
IPC: G06V20/10 , G06F18/24 , G06T7/70 , G06T19/00 , G06V30/262
CPC classification number: G06V20/10 , G06F18/24 , G06T7/70 , G06T19/006 , G06V30/274 , G06T2200/24 , G06T2207/10028 , G06T2207/20084
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method includes obtaining a plurality of points of a point cloud based on the image of the scene. The method includes obtaining an object classification set based on the image of the scene. Each element of the object classification set includes a plurality of pixels respectively associated with a corresponding object in the scene. The method includes detecting a plane within the scene by identifying a subset of the plurality of points of the point cloud that correspond to a particular element of the object classification set.
-
公开(公告)号:US11783552B2
公开(公告)日:2023-10-10
申请号:US17557805
申请日:2021-12-21
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
IPC: G06T19/00 , G06F3/01 , A63F13/825 , G02B27/01 , A63F13/212 , G06F3/03
CPC classification number: G06T19/006 , A63F13/212 , A63F13/825 , G02B27/017 , G06F3/011 , G06F3/0304 , G06T19/003
Abstract: In one implementation, a method of including a person in a CGR experience or excluding the person from the CGR experience is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes, while presenting a CGR experience, capturing an image of scene; detecting, in the image of the scene, a person; and determining an identity of the person. The method includes determining, based on the identity of the person, whether to include the person in the CGR experience or exclude the person from the CGR experience. The method includes presenting the CGR experience based on the determination.
-
公开(公告)号:US11610397B2
公开(公告)日:2023-03-21
申请号:US17473469
申请日:2021-09-13
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
IPC: G06V20/10 , G06T7/70 , G06V30/262 , G06K9/62 , G06T19/00
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method includes obtaining a plurality of points of a point cloud based on the image of the scene. The method includes obtaining an object classification set based on the image of the scene. Each element of the object classification set includes a plurality of pixels respectively associated with a corresponding object in the scene. The method includes detecting a plane within the scene by identifying a subset of the plurality of points of the point cloud that correspond to a particular element of the object classification set.
-
公开(公告)号:US10896548B1
公开(公告)日:2021-01-19
申请号:US16580176
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
IPC: G06T19/00 , G06F3/01 , A63F13/825 , G02B27/01 , A63F13/212 , G06F3/03
Abstract: In one implementation, a method of including a person in a CGR experience or excluding the person from the CGR experience is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes, while presenting a CGR experience, capturing an image of scene; detecting, in the image of the scene, a person; and determining an identity of the person. The method includes determining, based on the identity of the person, whether to include the person in the CGR experience or exclude the person from the CGR experience. The method includes presenting the CGR experience based on the determination.
-
公开(公告)号:US12033058B1
公开(公告)日:2024-07-09
申请号:US16421606
申请日:2019-05-24
Applicant: Apple Inc.
Inventor: Peter Meier , Tanmay Batra
IPC: G06N3/045 , G06F18/2115 , G06F18/214 , G06N3/082
CPC classification number: G06N3/045 , G06F18/2115 , G06F18/2148 , G06N3/082
Abstract: In some implementations initially training a first neural network includes inputting the training inputs and corresponding training labels into the first neural network to produce output labels, comparing the output labels to the corresponding training labels using a second neural network that learns and applies a comparison metric, and adjusting parameters of the first neural network based on the comparing. The device then inputs additional inputs into the first neural network to produce additional output labels and corresponding confidence values from the second neural network. The device selects, based on the confidence values, an automatically-labeled training set of data including a subset of the additional inputs and a corresponding subset of the additional output labels. During a second training stage, the device trains the first neural network and the second neural network using the automatically-labeled training set of data.
-
公开(公告)号:US11954881B2
公开(公告)日:2024-04-09
申请号:US16513991
申请日:2019-07-17
Applicant: Apple Inc.
Inventor: Peter Meier , Tanmay Batra
IPC: G06K9/62 , G06F18/2115 , G06F18/214 , G06F18/23213 , G06F18/25 , G06N3/045 , G06N3/084 , G06T7/20 , G06T7/70 , G06T7/73 , G06V10/70 , G06V10/774 , G06V10/82 , G06V40/10 , G06V40/16 , G06V40/20 , G10L15/16
CPC classification number: G06T7/73 , G06F18/2115 , G06F18/214 , G06F18/23213 , G06F18/251 , G06N3/045 , G06N3/084 , G06T7/20 , G06T7/70 , G06V10/70 , G06V10/774 , G06V10/7753 , G06V10/82 , G06V40/10 , G06V40/11 , G06V40/171 , G06V40/20 , G10L15/16 , G06T2207/20081 , G06T2207/20084
Abstract: In some implementations a neural network is trained to perform a main task using a clustering constraint, for example, using both a main task training loss and a clustering training loss. Training inputs are inputted into a main task neural network to produce output labels predicting locations of the parts of the objects in the training inputs. Data from pooled layers of the main task neural network is inputted into a clustering neural network. The main task neural network and the clustering neural network are trained based on a main task loss from the main task neural network and a clustering loss from the clustering neural network. The main task loss is determined by comparing differences between the output labels and the training labels. The clustering loss encourages the clustering network to learn to label the parts of the objects individually, e.g., to learn groups corresponding to the object parts.
-
公开(公告)号:US11710283B2
公开(公告)日:2023-07-25
申请号:US17508010
申请日:2021-10-22
Applicant: Apple Inc.
Inventor: Eshan Verma , Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Chen-Yu Lee , Tanmay Batra
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Various implementations disclosed herein include devices, systems, and methods that enable faster and more efficient real-time physical object recognition, information retrieval, and updating of a CGR environment. In some implementations, the CGR environment is provided at a first device based on a classification of the physical object, image or video data including the physical object is transmitted by the first device to a second device, and the CGR environment is updated by the first device based on a response associated with the physical object received from the second device.
-
公开(公告)号:US11295529B2
公开(公告)日:2022-04-05
申请号:US17149949
申请日:2021-01-15
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
IPC: G06T19/00 , G06F3/01 , A63F13/825 , G02B27/01 , A63F13/212 , G06F3/03
Abstract: In one implementation, a method of including a person in a CGR experience or excluding the person from the CGR experience is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes, while presenting a CGR experience, capturing an image of scene; detecting, in the image of the scene, a person; and determining an identity of the person. The method includes determining, based on the identity of the person, whether to include the person in the CGR experience or exclude the person from the CGR experience. The method includes presenting the CGR experience based on the determination.
-
公开(公告)号:US11132546B2
公开(公告)日:2021-09-28
申请号:US17032213
申请日:2020-09-25
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
-
-
-
-
-
-
-
-