-
公开(公告)号:US11610414B1
公开(公告)日:2023-03-21
申请号:US16795732
申请日:2020-02-20
Applicant: Apple Inc.
Inventor: Mohammad Haris Baig , Angela Blechschmidt , Daniel Ulbricht
IPC: G06K9/00 , G06V20/64 , G06V10/28 , G06V20/10 , G06F18/214
Abstract: A machine learning model is trained and used to perform a computer vision task such as semantic segmentation or normal direction prediction. The model uses a current image of a physical setting and input generated from three dimensional (3D) anchor points that store information determined from prior assessments of the physical setting. The 3D anchor points store previously-determined computer vision task information for the physical setting for particular 3D points locations in a 3D worlds space, e.g., an x, y, z coordinate system that is independent of image capture device pose. For example, 3D anchor points may store previously-determined semantic labels or normal directions for 3D points identified by simultaneous localization and mapping (SLAM) processes. The 3D anchor points are stored and used to generate input for the machine model as the model continues to reason about future images of the physical setting.
-
公开(公告)号:US20220222869A1
公开(公告)日:2022-07-14
申请号:US17707774
申请日:2022-03-29
Applicant: Apple Inc.
Inventor: Ian M. Richter , Daniel Ulbricht , Jean-Daniel E. Nahmias , Omar Elafifi , Peter Meier
IPC: G06T11/00
Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.
-
公开(公告)号:US11328456B2
公开(公告)日:2022-05-10
申请号:US16963308
申请日:2019-01-18
Applicant: Apple Inc.
Inventor: Ian M. Richter , Daniel Ulbricht , Jean-Daniel E. Nahmias , Omar Elafifi , Peter Meier
IPC: G06T11/00 , G06F3/04883
Abstract: In one implementation, a method includes: while causing presentation of video content having a current plot setting, receiving a user input indicating a request to explore the current plot setting; obtaining synthesized reality (SR) content associated with the current plot setting in response to receiving the user input; causing presentation of the SR content associated with the current plot setting; receiving one or more user interactions with the SR content; and adjusting the presentation of the SR content in response to receiving the one or more user interactions with the SR content.
-
公开(公告)号:US20210406541A1
公开(公告)日:2021-12-30
申请号:US17473469
申请日:2021-09-13
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method includes obtaining a plurality of points of a point cloud based on the image of the scene. The method includes obtaining an object classification set based on the image of the scene. Each element of the object classification set includes a plurality of pixels respectively associated with a corresponding object in the scene. The method includes detecting a plane within the scene by identifying a subset of the plurality of points of the point cloud that correspond to a particular element of the object classification set.
-
公开(公告)号:US11189103B2
公开(公告)日:2021-11-30
申请号:US16924559
申请日:2020-07-09
Applicant: Apple Inc.
Inventor: Eshan Verma , Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Chen-Yu Lee , Tanmay Batra
Abstract: Various implementations disclosed herein include devices, systems, and methods that enable faster and more efficient real-time physical object recognition, information retrieval, and updating of a CGR environment. In some implementations, the CGR environment is provided at a first device based on a classification of the physical object, image or video data including the physical object is transmitted by the first device to a second device, and the CGR environment is updated by the first device based on a response associated with the physical object received from the second device.
-
公开(公告)号:US20210092555A1
公开(公告)日:2021-03-25
申请号:US16576573
申请日:2019-09-19
Applicant: Apple Inc.
Inventor: Robert William Mayor , Isaac T. Miller , Adam S. Howell , Vinay R. Majjigi , Oliver Ruepp , Daniel Ulbricht , Oleg Naroditsky , Christian Lipski , Sean P. Cier , Hyojoon Bae , Saurabh Godha , Patrick J. Coleman
Abstract: Location mapping and navigation user interfaces may be generated and presented via mobile computing devices. A mobile device may detect its location and orientation using internal systems, and may capture image data using a device camera. The mobile device also may retrieve map information from a map server corresponding to the current location of the device. Using the image data captured at the device, the current location data, and the corresponding local map information, the mobile device may determine or update a current orientation reading for the device. Location errors and updated location data also may be determined for the device, and a map user interface may be generated and displayed on the mobile device using the updated device orientation and/or location data.
-
公开(公告)号:US20210035367A1
公开(公告)日:2021-02-04
申请号:US16924559
申请日:2020-07-09
Applicant: Apple Inc.
Inventor: Eshan Verma , Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Chen-Yu Lee , Tanmay Batra
IPC: G06T19/00
Abstract: Various implementations disclosed herein include devices, systems, and methods that enable faster and more efficient real-time physical object recognition, information retrieval, and updating of a CGR environment. In some implementations, the CGR environment is provided at a first device based on a classification of the physical object, image or video data including the physical object is transmitted by the first device to a second device, and the CGR environment is updated by the first device based on a response associated with the physical object received from the second device.
-
公开(公告)号:US20210019949A1
公开(公告)日:2021-01-21
申请号:US17031676
申请日:2020-09-24
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
Abstract: In one implementation, a method of generating a depth map is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes generating, based on a first image and a second image, a first depth map of the second image. The method includes generating, based on the first depth map of the second image and pixel values of the second image, a second depth map of the second image.
-
公开(公告)号:US20210012112A1
公开(公告)日:2021-01-14
申请号:US17032213
申请日:2020-09-25
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
公开(公告)号:US20190392213A1
公开(公告)日:2019-12-26
申请号:US16360732
申请日:2019-03-21
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
-
-
-
-
-
-
-
-