-
公开(公告)号:US20210019949A1
公开(公告)日:2021-01-21
申请号:US17031676
申请日:2020-09-24
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
Abstract: In one implementation, a method of generating a depth map is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes generating, based on a first image and a second image, a first depth map of the second image. The method includes generating, based on the first depth map of the second image and pixel values of the second image, a second depth map of the second image.
-
公开(公告)号:US20210012112A1
公开(公告)日:2021-01-14
申请号:US17032213
申请日:2020-09-25
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
公开(公告)号:US20190392213A1
公开(公告)日:2019-12-26
申请号:US16360732
申请日:2019-03-21
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Angela Blechschmidt , Mohammad Haris Baig , Tanmay Batra , Eshan Verma , Amit Kumar KC
Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.
-
公开(公告)号:US12094019B1
公开(公告)日:2024-09-17
申请号:US16944812
申请日:2020-07-31
Applicant: Apple Inc.
Inventor: Jack R. Greasley , Daniel Ulbricht , Eshan Verma
CPC classification number: G06Q50/184 , G06F16/23
Abstract: Various implementations manage an electronic asset by creating a representation of an electronic asset and its variants. This may be accomplished by identifying variants of an electronic asset, identifying a portion of a feature space associated with the asset and variants, and providing a representation corresponding to that portion of feature space. A fixed function classifier may be used to determine the points in the feature space for the electronic asset and its variants. The set of points produced for an asset and its variants using such a fixed function classifier will be near one another in feature space. Moreover, the area around such points will also represent points for other similar variations of the asset and thus, the portion of the feature space around the points can be considered the area of ownership for the electronic asset, e.g., it defines a boundary of what the creator is asserting is his or her creation.
-
公开(公告)号:US20240104686A1
公开(公告)日:2024-03-28
申请号:US18469984
申请日:2023-09-19
Applicant: Apple Inc.
Inventor: Srinidhi Aravamudhan , Adrian P. Lindberg , Eshan Verma , Jaya Vijetha Gattupalli , Mingshan Wang , Ranjit Desai , Vinay Palakkode
CPC classification number: G06T1/20 , G06T3/40 , G06T7/11 , G06T2207/20081
Abstract: Techniques are disclosed herein for implementing a novel, low latency, guidance map-free video matting system, e.g., for use in extended reality (XR) platforms. The techniques may be designed to work with low resolution auxiliary inputs (e.g., binary segmentation masks) and to generate alpha mattes (e.g., alpha mattes configured to segment out any object(s) of interest, such as human hands, from a captured image) in near real-time and in a computationally efficient manner. Further, in a domain-specific setting, the system can function on a captured image stream alone, i.e., it would not require any auxiliary inputs, thereby reducing computational costs—without compromising on visual quality and user comfort. Once an alpha matte has been generated, various alpha-aware graphical processing operations may be performed on the captured images according to the generated alpha mattes (e.g., background replacement operations, synthetic shallow depth of field (SDOF) rendering operations, and/or various XR environment rendering operations).
-
26.
公开(公告)号:US11341373B1
公开(公告)日:2022-05-24
申请号:US16777310
申请日:2020-01-30
Applicant: Apple Inc.
Inventor: Amritpal Singh Saini , Adrian Peter Lindberg , Eshan Verma , Pedro Manuel Da Silva Quelhas
Abstract: In some implementations, a method includes: obtaining a logical representation of a fixed function node; generating, by concerted operation of the logical representation of the fixed function node and a machine learning node that interfaces with the logical representation of the fixed function node, a candidate result based on a set of image data frames; determining whether error criteria are satisfied based at least in part on a comparison between the candidate result and a predetermined result for the set of image data frames; and, in response to determining that the error criteria are satisfied, modifying at least one of: a first portion of operating parameters of the machine learning node associated with operations of the machine learning node; and a second portion of operating parameters of the machine learning node associated with interfacing operations between the machine learning node and the logical representation of the fixed function node.
-
公开(公告)号:US11315278B1
公开(公告)日:2022-04-26
申请号:US16580181
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
Abstract: In one implementation, a method of estimating the orientation of an object in an image is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels at a respective plurality of pixel locations and having a respective plurality of pixel values. The method includes determining a first set of pixels locations corresponding to a 2D boundary surrounding an object represented in the image and determining, based on the first set of pixel locations, a second set of pixel locations corresponding to a 3D boundary surrounding the object.
-
公开(公告)号:US20220114796A1
公开(公告)日:2022-04-14
申请号:US17557805
申请日:2021-12-21
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
IPC: G06T19/00 , G06F3/01 , A63F13/825 , G02B27/01 , A63F13/212 , G06F3/03
Abstract: In one implementation, a method of including a person in a CGR experience or excluding the person from the CGR experience is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes, while presenting a CGR experience, capturing an image of scene; detecting, in the image of the scene, a person; and determining an identity of the person. The method includes determining, based on the identity of the person, whether to include the person in the CGR experience or exclude the person from the CGR experience. The method includes presenting the CGR experience based on the determination.
-
公开(公告)号:US20220060802A1
公开(公告)日:2022-02-24
申请号:US17275038
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Ian M. Richter , Daniel Ulbricht , Eshan Verma
IPC: H04N21/81 , G06T19/00 , G06K9/00 , H04N21/44 , H04N21/845
Abstract: In one implementation, consumption of media content (such as video, audio, or text) is supplemented with an immersive synthesized reality (SR) map based on the media content. In various implementations described herein, the SR map includes a plurality of SR environment representations which, when selected by a user, cause display of a corresponding SR environment.
-
公开(公告)号:US20210134067A1
公开(公告)日:2021-05-06
申请号:US17149949
申请日:2021-01-15
Applicant: Apple Inc.
Inventor: Daniel Ulbricht , Amit Kumar K C , Angela Blechschmidt , Chen-Yu Lee , Eshan Verma , Mohammad Haris Baig , Tanmay Batra
IPC: G06T19/00 , G06F3/01 , A63F13/825 , G02B27/01 , A63F13/212 , G06F3/03
Abstract: In one implementation, a method of including a person in a CGR experience or excluding the person from the CGR experience is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes, while presenting a CGR experience, capturing an image of scene; detecting, in the image of the scene, a person; and determining an identity of the person. The method includes determining, based on the identity of the person, whether to include the person in the CGR experience or exclude the person from the CGR experience. The method includes presenting the CGR experience based on the determination.
-
-
-
-
-
-
-
-
-