Temporal and geometric consistency in physical setting understanding

    公开(公告)号:US11610414B1

    公开(公告)日:2023-03-21

    申请号:US16795732

    申请日:2020-02-20

    Applicant: Apple Inc.

    Abstract: A machine learning model is trained and used to perform a computer vision task such as semantic segmentation or normal direction prediction. The model uses a current image of a physical setting and input generated from three dimensional (3D) anchor points that store information determined from prior assessments of the physical setting. The 3D anchor points store previously-determined computer vision task information for the physical setting for particular 3D points locations in a 3D worlds space, e.g., an x, y, z coordinate system that is independent of image capture device pose. For example, 3D anchor points may store previously-determined semantic labels or normal directions for 3D points identified by simultaneous localization and mapping (SLAM) processes. The 3D anchor points are stored and used to generate input for the machine model as the model continues to reason about future images of the physical setting.

    METHOD AND DEVICE FOR PRESENTING SYNTHESIZED REALITY COMPANION CONTENT

    公开(公告)号:US20220222869A1

    公开(公告)日:2022-07-14

    申请号:US17707774

    申请日:2022-03-29

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes: obtaining a user input to view SR content associated with video content; if the video content includes a first scene when the user input was detected: obtaining first SR content for a first time period of the video content associated with the first scene; obtaining a task associated with the first scene; and causing presentation of the first SR content and a first indication of the task associated with the first scene; and if the video content includes a second scene when the user input was detected: obtaining second SR content for a second time period of the video content associated with the second scene; obtaining a task associated with the second scene; and causing presentation of the second SR content and a second indication of the task associated with the second scene.

    Method and device for presenting synthesized reality companion content

    公开(公告)号:US11328456B2

    公开(公告)日:2022-05-10

    申请号:US16963308

    申请日:2019-01-18

    Applicant: Apple Inc.

    Abstract: In one implementation, a method includes: while causing presentation of video content having a current plot setting, receiving a user input indicating a request to explore the current plot setting; obtaining synthesized reality (SR) content associated with the current plot setting in response to receiving the user input; causing presentation of the SR content associated with the current plot setting; receiving one or more user interactions with the SR content; and adjusting the presentation of the SR content in response to receiving the one or more user interactions with the SR content.

    Plane Detection Using Semantic Segmentation

    公开(公告)号:US20210406541A1

    公开(公告)日:2021-12-30

    申请号:US17473469

    申请日:2021-09-13

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of generating a plane hypothesis is performed by a device including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method includes obtaining a plurality of points of a point cloud based on the image of the scene. The method includes obtaining an object classification set based on the image of the scene. Each element of the object classification set includes a plurality of pixels respectively associated with a corresponding object in the scene. The method includes detecting a plane within the scene by identifying a subset of the plurality of points of the point cloud that correspond to a particular element of the object classification set.

    PLANE DETECTION USING SEMANTIC SEGMENTATION

    公开(公告)号:US20210012112A1

    公开(公告)日:2021-01-14

    申请号:US17032213

    申请日:2020-09-25

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.

    PLANE DETECTION USING SEMANTIC SEGMENTATION
    50.
    发明申请

    公开(公告)号:US20190392213A1

    公开(公告)日:2019-12-26

    申请号:US16360732

    申请日:2019-03-21

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.

Patent Agency Ranking