Object correction using scene graphs

    公开(公告)号:US11783558B1

    公开(公告)日:2023-10-10

    申请号:US17678544

    申请日:2022-02-23

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that uses object relationships represented in the scene graph to adjust the position of objects. For example, an example process may include obtaining a three-dimensional (3D) representation of a physical environment that was generated based on sensor data obtained during a scanning process, detecting positions of a set of objects in the physical environment based on the 3D representation, generating a scene graph for the 3D representation of the physical environment based on the detected positions of the set of objects, wherein the scene graph represents the set of objects and relationships between the objects, and determining a refined 3D representation of the physical environment by refining the position of at least one object in the set of objects based on the scene graph and an alignment rule associated with a relationship in the scene graph.

    Content event mapping
    15.
    发明授权

    公开(公告)号:US11343589B2

    公开(公告)日:2022-05-24

    申请号:US17275038

    申请日:2019-09-24

    Applicant: Apple Inc.

    Abstract: In one implementation, consumption of media content (such as video, audio, or text) is supplemented with an immersive synthesized reality (SR) map based on the media content. In various implementations described herein, the SR map includes a plurality of SR environment representations which, when selected by a user, cause display of a corresponding SR environment.

    Plane detection using semantic segmentation

    公开(公告)号:US11132546B2

    公开(公告)日:2021-09-28

    申请号:US17032213

    申请日:2020-09-25

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of generating a plane hypothesis is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, and a scene camera. The method includes obtaining an image of a scene including a plurality of pixels. The method include obtaining a point cloud based on the image of the scene and generating an object classification set based on the image of the scene, each element of the object classification set including a respective plurality of pixels classified as a respective object in the scene. The method includes generating a plane hypothesis based on the point cloud and the object classification set.

    Method of determining a similarity transformation between first and second coordinates of 3D features

    公开(公告)号:US10762386B2

    公开(公告)日:2020-09-01

    申请号:US16530694

    申请日:2019-08-02

    Applicant: Apple Inc.

    Abstract: The invention is related to a method of determining a similarity transformation between first coordinates and second coordinates of 3D features, comprising providing a first plurality of 3D features having first coordinates in a first coordinate system which is associated with a first geometrical model of a first real object, wherein the first plurality of 3D features describes physical 3D features of the first real object, providing a second coordinate system, providing image information associated with a plurality of images captured by at least one camera, for each respective 3D feature of at least part of the first plurality of 3D features, wherein the respective 3D feature is captured by at least two of the plurality of images, determining camera poses of the at least one camera in the second coordinate system while the at least two of the plurality of images are captured, determining for the respective 3D feature a second coordinate in the second coordinate system according to the at least two of the plurality of images and the camera poses, and the method further comprising determining a similarity transformation between the first coordinates and the second coordinates of the at least part of the first plurality of 3D features, wherein the similarity transformation includes at least one translation, at least one rotation, at least one scale and/or their combinations in 3D space.

    ENVIRONMENT-BASED APPLICATION PRESENTATION
    20.
    发明申请

    公开(公告)号:US20200226383A1

    公开(公告)日:2020-07-16

    申请号:US16833364

    申请日:2020-03-27

    Applicant: Apple Inc.

    Abstract: In an exemplary process for providing content in an augmented reality environment, image data correspond to a physical environment are obtained. Based on the image data, predefined entities of the plurality of predefined entities in the physical environment are identified using classifiers corresponding to predefined entities. Based on the one or more of the identified predefined entities, a geometric layout of the physical environment is determined. Based on the geometric layout, an area corresponding to a particular entity is determined. The particular entity corresponds to one or more identified predefined entities. Based on the area corresponding to the particular entity, the particular entity in the physical environment is identified using classifiers corresponding to the determined area. Based on the identified particular entity, a type of the physical environment is determined. Based on the type of the physical environment, virtual-reality objects are displayed corresponding to a representation of the physical environment.

Patent Agency Ranking