End-to-end room layout estimation

    公开(公告)号:US11188787B1

    公开(公告)日:2021-11-30

    申请号:US16582722

    申请日:2019-09-25

    Applicant: Apple Inc.

    Abstract: Systems, methods, and computer readable media to implementing an end-to-end room layout estimation are described. A room layout estimation engine performs feature extraction on an image frame to generate a first set of coefficients for a first room layout class and a second set of coefficients for a second room layout class. Afterwards, the room layout estimation engine generates a first set of planes according to the first set of coefficients and a second set of planes according to the second set of coefficients. The room layout estimation engine generates a first prediction plane according to the first set of planes and a second prediction plane according to the second set of planes. Afterwards, the room layout estimation engine merges the first prediction plane and the second prediction plane to generate a predicted room layout for the room.

    Method and device for pixel-level object segmentation

    公开(公告)号:US11048977B1

    公开(公告)日:2021-06-29

    申请号:US16580294

    申请日:2019-09-24

    Applicant: Apple Inc.

    Abstract: In one implementation, a method of training a type-agnostic object segmentation system is performed in a type-agnostic object segmentation system including one or more processors, and a non-transitory memory. The method includes obtaining a data set; generating a respective embedding vector for each of a plurality of pixels of the image frame; mapping a plurality of embedding vector representations into a dataspace defined by a dimensionality of the plurality of embedding vector representations; comparing the at least one object instance representation candidate against the respective segmentation mask; and adjusting the type-agnostic object segmentation system in order to satisfy an error threshold across the plurality of image data frames according to a determination that the at least one object instance representation candidate and the respective segmentation mask differ by a threshold value.

Patent Agency Ranking