SYSTEMS AND METHODS OF IMAGE PROCESSING BASED ON GAZE DETECTION

    公开(公告)号:US20230281885A1

    公开(公告)日:2023-09-07

    申请号:US17685278

    申请日:2022-03-02

    CPC classification number: G06T11/00 G06F3/013 G06V40/174 G06V40/18

    Abstract: Imaging systems and techniques are described. An imaging system receives image data representing at least a portion (e.g., a face) of a first user as captured by a first image sensor. The imaging system identifies that a gaze of the first user as represented in the image data is directed toward a displayed representation of at least a portion (e.g., a face) of a second user. The imaging system identifies an arrangement of representations of users for output. The imaging system generates modified image data based on the gaze and the arrangement at least in part by modifying the image data to modify at least the portion of the first user in the image data to be visually directed toward a direction corresponding to the second user based on the gaze and the arrangement. The imaging system outputs the modified image data arranged according to the arrangement.

    MULTI-MODAL REPRESENTATION BASED EVENT LOCALIZATION

    公开(公告)号:US20220101087A1

    公开(公告)日:2022-03-31

    申请号:US17405879

    申请日:2021-08-18

    Abstract: A method performed by an artificial neural network (ANN) includes determining, at a first stage of a multi-stage cross-attention model of the ANN, a first cross-correlation between a first representation of each modality of a number of modalities associated with a sequence of inputs. The method still further includes determining, at each second stage of one or more second stages of the multi-stage cross-attention model, a second cross-correlation between first attended representations of each modality. The method also includes generating a concatenated feature representation associated with a final second stage of the one or more second stages based on the second cross-correlation associated with the final second stage, the first attended representation of each modality, and the first representation of each modality. The method further includes determining a probability distribution between a set of background actions and a set of foreground actions from the concatenated feature representation. The method still further includes localizing an action in the sequence of inputs based on the probability distribution.

Patent Agency Ranking