MULTI-MODAL UNDERSTANDING OF EMOTIONS IN VIDEO CONTENT

    公开(公告)号:US20240169711A1

    公开(公告)日:2024-05-23

    申请号:US18057643

    申请日:2022-11-21

    CPC classification number: G06V10/80 G06V40/168 G06V40/174

    Abstract: A method includes obtaining a video sequence having multiple video frames and audio data. The method also includes extracting video features associated with at least one face in the video frames and audio features associated with the audio data. The method further includes processing the video features and the audio features using a trained machine learning model. The trained machine learning model performs a multi-tiered fusion of the video features and different subsets of the audio features in order to identify at least one emotion expressed by at least one person in the video sequence. The multi-tiered fusion of the video features and the audio features may include (i) a first fusion of the video features and a first subset of the audio features and (ii) a second fusion of processed features and a second subset of the audio features, where the processed features are based on the first fusion.

    Facial recognition method, facial recognition system, and electronic device

    公开(公告)号:US11967176B2

    公开(公告)日:2024-04-23

    申请号:US17268127

    申请日:2019-04-03

    Inventor: Hui Wang

    CPC classification number: G06V40/168 G06F18/22 G06V40/171 G06V40/172

    Abstract: Provided are a facial recognition method, an electronic device, a computer-readable storage medium, and a facial recognition system. The facial recognition method includes: obtaining a first required comparison value and a second required comparison value based on a facial feature; if the first required comparison value is less than a preset comparison threshold and the second required comparison value is also less than the preset comparison threshold, re-extracting a facial feature, and matching the re-extracted facial feature against a plurality of original images separately to obtain a third required comparison value; and if the third required comparison value is greater than or equal to the preset comparison threshold, determining that the recognition is successful.

Patent Agency Ranking