METHOD AND DEVICE FOR PERFORMING BEHAVIOR PREDICTION BY USING EXPLAINABLE SELF-FOCUSED ATTENTION

    公开(公告)号:US20210357763A1

    公开(公告)日:2021-11-18

    申请号:US17135396

    申请日:2020-12-28

    申请人: Stradvision, Inc.

    IPC分类号: G06N3/08 G06N3/04

    摘要: A method for predicting behavior using explainable self-focused attention is provided. The method includes steps of: a behavior prediction device, (a) inputting test images and the sensing information acquired from a moving subject into a metadata recognition module to apply learning operation to output metadata, and inputting the metadata into a feature encoding module to output features; (b) inputting the test images, the metadata, and the features into an explaining module to generate explanation information on affecting factors affecting behavior predictions, inputting the test images and the metadata into a self-focused attention module to output attention maps, and inputting the features and the attention maps into a behavior prediction module to generate the behavior predictions; and (c) allowing an outputting module to output behavior results and allowing a visualization module to visualize and output the affecting factors by referring to the explanation information and the behavior results.