Occlusion-aware prediction of human behavior

    公开(公告)号:US12094252B2

    公开(公告)日:2024-09-17

    申请号:US17549680

    申请日:2021-12-13

    CPC classification number: G06V40/23 G06T7/70 G06T2207/20081 G06T2207/30196

    Abstract: An occlusion analysis system improves accuracy of behavior prediction models by generating occlusion parameters that may inform mathematical models to generate more accurate predictions. The occlusion analysis system trains and applies models for generating occlusion parameters, such as a manner in which a person is occluded, occlusion percentage, occlusion type. A behavior prediction system may input the occlusion parameters as well as other parameters relating to activity of the human into a second mathematical model for behavior prediction. The second machine learning model is a higher-level model trained to output a prediction that the human will exhibit a future behavior and a confidence level associated with the prediction. The confidence level is at least partially determined based on the occlusion parameters. The behavior prediction system may output the prediction and the confidence level to a control system that generates commands associated with a vehicle and other intelligent video analytics systems.

    Occlusion-Aware Prediction of Human Behavior

    公开(公告)号:US20220189210A1

    公开(公告)日:2022-06-16

    申请号:US17549680

    申请日:2021-12-13

    Abstract: An occlusion analysis system improves accuracy of behavior prediction models by generating occlusion parameters that may inform mathematical models to generate more accurate predictions. The occlusion analysis system trains and applies models for generating occlusion parameters, such as a manner in which a person is occluded, occlusion percentage, occlusion type. A behavior prediction system may input the occlusion parameters as well as other parameters relating to activity of the human into a second mathematical model for behavior prediction. The second machine learning model is a higher-level model trained to output a prediction that the human will exhibit a future behavior and a confidence level associated with the prediction. The confidence level is at least partially determined based on the occlusion parameters. The behavior prediction system may output the prediction and the confidence level to a control system that generates commands associated with a vehicle and other intelligent video analytics systems.

    Systems and methods for predicting pedestrian intent

    公开(公告)号:US10913454B2

    公开(公告)日:2021-02-09

    申请号:US16219566

    申请日:2018-12-13

    Abstract: A system and a method are disclosed for determining intent of a human based on human pose. In some embodiments, a processor obtains a plurality of sequential images from a video feed, and determines respective keypoints corresponding a human in each respective image of the plurality of sequential images. The processor aggregates the respective keypoints for each respective image into a pose of the human and transmits a query to a database to find a template that matches the pose by comparing the pose to a plurality of templates poses that translate candidate poses to intent, each template corresponding to an associated intent. The processor receives a reply message from the database that either indicates an intent of the human based on a matching template, or an inability to locate the matching template, and, in response to the reply message indicating the intent of the human, outputs the intent.

    VISUAL DETECTION AND PREDICTION OF SENTIMENT
    10.
    发明公开

    公开(公告)号:US20240104926A1

    公开(公告)日:2024-03-28

    申请号:US17952062

    申请日:2022-09-23

    CPC classification number: G06V20/41 G06V10/764

    Abstract: A system and a method are disclosed for detecting a sentiment based in part on visual data. The system receives visual data of an environment generated by one or more sensors, accesses a sequence of AI models. Outputs of earlier models in the sequence act as inputs to one or more later models in the sequence. The sequence of AI models includes one or more frame-based models and one or more temporal-based models. The frame-based model is configured to receive the visual data as input, and extract multiple sets of frame-based features associated with the person based in part on the visual data. The temporal-based model is configured to receive the multiple sets of frame-based features as input, and determine a sentiment of the one or more persons based in part on the multiple sets of frame-based features.

Patent Agency Ranking