-
公开(公告)号:US12012118B2
公开(公告)日:2024-06-18
申请号:US17081202
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
IPC: G06V40/00 , B60W30/095 , B60W60/00 , G06F18/214 , G06N20/00 , G06V10/774 , G06V10/778 , G06V20/40 , G06V20/58 , G06V40/20
CPC classification number: B60W60/001 , B60W30/0956 , G06F18/214 , G06N20/00 , G06V10/774 , G06V10/7788 , G06V20/46 , G06V20/48 , G06V20/58 , G06V40/20 , B60W2420/403
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and the sampled video frames are presented to users to provide input on a traffic entity's state of mind. The system determines an attribute value that describes a statistical distribution of user responses for the traffic entity. If the attribute for a sampled video frame is within a threshold of the attribute of another video frame, the system interpolates attribute for a third video frame between the two sampled video frames. Otherwise, the system requests further user input for a video frame captured between the two sampled video frames. The interpolated and/or user based attributes are used to train a machine learning based model that predicts a hidden context of the traffic entity. The trained model is used for navigation of autonomous vehicles.
-
公开(公告)号:US20210354730A1
公开(公告)日:2021-11-18
申请号:US17321253
申请日:2021-05-14
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Till S. Hartmann , Jacob Reinier Maat , Dylan James Rose , Kevin W. Sylvestre
Abstract: An autonomous vehicle collects sensor data of an environment surrounding the autonomous vehicle including traffic entities such as pedestrians, bicyclists, or other vehicles. The sensor data is provided to a machine learning based model along with an expected turn direction of the autonomous vehicle to determine a hidden context attribute of a traffic entity given the expected turn direction of the autonomous vehicle. The hidden context attribute of the traffic entity represents factors that affect the behavior of the traffic entity, and the hidden context attribute is used to predict future behavior of the traffic entity. Instructions to control the autonomous vehicle are generated based on the hidden context attribute.
-
公开(公告)号:US20210182605A1
公开(公告)日:2021-06-17
申请号:US17190631
申请日:2021-03-03
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US11981352B2
公开(公告)日:2024-05-14
申请号:US17190631
申请日:2021-03-03
Applicant: Perceptive Automata, Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
IPC: G06N3/04 , B60W30/00 , B60W60/00 , G05D1/00 , G06F18/214 , G06F18/40 , G06N3/08 , G06N3/084 , G06V10/778 , G06V20/40 , G06V20/58 , G06V40/20 , G08G1/04 , G08G1/16 , G06N5/01 , G06N20/10
CPC classification number: B60W60/00274 , B60W30/00 , G05D1/0088 , G06F18/214 , G06F18/41 , G06N3/04 , G06N3/08 , G06N3/084 , G06V10/7784 , G06V20/41 , G06V20/58 , G06V40/20 , G08G1/04 , G08G1/166 , G05D2201/0213 , G06N5/01 , G06N20/10
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US20230347931A1
公开(公告)日:2023-11-02
申请号:US18308626
申请日:2023-04-27
Applicant: Perceptive Automata, Inc.
Inventor: Jeffrey Donald Zaremba , Chuan Yen Ian Goh , Omar Al Assad , Till S. Hartman , Sonia Poltoraski , Samuel English Anthony
CPC classification number: B60W60/001 , G06V20/56 , B60W40/04 , B60W2420/42 , B60W2554/4041
Abstract: A system evaluates modifications to components of an autonomous vehicle (AV) stack. The system receives driving recommendations traffic scenarios based on user annotations of video frames showing each traffic scenario. For each traffic scenario, the system predicts driving recommendations based on the AV stack. The system determines a measure of quality of driving recommendation by comparing predicted driving recommendations based on the AV stack with the driving recommendations received for the traffic scenario. The measure of quality of driving recommendation is used for evaluating components of the AV stack. The system determines a driving recommendation for an AV corresponding to ranges of SOMAI (state of mind) score and sends signals to controls of the autonomous vehicle to navigate the autonomous vehicle according to the driving recommendation. The system identifies additional training data for training machine learning model based on the measure of driving quality.
-
公开(公告)号:US11467579B2
公开(公告)日:2022-10-11
申请号:US16783845
申请日:2020-02-06
Applicant: Perceptive Automata, Inc.
Inventor: Jacob Reinier Maat , Samuel English Anthony
Abstract: An autonomous vehicle uses probabilistic neural networks to predict hidden context attributes associated with traffic entities. The hidden context represents behavior of the traffic entities in the traffic. The probabilistic neural network is configured to receive an image of traffic as input and generate output representing hidden context for a traffic entity displayed in the image. The system executes the probabilistic neural network to generate output representing hidden context for traffic entities encountered while navigating through traffic. The system determines a measure of uncertainty for the output values. The autonomous vehicle uses the measure of uncertainty generated by the probabilistic neural network during navigation.
-
公开(公告)号:US20210356968A1
公开(公告)日:2021-11-18
申请号:US17321309
申请日:2021-05-14
Applicant: Perceptive Automata, Inc.
Inventor: Jeffrey D. Zaremba , Till S. Hartmann , Samuel English Anthony
Abstract: A system uses a machine learning based model to determine attributes describing states of mind and behavior of traffic entities in video frames captured by an autonomous vehicle. The system classifies video frames according to traffic scenarios depicted, where each scenario is associated with a filter based on vehicle attributes, traffic attributes, and road attributes. The system identifies a set of video frames associated with ground truth scenarios for validating the accuracy of the machine learning based model and predicts attributes of traffic entities in the video frames. The system analyzes video frames captured after the set of video frames to determine actual attributes of the traffic entities. Based on a comparison of the predicted attributes and actual attributes, the system determines a likelihood of the machine learning based model making accurate predictions and uses the likelihood to generate a navigation action table for controlling the autonomous vehicle.
-
公开(公告)号:US11126889B2
公开(公告)日:2021-09-21
申请号:US16828823
申请日:2020-03-24
Applicant: Perceptive Automata Inc.
Inventor: Samuel English Anthony , Kshitij Misra , Avery Wagner Faller
IPC: G06K9/00 , G06K9/62 , G06N3/08 , G06N3/04 , G08G1/16 , G08G1/04 , G05D1/00 , B60W30/00 , G06N5/00 , G06N20/10
Abstract: Systems and methods for predicting user interaction with vehicles. A computing device receives an image and a video segment of a road scene, the first at least one of an image and a video segment being taken from a perspective of a participant in the road scene and then generates stimulus data based on the image and the video segment. Stimulus data is transmitted to a user interface and response data is received, which includes at least one of an action and a likelihood of the action corresponding to another participant in the road scene. The computing device aggregates a subset of the plurality of response data to form statistical data and a model is created based on the statistical data. The model is applied to another image or video segment and a prediction of user behavior in the another image or video segment is generated.
-
公开(公告)号:US20210133497A1
公开(公告)日:2021-05-06
申请号:US17081211
申请日:2020-10-27
Applicant: Perceptive Automata Inc.
Inventor: Avery Wagner Faller
Abstract: A vehicle collects video data of an environment surrounding the vehicle including traffic entities, e.g., pedestrians, bicyclists, or other vehicles. The captured video data is sampled and presented to users to provide input on a traffic entity's state of mind. The user responses on the captured video data is used to generate a training dataset. A machine learning based model configured to predict a traffic entity's state of mind is trained with the training dataset. The system determines input video frames and associated dimension attributes for which the model performs poorly. The dimension attributes characterize stimuli and/or an environment shown in the input video frames. The system generates a second training dataset based on video frames that have the dimension attributes for which the model performed poorly. The model is retrained using the second training dataset and provided to an autonomous vehicle to assist with navigation in traffic.
-
10.
公开(公告)号:US11993291B2
公开(公告)日:2024-05-28
申请号:US17071115
申请日:2020-10-15
Applicant: Perceptive Automata, Inc.
Inventor: Mel McCurrie
CPC classification number: B60W60/00276 , B60W60/0027 , G06N3/045 , G06V10/255 , G06V10/82 , G06V20/58 , G06V20/584 , G06V40/103 , B60W2420/403 , B60W2554/402 , B60W2554/4041 , B60W2554/4045 , G06V10/454
Abstract: A system uses neural networks to determine intents of traffic entities (e.g., pedestrians, bicycles, vehicles) in an environment surrounding a vehicle (e.g., an autonomous vehicle) and generates commands to control the vehicle based on the determined intents. The system receives images of the environment captured by sensors on the vehicle, and processes the images using neural network models to determine overall intents or predicted actions of the one or more traffic entities within the images. The system generates commands to control the vehicle based on the determined overall intents of the traffic entities.
-
-
-
-
-
-
-
-
-