公开(公告)号：US11816914B2

公开(公告)日：2023-11-14

申请号：US17011854

申请日：2020-09-03

Applicant: Humanising Autonomy Limited

Inventor： Dominic Noy ,  Matthew Cameron Angus ,  James Over Everard ,  Wassim El Youssoufi ,  Raunaq Bose ,  Leslie Cees Nooteboom ,  Maya Audrey Lara Pindeus

IPC: G06V40/00 ,  G06V40/10 ,  B60W60/00 ,  G06N3/08 ,  G06V20/58 ,  G06F18/20 ,  G06N7/01 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56

CPC classification number: G06V40/103 ,  B60W60/0027 ,  G06F18/295 ,  G06N3/08 ,  G06N7/01 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58 ,  B60W2554/4046

Abstract: A device performs operations including determining a probability that a vulnerable road user (VRU) will continue on a current path (e.g., in connection with controlling an autonomous vehicle). The device receives an image depicting a vulnerable road user (VRU). The device inputs at least a portion of the image into a model, and receives, as output from the model, a plurality of probabilities describing the VRU, each of the probabilities corresponding to a probability that the VRU is in a given state. The device determines, based on at least some of the plurality of probabilities, a probability that the VRU will exhibit a behavior, and outputs the probability that the VRU will exhibit the behavior to a control system.

公开(公告)号：US20210334982A1

公开(公告)日：2021-10-28

申请号：US16857645

申请日：2020-04-24

Applicant: Humanising Autonomy Limited

Inventor： Yazhini Chitra Pradeep ,  Wassim El Youssoufi ,  Dominic Noy ,  James Over Everard ,  Raunaq Bose ,  Maya Audrey Lara Pindeus ,  Leslie Cees Nooteboom

IPC: G06T7/20

Abstract: Systems and methods are disclosed herein for tracking a vulnerable road user (VRU) regardless of occlusion. In an embodiment, the system captures a series of images including the VRU, and inputs each of the images into a detection model. The system receives a bounding box for each of the series of images of the VRU as output from the detection model. The system inputs each bounding box into a multi-task model, and receives as output from the multi-task model an embedding for each bounding box. The system determines, using the embeddings for each bounding box across the series of images, an indication of which of the embeddings correspond to the VRU.

公开(公告)号：US20210070322A1

公开(公告)日：2021-03-11

申请号：US17011854

申请日：2020-09-03

Applicant: Humanising Autonomy Limited

Inventor： Dominic Noy ,  Matthew Cameron Angus ,  James Over Everard ,  Wassim El Youssoufi ,  Raunaq Bose ,  Leslie Cees Nooteboom ,  Maya Audrey Lara Pindeus

IPC: B60W60/00 ,  G06N7/00 ,  G06N3/08 ,  G06K9/00 ,  G06K9/62

Abstract: A device performs operations including determining a probability that a vulnerable road user (VRU) will continue on a current path (e.g., in connection with controlling an autonomous vehicle). The device receives an image depicting a vulnerable road user (VRU). The device inputs at least a portion of the image into a model, and receives, as output from the model, a plurality of probabilities describing the VRU, each of the probabilities corresponding to a probability that the VRU is in a given state. The device determines, based on at least some of the plurality of probabilities, a probability that the VRU will exhibit a behavior, and outputs the probability that the VRU will exhibit the behavior to a control system.

公开(公告)号：US20240029467A1

公开(公告)日：2024-01-25

申请号：US18479797

申请日：2023-10-02

Applicant: Humanising Autonomy Limited

Inventor： Dominic Noy ,  Matthew Cameron Angus ,  James Over Everard ,  Wassim El Youssoufi ,  Raunaq Bose ,  Leslie Cees Nooteboom ,  Maya Audrey Lara Pindeus

IPC: G06V40/10 ,  B60W60/00 ,  G06N3/08 ,  G06V20/58 ,  G06F18/20 ,  G06N7/01 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56

CPC classification number: G06V40/103 ,  B60W60/0027 ,  G06N3/08 ,  G06V20/58 ,  G06F18/295 ,  G06N7/01 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  B60W2554/4046

Abstract: A device performs operations including determining a probability that a vulnerable road user (VRU) will continue on a current path (e.g., in connection with controlling an autonomous vehicle). The device receives an image depicting a vulnerable road user (VRU). The device inputs at least a portion of the image into a model, and receives, as output from the model, a plurality of probabilities describing the VRU, each of the probabilities corresponding to a probability that the VRU is in a given state. The device determines, based on at least some of the plurality of probabilities, a probability that the VRU will exhibit a behavior, and outputs the probability that the VRU will exhibit the behavior to a control system.

公开(公告)号：US12190625B2

公开(公告)日：2025-01-07

申请号：US18479797

申请日：2023-10-02

Applicant: Humanising Autonomy Limited

Inventor： Dominic Noy ,  Matthew Cameron Angus ,  James Over Everard ,  Wassim El Youssoufi ,  Raunaq Bose ,  Leslie Cees Nooteboom ,  Maya Audrey Lara Pindeus

IPC: G06V40/00 ,  B60W60/00 ,  G06F18/20 ,  G06N3/08 ,  G06N7/01 ,  G06V10/764 ,  G06V10/82 ,  G06V20/56 ,  G06V20/58 ,  G06V40/10

Abstract: A device performs operations including determining a probability that a vulnerable road user (VRU) will continue on a current path (e.g., in connection with controlling an autonomous vehicle). The device receives an image depicting a vulnerable road user (VRU). The device inputs at least a portion of the image into a model, and receives, as output from the model, a plurality of probabilities describing the VRU, each of the probabilities corresponding to a probability that the VRU is in a given state. The device determines, based on at least some of the plurality of probabilities, a probability that the VRU will exhibit a behavior, and outputs the probability that the VRU will exhibit the behavior to a control system.

公开(公告)号：US12094252B2

公开(公告)日：2024-09-17

申请号：US17549680

申请日：2021-12-13

Applicant: Humanising Autonomy Limited

Inventor： Wassim El Youssoufi ,  Dominic Noy ,  Yazhini Chitra Pradeep ,  James Over Everard ,  Leslie Cees Nooteboom ,  Raunaq Bose ,  Maya Audrey Lara Pindeus

IPC: G06K9/00 ,  G06T7/70 ,  G06V40/20

CPC classification number: G06V40/23 ,  G06T7/70 ,  G06T2207/20081 ,  G06T2207/30196

Abstract: An occlusion analysis system improves accuracy of behavior prediction models by generating occlusion parameters that may inform mathematical models to generate more accurate predictions. The occlusion analysis system trains and applies models for generating occlusion parameters, such as a manner in which a person is occluded, occlusion percentage, occlusion type. A behavior prediction system may input the occlusion parameters as well as other parameters relating to activity of the human into a second mathematical model for behavior prediction. The second machine learning model is a higher-level model trained to output a prediction that the human will exhibit a future behavior and a confidence level associated with the prediction. The confidence level is at least partially determined based on the occlusion parameters. The behavior prediction system may output the prediction and the confidence level to a control system that generates commands associated with a vehicle and other intelligent video analytics systems.

公开(公告)号：US20220189210A1

公开(公告)日：2022-06-16

申请号：US17549680

申请日：2021-12-13

Applicant: Humanising Autonomy Limited

Inventor： Wassim El Youssoufi ,  Dominic Noy ,  Yazhini Chitra Pradeep ,  James Over Everard ,  Leslie Cees Nooteboom ,  Raunaq Bose ,  Maya Audrey Lara Pindeus

IPC: G06V40/20 ,  G06T7/70

Abstract: An occlusion analysis system improves accuracy of behavior prediction models by generating occlusion parameters that may inform mathematical models to generate more accurate predictions. The occlusion analysis system trains and applies models for generating occlusion parameters, such as a manner in which a person is occluded, occlusion percentage, occlusion type. A behavior prediction system may input the occlusion parameters as well as other parameters relating to activity of the human into a second mathematical model for behavior prediction. The second machine learning model is a higher-level model trained to output a prediction that the human will exhibit a future behavior and a confidence level associated with the prediction. The confidence level is at least partially determined based on the occlusion parameters. The behavior prediction system may output the prediction and the confidence level to a control system that generates commands associated with a vehicle and other intelligent video analytics systems.

公开(公告)号：US20230343062A1

公开(公告)日：2023-10-26

申请号：US18215075

申请日：2023-06-27

Applicant: Humanising Autonomy Limited

Inventor： Yazhini Chitra Pradeep ,  Wassim El Youssoufi ,  Dominic Noy ,  James Over Everard ,  Raunaq Bose ,  Maya Audrey Lara Pindeus ,  Leslie Cees Nooteboom

IPC: G06V10/25 ,  G06T7/20 ,  G06V10/764 ,  G06V10/82 ,  G06V10/40 ,  G06V20/58

CPC classification number: G06V10/25 ,  G06T7/20 ,  G06V10/764 ,  G06V10/82 ,  G06V10/40 ,  G06V20/58 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/30196 ,  G06T2207/30261

Abstract: Systems and methods are disclosed herein for tracking a vulnerable road user (VRU) regardless of occlusion. In an embodiment, the system captures a series of images including the VRU, and inputs each of the images into a detection model. The system receives a bounding box for each of the series of images of the VRU as output from the detection model. The system inputs each bounding box into a multi-task model, and receives as output from the multi-task model an embedding for each bounding box. The system determines, using the embeddings for each bounding box across the series of images, an indication of which of the embeddings correspond to the VRU.

公开(公告)号：US11734907B2

公开(公告)日：2023-08-22

申请号：US16857645

申请日：2020-04-24

Applicant: Humanising Autonomy Limited

Inventor： Yazhini Chitra Pradeep ,  Wassim El Youssoufi ,  Dominic Noy ,  James Over Everard ,  Raunaq Bose ,  Maya Audrey Lara Pindeus ,  Leslie Cees Nooteboom

IPC: G06V10/25 ,  G06T7/20 ,  G06V10/764 ,  G06V10/82 ,  G06V10/40 ,  G06V20/58

CPC classification number: G06V10/25 ,  G06T7/20 ,  G06V10/40 ,  G06V10/764 ,  G06V10/82 ,  G06V20/58 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/30196 ,  G06T2207/30261

Abstract: Systems and methods are disclosed herein for tracking a vulnerable road user (VRU) regardless of occlusion. In an embodiment, the system captures a series of images including the VRU, and inputs each of the images into a detection model. The system receives a bounding box for each of the series of images of the VRU as output from the detection model. The system inputs each bounding box into a multi-task model, and receives as output from the multi-task model an embedding for each bounding box. The system determines, using the embeddings for each bounding box across the series of images, an indication of which of the embeddings correspond to the VRU.