-
公开(公告)号:US11430218B2
公开(公告)日:2022-08-30
申请号:US17139225
申请日:2020-12-31
发明人: Jie Li , Rares A. Ambrus , Vitor Guizilini , Adrien David Gaidon , Jia-En Pan
摘要: A bird's eye view feature map, augmented with semantic information, can be used to detect an object in an environment. A point cloud data set augmented with the semantic information that is associated with identities of classes of objects can be obtained. Features can be extracted from the point cloud data set. Based on the features, an initial bird's eye view feature map can be produced. Because operations performed on the point cloud data set to extract the features or to produce the initial bird's eye view feature map can have an effect of diminishing an ability to distinguish the semantic information in the initial bird's eye view feature map, the initial bird's eye view feature map can be augmented with the semantic information to produce an augmented bird's eye view feature map. Based on the augmented bird's eye view feature map, the object in the environment can be detected.
-
公开(公告)号:US12014549B2
公开(公告)日:2024-06-18
申请号:US17192443
申请日:2021-03-04
发明人: Jia-En Pan , Kuan-Hui Lee , Chao Fang , Kun-Hsin Chen , Arjun Bhargava , Sudeep Pillai
CPC分类号: G06V20/56 , B60R11/04 , G06T3/0093 , G06T7/337 , B60R2300/303 , G06T2207/20084 , G06T2207/20221 , G06T2207/30252
摘要: A vehicle light classification system captures a sequence of images of a scene that includes a front/rear view of a vehicle with front/rear-side lights, determines semantic keypoints, in the images and associated with the front/rear-side lights, based on inputting the images into a first neural network, obtains multiple difference images that are each a difference between successive images from among the sequence of images, the successive images being aligned based on their respective semantic keypoints, and determines a classification of the front/rear-side lights based at least in part on the difference images by inputting the difference images into a second neural network.
-
公开(公告)号:US11810367B2
公开(公告)日:2023-11-07
申请号:US17361424
申请日:2021-06-29
发明人: Chao Fang , Kuan-Hui Lee , Logan Michael Ellis , Jia-En Pan , Kun-Hsin Chen , Sudeep Pillai , Daniele Molinari , Constantin Franziskus Dominik Hubmann , T. Wolfram Burgard
CPC分类号: G06V20/584 , G01S17/89 , G06F18/21 , G06F18/24323 , G06N3/044 , G06T7/246 , G06T7/521 , G06T2207/10028 , G06T2207/30252 , G06V2201/08
摘要: Described herein are systems and methods for determining if a vehicle is parked. In one example, a system includes a processor, a sensor system, and a memory. Both the sensor system and the memory are in communication with the processor. The memory includes a parking determination module having instructions that, when executed by the processor, cause the processor to determine, using a random forest model, when the vehicle is parked based on vehicle estimated features, vehicle learned features, and vehicle taillight features of the vehicle that are based on sensor data from the sensor system.
-
公开(公告)号:US20220414388A1
公开(公告)日:2022-12-29
申请号:US17361424
申请日:2021-06-29
发明人: Chao Fang , Kuan-Hui Lee , Logan Michael Ellis , Jia-En Pan , Kun-Hsin Chen , Sudeep Pillai , Daniele Molinari , Constantin Franziskus Dominik Hubmann , T. Wolfram Burgard
摘要: Described herein are systems and methods for determining if a vehicle is parked. In one example, a system includes a processor, a sensor system, and a memory. Both the sensor system and the memory are in communication with the processor. The memory includes a parking determination module having instructions that, when executed by the processor, cause the processor to determine, using a random forest model, when the vehicle is parked based on vehicle estimated features, vehicle learned features, and vehicle taillight features of the vehicle that are based on sensor data from the sensor system.
-
公开(公告)号:US20220198204A1
公开(公告)日:2022-06-23
申请号:US17130435
申请日:2020-12-22
发明人: Kun-Hsin Chen , Kuan-Hui Lee , Jia-En Pan , Sudeep Pillai
摘要: In one embodiment, a traffic light classification system for a vehicle, includes an image capture device to capture an image of a scene that includes a traffic light with multiple light signals, a processor, and a memory communicably coupled to the processor and storing a first neural network module including instructions that when executed by the processor cause the processor to determine, based on inputting the image into a neural network, a semantic keypoint for each light signal in the traffic light, and determine, based on each semantic keypoint, a classification state of each light signal.
-
公开(公告)号:US11776281B2
公开(公告)日:2023-10-03
申请号:US17130435
申请日:2020-12-22
发明人: Kun-Hsin Chen , Kuan-Hui Lee , Jia-En Pan , Sudeep Pillai
IPC分类号: G06V20/00 , G06V20/58 , G06T7/246 , G06V30/262 , G06F18/21 , G06F18/24 , G06N3/044 , G06N3/045 , G08G1/095
CPC分类号: G06V20/584 , G06F18/21 , G06F18/24 , G06N3/044 , G06N3/045 , G06T7/248 , G06V30/274 , G06T2207/10016 , G06T2207/20084 , G06T2207/30252 , G08G1/095
摘要: A traffic light classification system for a vehicle includes an image capture device to capture an image of a scene that includes a traffic light with multiple light signals, a processor, and a memory communicably coupled to the processor and storing a first neural network module including instructions that when executed by the processor cause the processor to determine, based on inputting the image into a neural network, a semantic keypoint for each light signal in the traffic light, and determine, based on each semantic keypoint, a classification state of each light signal.
-
公开(公告)号:US20220284222A1
公开(公告)日:2022-09-08
申请号:US17192443
申请日:2021-03-04
发明人: Jia-En Pan , Kuan-Hui Lee , Chao Fang , Kun-Hsin Chen , Arjun Bhargava , Sudeep Pillai
摘要: In one embodiment, a vehicle light classification system captures a sequence of images of a scene that includes a front/rear view of a vehicle with front/rear-side lights, determines semantic keypoints, in the images and associated with the front/rear-side lights, based on inputting the images into a first neural network, obtains multiple difference images that are each a difference between successive images from among the sequence of images, the successive images being aligned based on their respective semantic keypoints, and determines a classification of the front/rear-side lights based at least in part on the difference images by inputting the difference images into a second neural network.
-
公开(公告)号:US20220207270A1
公开(公告)日:2022-06-30
申请号:US17139225
申请日:2020-12-31
发明人: Jie Li , Rares A. Ambrus , Vitor Guizilini , Adrien David Gaidon , Jia-En Pan
摘要: A bird's eye view feature map, augmented with semantic information, can be used to detect an object in an environment. A point cloud data set augmented with the semantic information that is associated with identities of classes of objects can be obtained. Features can be extracted from the point cloud data set. Based on the features, an initial bird's eye view feature map can be produced. Because operations performed on the point cloud data set to extract the features or to produce the initial bird's eye view feature map can have an effect of diminishing an ability to distinguish the semantic information in the initial bird's eye view feature map, the initial bird's eye view feature map can be augmented with the semantic information to produce an augmented bird's eye view feature map. Based on the augmented bird's eye view feature map, the object in the environment can be detected.
-
-
-
-
-
-
-