-
公开(公告)号：US20230140890A1
公开(公告)日：2023-05-11
申请号：US17661223
申请日：2022-04-28
发明人： Kanishka Tyagi , Yihang Zhang , Kaveh Ahmadi , Shan Zhang , Narbik Manukian
CPC分类号： G01S13/89 , G06T3/4053 , G06T3/4046
摘要： This document describes techniques and systems for machine-learning-based super resolution of radar data. A low-resolution radar image can be used as input to train a model for super resolution of radar data. A higher-resolution radar image, generated by an effective, but costly in terms of computing resources, traditional super resolution method, and the higher-resolution image can serve as ground truth for training the model. The resulting trained model may generate a high-resolution sensor image that closely approximates the image generated by the traditional method. Because this trained model needs only to be executed in feed-forward mode in the inference stage, it may be suited for real-time applications. Additionally, if low-level radar data is used as input for training the model, the model may be trained with more comprehensive information than can be obtained in detection level radar data.
-
公开(公告)号：US20220335279A1
公开(公告)日：2022-10-20
申请号：US17230877
申请日：2021-04-14
发明人： Kanishka Tyagi , Yihang Zhang , John Kirkwood , Shan Zhang , Sanling Song , Narbik Manukian
IPC分类号： G06N3/063 , G06N20/00 , G06N3/08 , G01S13/931
摘要： This document describes techniques and systems related to a radar system using a machine-learned model for stationary object detection. The radar system includes a processor that can receive radar data as time-series frames associated with electromagnetic (EM) energy. The processor uses the radar data to generate a range-time map of the EM energy that is input to a machine-learned model. The machine-learned model can receive as inputs extracted features corresponding to the stationary objects from the range-time map for multiple range bins at each of the time-series frames. In this way, the described radar system and techniques can accurately detect stationary objects of various sizes and extract critical features corresponding to the stationary objects.
-
公开(公告)号：US11415670B2
公开(公告)日：2022-08-16
申请号：US16825186
申请日：2020-03-20
发明人： Kanishka Tyagi , John Kirkwood
IPC分类号： G01S7/41 , G01S13/72 , G01S13/931 , G01S13/52 , G01S13/58
摘要： Techniques and apparatuses are described that implement object classification using low-level radar data. In particular, a radar system extracts features of a detected object based on low-level data. The radar system analyzes these features using machine learning to determine an object class associated with the detected object. By relying on low-level data, the radar system is able to extract additional information regarding the distribution of energy across range, range rate, azimuth, or elevation, which is not available in detection-level data. With the use of machine learning, the object can be classified quickly (e.g., within a single frame or observation), thereby enabling sufficient time for the autonomous-driving logic to initiate an appropriate action based on the object's class. Furthermore, this classification can be performed without the use of information from other sensors.
-
公开(公告)号：US20240134038A1
公开(公告)日：2024-04-25
申请号：US17938876
申请日：2022-10-07
发明人： Shan Zhang , Kanishka Tyagi , Steven Shaw , Narbik Manukian
IPC分类号： G01S13/931 , B60W30/095 , G01S13/89 , G06N3/08
CPC分类号： G01S13/931 , B60W30/0956 , G01S13/89 , G06N3/08 , B60W60/0015 , B60W2420/52
摘要： This document describes techniques and systems for stationary object detection and classification based on low-level radar data. Raw electromagnetic signals reflected off stationary objects and received by a radar system may be preprocessed to produce low-level spectrum data in the form of range-Doppler maps that retain all or nearly all the data present in the raw electromagnetic signals. The preprocessing may also filter non-stationary range-Doppler bins. The remaining low-level spectrum data represents stationary objects present in a field-of-view (FOV) of the radar system. The low-level spectrum data representing stationary objects can be fed to an end-to-end deep convolutional detection and classification network that is trained to classify and provide object bounding boxes for the stationary objects. The outputted classifications and bounding boxes related to the stationary objects may be provided to other driving systems to improve their functionality resulting in a safer driving experience.
-
公开(公告)号：US20230410490A1
公开(公告)日：2023-12-21
申请号：US17929612
申请日：2022-09-02
发明人： Shan Zhang , Nianxia Cao , Kanishka Tyagi , Xiaohui Wang , Narbik Manukian
IPC分类号： G06V10/80 , G01S13/86 , G01S17/86 , G01S13/931 , G01S17/931 , G06V20/56
CPC分类号： G06V10/806 , G01S13/865 , G01S13/867 , G01S17/86 , G01S13/931 , G01S17/931 , G06V20/56
摘要： This document describes systems and techniques related to deep association for sensor fusion. For example, a model trained using deep machine learning techniques, may be used to generate an association score matrix that includes probabilities that tracks from different types of sensors are related to the same objects. This model may be trained using a convolutional recurrent neural network and include constraints not included in other training techniques. Focal loss can be used during training to compensate for imbalanced data samples and address difficult cases, and data expansion techniques can be used to increase the multi-sensor data space. Simple thresholding techniques can be applied to the association score matrix to generate an assignment matrix that indicates whether tracks from one sensor and tracks from another sensor match. In this manner, the track association process may be more accurate than current sensor fusion techniques, and vehicle safety may be increased.
-
公开(公告)号：US20230194700A1
公开(公告)日：2023-06-22
申请号：US17658089
申请日：2022-04-05
发明人： Yihang Zhang , Kanishka Tyagi , Narbik Manukian
CPC分类号： G01S13/9005 , G06N3/08 , G01S13/865 , G01S13/867 , G06N3/0436 , G01S7/417
摘要： This document describes techniques and systems for fuzzy labeling of low-level electromagnetic sensor data. Sensor data in the form of an energy spectrum is obtained and the points within an estimated geographic boundary of a scatterer represented by the smear is labeled with a value of one. The remaining points of the energy spectrum are labeled with values between zero and one with the values decreasing the further away each respective remaining point is from the geographic boundary. The fuzzy labeling process may harness more in-depth information available from the distribution of the energy in the energy spectrum. A model can be trained to efficiently label an energy spectrum map in this manner. This may result in lower computational costs than other labeling methods. Additionally, false detections by the sensor may be reduced resulting in more accurate detection and tracking of objects.
-
公开(公告)号：US20230005362A1
公开(公告)日：2023-01-05
申请号：US17662998
申请日：2022-05-11
摘要： This document describes techniques and systems for improving accuracy of predictions on radar data using vehicle-to-vehicle (V2V) technology. V2V communications data and the matching sensor data related to one or more vehicles in the vicinity of a host vehicle are collected. The V2V data is used as label data and the radar data is used as the input data for training the model. The training may either occur onboard the host vehicle or remotely. Further, multiple host vehicles may contribute data to train the model. Once the model has been updated with the included training, the updated model is deployed to the sensor tracking system of the host vehicle. By using the dataset that includes the V2V communications data and the matching sensor data, the updated model may accurately track other vehicles and enable the host vehicle to utilize advanced driver-assistance systems safely and reliably.
-
公开(公告)号：US20210293927A1
公开(公告)日：2021-09-23
申请号：US16825186
申请日：2020-03-20
发明人： Kanishka Tyagi , John Kirkwood
IPC分类号： G01S7/41 , G01S13/931 , G01S13/72
摘要： Techniques and apparatuses are described that implement object classification using low-level radar data. In particular, a radar system extracts features of a detected object based on low-level data. The radar system analyzes these features using machine learning to determine an object class associated with the detected object. By relying on low-level data, the radar system is able to extract additional information regarding the distribution of energy across range, range rate, azimuth, or elevation, which is not available in detection-level data. With the use of machine learning, the object can be classified quickly (e.g., within a single frame or observation), thereby enabling sufficient time for the autonomous-driving logic to initiate an appropriate action based on the object's class. Furthermore, this classification can be performed without the use of information from other sensors.
-
-
-
-
-
-
-
搜索结果
8 条记录 (耗时 0.015 秒)
