- 专利标题: All-weather target detection method based on vision and millimeter wave fusion
-
申请号: US17543777申请日: 2021-12-07
-
公开(公告)号: US11380089B1公开(公告)日: 2022-07-05
- 发明人: Xinyu Zhang , Jun Li , Zhiwei Li , Huaping Liu , Xingang Wu
- 申请人: Tsinghua University
- 申请人地址: CN Beijing
- 专利权人: Tsinghua University
- 当前专利权人: Tsinghua University
- 当前专利权人地址: CN Beijing
- 代理机构: Bayramoglu Law Offices LLC
- 优先权: CN202011595732.1 20201229
- 主分类号: G06V10/80
- IPC分类号: G06V10/80 ; G06V10/77 ; G06V10/774 ; G01S7/41 ; G06V10/82 ; G01S13/86 ; G01S13/931 ; G01S13/89 ; G06V20/56
摘要:
An all-weather target detection method based on a vision and millimeter wave fusion includes: simultaneously acquiring continuous image data and point cloud data using two types of sensors of a vehicle-mounted camera and a millimeter wave radar; pre-processing the image data and point cloud data; fusing the pre-processed image data and point cloud data by using a pre-established fusion model, and outputting a fused feature map; and inputting the fused feature map into a YOLOv5 detection network for detection, and outputting a target detection result by non-maximum suppression. The method fully fuses millimeter wave radar echo intensity and distance information with the vehicle-mounted camera images. It analyzes different features of a millimeter wave radar point cloud and fuses the features with image information by using different feature extraction structures and ways, so that the advantages of the two types of sensor data complement each other.
公开/授权文献
信息查询