SYSTEM AND METHOD FOR FISHEYE IMAGE PROCESSING

    公开(公告)号:US20240311954A1

    公开(公告)日:2024-09-19

    申请号:US18437734

    申请日:2024-02-09

    申请人: TUSIMPLE, INC.

    摘要: A system and method for fisheye image processing can be configured to: receive fisheye image data from at least one fisheye lens camera associated with an autonomous vehicle, the fisheye image data representing at least one fisheye image frame; partition the fisheye image frame into a plurality of image portions representing portions of the fisheye image frame; warp each of the plurality of image portions to map an arc of a camera projected view into a line corresponding to a mapped target view, the mapped target view being generally orthogonal to a line between a camera center and a center of the arc of the camera projected view; combine the plurality of warped image portions to form a combined resulting fisheye image data set representing recovered or distortion-reduced fisheye image data corresponding to the fisheye image frame; generate auto-calibration data representing a correspondence between pixels in the at least one fisheye image frame and corresponding pixels in the combined resulting fisheye image data set; and provide the combined resulting fisheye image data set as an output for other autonomous vehicle subsystems.

    SYSTEM AND METHOD FOR SEMANTIC SEGMENTATION USING HYBRID DILATED CONVOLUTION (HDC)

    公开(公告)号:US20200265244A1

    公开(公告)日:2020-08-20

    申请号:US16867472

    申请日:2020-05-05

    申请人: TUSIMPLE, INC.

    摘要: A system and method for semantic segmentation using hybrid dilated convolution (HDC) are disclosed. A particular embodiment includes: receiving an input image; producing a feature map from the input image; performing a convolution operation on the feature map and producing multiple convolution layers; grouping the multiple convolution layers into a plurality of groups; applying different dilation rates for different convolution layers in a single group of the plurality of groups; and applying a same dilation rate setting across all groups of the plurality of groups.

    SYSTEM AND METHOD FOR IMAGE LOCALIZATION BASED ON SEMANTIC SEGMENTATION

    公开(公告)号:US20200160067A1

    公开(公告)日:2020-05-21

    申请号:US16752632

    申请日:2020-01-25

    申请人: TuSimple, Inc.

    IPC分类号: G06K9/00 G05D1/02

    摘要: A system and method for image localization based on semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device mounted on an autonomous vehicle; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; identifying extraneous objects in the semantic label image data; removing the extraneous objects from the semantic label image data; comparing the semantic label image data to a baseline semantic label map; and determining a vehicle location of the autonomous vehicle based on information in a matching baseline semantic label map.

    SYSTEM AND METHOD FOR LATERAL VEHICLE DETECTION

    公开(公告)号:US20190286916A1

    公开(公告)日:2019-09-19

    申请号:US15924249

    申请日:2018-03-18

    申请人: TuSimple

    摘要: A system and method for lateral vehicle detection is disclosed. A particular embodiment can be configured to: receive lateral image data from at least one laterally-facing camera associated with an autonomous vehicle; warp the lateral image data based on a line parallel to a side of the autonomous vehicle; perform object extraction on the warped lateral image data to identify extracted objects in the warped lateral image data; and apply bounding boxes around the extracted objects.

    SYSTEM AND METHOD FOR ACTIVELY SELECTING AND LABELING IMAGES FOR SEMANTIC SEGMENTATION

    公开(公告)号:US20180365835A1

    公开(公告)日:2018-12-20

    申请号:US15623323

    申请日:2017-06-14

    申请人: TuSimple

    IPC分类号: G06T7/11 G06K9/00

    摘要: A system and method for actively selecting and labeling images for semantic segmentation are disclosed. A particular embodiment includes: receiving image data from an image generating device; performing semantic segmentation or other object detection on the received image data to identify and label objects in the image data and produce semantic label image data; determining the quality of the semantic label image data based on prediction probabilities associated with regions or portions of the image; and identifying a region or portion of the image for manual labeling if an associated prediction probability is below a pre-determined threshold.

    SYSTEM AND METHOD FOR VEHICLE WHEEL DETECTION

    公开(公告)号:US20180260651A1

    公开(公告)日:2018-09-13

    申请号:US15917331

    申请日:2018-03-09

    申请人: TuSimple

    摘要: A system and method for vehicle wheel detection is disclosed. A particular embodiment can be configured to: receive training image data from a training image data collection system; obtain ground truth data corresponding to the training image data; perform a training phase to train one or more classifiers for processing images of the training image data to detect vehicle wheel objects in the images of the training image data; receive operational image data from an image data collection system associated with an autonomous vehicle; and perform an operational phase including applying the trained one or more classifiers to extract vehicle wheel objects from the operational image data and produce vehicle wheel object data.