Camera orientation estimation
    1.
    发明授权

    公开(公告)号:US12131499B2

    公开(公告)日:2024-10-29

    申请号:US18339940

    申请日:2023-06-22

    申请人: TUSIMPLE, INC.

    IPC分类号: G06T7/73 G06T7/33

    摘要: Techniques are described to estimate orientation of one or more cameras located on a vehicle. The orientation estimation technique can include obtaining an image from a camera located on a vehicle while the vehicle is being driven on a road, determining, from a terrain map, a location of a landmark located at a distance from a location of the vehicle on the road, determining, in the image, pixel locations of the landmark, selecting one pixel location from the determined pixel locations; and calculating values that describe an orientation of the camera using at least an intrinsic matrix and a previously known extrinsic matrix of the camera, where the intrinsic matrix is characterized based on at least the one pixel location and the location of the landmark.

    NEURAL NETWORK BASED VEHICLE DYNAMICS MODEL
    2.
    发明公开

    公开(公告)号:US20240353839A1

    公开(公告)日:2024-10-24

    申请号:US18662273

    申请日:2024-05-13

    申请人: TuSimple, Inc.

    摘要: A system and method for implementing a neural network based vehicle dynamics model are disclosed. A particular embodiment includes: training a machine learning system with a training dataset corresponding to a desired autonomous vehicle simulation environment; receiving vehicle control command data and vehicle status data, the vehicle control command data not including vehicle component types or characteristics of a specific vehicle; by use of the trained machine learning system, the vehicle control command data, and vehicle status data, generating simulated vehicle dynamics data including predicted vehicle acceleration data; providing the simulated vehicle dynamics data to an autonomous vehicle simulation system implementing the autonomous vehicle simulation environment; and using data produced by the autonomous vehicle simulation system to modify the vehicle status data for a subsequent iteration.

    APPARATUS, SYSTEM, AND METHOD FOR SENSOR HOUSING

    公开(公告)号:US20240317187A1

    公开(公告)日:2024-09-26

    申请号:US18444121

    申请日:2024-02-16

    申请人: TuSimple, Inc.

    IPC分类号: B60S1/56 B60S1/48

    CPC分类号: B60S1/56 B60S1/486

    摘要: Provided herein is a system and method for a sensor housing that mitigates glare within the field-of-view and facilitates cleaning of a sensor lens. A sensor assembly may include: a sensor having a sensor lens and a field-of-view through the sensor lens; and a baffle defining a sensor lens aperture, where the field-of-view through the sensor lens is through the sensor lens aperture, where the baffle includes a series of concentric rings extending away from the sensor lens aperture and increasing in diameter as a distance from the sensor lens aperture increases. According to some embodiments, the series of concentric rings defines a viewing angle, where the viewing angle corresponds to the field-of-view of the sensor lens.

    SYSTEM AND METHOD FOR FISHEYE IMAGE PROCESSING

    公开(公告)号:US20240311954A1

    公开(公告)日:2024-09-19

    申请号:US18437734

    申请日:2024-02-09

    申请人: TUSIMPLE, INC.

    摘要: A system and method for fisheye image processing can be configured to: receive fisheye image data from at least one fisheye lens camera associated with an autonomous vehicle, the fisheye image data representing at least one fisheye image frame; partition the fisheye image frame into a plurality of image portions representing portions of the fisheye image frame; warp each of the plurality of image portions to map an arc of a camera projected view into a line corresponding to a mapped target view, the mapped target view being generally orthogonal to a line between a camera center and a center of the arc of the camera projected view; combine the plurality of warped image portions to form a combined resulting fisheye image data set representing recovered or distortion-reduced fisheye image data corresponding to the fisheye image frame; generate auto-calibration data representing a correspondence between pixels in the at least one fisheye image frame and corresponding pixels in the combined resulting fisheye image data set; and provide the combined resulting fisheye image data set as an output for other autonomous vehicle subsystems.

    System and method for determining car to lane distance

    公开(公告)号:US12073724B2

    公开(公告)日:2024-08-27

    申请号:US18335886

    申请日:2023-06-15

    申请人: TuSimple, Inc.

    发明人: Panqu Wang

    摘要: A system and method for determining car to lane distance is provided. In one aspect, the system includes a camera configured to generate an image, a processor, and a computer-readable memory. The processor is configured to receive the image from the camera, generate a wheel segmentation map representative of one or more wheels detected in the image, and generate a lane segmentation map representative of one or more lanes detected in the image. For at least one of the wheels in the wheel segmentation map, the processor is also configured to determine a distance between the wheel and at least one nearby lane in the lane segmentation map. The processor is further configured to determine a distance between a vehicle in the image and the lane based on the distance between the wheel and the lane.