-
公开(公告)号:US20190320115A1
公开(公告)日:2019-10-17
申请号:US15950587
申请日:2018-04-11
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Unmesh Dutta Bordoloi , Shige Wang , Stephen G. Lusko , Jinsong Wang
Abstract: Examples of techniques for dynamically selecting a batch size used in vehicle camera image processing are disclosed. In one example implementation, a method includes generating, by a processing device, a batch table and a mode table. The method further includes determining, by the processing device, image processing performance requirements for a current mode of a vehicle using the mode table, the vehicle comprising a plurality of cameras configured to capture a plurality of images. The method further includes selecting, by the processing device, a batch size and a processing frequency based at least in part on the image processing performance requirements for the current mode of the vehicle. The method further includes processing, by an accelerator, at least a subset of the plurality of images based at least in part on the batch size and processing frequency.
-
公开(公告)号:US10339391B2
公开(公告)日:2019-07-02
申请号:US15245536
申请日:2016-08-24
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Qingrong Zhao , Bakhtiar B. Litkouhi , Qi Zhang , Jinsong Wang
Abstract: A method for determining wetness on a path of travel. A surface of the path of travel is captured by at least one image capture device. A plurality of wet surface detection techniques is applied to the at least one image. An analysis for each wet surface detection technique is determined in real-time of whether the surface of the path of travel is wet. Each analysis independently determines whether the path of travel is wet. Each analysis by each wet surface detection technique is input to a fusion and decision making module. Each analysis determined by each wet surface detection technique is weighted within the fusion and decision making module by comprehensive analysis of weather information, geology information, and vehicle motions. A wet surface detection signal is provided to a control device. The control device applies the wet surface detection signal to mitigate the wet surface condition.
-
公开(公告)号:US10162360B2
公开(公告)日:2018-12-25
申请号:US15366948
申请日:2016-12-01
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Xiujie Gao , Jinsong Wang , Wende Zhang , Paul E. Krajewski , Nancy L. Johnson , Timothy J. Canner , Donald K. Grimm
Abstract: A vehicle includes at least one image capture device and a user display configured to display images receive from the at least one image capture device. The vehicle also includes a controller programmed to generate a user prompt to set a home vehicle position in response the vehicle entering a first parked state. The controller is also programmed to store at least one reference image indicative of an area in a vicinity of the vehicle corresponding to the home vehicle position. The controller is further programmed to collect a current image corresponding to a current vehicle position in response to a subsequent approach toward the vicinity, and compare the current image to the reference image. The controller is further programmed to generate a user display depicting the vicinity, the current vehicle position, and the home vehicle position.
-
公开(公告)号:US10078892B1
公开(公告)日:2018-09-18
申请号:US15461269
申请日:2017-03-16
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jinsong Wang , Bakhtiar B. Litkouhi
Abstract: Methods and systems are provided for analyzing tires of a vehicle utilizing camera images from one or more cameras mounted on the vehicle (or infrastructure). In one example, the method includes obtaining camera images of one or more tires of a vehicle, utilizing one or more cameras that are mounted on the vehicle, during operation of the vehicle; and processing the camera images, via a processor, in order to generate an analysis of one or more of the tires based on the images that were obtained via the one or more cameras that are mounted on the vehicle.
-
公开(公告)号:US09986173B2
公开(公告)日:2018-05-29
申请号:US14710289
申请日:2015-05-12
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jinsong Wang , Wende Zhang , Bakhtiar Brian Litkouhi
CPC classification number: H04N5/247 , B60R1/00 , B60R2300/102 , B60R2300/105 , B60R2300/303 , G06T7/80 , G06T7/85 , G06T2207/10021 , G06T2207/30261 , G06T2207/30264 , H04N17/002
Abstract: A system and method for providing online calibration of a plurality of cameras in a surround-view camera system on a vehicle. The method provides consecutive images from each of the cameras in the surround-view system and identifies overlap image areas for adjacent cameras. The method identifies matching feature points in the overlap areas of the images and estimates camera parameters in world coordinates for each of the cameras. The method then estimates a vehicle pose of the vehicle in world coordinates and calculates the camera parameters in vehicle coordinates using the estimated camera parameters in the world coordinates and the estimated vehicle pose to provide the calibration.
-
公开(公告)号:US09981605B2
公开(公告)日:2018-05-29
申请号:US14710322
申请日:2015-05-12
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jinsong Wang , Wende Zhang , Bakhtiar B. Litkouhi
IPC: H04N7/18 , H04N9/47 , B60R1/00 , H04N13/02 , B60R11/04 , H04N5/247 , H04N17/00 , G06T7/80 , H04N13/00 , B60R11/00
CPC classification number: B60R1/00 , B60R11/04 , B60R2011/004 , B60R2011/0089 , B60R2300/402 , G06T7/85 , G06T2207/10004 , G06T2207/10012 , G06T2207/30232 , G06T2207/30252 , H04N5/247 , H04N13/243 , H04N13/246 , H04N13/282 , H04N17/002 , H04N2013/0085 , H04N2013/0088
Abstract: A system and method for correcting the calibration of a plurality of cameras on a mobile platform such as in a surround-view camera system on a vehicle based on changes in vehicle dynamics. The method includes reading measurement values from one or more sensors on the vehicle that identify a change in vehicle dynamics and defining the plurality of cameras and a vehicle body as a single reference coordinate system. The method also includes identifying the measured values as a rotation matrix and a translation vector in the coordinate system, and integrating the rotation matrix and the translation vector into a relationship between a vehicle coordinate system and a camera coordinate system to provide the calibration correction of the cameras.
-
公开(公告)号:US20170322560A1
公开(公告)日:2017-11-09
申请号:US15492339
申请日:2017-04-20
Applicant: GM Global Technology Operations LLC
Inventor: Wende Zhang , Adrienne M. Williamson , Esther Anderson , Jinsong Wang
Abstract: A vehicle guidance system facilitates maneuvering of an autonomous vehicle with respect to an object in a scene. The vehicle includes a steering apparatus having a range of angular positions and a multitude of actuators for controlling the dynamics of the vehicle. The system includes a steering angle sensor, a camera device, and a video processing module. The sensor is configured to monitor the angular position of the wheel. The device is configured to capture an original image of a scene having the object. The module is configured to receive and process the original image from the device, detect the object in the original image, receive and process the angular position from the sensor, generate a dynamic trajectory based on at least the angular position, orientate the dynamic trajectory with regard to the object, and operate at least one of the actuators to guide the vehicle along the dynamic trajectory.
-
公开(公告)号:US09696723B2
公开(公告)日:2017-07-04
申请号:US14747888
申请日:2015-06-23
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Shuqing Zeng , Wei Tong , Jinsong Wang , Wende Zhang
CPC classification number: G05D1/0246 , B60D1/36 , B60D1/62 , B60R1/00 , B60R2300/202 , B60R2300/808 , B62D13/00 , G05D1/0212
Abstract: A method for autonomously aligning a tow hitch ball on a towing vehicle and a trailer drawbar on a trailer through a human-machine interface (HMI) assisted visual servoing process. The method includes providing rearview images from a rearview camera. The method includes touching the tow ball on a display to register a location of the tow ball in the image and touching the drawbar on the display to register a location of a target where the tow ball will be properly aligned with the drawbar. The method provides a template pattern around the target on the image and autonomously moves the vehicle so that the tow ball moves towards the target. The method predicts a new location of the target as the vehicle moves and identifies the target in new images as the vehicle moves by comparing the previous template pattern with an image patch around the predicted location.
-
公开(公告)号:US09619894B2
公开(公告)日:2017-04-11
申请号:US14710364
申请日:2015-05-12
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jinsong Wang , Wende Zhang , Bakhtiar B. Litkouhi
CPC classification number: G06T7/246 , G06K9/00791 , G06K9/3241 , G06T7/579 , G06T7/73 , G06T2207/10016 , G06T2207/30252
Abstract: A system and method for estimating dynamics of a mobile platform by matching feature points in overlapping images from cameras on the platform, such as cameras in a surround-view camera system on a vehicle. The method includes identifying overlap image areas for any two cameras in the surround-view camera system, identifying common feature points in the overlap image areas, and determining that the common feature points in the overlap image areas are not at the same location. The method also includes estimating three-degree of freedom vehicle dynamic parameters from the matching between the common feature points, and estimating vehicle dynamics of one or more of pitch, roll and height variation using the vehicle dynamic parameters.
-
公开(公告)号:US09598087B2
公开(公告)日:2017-03-21
申请号:US14568656
申请日:2014-12-12
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Qingrong Zhao , Qi Zhang , Jinsong Wang , Bakhtiar Litkouhi , Wende Zhang
CPC classification number: B60W40/06 , B60W2420/42 , G06K9/00791 , H04N5/2256
Abstract: Systems and methods use an image of a road surface that is generated by a camera. The image includes a pattern from a light source. A region of interest in the image is determined based on the pattern from the light source. A total area is determined that includes at least part of the region of interest and an area adjacent the region of interest. A feature vector is extracted based on the region of interest and the total area. A road condition is determined based on the feature vector and a classifier.
-
-
-
-
-
-
-
-
-