-
公开(公告)号:US11669956B2
公开(公告)日:2023-06-06
申请号:US17335835
申请日:2021-06-01
Applicant: Caterpillar Inc.
Inventor: Lawrence A Mianzo , Tod A Oblak , John M Plouzek , Raymond Alan Wise , Shawn Nainan Mathew
CPC classification number: G06T7/001 , G06T7/11 , G06T7/174 , G06T7/521 , G06V10/44 , G06V20/647 , G06T2207/10012 , G06T2207/10028 , G06T2207/30164
Abstract: An example wear detection system receives first imaging data from one or more sensors associated with a work machine. The first imaging data comprises data related to at least one ground engaging tool (GET) of the work machine. The example system identifies a region of interest including data of the at least one GET within the first imaging data. Based on the identified region of interest, the example system controls a LiDAR sensor to capture second imaging data capturing the at least one GET that is of higher resolution than the first imaging data. The example system generates a three-dimensional point cloud of the at least one GET based on the second imaging data and determines a wear level or loss for the at least one GET based on the three-dimensional point cloud.
-
公开(公告)号:US11869331B2
公开(公告)日:2024-01-09
申请号:US17399199
申请日:2021-08-11
Applicant: Caterpillar Inc.
Inventor: Lawrence A Mianzo , Tod A Oblak , Shawn Nainan Mathew , John M Plouzek , Raymond Alan Wise , Daniel Paul Adler
IPC: G08B21/18 , G06T7/593 , H04N13/239 , G06T7/00 , G08B31/00
CPC classification number: G08B21/182 , G06T7/001 , G06T7/593 , G08B31/00 , H04N13/239 , G06T2207/20081 , G06T2207/20228 , G06T2207/30164 , G06V2201/06
Abstract: An example wear detection system receives first image data related to at least one ground engaging tool (GET) of a work machine from one or more sensors at a first time instance in a dig-dump cycle of the work machine. The wear detection system processes the first image data to determine a first wear measurement and first wear level for the at least one GET. The wear detection system determines whether the first wear level is indicative of a GET replacement condition. The wear detection system generates an alert when the first wear level is indicative of the GET replacement condition. The wear detection system receives second image data related to the at least one GET a second time instance different from the first time instance when the first wear level is not indicative of the GET replacement condition and determines a second wear measurement and second wear level for the at least one GET. The wear detection system generates an alert indicative of the first wear level and the second wear level based on determining that the first wear level and the second wear level are indicative of the GET replacement condition.
-
公开(公告)号:US10832435B1
公开(公告)日:2020-11-10
申请号:US16396238
申请日:2019-04-26
Applicant: Caterpillar Inc.
Inventor: Shawn Nainan Mathew , Christopher Ha , Yang Liu , Sanghyun Shin
Abstract: A method for loading a payload carrier of a machine includes receiving, from a camera on the machine, a two-dimensional image of an interior of the payload carrier as material is loaded into the payload carrier. The method further includes sectioning the two-dimensional image into a plurality of regions, and determining, for individual of the regions, whether the region includes a representative of fill material. The method may also include determining a fill volume based on the regions having fill and those not having fill.
-
公开(公告)号:US20200342616A1
公开(公告)日:2020-10-29
申请号:US16396238
申请日:2019-04-26
Applicant: Caterpillar Inc.
Inventor: Shawn Nainan Mathew , Christopher Ha , Yang Liu , Sanghyun Shin
Abstract: A method for loading a payload carrier of a machine includes receiving, from a camera on the machine, a two-dimensional image of an interior of the payload carrier as material is loaded into the payload carrier. The method further includes sectioning the two-dimensional image into a plurality of regions, and determining, for individual of the regions, whether the region includes a representative of fill material. The method may also include determining a fill volume based on the regions having fill and those not having fill.
-
公开(公告)号:US12020419B2
公开(公告)日:2024-06-25
申请号:US17399433
申请日:2021-08-11
Applicant: Caterpillar Inc.
Inventor: Lawrence A Mianzo , Tod A Oblak , John M Plouzek , Raymond Alan Wise , Shawn Nainan Mathew , Daniel Paul Adler
CPC classification number: G06T7/001 , G06T7/12 , G06T7/174 , G06T7/593 , G06T7/60 , G06V10/25 , G06T2207/10012 , G06T2207/10028 , G06T2207/20081 , G06T2207/30164
Abstract: An example wear detection system receives a plurality of images from a plurality of sensors associated with a work machine. Individual sensors of the plurality of sensors have respective fields-of-view different from other sensors of the plurality of sensors. The wear detection system identifies a first region of interest and second region of interest associated with the at least one GET. The wear detection system determines a first set of image points and a second set of images points for the at least one GET based on geometric parameters associated with the GET. The wear detection system determines a wear level or loss for the at least one GET based on the GET measurement.
-
公开(公告)号:US11821177B2
公开(公告)日:2023-11-21
申请号:US17171569
申请日:2021-02-09
Applicant: Caterpillar Inc.
Inventor: Lawrence A Mianzo , Tod A Oblak , John M Plouzek , Shawn Nainan Mathew , Raymond Alan Wise
CPC classification number: E02F9/267 , E02F9/2808 , G06V10/25 , G06V10/443 , G06V10/70 , G06V2201/07
Abstract: An example wear detection system receives a left image and a right image of a bucket of a work machine having at least one ground engaging tool (GET). The example system identifies a first region of interest from the left image corresponding to the GET and a second region of interest from the right image corresponding to the GET. The example system also generates a left-edge digital image corresponding to the first region of interest and a right-edge digital image corresponding to the second region of interest. Further, the example system determines a sparse stereo disparity between the left-edge digital image and the right-edge digital image, and also determines a wear level or loss for the at least one GET based on the sparse stereo disparity.
-
公开(公告)号:US20220383469A1
公开(公告)日:2022-12-01
申请号:US17335835
申请日:2021-06-01
Applicant: Caterpillar Inc.
Inventor: Lawrence A. Mianzo , Tod A. Oblak , John M. Plouzek , Raymond Alan Wise , Shawn Nainan Mathew
Abstract: An example wear detection system receives first imaging data from one or more sensors associated with a work machine. The first imaging data comprises data related to at least one ground engaging tool (GET) of the work machine. The example system identifies a region of interest including data of the at least one GET within the first imaging data. Based on the identified region of interest, the example system controls a LiDAR sensor to capture second imaging data capturing the at least one GET that is of higher resolution than the first imaging data. The example system generates a three-dimensional point cloud of the at least one GET based on the second imaging data and determines a wear level or loss for the at least one GET based on the three-dimensional point cloud.
-
公开(公告)号:US11001991B2
公开(公告)日:2021-05-11
申请号:US16245829
申请日:2019-01-11
Applicant: Caterpillar Inc.
Inventor: Christopher Ha , Shawn Nainan Mathew , Yang Liu , Qi Wang
IPC: G06K9/00 , E02F9/26 , H04N7/18 , E02F3/65 , E02F3/64 , G06T7/20 , B60R11/04 , G06T7/90 , G06T7/50
Abstract: A method for loading a payload carrier of a machine includes receiving, from a camera on the machine, a two-dimensional image of an interior of the payload carrier as material is loaded into the payload carrier. The method further includes filtering the image to identify a contour of the loaded material and determining an area of the contour. The method further includes controlling a display device indicate the determined area.
-
公开(公告)号:US20230399820A1
公开(公告)日:2023-12-14
申请号:US17806106
申请日:2022-06-09
Applicant: Caterpillar Inc.
Inventor: Shawn Nainan Mathew , Arthur Milkowski , John Michael Plouzek , Norman Keith Lay , Subhani Mahaboob Shaik
Abstract: A mounting system for a work machine includes a first member extending along a vertical axis of the mounting system, and a second member extending along the vertical axis and spaced apart from the first member along a lateral axis of the mounting system. The mounting system also includes a bracket assembly extending between the first member and the second member. The bracket assembly is disposable at a location along the vertical axis based on a removable coupling of the bracket assembly with each of the first member and the second member. The mounting system further includes an imaging device coupled with the bracket assembly. A position of the imaging device is adjustable with respect to the lateral axis of the mounting system and the vertical axis, such that a portion of a work implement of the work machine lies in a field of view of the imaging device.
-
公开(公告)号:US20230053154A1
公开(公告)日:2023-02-16
申请号:US17399433
申请日:2021-08-11
Applicant: Caterpillar Inc.
Inventor: Lawrence A. Mianzo , Tod A. Oblak , John M. Plouzek , Raymond Alan Wise , Shawn Nainan Mathew , Daniel Paul Adler
Abstract: An example wear detection system receives a plurality of images from a plurality of sensors associated with a work machine. Individual sensors of the plurality of sensors have respective fields-of-view different from other sensors of the plurality of sensors. The wear detection system identifies a first region of interest and second region of interest associated with the at least one GET. The wear detection system determines a first set of image points and a second set of images points for the at least one GET based on geometric parameters associated with the GET. The wear detection system determines a wear level or loss for the at least one GET based on the GET measurement.
-
-
-
-
-
-
-
-
-