Image processing apparatus and image processing method

    公开(公告)号:US11625842B2

    公开(公告)日:2023-04-11

    申请号:US16575388

    申请日:2019-09-19

    申请人: FANUC Corporation

    发明人: Yuta Namiki

    摘要: An image processing apparatus includes: a model pattern storage unit that stores a model pattern composed of a plurality of model feature points; an image data acquisition unit that acquires a plurality of images obtained through capturing an object to be detected; an object detection unit that detects the object to be detected from the images using the model pattern; a model pattern transformation unit that transforms a position and posture such that the model pattern is superimposed on an image of the object to be detected; a corresponding point acquisition unit that acquires a corresponding point on image data corresponding to each of the model feature points; a corresponding point set selection unit that selects a set of corresponding points on the plurality of images; and a three-dimensional position calculation unit that calculates a three-dimensional position of the image of the object to be detected.

    Image processing device and method for detecting image of object to be detected from input data

    公开(公告)号:US11227144B2

    公开(公告)日:2022-01-18

    申请号:US15343215

    申请日:2016-11-04

    申请人: FANUC CORPORATION

    摘要: An image processing device that detects an image of an object from input data captured by a vision sensor, on the basis of a model pattern including a set of a plurality of first feature points representing the shape of the object, includes an object detection unit that detects images of the object by matching between a plurality of second feature points extracted from the input data and a plurality of first feature points forming the model pattern, a corresponding point selection unit that selects, for each image of the object, second feature points corresponding to the first feature points and stores the selected second feature points as corresponding points, and a model pattern correction unit that calculates a statistic of a predetermined physical quantity of the plurality of corresponding points associated with each first feature point and corrects the first feature point on the basis of the statistic.

    Image processing system
    4.
    发明授权

    公开(公告)号:US11989928B2

    公开(公告)日:2024-05-21

    申请号:US16921030

    申请日:2020-07-06

    申请人: FANUC CORPORATION

    发明人: Yuta Namiki

    摘要: An image processing system that detects a picture of an object from an image in which the object is captured includes: a first detector that detects a picture of the object from the image based on a model pattern representing a feature of the picture of the object; a learning device that learns a learning model using the image used for detection by the first detector as input data, and using a detection result by the first detector as training data; and a second detector that detects the picture of the object from the image based on the learning model learned by the learning device.

    Identification code reading apparatus and machine learning device

    公开(公告)号:US10960550B2

    公开(公告)日:2021-03-30

    申请号:US16150430

    申请日:2018-10-03

    申请人: FANUC CORPORATION

    发明人: Yuta Namiki

    摘要: An identification code reading apparatus includes a machine learning device for learning estimation of an ideal image of an identification code with respect to an image of the identification code read by the visual sensor. The machine learning device observes read image data related to an image of the identification code read by the visual sensor as a state variable representing a current state of an environment, and acquires ideal image data related to the ideal image of the identification code as label data. Then, the machine learning device learns the read image data and the ideal image data in association with each other using the observed state variable and the acquired label data.

    DISTANCE IMAGE DISPLAY APPARATUS AND DISTANCE IMAGE DISPLAY METHOD

    公开(公告)号:US20200074650A1

    公开(公告)日:2020-03-05

    申请号:US16533401

    申请日:2019-08-06

    申请人: Fanuc Corporation

    摘要: A distance image display apparatus includes: a distance range specifying unit that allows an operator to specify a partial distance range desired to be displayed within a first distance image in which, based on three-dimensional information of an object acquired by a three-dimensional camera, a color or density corresponding to a distance from the three-dimensional camera of the object positioned at each pixel is assigned to each of the pixels; a distance image generation unit that generates a second distance image in which a color or density of each of the pixels positioned within the specified distance range is reassigned so as to correspond to a distance from the three-dimensional camera; and a display unit that displays the generated second distance image.

    IMAGE PROCESSING DEVICE FOR DISPLAYING OBJECT DETECTED FROM INPUT PICTURE IMAGE

    公开(公告)号:US20170249766A1

    公开(公告)日:2017-08-31

    申请号:US15441934

    申请日:2017-02-24

    申请人: FANUC CORPORATION

    IPC分类号: G06T11/60 G06K9/66 G06K9/62

    摘要: An image processing device including an object detection unit for detecting one or more images of objects from an input picture image, on the basis of a model pattern of the object, and a detection result display unit for graphically superimposing and displaying a detection result. The detection result display unit includes a first frame for displaying the entire input picture image and a second frame for listing and displaying one or more partial picture images each including an image detected. In the input picture image displayed in the first frame, a detection result is superimposed and displayed on all the detected images, and in the partial picture image displayed in the second frame, a detection result of an image corresponding to each partial picture image is superimposed and displayed.

    Imaging device including vision sensor capturing image of workpiece

    公开(公告)号:US11267142B2

    公开(公告)日:2022-03-08

    申请号:US16195860

    申请日:2018-11-20

    申请人: FANUC CORPORATION

    发明人: Yuta Namiki

    IPC分类号: B25J19/02 H04N5/232 H04N5/225

    摘要: An imaging device includes a camera, a robot that moves the camera, and a controller that processes an image. A detection surface defined on a workpiece and a set position serving as an imaginary position of the robot for detecting the workpiece are determined in advance. The camera captures a plurality of first images at a plurality of positions. The controller includes an image conversion unit converting the plurality of the first images into a plurality of second images when captured at the set position. The controller includes a composition unit generating a composite image into which the plurality of the second images are composited, and a composite image processing unit performing at least one of detection and inspection of the workpiece on the detection surface on the basis of the composite image.

    Machine learning device, inspection device and machine learning method

    公开(公告)号:US10891520B2

    公开(公告)日:2021-01-12

    申请号:US16029827

    申请日:2018-07-09

    申请人: FANUC CORPORATION

    发明人: Yuta Namiki

    摘要: A machine learning device that creates training data to be used in machine learning includes: an image input unit that inputs an image which was obtained by capturing an inspection target on which a symbol indicating a defect is marked; and a creation unit that creates the training data based on the inputted image, in which the creation unit: creates training data consisting of a training image which is the image as inputted, and a label that retains a value of OK which signifies not having a defect, in a case of there not being the symbol in the image inputted; and creates training data consisting of a training image generated based on the image inputted, and a label that retains a value of NG signifying having a defect, in a case of there being the symbol in the image inputted.

    Machine learning device, robot system, and machine learning method

    公开(公告)号:US10737385B2

    公开(公告)日:2020-08-11

    申请号:US16117518

    申请日:2018-08-30

    申请人: FANUC CORPORATION

    IPC分类号: B25J13/02 B25J9/16

    摘要: A hand for transferring a transfer target can be selected even when the combination of the transfer target and the hand is not taught. A machine learning device includes: state observation means for acquiring at least a portion of image data obtained by imaging a transfer target as input data; label acquisition means for acquiring information related to grasping means attached to a robot for transferring the transfer target as a label; and learning means for performing supervised learning using a set of the input data acquired by the state observation means and the label acquired by the label acquisition means as teacher data to construct a learning model that outputs information related to the grasping means appropriate for the transferring.