Industrial robot training using mixed reality

    公开(公告)号:US10751877B2

    公开(公告)日:2020-08-25

    申请号:US15902142

    申请日:2018-02-22

    Applicant: ABB Schweiz AG

    Abstract: Unique systems, methods, techniques and apparatuses of a robot training system are disclosed. One exemplary embodiment is an industrial robot training system comprising a mixed reality display device structured to superimpose a virtual scene on a real-world view of a real-world scene including a plurality of physical objects including an industrial robot, a video input device, and a computing device. The computing device is structured to detect physical objects using video output from the video input device, generate virtual objects using the detected physical objects, simulate a virtual robot path, determine one movement of the series of robot movements causes a collision, adjust the virtual robot path so as to avoid the collision between the two virtual objects of the plurality of virtual objects, and program the industrial robot to perform a real robot path using the adjusted virtual robot path.

    Method and apparatus for robot path teaching

    公开(公告)号:US10737396B2

    公开(公告)日:2020-08-11

    申请号:US15926513

    申请日:2018-03-20

    Applicant: ABB Schweiz AG

    Abstract: A dummy tool is used to teach a robot the path the robot will follow to perform work on a workpiece to eliminate the possibility of damaging an actual tool during the training. The dummy tool provides the robot programmer an indication of potential collisions between the tool and the workpiece and other objects in the work cell when path is being taught. The dummy tool can have a detachable input/output device with a graphic user interface (GUI) that can communicate wirelessly with the robot controller. The dummy tool can also have a moveable camera attached thereto to track the relationship of the tool to objects in the work area.

    ROBOT LOCALIZATION IN A WORKSPACE VIA DETECTION OF A DATUM

    公开(公告)号:US20180275632A1

    公开(公告)日:2018-09-27

    申请号:US15467573

    申请日:2017-03-23

    Applicant: ABB Schweiz AG

    CPC classification number: G05B19/4086

    Abstract: Apparatus and method is disclosed for determining position of a robot relative to objects in a workspace which includes the use of a camera, scanner, or other suitable device in conjunction with object recognition. The camera, etc is used to receive information from which a point cloud can be developed about the scene that is viewed by the camera. The point cloud will be appreciated to be in a camera centric frame of reference. Information about a known datum is used and compared to the point cloud through object recognition. For example, a link from a robot could be the identified datum so that, when recognized, the coordinates of the point cloud can be converted to a robot centric frame of reference since the position of the datum would be known relative to the robot.

    3D SEGMENTATION FOR ROBOTIC APPLICATIONS
    18.
    发明申请

    公开(公告)号:US20180056515A1

    公开(公告)日:2018-03-01

    申请号:US15663783

    申请日:2017-07-30

    Applicant: ABB Schweiz AG

    Abstract: A robotic system includes a robot having an associated workspace; a vision sensor constructed to obtain a 3D image of a robot scene including a workpiece located in the workspace; and a control system communicatively coupled to the vision sensor and to the robot. The control system is configured to execute program instructions to filter the image by segmenting the image into a first image portion containing substantially only a region of interest within the robot scene, and a second image portion containing the balance of the robot scene outside the region of interest; and by storing image data associated with the first image portion. The control system is operative to control movement of the robot to perform work, on the workpiece based on the image data associated with the first image portion.

    Calibration article for a 3D vision robotic system

    公开(公告)号:US10661442B2

    公开(公告)日:2020-05-26

    申请号:US15424058

    申请日:2017-02-03

    Applicant: ABB Schweiz AG

    Abstract: A calibration article is provided for calibrating a robot and 3D camera. The calibration article includes side surfaces that are angled inward toward a top surface. The robot and camera are calibrated by capturing positional data of the calibration article relative to the robot and the camera. The captured data is used to generate correlation data between the robot and the camera. The correlation data is used by the controller to align the robot with the camera during operational use of the robot and camera.

Patent Agency Ranking