Control device, picking system, distribution system, program, control method and production method

    公开(公告)号:US11679503B2

    公开(公告)日:2023-06-20

    申请号:US17375084

    申请日:2021-07-14

    申请人: MUJIN, INC.

    发明人: Rosen Diankov

    IPC分类号: B25J9/16 B65G47/90

    摘要: An trajectory information generating unit for generating trajectory information defining a trajectory for which a picking hand picks a work at a first position and arranges the work at a second position, an execution control unit for operating a picking apparatus based on trajectory information generated by the trajectory information generating unit, and an execution time estimating unit for estimating a period of time from when the picking apparatus receives an instruction for starting an operation on a work to a time when the operation of the picking apparatus on the work is ended are included. The trajectory information generating unit may adjust an amount of calculation based on an estimation result of the execution time estimating unit.

    Robotic system with enhanced scanning mechanism

    公开(公告)号:US11638993B2

    公开(公告)日:2023-05-02

    申请号:US17157975

    申请日:2021-01-25

    申请人: MUJIN, Inc.

    发明人: Rosen Diankov

    摘要: A method for operating a robotic system including determining an initial pose of a target object based on imaging data; calculating a confidence measure associated with an accuracy of the initial pose; and determining that the confidence measure fails to satisfy a sufficiency condition; and deriving a motion plan accordingly for scanning an object identifier while transferring the target object from a start location to a task location.

    Control device, picking system, distribution system, program, control method and production method

    公开(公告)号:US11097421B2

    公开(公告)日:2021-08-24

    申请号:US16592757

    申请日:2019-10-03

    申请人: MUJIN, Inc.

    发明人: Rosen Diankov

    IPC分类号: B25J9/16 B65G47/90

    摘要: An trajectory information generating unit for generating trajectory information defining a trajectory for which a picking hand picks a work at a first position and arranges the work at a second position, an execution control unit for operating a picking apparatus based on trajectory information generated by the trajectory information generating unit, and an execution time estimating unit for estimating a period of time from when the picking apparatus receives an instruction for starting an operation on a work to a time when the operation of the picking apparatus on the work is ended are included. The trajectory information generating unit may adjust an amount of calculation based on an estimation result of the execution time estimating unit.

    Control device, picking system, distribution system, program, control method and production method

    公开(公告)号:US11007643B2

    公开(公告)日:2021-05-18

    申请号:US16592755

    申请日:2019-10-03

    申请人: MUJIN, Inc.

    发明人: Rosen Diankov

    IPC分类号: B25J9/16 B65G47/90

    摘要: A trajectory information generating unit is included, the trajectory information generating unit generating trajectory information that defines a trajectory for which a picking hand picks one of one or more works stored in one supply container included in one or more supply containers and arranges the work in one arrangement container included in one or more arrangement containers. After performing a process of generating trajectory information representing a first work included in the one or more works and before a movement of the first work is completed, the trajectory information generating unit may generate trajectory information representing a second work included in the one or more work and different from the first work by using an operation result in the process of generating the trajectory information regarding the first work.

    Robotic system with a robot arm suction control mechanism and method of operation thereof

    公开(公告)号:US10576630B1

    公开(公告)日:2020-03-03

    申请号:US16428333

    申请日:2019-05-31

    申请人: Mujin, Inc.

    摘要: A system and method of operation of a robotic system including: receiving a sensor reading associated with a target object; generating a base plan for performing a task on the target object, wherein generating the base plan includes determining a grip point and one or more grip patterns associated with the grip point for gripping the target object based on a location of the grip point relative to a designated area, a task location, and another target object; implementing the base plan for performing the task by operating an actuation unit and one or more suction grippers according to a grip pattern rank, to generate an established grip on the target object, wherein the established grip is at a grip pattern location associated with the grip patterns; measuring the established grip; comparing the established grip to a force threshold; and re-gripping the target object based on the established grip falling below the force threshold.

    Method and control system for verifying and updating camera calibration for robot control

    公开(公告)号:US10562186B1

    公开(公告)日:2020-02-18

    申请号:US16525004

    申请日:2019-07-29

    申请人: MUJIN, INC.

    IPC分类号: B25J9/16 G06T7/80

    摘要: A robot control system and a method for camera calibration verification is presented. The robot control system is configured to perform a first camera calibration, and to control a robot arm to move a verification symbol to a reference location. The robot control system further receives, from a camera, a reference image of the verification symbol, and determines a reference image coordinate for the verification symbol. The robot control system further controls the robot arm to move the verification symbol to the reference location again during an idle period, receives an additional image of the verification symbol, and determines a verification image coordinate. The robot control system determines a deviation parameter value based the reference image coordinate and the verification image coordinate, and whether the deviation parameter value exceeds a defined threshold, and performs a second camera calibration if the threshold is exceeded.

    Method and control system for verifying and updating camera calibration for robot control

    公开(公告)号:US11883964B2

    公开(公告)日:2024-01-30

    申请号:US18164295

    申请日:2023-02-03

    申请人: MUJIN, INC.

    IPC分类号: B25J9/16 G06T7/80

    摘要: A computing system and a method for calibration verification is presented. The computing system is configured to perform a first calibration operation, and to control a robot arm to move a verification symbol to a reference location. The robot control system further receives, from a camera, a reference image of the verification symbol, and determines a reference image coordinate for the verification symbol. The robot control system further controls the robot arm to move the verification symbol to the reference location again during an idle period, receives an additional image of the verification symbol, and determines a verification image coordinate. The robot control system determines a deviation parameter value based the reference image coordinate and the verification image coordinate, and whether the deviation parameter value exceeds a defined threshold, and performs a second calibration operation if the threshold is exceeded.

    Method and control system for updating camera calibration for robot control

    公开(公告)号:US11571816B2

    公开(公告)日:2023-02-07

    申请号:US16749365

    申请日:2020-01-22

    申请人: MUJIN, INC.

    IPC分类号: B25J13/08 B25J9/16 G06T7/80

    摘要: A robot control system and a method for updating camera calibration is presented. The method comprises the robot control system performing a first camera calibration to determine camera calibration information, and outputting a first movement command based on the camera calibration information for a robot operation. The method further comprises outputting, after the first camera calibration, a second movement command to move a calibration pattern within a camera field of view, receiving one or more calibration images, and adding the one or more calibration images to a captured image set. The method further comprises performing a second camera calibration based on calibration images in the captured image set to determine updated camera calibration information, determining whether a deviation between the camera calibration information and the updated camera calibration information exceeds a defined threshold, and outputting a notification signal if the deviation exceeds the defined threshold.

    Control device, picking system, distribution system, program, control method and production method

    公开(公告)号:US11090808B2

    公开(公告)日:2021-08-17

    申请号:US16592742

    申请日:2019-10-03

    申请人: MUJIN, Inc.

    发明人: Rosen Diankov

    IPC分类号: B25J9/16 B65G47/90

    摘要: Automatic calculation of a trajectory by taking the interference with an obstacle into account may be performed by calculating trajectory information representing a trajectory on which (i) the picking hand picks, on the first position, the work with a posture associated with the first position included in the first combination; and (ii) the picking hand arranges, on the second position, the work with a posture associated with the second position included in the first combination, and determining whether an interference is present or absent on the trajectory represented by the trajectory information calculated in the calculating a trajectory.