Methods and system for improved quality inspection

    公开(公告)号:US10733723B2

    公开(公告)日:2020-08-04

    申请号:US15986702

    申请日:2018-05-22

    发明人: Liang Diao Haisong Gu

    IPC分类号: G06T7/00 G06T7/10 G06K9/62

    摘要: A method of performing automated object inspection includes obtaining a plurality of test images. For each of the plurality of test images, the method includes quantitatively determining a respective transformation from a predefined contour of the reference marker in the predefined common layout to a respective anchor contour corresponding to the reference marker as captured in the test image; and applying an inverse of the respective transformation to at least a portion of the test image to obtain a respective regularized version of the test image, such that the reference markers captured in the respective regularized versions of the plurality of test images share an image-independent location and orientation. The method further includes performing independent automated inspection on each of two or more sub-portions of the respective regularized versions of the test images.

    Methods and systems for improved quality inspection

    公开(公告)号:US10706525B2

    公开(公告)日:2020-07-07

    申请号:US15986699

    申请日:2018-05-22

    IPC分类号: G06T7/00 G06K9/62 G06T7/11

    摘要: A method of performing automated object inspection includes obtaining a plurality of test images. For each of the plurality of test images, the method includes performing independent object inspection on each of two or more sub-portions of the test image. The method further includes segmenting the test image into at least a first sub-portion of the test image and a second sub-portion of the test image; performing object inspection on the first sub-portion of the test image using a first subset of information channels of the test image and a first model trained on a first set of training images containing the first component; and performing object inspection on the second sub-portion of the test image using a second subset of information channels of the test image, and a second model trained on a second set of training images containing the second component.

    MACHINE GENERATION OF CONTEXT-FREE GRAMMAR FOR INTENT DEDUCTION

    公开(公告)号:US20190258461A1

    公开(公告)日:2019-08-22

    申请号:US15902911

    申请日:2018-02-22

    发明人: Baojie Li Haisong Gu

    IPC分类号: G06F8/41 G06F17/27

    摘要: A method for generating context-free grammar for intent deduction includes: retrieving, through a compiler, a first template file for a respective actionable intent corresponding to a first task that is to be performed by a machine; parsing the first template file, using the compiler, to identify a first nonterminal variable that refers to a first nonterminal file containing a plurality of first named entity values; and generating, based on a plurality of production rules specified in the first template file, including at least a first production rule that includes the first nonterminal variable, first context-free grammar for the respective actionable intent corresponding to the first task, wherein generating the first context-free grammar for the respective actionable intent corresponding to the first task includes rewriting the first production rule by replacing the first nonterminal variable in the first production rule with the plurality of first named entity values.

    Food preparation system
    4.
    发明授权

    公开(公告)号:US11229311B2

    公开(公告)日:2022-01-25

    申请号:US16230815

    申请日:2018-12-21

    发明人: Liang Diao Haisong Gu

    摘要: A food preparation system and method include: triggering image capturing of a camera to obtain one or more images of a food support platform while the food support platform supports a first food item; performing ingredient recognition for the first food item, including: classifying a feature tensor of a respective image in a general classifier to identify one or more first-level food ingredient categories corresponding to the first food item; and classifying the feature tensor of the respective image in a respective detailed classifier corresponding to each of the one or more first-level food ingredient categories to identify a corresponding second-level food ingredient category corresponding to the first food item, wherein the second-level food ingredient category is a sub-category of said each first-level food ingredient category; and, adjusting one or more heating units for heating the first food item in accordance with the ingredient recognition that has been performed.

    Methods, devices, and systems for improved quality inspection of products

    公开(公告)号:US10580125B2

    公开(公告)日:2020-03-03

    申请号:US16293417

    申请日:2019-03-05

    摘要: A method of quality inspection is performed by a robotic arm that includes a plurality of segments, a camera at an end of the robotic arm, and a plurality of joints connecting two segments of the plurality of segments. The method includes (i) inspecting, via the camera, a surface of a product with the camera positioned at a first position, (ii) based on the inspecting, identifying: (a) an area of interest on the surface of the product, and (b) a relative location of the area of interest on the surface, (iii) positioning, based on the relative location of the area of interest on the surface, the camera at a second position, and (iv) inspecting, via the camera, the area of interest on the surface of the product with the camera positioned at the second position. Inspecting the area of interest includes inspecting a subset of the surface of the product.

    Massage robot using machine vision

    公开(公告)号:US10434658B2

    公开(公告)日:2019-10-08

    申请号:US15826569

    申请日:2017-11-29

    摘要: A massage robot uses machine vision to locate treatment spots for massage. In one approach, a massage robot includes one or more robotic arms, an image sensor and a control system. The image sensor captures images of the user. The control system includes an image processing module and a motion controller. The image processing module processes the images to locate a treatment spot on the user. The motion controller controls the robotic arm to perform a massage procedure on the identified treatment spot.

    METHOD AND SYSTEM FOR CONTROLLING HOME ASSISTANT DEVICES

    公开(公告)号:US20190206412A1

    公开(公告)日:2019-07-04

    申请号:US16230835

    申请日:2018-12-21

    IPC分类号: G10L17/22 G10L17/00

    摘要: System and method for controlling a home assistant device include: receiving an audio input; performing speaker recognition on the audio input; in accordance with a determination that the audio input includes a voice input from a first user that is authorized to control the home assistant device: performing speech-to-text conversion on the audio input to obtain a textual string; and searching for a predefined trigger word for activating the home assistant device in the textual string; and in accordance with a determination that the audio input includes a voice input from the home assistant device: forgoing performance of speech-to-text conversion on the audio input; and forgoing search for the predefined trigger word.

    Methods and systems for improved quality inspection of products using a robot

    公开(公告)号:US10269108B2

    公开(公告)日:2019-04-23

    申请号:US15694115

    申请日:2017-09-01

    摘要: A method of improved quality inspection includes (i) receiving a first command to capture a first image of a surface of a product, (ii) positioning, by actuating a plurality of rotatable joints, a camera at a first position that is substantially adjacent to the surface of the product, and capturing the first image of the surface of the product. The method further includes, after capturing the first image: (i) processing the first image to identify a defect in the first image and a relative location of the defect in the first image, and (ii) determining a second position of the camera in accordance with the first position of the camera and the relative location of the defect in the first image, and (iii) repositioning, by actuating the plurality of rotatable joints, the camera from the first position to the second position. The method further includes capturing the second image.

    Customizable Wake-up Voice Commands
    9.
    发明申请

    公开(公告)号:US20190027138A1

    公开(公告)日:2019-01-24

    申请号:US15658357

    申请日:2017-07-24

    摘要: A voice command module is used to execute voice commands in a residential environment that contains a plurality of home devices. The voice command module includes a speech recognition module and command logic. The speech recognition module receives utterances from users and converts the utterances to commands from a vocabulary of predetermined commands, which includes a customization command to define a new wake-up utterance as corresponding to a wake-up command. The command logic executes the commands. When the customization command is received, the command logic changes the voice command module so that it now executes the wake-up command upon detection of the new wake-up utterance.

    Method and system for controlling home assistant devices

    公开(公告)号:US10796702B2

    公开(公告)日:2020-10-06

    申请号:US16230835

    申请日:2018-12-21

    摘要: System and method for controlling a home assistant device include: receiving an audio input; performing speaker recognition on the audio input; in accordance with a determination that the audio input includes a voice input from a first user that is authorized to control the home assistant device: performing speech-to-text conversion on the audio input to obtain a textual string; and searching for a predefined trigger word for activating the home assistant device in the textual string; and in accordance with a determination that the audio input includes a voice input from the home assistant device: forgoing performance of speech-to-text conversion on the audio input; and forgoing search for the predefined trigger word.