Automatic labeling of products via expedited checkout system

    公开(公告)号:US11544506B2

    公开(公告)日:2023-01-03

    申请号:US17191654

    申请日:2021-03-03

    Abstract: A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.

    Operating System for Brick and Mortar Retail

    公开(公告)号:US20210398060A1

    公开(公告)日:2021-12-23

    申请号:US17023313

    申请日:2020-09-16

    Abstract: An operating system for a retail store applies AI to detect, from images of store shelves, out of stock and low stock conditions of shelved items based on camera images. The system takes in a set of input states of the store and recommends corrective action to optimize a set of objectives for the store. These objectives could be to optimize Operating Profit. The input states could be current shelf conditions inferred by shelf cameras. The actions could be ordering of restocking, changes in future inventory orders, the number of shelf facings per product, price to charge per product, or labor allocations and scheduling for store staff. Through repeated reiterations over an extended period, the system compares actual results with predicted results and retrains itself to minimize the difference and recommend smarter over time to “play the game of retail” better and better each day and in each store.

    Product onboarding machine
    3.
    发明授权

    公开(公告)号:US11080559B2

    公开(公告)日:2021-08-03

    申请号:US16575298

    申请日:2019-09-18

    Abstract: A method for generating training examples for a product recognition model is disclosed. The method includes capturing images of a product using an array of cameras. A product identifier for the product is associated with each of the images. A bounding box for the product is identified in each of the images. The bounding boxes are smoothed temporally. A segmentation mask for the product is identified in each bounding box. The segmentation masks are optimized to generate an optimized set of segmentation masks. A machine learning model is trained using the optimized set of segmentation masks to recognize an outline of the product. The machine learning model is run to generate a set of further-optimized segmentation masks. The bounding box and further-optimized segmentation masks from each image are stored in a master training set with its product identifier as a training example to be used to train a product recognition model.

    AUTOMATIC LABELING OF PRODUCTS VIA EXPEDITED CHECKOUT SYSTEM

    公开(公告)号:US20210192289A1

    公开(公告)日:2021-06-24

    申请号:US17191654

    申请日:2021-03-03

    Abstract: A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.

    On-shelf image based out-of-stock detection

    公开(公告)号:US11763254B2

    公开(公告)日:2023-09-19

    申请号:US17173028

    申请日:2021-02-10

    Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The system captures images of a shelf and determines the position product labels thereon. For each product label, a bounding box is generated based on the position of each product label on the shelf. The system then identifies a product for each product label based on information within each product label and, for each product label, stores a product identified for each bounding box. Accordingly, the system performs an out-of-stock detection process that includes capturing additional image data of the shelf periodically that includes each bounding box, providing a portion of the additional image data for each bounding box to a model trained to determine whether the bounding box contains products, sending a notification for a product determined to be out of stock to a store client device based on output from the model.

    On-Shelf Image Based Barcode Reader for Inventory Management System

    公开(公告)号:US20220284383A1

    公开(公告)日:2022-09-08

    申请号:US17685000

    申请日:2022-03-02

    Abstract: An inventory visibility management system utilizes fixed or motorized cameras to scan inventory bearing shelves in a backroom or warehouse of a store, as opposed to store shelves where merchandise is available for purchase, for inventory frequently to keep the system up to date on what boxes of inventory are on the shelf, what is in those boxes and where those boxes are on the shelf. The system may identify a bounding polygon around an identifier corresponding to the product and apply the bounding polygon to a machine-learned model, which may generate a high-resolution crop of the identifier as output. The system registers the identifier to the first bounding polygon and to a location associated with cameras that captured the plurality of low-resolution images. Upon receiving a request from a client device, the system may provide the location associated with the one or more cameras to the client device.

    ON-SHELF IMAGE BASED OUT-OF-STOCK DETECTION

    公开(公告)号:US20210216954A1

    公开(公告)日:2021-07-15

    申请号:US17173028

    申请日:2021-02-10

    Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The system captures images of a shelf and determines the position product labels thereon. For each product label, a bounding box is generated based on the position of each product label on the shelf. The system then identifies a product for each product label based on information within each product label and, for each product label, stores a product identified for each bounding box. Accordingly, the system performs an out-of-stock detection process that includes capturing additional image data of the shelf periodically that includes each bounding box, providing a portion of the additional image data for each bounding box to a model trained to determine whether the bounding box contains products, sending a notification for a product determined to be out of stock to a store client device based on output from the model.

    OUT-OF-STOCK DETECTION BASED ON IMAGES
    8.
    发明申请

    公开(公告)号:US20180218494A1

    公开(公告)日:2018-08-02

    申请号:US15885744

    申请日:2018-01-31

    Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The out-of-stock detection system collects image data from shopper client devices that are attached to shopping carts or hand-held baskets being used by shoppers in the store. The shopper client devices include one or more cameras that capture images of the store as the shoppers travel through the store. The out-of-stock detection system detects products in the image data and determines whether any products are out of stock based on the products that are detected. For example, the out-of-stock detection system may determine which products should be detected in the image data and identify as out of stocks the products that are not actually detected in the image data. Upon identifying an item as out-of-stock, the out-of-stock detection system notifies the store management that the item is out of stock.

    ON-SHELF IMAGE BASED OUT-OF-STOCK DETECTION

    公开(公告)号:US20250156807A1

    公开(公告)日:2025-05-15

    申请号:US19024986

    申请日:2025-01-16

    Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The system captures images of a shelf and determines the position product labels thereon. For each product label, a bounding box is generated based on the position of each product label on the shelf. The system then identifies a product for each product label based on information within each product label and, for each product label, stores a product identified for each bounding box. Accordingly, the system performs an out-of-stock detection process that includes capturing additional image data of the shelf periodically that includes each bounding box, providing a portion of the additional image data for each bounding box to a model trained to determine whether the bounding box contains products, sending a notification for a product determined to be out of stock to a store client device based on output from the model.

Patent Agency Ranking