-
公开(公告)号:US11544506B2
公开(公告)日:2023-01-03
申请号:US17191654
申请日:2021-03-03
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard , Adriano Quiroga Garafulic
Abstract: A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.
-
公开(公告)号:US20210398060A1
公开(公告)日:2021-12-23
申请号:US17023313
申请日:2020-09-16
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard
Abstract: An operating system for a retail store applies AI to detect, from images of store shelves, out of stock and low stock conditions of shelved items based on camera images. The system takes in a set of input states of the store and recommends corrective action to optimize a set of objectives for the store. These objectives could be to optimize Operating Profit. The input states could be current shelf conditions inferred by shelf cameras. The actions could be ordering of restocking, changes in future inventory orders, the number of shelf facings per product, price to charge per product, or labor allocations and scheduling for store staff. Through repeated reiterations over an extended period, the system compares actual results with predicted results and retrains itself to minimize the difference and recommend smarter over time to “play the game of retail” better and better each day and in each store.
-
公开(公告)号:US11080559B2
公开(公告)日:2021-08-03
申请号:US16575298
申请日:2019-09-18
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard
Abstract: A method for generating training examples for a product recognition model is disclosed. The method includes capturing images of a product using an array of cameras. A product identifier for the product is associated with each of the images. A bounding box for the product is identified in each of the images. The bounding boxes are smoothed temporally. A segmentation mask for the product is identified in each bounding box. The segmentation masks are optimized to generate an optimized set of segmentation masks. A machine learning model is trained using the optimized set of segmentation masks to recognize an outline of the product. The machine learning model is run to generate a set of further-optimized segmentation masks. The bounding box and further-optimized segmentation masks from each image are stored in a master training set with its product identifier as a training example to be used to train a product recognition model.
-
公开(公告)号:US20210192289A1
公开(公告)日:2021-06-24
申请号:US17191654
申请日:2021-03-03
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard , Adriano Quiroga Garafulic
Abstract: A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.
-
公开(公告)号:US11763254B2
公开(公告)日:2023-09-19
申请号:US17173028
申请日:2021-02-10
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard
IPC: G06Q10/08 , G06T11/20 , G06V30/146 , G06V30/10 , G06Q10/087 , H04N23/54 , H04N23/698
CPC classification number: G06Q10/087 , G06T11/203 , G06V30/1473 , H04N23/54 , H04N23/698 , G06T2210/12 , G06V30/10
Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The system captures images of a shelf and determines the position product labels thereon. For each product label, a bounding box is generated based on the position of each product label on the shelf. The system then identifies a product for each product label based on information within each product label and, for each product label, stores a product identified for each bounding box. Accordingly, the system performs an out-of-stock detection process that includes capturing additional image data of the shelf periodically that includes each bounding box, providing a portion of the additional image data for each bounding box to a model trained to determine whether the bounding box contains products, sending a notification for a product determined to be out of stock to a store client device based on output from the model.
-
公开(公告)号:US20220284383A1
公开(公告)日:2022-09-08
申请号:US17685000
申请日:2022-03-02
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard
Abstract: An inventory visibility management system utilizes fixed or motorized cameras to scan inventory bearing shelves in a backroom or warehouse of a store, as opposed to store shelves where merchandise is available for purchase, for inventory frequently to keep the system up to date on what boxes of inventory are on the shelf, what is in those boxes and where those boxes are on the shelf. The system may identify a bounding polygon around an identifier corresponding to the product and apply the bounding polygon to a machine-learned model, which may generate a high-resolution crop of the identifier as output. The system registers the identifier to the first bounding polygon and to a location associated with cameras that captured the plurality of low-resolution images. Upon receiving a request from a client device, the system may provide the location associated with the one or more cameras to the client device.
-
公开(公告)号:US20210216954A1
公开(公告)日:2021-07-15
申请号:US17173028
申请日:2021-02-10
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard
Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The system captures images of a shelf and determines the position product labels thereon. For each product label, a bounding box is generated based on the position of each product label on the shelf. The system then identifies a product for each product label based on information within each product label and, for each product label, stores a product identified for each bounding box. Accordingly, the system performs an out-of-stock detection process that includes capturing additional image data of the shelf periodically that includes each bounding box, providing a portion of the additional image data for each bounding box to a model trained to determine whether the bounding box contains products, sending a notification for a product determined to be out of stock to a store client device based on output from the model.
-
公开(公告)号:US20180218494A1
公开(公告)日:2018-08-02
申请号:US15885744
申请日:2018-01-31
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard , Adriano Quiroga Garafulic
CPC classification number: G06T7/0008 , G06K9/00664 , G06K9/183 , G06K9/3258 , G06K9/6267 , G06K2209/01 , G06N20/00 , G06Q10/087 , G06T2207/20081 , G06T2207/30108 , G06T2210/12
Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The out-of-stock detection system collects image data from shopper client devices that are attached to shopping carts or hand-held baskets being used by shoppers in the store. The shopper client devices include one or more cameras that capture images of the store as the shoppers travel through the store. The out-of-stock detection system detects products in the image data and determines whether any products are out of stock based on the products that are detected. For example, the out-of-stock detection system may determine which products should be detected in the image data and identify as out of stocks the products that are not actually detected in the image data. Upon identifying an item as out-of-stock, the out-of-stock detection system notifies the store management that the item is out of stock.
-
公开(公告)号:US20180218351A1
公开(公告)日:2018-08-02
申请号:US15885746
申请日:2018-01-31
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard , Adriano Quiroga Garafulic
IPC: G06Q20/20 , G06Q30/06 , B62B5/00 , G01G19/414 , H04N5/225
CPC classification number: G06Q20/208 , B62B3/14 , B62B5/0096 , B62B2203/50 , G01G19/4144 , G06N3/0445 , G06N3/0454 , G06N3/08 , G06Q30/0633 , G07G1/0072 , G07G1/0081 , H04N5/2253 , H04N7/181
Abstract: A mobile shopping unit of an automated checkout system includes one or more sensors within a shopping cart that detect when a change to the contents of the shopping cart has occurred. If the mobile shopping unit detects a change, the mobile shopping unit captures image data of the contents of the shopping cart using one or more cameras mounted to the shopping cart. The mobile shopping unit uses the image data to identify the item added to or removed from the cart. The mobile shopping unit applies a machine-learned item identification model to the image data received from the cameras to determine an item identifier for the added or removed item. When the mobile shopping unit determines the identifier for the added or removed item, the mobile shopping unit updates a contents list associated with the customer that stores the items currently collected by the customer.
-
公开(公告)号:US20250156807A1
公开(公告)日:2025-05-15
申请号:US19024986
申请日:2025-01-16
Applicant: Focal Systems, Inc.
Inventor: Francois Chaubard
IPC: G06Q10/087 , G06T11/20 , G06V30/10 , G06V30/146 , H04N23/54 , H04N23/698
Abstract: An out-of-stock detection system notifies store management that a product is out of stock. The system captures images of a shelf and determines the position product labels thereon. For each product label, a bounding box is generated based on the position of each product label on the shelf. The system then identifies a product for each product label based on information within each product label and, for each product label, stores a product identified for each bounding box. Accordingly, the system performs an out-of-stock detection process that includes capturing additional image data of the shelf periodically that includes each bounding box, providing a portion of the additional image data for each bounding box to a model trained to determine whether the bounding box contains products, sending a notification for a product determined to be out of stock to a store client device based on output from the model.
-
-
-
-
-
-
-
-
-