公开(公告)号：US20250104040A1

公开(公告)日：2025-03-27

申请号：US18974543

申请日：2024-12-09

Applicant: Maplebear Inc.

Inventor： Yilin Huang ,  Ganglu Wu ,  Xiao Zhou ,  Youming Luo ,  Shiyuan Yang

IPC: G06Q20/20 ,  G01G19/12 ,  G01G19/40 ,  G06V10/25 ,  G06V10/778 ,  G06V10/80 ,  G06V20/50

Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

公开(公告)号：US20240202475A1

公开(公告)日：2024-06-20

申请号：US18587719

申请日：2024-02-26

Applicant: Maplebear Inc.

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06K7/14 ,  G06Q30/0601 ,  G06T9/00 ,  G06V10/25

CPC classification number: G06K7/1413 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06T9/00 ,  G06V10/25 ,  G06V2201/07

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

公开(公告)号：US20250139687A1

公开(公告)日：2025-05-01

申请号：US18499154

申请日：2023-10-31

Applicant: Maplebear Inc.

Inventor： Ganglu Wu

IPC: G06Q30/0601 ,  G06T7/70 ,  G06V40/20

Abstract: A system may access a first set of images captured by cameras coupled to a shopping cart, wherein each image depicts a user associated with the shopping cart. A system may apply a pose detection model to each of the images to predict a user's pose. A system may apply an action prediction model to the set of images and the predicted poses to predict whether the user performed an action to change the contents of a storage area of the shopping cart. A system may, responsive to predicting that the user performed a change action, apply an item identification model to a second set of images of a storage area of the shopping cart to identify an item associated with the change action. A system may update an item list of the user based on the change action and the identified item.

公开(公告)号：US12205098B2

公开(公告)日：2025-01-21

申请号：US17874956

申请日：2022-07-27

Applicant: Maplebear Inc.

Inventor： Yilin Huang ,  Ganglu Wu ,  Xiao Zhou ,  Youming Luo ,  Shiyuan Yang

IPC: G06V10/25 ,  G01G19/12 ,  G01G19/40 ,  G06Q20/20 ,  G06V10/778 ,  G06V10/80 ,  G06V20/50

Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

公开(公告)号：US20240202694A1

公开(公告)日：2024-06-20

申请号：US18169012

申请日：2023-02-14

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06Q20/20 ,  G06K7/14 ,  G06Q30/0601 ,  G06T3/40 ,  G06V10/25

CPC classification number: G06Q20/208 ,  G06K7/1443 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06T3/40 ,  G06V10/25

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

公开(公告)号：US20240054449A1

公开(公告)日：2024-02-15

申请号：US17936232

申请日：2022-09-28

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Hao Wu ,  Ganglu Wu ,  Xiao Zhou

IPC: G06Q10/08 ,  G06V20/52

CPC classification number: G06Q10/087 ,  G06V20/52

Abstract: An online concierge system may use images received from shopping carts within retailers to determine the availability of items within those retailers. A shopping cart includes externally-facing cameras that automatically capture images of the area around the shopping cart as the shopping cart travels through a retailer. The online concierge system receives these images, which depict displays within the retailers from which a picker or a retailer patron can collect items. The online concierge system determines which items should be depicted in the images and which items are actually depicted in the images. The online concierge system identifies which items should be depicted, but are not depicted, and determines that these items are unavailable (e.g., out of stock) at that retailer. The online concierge system updates an availability database to indicate that these items are unavailable and may notify the retailer that the item is unavailable.

公开(公告)号：US20240013185A1

公开(公告)日：2024-01-11

申请号：US17874987

申请日：2022-07-27

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Lin Gao ,  Yilin Huang ,  Shiyuan Yang ,  Ganglu Wu ,  Yang Wang ,  Wentao Pan

IPC: G06Q20/20 ,  G06V10/80 ,  G01G19/40 ,  G01G19/12

CPC classification number: G06Q20/208 ,  G06V10/803 ,  G01G19/40 ,  G01G19/12

Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

公开(公告)号：US11948044B2

公开(公告)日：2024-04-02

申请号：US18169010

申请日：2023-02-14

Applicant: Maplebear Inc.

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06K7/14 ,  G06Q30/0601 ,  G06T9/00 ,  G06V10/25

CPC classification number: G06K7/1413 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06T9/00 ,  G06V10/25 ,  G06V2201/07

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.

公开(公告)号：US20240013184A1

公开(公告)日：2024-01-11

申请号：US17874956

申请日：2022-07-27

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Yilin Huang ,  Ganglu Wu ,  Xiao Zhou ,  Youming Luo ,  Shiyuan Yang

IPC: G06Q20/20 ,  G06V10/778 ,  G06V10/25 ,  G06V20/50

CPC classification number: G06Q20/208 ,  G06V10/778 ,  G06V10/25 ,  G06V20/50

Abstract: A smart shopping cart includes internally facing cameras and an integrated scale to identify objects that are placed in the cart. To avoid unnecessary processing of images that are irrelevant, and thereby save battery life, the cart uses the scale to detect when an object is placed in the cart. The cart obtains images from a cache and sends those to an object detection machine learning model. The cart captures and sends a load curve as input to the trained model for object detection. Labeled load data and labeled image data are used by a model training system to train the machine learning model to identify an item when it is added to the shopping cart. The shopping cart also uses weight data and the image data from a timeframe associated with the addition of the item to the cart as inputs.

公开(公告)号：US20230267292A1

公开(公告)日：2023-08-24

申请号：US18169010

申请日：2023-02-14

Applicant: Maplebear Inc. (dba Instacart)

Inventor： Ganglu Wu ,  Shiyuan Yang ,  Xiao Zhou ,  Qi Wang ,  Qunwei Liu ,  Youming Luo

IPC: G06K7/14 ,  G06T9/00 ,  G06V10/25 ,  G06Q30/0601

CPC classification number: G06K7/1413 ,  G06T9/00 ,  G06V10/25 ,  G06Q30/0633 ,  G06Q30/0641 ,  G06V2201/07

Abstract: An automated checkout system modifies received images of machine-readable labels to improve the performance of a label detection model that the system uses to decode item identifiers encoded in the machine-readable labels. For example, the automated checkout system may transform subregions of an image of a machine-readable label to adjust for distortions in the image's depiction of the machine-readable label. Similarly, the automated checkout system may identify readable regions within received images of machine-readable labels and apply a label detection model to those readable regions. By modifying received images of machine-readable labels, these techniques improve on existing computer-vision technologies by allowing for the effective decoding of machine-readable labels based on real-world images using relatively clean training data.