-
公开(公告)号:US20240249239A1
公开(公告)日:2024-07-25
申请号:US18158983
申请日:2023-01-24
Applicant: Walmart Apollo, LLC
Inventor: Ashlin Ghosh , Raghava Balusu , Abhinav Pachauri , Avinash M. Jade , Lingfeng Zhang , Amit Jhunjhunwala , William Craig Robinson, JR. , Benjamin R. Ellison , Srinivas Muktevi , Zhaoliang Duan
IPC: G06Q10/087
CPC classification number: G06Q10/087
Abstract: Systems and methods of creating reference template images for detecting and recognizing products at a product storage facility include an image capture device having a field of view that includes a product storage structure of the product storage facility, and a computing device including a control circuit and being communicatively coupled to the image capture device. The computing device obtains images of the product storage structure captured by the image capture device, analyzes the obtained images to detect individual ones of the products located on the product storage structure. Then, the computing device identifies the individual ones of the products detected in the images and crops each of the individual ones of the identified products from the images to generate cropped images. The computing device then creates a cluster of the cropped images, and selects one of the cropped images as a reference template image of an identified individual product.
-
2.
公开(公告)号:US20240273863A1
公开(公告)日:2024-08-15
申请号:US18168198
申请日:2023-02-13
Applicant: Walmart Apollo, LLC
Inventor: Ashlin Ghosh , Feiyun Zhu , Avinash M. Jade , Lingfeng Zhang , Amit Jhunjhunwala , Raghava Balusu , William Craig Robinson, JR. , Benjamin R. Ellison , Srinivas Muktevi , Zhaoliang Duan
IPC: G06V10/762 , G06Q10/087 , G06V10/74
CPC classification number: G06V10/762 , G06Q10/087 , G06V10/761 , G06V2201/07
Abstract: In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects at a product storage facility including a trained machine learning model; and a control circuit. The control circuit may group a plurality of product identifiers into one or more clusters based on at least one of visual similarity of corresponding images, textual similarity of corresponding associated descriptions, and associated relationships between product identifiers of the plurality of product identifiers; determine clusters having common elements that are at least within a similarity threshold of each other; merge the clusters with the common elements; and generate a mapping dataset used to retrain the trained machine learning model to identify a plurality of objects. The mapping dataset may include a plurality of associations of associated product identifiers to a single object.
-
公开(公告)号:US20240273463A1
公开(公告)日:2024-08-15
申请号:US18168174
申请日:2023-02-13
Applicant: Walmart Apollo, LLC
Inventor: Abhinav Pachauri , Raghava Balusu , Avinash M. Jade , Lingfeng Zhang , Srinivas Muktevi , Amit Jhunjhunwala , Zhaoliang Duan
IPC: G06Q10/087 , G06V10/77 , G06V30/14
CPC classification number: G06Q10/087 , G06V10/7715 , G06V30/1444 , G06V2201/07
Abstract: In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects at a product storage facility including a trained machine learning model; and a control circuit. The control circuit may identify a product identifier associated with an object in a captured image; generate predicted product identifiers associated with the object in the captured image based on text identified from the object in the captured image; aggregate the predicted product identifiers; determine a feature of the objects associated with the aggregated predicted product identifiers; determine one or more confusing product identifiers based on a determination of the aggregated predicted product identifiers being associated with the feature; and update a dataset with at least one of the one or more confusing product identifiers and images associated with the one or more confusing product identifiers.
-
4.
公开(公告)号:US20240257043A1
公开(公告)日:2024-08-01
申请号:US18102999
申请日:2023-01-30
Applicant: Walmart Apollo, LLC
Inventor: Han Zhang , Abhinav Pachauri , Raghava Balusu , Ashlin Ghosh , Avinash M. Jade , Lingfeng Zhang , Srinivas Muktevi , Amit Jhunjhunwala , Zhaoliang Duan
IPC: G06Q10/087 , G06V20/60
CPC classification number: G06Q10/087 , G06V20/60 , G06V2201/07
Abstract: Systems and methods of updating templates for use in recognizing individual products in images captured at a product storage facility include an image capture device that captures one or more images of product storage structure at a product storage facility, a computing device in communication with the image capture device, and an electronic database that stores keyword model templates and feature model templates associated with images of previously recognized individual products detected at the product storage facility. The computing device obtains the keyword and feature model templates associated with a recognized product from the electronic database, extracts the keywords from the products associated with the obtained keyword model templates, identifies products that are similar to the recognized product, and updates the keyword model template for each of the products to include must keywords and negative keywords, facilitating recognition of products in subsequent images captured by the image capture device.
-
5.
公开(公告)号:US20240257380A1
公开(公告)日:2024-08-01
申请号:US18103338
申请日:2023-01-30
Applicant: Walmart Apollo, LLC
Inventor: Wei Wang , Lingfeng Zhang , Han Zhang , Avinash M. Jade , Mingquan Yuan , Zhaoliang Duan , Siddhartha Chakraborty , Benjamin R. Ellison , William Craig Robinson, JR. , Eric W. Rader
CPC classification number: G06T7/70 , B25J5/007 , G06T7/90 , G06V10/16 , G06V10/56 , G06T2207/10024 , G06V2201/07
Abstract: Systems and methods of detecting support members of product storage structures that store products at a product storage facility include an image capture device that captures images of a product storage structure including vertical and horizontal support members. A computing device including a control circuit is configured to: obtain the images of the product storage structure captured by the image capture device, stitch the obtained images together to generate a stitched image that depicts the product storage structure, generate a color distribution map of the stitched image of the product storage structure to detect individual ones of the horizontal and vertical support members of the product storage structure.
-
6.
公开(公告)号:US20240232795A9
公开(公告)日:2024-07-11
申请号:US17971350
申请日:2022-10-21
Applicant: Walmart Apollo, LLC
Inventor: Jing Wang , Han Zhang , Lingfeng Zhang , Zhaoliang Duan , Mingquan Yuan , Wei Wang , Benjamin R. Ellison , Avinash M. Jade , Raghava Balusu , Zhichun Xiao
CPC classification number: G06Q10/087 , G06T7/50 , G06T7/62 , G06V10/25 , G06V10/762 , G06V30/41
Abstract: Systems and methods of analyzing on-shelf price tag labels and products at a product storage facility include an image capture device that captures one or more images of one or more product storage structures at a product storage facility. A computing device communicatively coupled to the image capture device analyzes the images of the product storage structures captured by the image capture device and detects individual price tag labels and individual products located on the product storage structure. Based on the detection of the price tag labels and the products, the computing device also defines separate product storage spaces of the product storage structure, determines which price tag labels are allocated to which of the separate product storage spaces, and associates in a database the price tag labels allocated to the product storage spaces with the products stored in those product storage spaces.
-
7.
公开(公告)号:US20240135315A1
公开(公告)日:2024-04-25
申请号:US17971350
申请日:2022-10-20
Applicant: Walmart Apollo, LLC
Inventor: Jing Wang , Han Zhang , Lingfeng Zhang , Zhaoliang Duan , Mingquan Yuan , Wei Wang , Benjamin R. Ellison , Avinash M. Jade , Raghava Balusu , Zhichun Xiao
CPC classification number: G06Q10/087 , G06T7/50 , G06T7/62 , G06V10/25 , G06V10/762 , G06V30/41
Abstract: Systems and methods of analyzing on-shelf price tag labels and products at a product storage facility include an image capture device that captures one or more images of one or more product storage structures at a product storage facility. A computing device communicatively coupled to the image capture device analyzes the images of the product storage structures captured by the image capture device and detects individual price tag labels and individual products located on the product storage structure. Based on the detection of the price tag labels and the products, the computing device also defines separate product storage spaces of the product storage structure, determines which price tag labels are allocated to which of the separate product storage spaces, and associates in a database the price tag labels allocated to the product storage spaces with the products stored in those product storage spaces.
-
公开(公告)号:US20240119409A1
公开(公告)日:2024-04-11
申请号:US17963903
申请日:2022-10-11
Applicant: Walmart Apollo, LLC
Inventor: Raghava Balusu , Avinash M. Jade , Lingfeng Zhang , Srinivas Muktevi , Amit Jhunjhunwala
CPC classification number: G06Q10/087 , G06F16/55
Abstract: In some embodiments, apparatuses and methods are provided herein useful to updating inventory of products. In some embodiments, there is provided a system for updating inventory of products including a database; at least one image capture device; and a control circuit. The control circuit is configured to: process an image by: detecting units of one or more products in the image; grouping each detected unit into one or more clusters based on at least one of textual similarities, visual similarities, geometrical similarities, or relative spatial distance; detecting a product identifier for each cluster; identifying a product corresponding to the detected product identifier of each cluster; and counting the detected units associated with each cluster. The control circuit is configured to cause an update to the inventory of products in the database based on the counted detected units of each cluster.
-
公开(公告)号:US20240265663A1
公开(公告)日:2024-08-08
申请号:US18106269
申请日:2023-02-06
Applicant: Walmart Apollo, LLC
Inventor: Zhaoliang Duan , Mingquan Yuan , Paul Lewis Lobo , Lingfeng Zhang , Avinash M. Jade , Yutao Tang
CPC classification number: G06V10/16 , B25J5/007 , G06Q10/087 , G06T7/70 , G06V10/25 , G06V30/10 , G06T2207/20132 , G06V2201/07
Abstract: Systems and methods of pairing product labels with products located on a product storage structure of a product storage facility include an image capture device that captures one or more images of the product storage structure and a computing device that obtains images of the product storage structure captured by the image capture device, analyzes the obtained images to detect product labels and products located on the product storage structure, and crops the detected individual products and individual price tag labels from the images to generate cropped images. Then the computing device stitches the cropped price tag label and product images, receives one or more characters extracted from the portions of the stitched images corresponding to the cropped images, and associates, based on known positional coordinates of the products and product labels in the stitched images, the received extracted characters with corresponding cropped images of the products and product labels.
-
公开(公告)号:US20240249505A1
公开(公告)日:2024-07-25
申请号:US18158925
申请日:2023-01-24
Applicant: WALMART APOLLO, LLC
Inventor: Raghava Balusu , Avinash M. Jade , Lingfeng Zhang , William C. Robinson, JR. , Benjamin R. Ellison , Srinivas Muktevi , Amit Jhunjhunwala , Zhaoliang Duan , Siddhartha Chakraborty , Ashlin Ghosh , Mingquan Yuan
IPC: G06V10/774 , G06V10/74 , G06V10/94 , G06V20/50
CPC classification number: G06V10/774 , G06V10/761 , G06V10/945 , G06V20/50 , G06V10/82
Abstract: In some embodiments, apparatuses and methods are provided herein useful to processing captured images of objects at a product storage facility. In some embodiments, there is provided a system for processing captured images of objects including a trained machine learning model and a control circuit. In some embodiments, the trained machine learning model is configured to process unprocessed captured images. In some embodiments, the control circuit is configured to associate each of the processed images into one of a first group, a second group, or a third group; remove at least one processed image associated with the first group from the processed images in accordance with a first processing rule; and output remaining processed images associated with the first group and processed images associated with the second group to be used to retrain the trained machine learning model.
-
-
-
-
-
-
-
-
-