公开(公告)号：US20240249506A1

公开(公告)日：2024-07-25

申请号：US18158950

申请日：2023-01-24

Applicant: WALMART APOLLO, LLC

Inventor： Ishan Arora ,  Raghava Balusu ,  Avi Raj ,  Abhinav Pachauri ,  Han Zhang ,  Mingquan Yuan ,  Avinash M. Jade ,  Lingfeng Zhang ,  Srinivas Muktevi ,  Amit Jhunjhunwala ,  Siddhartha Chakraborty

IPC: G06V10/774 ,  G06V10/762 ,  G06V10/764 ,  G06V10/776 ,  G06V10/94 ,  G06V20/70 ,  G06V30/19

CPC classification number: G06V10/774 ,  G06V10/762 ,  G06V10/764 ,  G06V10/776 ,  G06V10/945 ,  G06V20/70 ,  G06V30/19007 ,  G06V10/82

Abstract: In some embodiments, apparatuses and methods are provided herein useful to labeling objects in captured images. In some embodiments, there is provided a system for labeling objects in images captured at a product storage facility including a control circuit and a user interface. The control circuit is configured to select a set of unprocessed images; receive a selected configuration based on data resulting from iteratively processing the set of unprocessed images; cluster each unprocessed image into a corresponding group based on the selected configuration; select a plurality of clustered images from each of the plurality of groups; and output the plurality of clustered images from each group. The user interface is configured to: display each clustered image; and receive a user input labeling one or more objects shown in each clustered image resulting in a labeled dataset used to train a machine learning model.

公开(公告)号：US12288408B2

公开(公告)日：2025-04-29

申请号：US17963802

申请日：2022-10-11

Applicant: Walmart Apollo, LLC

Inventor： Lingfeng Zhang ,  Han Zhang ,  Abhinav Pachauri ,  Amit Jhunjhunwala ,  Ashlin Ghosh ,  Avinash Madhusudanrao Jade ,  Raghava Balusu ,  Srinivas Muktevi ,  Mingquan Yuan ,  Zhaoliang Duan ,  Zhiwei Huang ,  Tianyi Mao

IPC: G06V30/148 ,  G06Q10/08 ,  G06V20/00

Abstract: Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to extract meta data from the packaging the individual products to detect one more keywords and determine the locations of the detected keywords on the packaging, and then utilize this information to predict an identity of the products associated with the packaging.

公开(公告)号：US20240249239A1

公开(公告)日：2024-07-25

申请号：US18158983

申请日：2023-01-24

Applicant: Walmart Apollo, LLC

Inventor： Ashlin Ghosh ,  Raghava Balusu ,  Abhinav Pachauri ,  Avinash M. Jade ,  Lingfeng Zhang ,  Amit Jhunjhunwala ,  William Craig Robinson, JR. ,  Benjamin R. Ellison ,  Srinivas Muktevi ,  Zhaoliang Duan

IPC: G06Q10/087

CPC classification number: G06Q10/087

Abstract: Systems and methods of creating reference template images for detecting and recognizing products at a product storage facility include an image capture device having a field of view that includes a product storage structure of the product storage facility, and a computing device including a control circuit and being communicatively coupled to the image capture device. The computing device obtains images of the product storage structure captured by the image capture device, analyzes the obtained images to detect individual ones of the products located on the product storage structure. Then, the computing device identifies the individual ones of the products detected in the images and crops each of the individual ones of the identified products from the images to generate cropped images. The computing device then creates a cluster of the cropped images, and selects one of the cropped images as a reference template image of an identified individual product.

公开(公告)号：US20240119749A1

公开(公告)日：2024-04-11

申请号：US17963802

申请日：2022-10-11

Applicant: Walmart Apollo, LLC

Inventor： Lingfeng Zhang ,  Han Zhang ,  Abhinav Pachauri ,  Amit Jhunjhunwala ,  Ashlin Ghosh ,  Avinash Madhusudanrao Jade ,  Raghava Balusu ,  Srinivas Muktevi ,  Mingquan Yuan ,  Zhaoliang Duan ,  Zhiwei Huang ,  Tianyi Mao

IPC: G06V30/148 ,  G06Q10/08 ,  G06V20/00

CPC classification number: G06V30/153 ,  G06Q10/08 ,  G06V20/36

Abstract: Systems and methods of monitoring inventory of a product storage facility include an image capture device configured to move about the product storage areas of the product storage facility and capture images of the product storage areas from various angles. A computing device coupled to the image capture device obtains the images of the product storage areas captured by the image capture device and processes the obtained images of the product storage areas to detect individual products captured in the obtained images. Based on detection of the individual products captured in the images, the computing device analyzes each of the obtained images to extract meta data from the packaging the individual products to detect one more keywords and determine the locations of the detected keywords on the packaging, and then utilize this information to predict an identity of the products associated with the packaging.

公开(公告)号：US20240273463A1

公开(公告)日：2024-08-15

申请号：US18168174

申请日：2023-02-13

Applicant: Walmart Apollo, LLC

Inventor： Abhinav Pachauri ,  Raghava Balusu ,  Avinash M. Jade ,  Lingfeng Zhang ,  Srinivas Muktevi ,  Amit Jhunjhunwala ,  Zhaoliang Duan

IPC: G06Q10/087 ,  G06V10/77 ,  G06V30/14

CPC classification number: G06Q10/087 ,  G06V10/7715 ,  G06V30/1444 ,  G06V2201/07

Abstract: In some embodiments, apparatuses and methods are provided herein useful to processing captured images. In some embodiments, there is provided a system for processing captured images of objects at a product storage facility including a trained machine learning model; and a control circuit. The control circuit may identify a product identifier associated with an object in a captured image; generate predicted product identifiers associated with the object in the captured image based on text identified from the object in the captured image; aggregate the predicted product identifiers; determine a feature of the objects associated with the aggregated predicted product identifiers; determine one or more confusing product identifiers based on a determination of the aggregated predicted product identifiers being associated with the feature; and update a dataset with at least one of the one or more confusing product identifiers and images associated with the one or more confusing product identifiers.

公开(公告)号：US20240257043A1

公开(公告)日：2024-08-01

申请号：US18102999

申请日：2023-01-30

Applicant: Walmart Apollo, LLC

Inventor： Han Zhang ,  Abhinav Pachauri ,  Raghava Balusu ,  Ashlin Ghosh ,  Avinash M. Jade ,  Lingfeng Zhang ,  Srinivas Muktevi ,  Amit Jhunjhunwala ,  Zhaoliang Duan

IPC: G06Q10/087 ,  G06V20/60

CPC classification number: G06Q10/087 ,  G06V20/60 ,  G06V2201/07

Abstract: Systems and methods of updating templates for use in recognizing individual products in images captured at a product storage facility include an image capture device that captures one or more images of product storage structure at a product storage facility, a computing device in communication with the image capture device, and an electronic database that stores keyword model templates and feature model templates associated with images of previously recognized individual products detected at the product storage facility. The computing device obtains the keyword and feature model templates associated with a recognized product from the electronic database, extracts the keywords from the products associated with the obtained keyword model templates, identifies products that are similar to the recognized product, and updates the keyword model template for each of the products to include must keywords and negative keywords, facilitating recognition of products in subsequent images captured by the image capture device.