公开(公告)号：US20240220958A1

公开(公告)日：2024-07-04

申请号：US18609275

申请日：2024-03-19

Applicant: Walmart Apollo, LLC

Inventor： Zhichun Xiao ,  Lingfeng Zhang ,  Jon Hammer ,  Joseph Duffy ,  Yao Liu ,  Sicong Fang ,  Xiang Yao ,  Pingyuan Wang ,  Yu Tao ,  Tianyi Mao ,  Yutao Tang ,  Feiyun Zhu ,  Han Zhang ,  Chunmei Wang ,  Pingjian Yu ,  Muzzammil Afroz ,  Haining Liu

IPC: G06Q20/20 ,  G06N3/08

CPC classification number: G06Q20/208 ,  G06N3/08

Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.

公开(公告)号：US20230058632A1

公开(公告)日：2023-02-23

申请号：US17404329

申请日：2021-08-17

Applicant: Walmart Apollo, LLC

Inventor： Anbu Aaron Ajay Ullas ,  Ehsan Nazarian ,  Haining Liu ,  Pingjian Yu ,  Ketan Mudda ,  Sara Amin ,  Zekun Li

IPC: G06N3/08 ,  G06N3/04

Abstract: Particular data is selected from a members-based dataset to provide a resultant training corpus. A first neural network receives that training corpus and generates a first trained machine learning model. That first trained machine learning model can predict member engagement score values for each of a plurality of candidate variable values. The aforementioned training corpus can also be provided to a second neural network to generate a second trained machine learning model. That second trained machine learning model can then be used to predict member engagement score values for each of a plurality of initial-state variable values. The aforementioned member engagement score values for each of the plurality of candidate variable values can then be consolidated with the member engagement score values for each of a plurality of initial-state variable values to thereby provide resultant consolidated member engagement score values.

公开(公告)号：US20220036568A1

公开(公告)日：2022-02-03

申请号：US17389154

申请日：2021-07-29

Applicant: Walmart Apollo, LLC

Inventor： Haining Liu ,  Ryan B. Reagan ,  Zhichun Xiao

IPC: G06T7/246 ,  G06K9/00 ,  G06T7/90 ,  H04N7/18 ,  G06Q30/02 ,  G06Q10/06 ,  G06F16/583

Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting and tracking humans. In some embodiments, there is provided a system for detecting and tracking humans from one image to another image including: a camera; a control circuit configure to: receive a first image; detect a plurality of key body joints of a first human captured on the first image; determine segmentations of the plurality of key body joints to determine one or more body parts of the first human; determine a color distribution map of aggregate pixels associated with each body part of the first human on the first image; and cause a database to store the color distribution map; and a database comprising one or more color distribution map sets each associated with a detected human in a captured image of the camera.

公开(公告)号：US20210019725A1

公开(公告)日：2021-01-21

申请号：US16931076

申请日：2020-07-16

Applicant: Walmart Apollo, LLC

Inventor： Zhichun Xiao ,  Lingfeng Zhang ,  Jon Hammer ,  Joseph Duffy ,  Yao Liu ,  Sicong Fang ,  Xiang Yao ,  Pingyuan Wang ,  Yu Tao ,  Tianyi Mao ,  Yutao Tang ,  Feiyun Zhu ,  Han Zhang ,  Chunmei Wang ,  Pingjian Yu ,  Muzzammil Afroz ,  Haining Liu

IPC: G06Q20/20 ,  G06N3/08

Abstract: A transaction record is created showing a purchase transaction of a customer. A CV profile showing a list of items in the transaction obtained from images is also obtained. The items in the transaction record are compared to items on the list. When there is a discrepancy, an action to take is determined.

公开(公告)号：US11620839B2

公开(公告)日：2023-04-04

申请号：US17097734

申请日：2020-11-13

Applicant: Walmart Apollo, LLC

Inventor： Haining Liu ,  Feiyun Zhu ,  Jon Hammer ,  Ryan B. Reagan ,  Pingjian Yu ,  Zhichun Xiao ,  Yuqi Zhang ,  Yao Liu

IPC: G06K9/62 ,  G06V20/62 ,  G06V10/56 ,  G06V30/10

Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.

公开(公告)号：US11983216B2

公开(公告)日：2024-05-14

申请号：US18211913

申请日：2023-06-20

Applicant: Walmart Apollo, LLC

Inventor： Haining Liu ,  Feiyun Zhu ,  Ryan B. Reagan ,  Zhichun Xiao

IPC: G06K9/00 ,  G06F16/55 ,  G06F18/214 ,  G06N20/00 ,  G06T3/10 ,  G06T7/136 ,  G06V10/26 ,  G06V10/764 ,  G06V10/774 ,  G06V10/24

CPC classification number: G06F16/55 ,  G06F18/2148 ,  G06N20/00 ,  G06T3/10 ,  G06T7/136 ,  G06V10/26 ,  G06V10/764 ,  G06V10/774 ,  G06V10/247

Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.

公开(公告)号：US20230334088A1

公开(公告)日：2023-10-19

申请号：US18211913

申请日：2023-06-20

Applicant: Walmart Apollo, LLC

Inventor： Haining Liu ,  Feiyun Zhu ,  Ryan B. Reagan ,  Zhichun Xiao

IPC: G06F16/55 ,  G06T7/136 ,  G06N20/00 ,  G06T3/00 ,  G06F18/214 ,  G06V10/764 ,  G06V10/774 ,  G06V10/26

CPC classification number: G06F16/55 ,  G06T7/136 ,  G06N20/00 ,  G06T3/0056 ,  G06F18/2148 ,  G06V10/764 ,  G06V10/774 ,  G06V10/26 ,  G06V10/247

Abstract: In some embodiments, apparatuses and methods are provided herein useful to automatically annotating images. In some embodiments, a system for automatically annotating images comprises a database, wherein the database is configured to store images and annotations for the images and a control circuit, wherein the control circuit is communicatively coupled to the database, and wherein the control circuit is configured to retrieve, from the database, an image, generate, based on the image, a collection of augmented images, generate segmentation maps for each image in the collection of augmented images, wherein each of the segmentation maps include segments, select, based on a threshold, ones of the segments above a threshold, merge the ones of the segments above the threshold to create a segmented image, and generate, for each segment of the segmented image, classifications, wherein an annotation for the image includes the segmented images and the classifications.

公开(公告)号：US20230222825A1

公开(公告)日：2023-07-13

申请号：US18118658

申请日：2023-03-07

Applicant: Walmart Apollo, LLC

Inventor： Haining Liu ,  Feiyun Zhu ,  Jon Hammer ,  Ryan B. Reagan ,  Pingjian Yu ,  Zhichun Xiao ,  Yuqi Zhang ,  Yao Liu

IPC: G06V30/18 ,  G06V20/62 ,  G06V10/56 ,  G06V30/10

CPC classification number: G06V30/18105 ,  G06V20/62 ,  G06V10/56 ,  G06F18/22 ,  G06V30/10

Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting text in images. In some embodiments, a system for detecting text in images comprises a database configured to store images and a control circuit configured to retrieve an image, generate, based on the image, a collection of augmented images, detect characters in each of the augmented images, generate bounding boxes for the characters in each of augmented images, recognize the characters in each of the augmented images, select, based on the recognition of the characters in each of the augmented images, candidate characters, wherein the candidate characters are selected based on consistency of the recognition of the characters in each of the augmented images, detect, for the image, a color associated with the characters, and store, in the database, the image, the candidate characters, and the color associated with the characters.

公开(公告)号：US12094130B2

公开(公告)日：2024-09-17

申请号：US17389154

申请日：2021-07-29

Applicant: Walmart Apollo, LLC

Inventor： Haining Liu ,  Ryan B. Reagan ,  Zhichun Xiao

IPC: G06T7/246 ,  G06F16/583 ,  G06Q10/0631 ,  G06Q30/0201 ,  G06T7/90 ,  G06V40/10 ,  H04N7/18

CPC classification number: G06T7/248 ,  G06F16/5838 ,  G06Q10/06311 ,  G06Q30/0201 ,  G06T7/90 ,  G06V40/103 ,  H04N7/183 ,  G06T2207/30196 ,  G06T2207/30232 ,  G06T2207/30242

Abstract: In some embodiments, apparatuses and methods are provided herein useful to detecting and tracking humans. In some embodiments, there is provided a system for detecting and tracking humans from one image to another image including: a camera; a control circuit configure to: receive a first image; detect a plurality of key body joints of a first human captured on the first image; determine segmentations of the plurality of key body joints to determine one or more body parts of the first human; determine a color distribution map of aggregate pixels associated with each body part of the first human on the first image; and cause a database to store the color distribution map; and a database comprising one or more color distribution map sets each associated with a detected human in a captured image of the camera.

公开(公告)号：US12002080B2

公开(公告)日：2024-06-04

申请号：US17775414

申请日：2020-11-12

Applicant: Walmart Apollo, LLC

Inventor： Zhichun Xiao ,  Lingfeng Zhang ,  Yao Liu ,  Jon Hammer ,  Yutao Tang ,  Sicong Fang ,  Haining Liu ,  Yijing Sun ,  Mingquan Yuan ,  Shouyi Zhang ,  Pingjian Yu ,  Ryan B. Reagan ,  Tianyi Mao ,  Shangeetha Ravichandran Susseelaa ,  Zhenyu Wang ,  Feiyun Zhu

IPC: G06Q30/0601 ,  G06Q20/20

CPC classification number: G06Q30/0629 ,  G06Q20/209 ,  G06Q30/0633

Abstract: There are provided systems and methods relating to checking and confirming merchandise purchased at shopping facilities. In one form, the system includes: a shopping cart containing merchandise items to be purchased; a sales transaction database; a point-of-sales system that creates transaction records identified by transaction identifiers; and a mobile device used by an employee that includes a sensor to scan a paper or digital receipt to obtain the transaction identifier and a camera to capture images of the items in the shopping cart. The system also includes a control circuit that receives the transaction identifier, accesses the database using the identifier to determine the purchased items; analyzes the images of the merchandise items in the shopping cart and creates a computer vision receipt listing detected items; compares the purchased items with the detected items; and takes an action if there is a discrepancy.