-
公开(公告)号:US20200285886A1
公开(公告)日:2020-09-10
申请号:US16880911
申请日:2020-05-21
Applicant: Nant Holdings IP, LLC
Inventor: Mustafa Jaber , Jeremi M. Sudol , Bing Song
Abstract: A system capable of determining which recognition algorithms should be applied to regions of interest within digital representations is presented. A preprocessing module utilizes one or more feature identification algorithms to determine regions of interest based on feature density. The preprocessing modules leverages the feature density signature for each region to determine which of a plurality of diverse recognition modules should operate on the region of interest. A specific embodiment that focuses on structured documents is also presented. Further, the disclosed approach can be enhanced by addition of an object classifier that classifies types of objects found in the regions of interest.
-
公开(公告)号:US20200184696A1
公开(公告)日:2020-06-11
申请号:US16792105
申请日:2020-02-14
Applicant: Nant Holdings IP, LLC
Inventor: Bing Song
Abstract: Techniques are provided that include obtaining a vocabulary including a set of content indices that reference corresponding cells in a descriptor space based on an input set of descriptors. A plurality of local features of an image are identified based on the vocabulary, the local features being represented by a plurality of local descriptors. An associated visual word in the vocabulary is determined for each of the plurality of local descriptors. A plurality of global signatures for the image are generated based on the associated visual words, wherein some of the plurality of global signatures are generated using local descriptors corresponding to different cropped versions of the image, two or more of the different cropped versions of the image being centered at a same pixel location of the image, and an image recognition search is facilitated using the plurality of global signatures to search a document image dataset.
-
公开(公告)号:US20190012557A1
公开(公告)日:2019-01-10
申请号:US16123764
申请日:2018-09-06
Applicant: Nant Holdings IP, LLC
Inventor: Kamil Wnuk , David McKinnon , Jeremi Sudol , Bing Song , Matheen Siddiqui
CPC classification number: G06K9/3241 , G06F16/532 , G06F16/5838 , G06F16/5854 , G06F16/5866 , G06K9/00201 , G06K9/00744 , G06K9/4609 , G06T7/13 , G06T7/60 , G06T2207/20061 , G06T2207/20116
Abstract: An object recognition ingestion system is presented. The object ingestion system captures image data of objects, possibly in an uncontrolled setting. The image data is analyzed to determine if one or more a priori know canonical shape objects match the object represented in the image data. The canonical shape object also includes one or more reference PoVs indicating perspectives from which to analyze objects having the corresponding shape. An object ingestion engine combines the canonical shape object along with the image data to create a model of the object. The engine generates a desirable set of model PoVs from the reference PoVs, and then generates recognition descriptors from each of the model PoVs. The descriptors, image data, model PoVs, or other contextually relevant information are combined into key frame bundles having sufficient information to allow other computing devices to recognize the object at a later time.
-
公开(公告)号:US10140317B2
公开(公告)日:2018-11-27
申请号:US15794993
申请日:2017-10-26
Applicant: Nant Holdings IP, LLC
Inventor: David McKinnon , Kamil Wnuk , Jeremi Sudol , Matheen Siddiqui , John Wiacek , Bing Song , Nicholas J. Witchey
Abstract: Apparatus, methods and systems of providing AR content are disclosed. Embodiments of the inventive subject matter can obtain an initial map of an area, derive views of interest, obtain AR content objects associated with the views of interest, establish experience clusters and generate a tile map tessellated based on the experience clusters. A user device could be configured to obtain and instantiate at least some of the AR content objects based on at least one of a location and a recognition.
-
公开(公告)号:US09922270B2
公开(公告)日:2018-03-20
申请号:US14622621
申请日:2015-02-13
Applicant: Nant Holdings IP, LLC
Inventor: Bing Song , David McKinnon
CPC classification number: G06K9/6256 , G06F17/2735 , G06F17/3002 , G06F17/30321 , G06F17/30386 , G06F17/30598 , G06K9/6218 , G06K9/6255 , G06K9/6261 , G06K9/627 , G06K9/6276
Abstract: Systems and methods of generating a compact visual vocabulary are provided. Descriptor sets related to digital representations of objects are obtained, clustered and partitioned into cells of a descriptor space, and a representative descriptor and index are associated with each cell. Generated visual vocabularies could be stored in client-side devices and used to obtain content information related to objects of interest that are captured.
-
公开(公告)号:US20170262704A1
公开(公告)日:2017-09-14
申请号:US15602022
申请日:2017-05-22
Applicant: Nant Holdings IP, LLC
Inventor: Kamil Wnuk , Bing Song , Matheen Siddiqui , David McKinnon , Jeremi Sudol , Patrick Soon-Shiong , Orang Dialameh
CPC classification number: G06K9/00671 , G06F17/30247 , G06F19/00 , G06F19/321 , G06K9/00718 , G06K9/6202 , G06T7/0014 , G06T11/60 , G06T2207/10016 , G06T2207/20004 , G16H30/40
Abstract: Systems and methods of quickly recognizing or differentiating many objects are presented. Contemplated systems include an object model database storing recognition models associated with known modeled objects. The object identifiers can be indexed in the object model database based on recognition features derived from key frames of the modeled object. Such objects are recognized by a recognition engine at a later time. The recognition engine can construct a recognition strategy based on a current context where the recognition strategy includes rules for executing one or more recognition algorithms on a digital representation of a scene. The recognition engine can recognize an object from the object model database, and then attempt to identify key frame bundles that are contextually relevant, which can then be used to track the object or to query a content database for content information.
-
公开(公告)号:US20170200049A1
公开(公告)日:2017-07-13
申请号:US15461197
申请日:2017-03-16
Applicant: Nant Holdings IP, LLC
Inventor: David McKinnon , John Wiacek , Jeremi Sudol , Kamil Wnuk , Bing Song
CPC classification number: G06K9/00684 , G06F17/30244 , G06F17/3028 , G06K9/20 , G06K9/6215 , G06K9/6807
Abstract: A system for analyzing scene traits in an object recognition ingestion ecosystem is presented. In some embodiment, a trait analysis engine analyzes a digital representation of a scene to derive one or more features. The features are compiled into sets of similar features with respect to a feature space. The engine attempts to discover which traits of the scene (e.g., temperature, lighting, gravity, etc.) can be used to distinguish the features for purposes of object recognition. When such distinguishing traits are found, an object recognition database is populated with object information, possibly indexed according to the similar features and their corresponding distinguishing traits.
-
公开(公告)号:US09665606B2
公开(公告)日:2017-05-30
申请号:US14623341
申请日:2015-02-16
Applicant: Nant Holdings IP, LLC
Inventor: Bing Song , Matheen Siddiqui
CPC classification number: G06K9/4638 , G06F17/30259 , G06F17/3028 , G06F17/30327 , G06K9/3241 , G06K9/4633 , G06K9/4671 , G06K9/48 , G06K2209/051 , G06T7/13 , H04L67/10
Abstract: Edge-based recognition systems and methods are presented. Edges of the object are identified from the image data based on co-circularity of edgels, and edge-based descriptors are constructed based on the identified edges. The edge-based descriptors along with additional perception metrics are used to obtain a list of candidate objects matched with the edge-based descriptors. Through various filtering processes and verification processes, false positive candidate objects are further removed from the list to determine the final candidate object.
-
公开(公告)号:US09542593B2
公开(公告)日:2017-01-10
申请号:US15199267
申请日:2016-06-30
Applicant: Nant Holdings IP, LLC
Inventor: Bing Song , Nicholas J. Witchey
CPC classification number: G06K9/481 , G06F17/30256 , G06F17/3028 , G06K9/00201 , G06K9/4604 , G06K9/4671 , G06K9/48 , G06K9/6212 , G06K9/6214 , G06K9/6215 , G06T3/40 , G06T3/403 , G06T5/40 , G06T7/13 , G06T7/143 , G06T7/181 , G06T7/248 , G06T2207/10004 , G06T2207/10016 , G06T2207/10028 , G06T2207/10116 , G06T2207/20076 , G06T2207/20164 , G06T2207/30004
Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
Abstract translation: 提供了在数字图像内检测多个边缘的技术。 选择沿着多个边缘的边缘定位的锚定点。 生成与锚点相关联的分析网格,分析网格包括多个单元。 计算包括锚定点处的边缘的法向量的锚点法向量。 计算在分析网格的单元内沿着边缘的位置处包含边缘的法向矢量的边缘像素法向矢量。 为分析网格的一个或多个单元中的每一个生成相似度直方图,每个相似度直方图基于单元格内的每个边缘像素法向量与定位点法向量之间的相似性度量,描述符是 基于相似性的直方图为分析网格生成。
-
公开(公告)号:US20160314339A1
公开(公告)日:2016-10-27
申请号:US15199267
申请日:2016-06-30
Applicant: Nant Holdings IP, LLC
Inventor: Bing Song , Nicholas J. Witchey
CPC classification number: G06K9/481 , G06F17/30256 , G06F17/3028 , G06K9/00201 , G06K9/4604 , G06K9/4671 , G06K9/48 , G06K9/6212 , G06K9/6214 , G06K9/6215 , G06T3/40 , G06T3/403 , G06T5/40 , G06T7/13 , G06T7/143 , G06T7/181 , G06T7/248 , G06T2207/10004 , G06T2207/10016 , G06T2207/10028 , G06T2207/10116 , G06T2207/20076 , G06T2207/20164 , G06T2207/30004
Abstract: Techniques are provided in which a plurality of edges are detected within a digital image. An anchor point located along an edge of the plurality of edges is selected. An analysis grid associated with the anchor point is generated, the analysis grid including a plurality of cells. An anchor point normal vector comprising a normal vector of the edge at the anchor point is calculated. Edge pixel normal vectors comprising normal vectors of the edge at locations along the edge within the cells of the analysis grid are calculated. A histogram of similarity is generated for each of one or more cells of the analysis grid, each histogram of similarity being based on a similarity measure between each of the edge pixel normal vectors within a cell and the anchor point normal vector, and a descriptor is generated for the analysis grid based on the histograms of similarity.
-
-
-
-
-
-
-
-
-