公开(公告)号：US09171018B2

公开(公告)日：2015-10-27

申请号：US13742791

申请日：2013-01-16

Applicant: Google Inc.

Inventor： Maks Ovsjanikov ,  Yuan Li ,  Hartwig Adam ,  Charles Joseph Rosenberg

IPC: G06F17/30

CPC classification number: G06F17/30256 ,  G06F17/30247 ,  G06F17/30277 ,  G06F17/3053 ,  G06F17/30542 ,  G06F17/30867

Abstract: A system and computer-implemented method for associating images with semantic entities and providing search results using the semantic entities. An image database contains one or more source images associated with one or more images labels. A computer may generate one or more documents containing the labels associated with each image. Analysis may be performed on the one or more documents to associate the source images with semantic entities. The semantic entities may be used to provide search results. In response to receiving a target image as a search query, the target image may be compared with the source images to identify similar images. The semantic entities associated with the similar images may be used to determine a semantic entity for the target image. The semantic entity for the target image may be used to provide search results in response to the search initiated by the target image.

Abstract translation: 一种用于将图像与语义实体相关联并使用语义实体提供搜索结果的系统和计算机实现的方法。 图像数据库包含与一个或多个图像标签相关联的一个或多个源图像。 计算机可以生成包含与每个图像相关联的标签的一个或多个文档。 可以对一个或多个文档执行分析，以将源图像与语义实体相关联。 语义实体可以用于提供搜索结果。 响应于接收目标图像作为搜索查询，可以将目标图像与源图像进行比较以识别相似的图像。 与相似图像相关联的语义实体可以用于确定目标图像的语义实体。 用于目标图像的语义实体可以用于响应于由目标图像发起的搜索来提供搜索结果。

公开(公告)号：US20150227797A1

公开(公告)日：2015-08-13

申请号：US14618962

申请日：2015-02-10

Applicant: GOOGLE INC.

Inventor： Teresa Ko ,  Hartwig Adam ,  Mikkel Crone Koser ,  Alexei Masterov ,  Andrews-Junior Kimbembe ,  Matthew J. Bridges ,  Paul Chang ,  David Petrou

IPC: G06K9/00 ,  G06F3/14

CPC classification number: H04N5/23293 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/1431 ,  G06F3/1438 ,  G06K9/00671 ,  G06K9/00677 ,  G06K9/78 ,  G09G5/363 ,  G09G2360/08 ,  H04N5/23216

Abstract: Implementations of the present disclosure include actions of receiving image data, the image data being provided from a camera and corresponding to a scene viewed by the camera, receiving one or more annotations, the one or more annotations being provided based on one or more entities determined from the scene, each annotation being associated with at least one entity, determining one or more actions based on the one or more annotations, and providing instructions to display an action interface including one or more action elements, each action element being selectable to induce execution of a respective action, the action interface being displayed in a viewfinder.

Abstract translation: 本公开的实现包括接收图像数据的动作，图像数据从相机提供并对应于由相机观看的场景，接收一个或多个注释，基于确定的一个或多个实体提供的一个或多个注释 从场景中，每个注释与至少一个实体相关联，基于一个或多个注释来确定一个或多个动作，以及提供指示以显示包括一个或多个动作元素的动作界面，每个动作元素可选择以诱导执行 操作界面被显示在取景器中。

公开(公告)号：US20150169611A1

公开(公告)日：2015-06-18

申请号：US14526612

申请日：2014-10-29

Applicant: Google Inc.

Inventor： James William Philbin ,  Anand Pillai ,  John Flynn ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30153 ,  G06F17/30247 ,  G06F17/30256 ,  G06F17/30864

Abstract: Systems and methods for a dynamic visual search engine are provided. In one example method, a criteria used to partition a set of compressed image descriptors into multiple database shards may be determined. Additionally, a size of a dynamic index may be determined. The dynamic index may represent a dynamic number of images and may be configured to accept insertion of reference images into the dynamic index that can be search against immediately. According to the method, an instruction to merge the uncompressed image descriptors of the dynamic index into the database shards of the compressed image descriptors may be received, and the uncompressed image descriptors of the dynamic index may be responsively merged into the database shards of the compressed image descriptors based on the criteria.

Abstract translation: 提供了动态视觉搜索引擎的系统和方法。 在一个示例性方法中，可以确定用于将一组压缩图像描述符分割成多个数据库分片的标准。 另外，可以确定动态索引的大小。 动态索引可以表示动态数量的图像，并且可以被配置为接受将参考图像插入到可以立即搜索的动态索引中。 根据该方法，可以接收将动态索引的未压缩图像描述符合并到压缩图像描述符的数据库碎片中的指令，并且动态索引的未压缩图像描述符可以被响应地合并到压缩的图像描述符的数据库碎片中 基于标准的图像描述符。

公开(公告)号：US20140310319A1

公开(公告)日：2014-10-16

申请号：US14314948

申请日：2014-06-25

Applicant: Google Inc.

Inventor： Ming Zhao ,  Yantao Zheng ,  Yang Song ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30289 ,  G06F17/30247 ,  G06F17/30265 ,  G06F17/30312 ,  G06F17/30861

Abstract: This invention relates to building a landmark database from web data. In one embodiment, a computer-implemented method builds a landmark database. Web data including a web page is received from one or more websites via one or more networks. The web data is interpreted using at least one processor to determine landmark data describing a landmark. At least a portion of the landmark data identifies a landmark. Finally, a visual model is generated using the landmark data. A computing device is able to recognize the landmark in an image based on the visual model.

Abstract translation: 本发明涉及从网络数据建立地标数据库。 在一个实施例中，计算机实现的方法构建地标数据库。 通过一个或多个网络从一个或多个网站接收包括网页的网页数据。 使用至少一个处理器来解释网络数据，以确定描述地标的地标数据。 地标数据的至少一部分标识了一个里程碑。 最后，使用地标数据生成视觉模型。 计算设备能够基于视觉模型识别图像中的地标。

公开(公告)号：US08768107B2

公开(公告)日：2014-07-01

申请号：US14037681

申请日：2013-09-26

Applicant: Google Inc.

Inventor： John Flynn ,  Ulrich Buddemeier ,  Henrik C. Stewenius ,  Hartmut Neven ,  Fernando Brucher ,  Hartwig Adam

IPC: G06K9/62

CPC classification number: G06K9/00671 ,  G06F17/30241 ,  G06F17/30247 ,  G06K9/00704

Abstract: Aspects of the invention pertain to matching a selected image/photograph against a database of reference images having location information. The image of interest may include some location information itself, such as latitude/longitude coordinates and orientation. However, the location information provided by a user's device may be inaccurate or incomplete. The image of interest is provided to a front end server, which selects one or more cells to match the image against. Each cell may have multiple images and an index. One or more cell match servers compare the image against specific cells based on information provided by the front end server. An index storage server maintains index data for the cells and provides them to the cell match servers. If a match is found, the front end server identifies the correct location and orientation of the received image, and may correct errors in an estimated location of the user device.

Abstract translation: 本发明的方面涉及将选定的图像/照片与具有位置信息的参考图像的数据库进行匹配。 感兴趣的图像可以包括一些位置信息本身，例如纬度/经度坐标和方向。 然而，用户设备提供的位置信息可能不准确或不完整。 感兴趣的图像被提供给前端服务器，前端服务器选择一个或多个单元以匹配图像。 每个单元可以具有多个图像和索引。 一个或多个单元匹配服务器根据前端服务器提供的信息将图像与特定单元进行比较。 索引存储服务器维护单元的索引数据，并将它们提供给单元匹配服务器。 如果找到匹配，则前端服务器识别接收到的图像的正确位置和方向，并且可以校正用户设备的估计位置中的错误。

公开(公告)号：US20140172881A1

公开(公告)日：2014-06-19

申请号：US14185392

申请日：2014-02-20

Applicant: Google Inc.

Inventor： David Petrou ,  Andrew Rabinovich ,  Hartwig Adam

IPC: G06F17/30

CPC classification number: G06F17/30268 ,  G06F17/30256 ,  G06F17/30277 ,  G06F17/3053 ,  G06F17/30867 ,  G06K9/00288 ,  G06K9/00677

Abstract: A facial recognition search system identifies one or more likely names (or other personal identifiers) corresponding to the facial image(s) in a query as follows. After receiving the visual query with one or more facial images, the system identifies images that potentially match the respective facial image in accordance with visual similarity criteria. Then one or more persons associated with the potential images are identified. For each identified person, person-specific data comprising metrics of social connectivity to the requester are retrieved from a plurality of applications such as communications applications, social networking applications, calendar applications, and collaborative applications. An ordered list of persons is then generated by ranking the identified persons in accordance with at least metrics of visual similarity between the respective facial image and the potential image matches and with the social connection metrics. Finally, at least one person identifier from the list is sent to the requester.

Abstract translation: 面部识别搜索系统如下所述识别与查询中的面部图像相对应的一个或多个可能的名称（或其他个人标识符）。 在接收到具有一个或多个面部图像的视觉查询之后，系统根据视觉相似性标准识别潜在地匹配相应面部图像的图像。 然后识别与潜在图像相关联的一个或多个人。 对于每个已识别的人，从诸如通信应用，社交网络应用，日历应用和协作应用的多个应用中检索包括对请求者的社交连接性度量的个人特定数据。 然后通过根据相应的面部图像和潜在图像匹配之间的视觉相似性的度量以及与社会连接度量进行评估来对所识别的人进行排序来生成人的有序列表。 最后，从列表中至少有一个人标识符被发送到请求者。

公开(公告)号：US20170286493A1

公开(公告)日：2017-10-05

申请号：US15624056

申请日：2017-06-15

Applicant: Google Inc.

Inventor： David Petrou ,  John Flynn ,  Hartwig Adam ,  Hartmut Neven

IPC: G06F17/30 ,  H04W4/02

CPC classification number: G06F16/583 ,  G06F16/242 ,  G06F16/24575 ,  G06F16/29 ,  H04W4/029 ,  H04W64/00

Abstract: A visual query is received from a client system, along with location information for the client system, and processed by a server system. The server system sends the visual query and the location information to a visual query search system, and receives from the visual query search system enhanced location information based on the visual query and the location information. The server system then sends a search query, including the enhanced location information, to a location-based search system. The search system receives and provides to the client one or more search results to the client system.

公开(公告)号：US20170155850A1

公开(公告)日：2017-06-01

申请号：US15428821

申请日：2017-02-09

Applicant: Google Inc.

Inventor： Teresa Ko ,  Hartwig Adam ,  Mikkel Crone Koser ,  Alexei Masterov ,  Andrews-Junior Kimbembe ,  Matthew J. Bridges ,  Paul Chang ,  David Petrou ,  Adam Berenzweig

IPC: H04N5/232 ,  G06F3/0481 ,  G06F3/0484

CPC classification number: H04N5/23293 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/1431 ,  G06F3/1438 ,  G06K9/00671 ,  G06K9/00677 ,  G06K9/78 ,  G09G5/363 ,  G09G2360/08 ,  H04N5/23216

Abstract: Implementations of the present disclosure include actions of receiving image data of an image capturing a scene, receiving data describing one or more entities determined from the scene, the one or more entities being determined from the scene, determining one or more actions based on the one or more entities, each action being provided at least partly based on search results from searching the one or more entities, and providing instructions to display an action interface comprising one or more action elements, each action element being to induce execution of a respective action, the action interface being displayed in a viewfinder

公开(公告)号：US09639782B2

公开(公告)日：2017-05-02

申请号：US14798569

申请日：2015-07-14

Applicant: Google Inc.

Inventor： Troy Chinen ,  Ameesh Makadia ,  Corinna Cortes ,  Hartwig Adam ,  Nemanja Petrovic ,  Teresa Ko ,  Sebastian Pueblas

IPC: G06K9/00 ,  G06K9/62 ,  G06F17/30 ,  H04N5/232

CPC classification number: G06K9/6267 ,  G06F17/30259 ,  G06F17/30277 ,  G06K9/0055 ,  G06K9/6202 ,  G06K9/6215 ,  H04N5/23222 ,  H04N5/23293 ,  H04N5/23296

Abstract: Techniques for providing image search templates are provided. An image search template may be associated with an image search query to aid the user in capturing an image that will be appropriate for processing the search query. The template may be displayed as an overlay during an image capturing process to indicate an appropriate image capturing pose, range, angle, or other view characteristics that may provide more accurate search results. The template may also be used in the image search query to segment the image and identify features relevant to the search query. Images in an image database may be clustered using characteristics of the images or metadata associated with the images in order to establish groups of images from which templates may be derived. The generated templates may be provided to users to assist in capturing images to be used as search engine queries.

公开(公告)号：US09600496B1

公开(公告)日：2017-03-21

申请号：US14850275

申请日：2015-09-10

Applicant: Google Inc.

Inventor： Maks Ovsjanikov ,  Yuan Li ,  Hartwig Adam ,  Charles Joseph Rosenberg

IPC: G06F17/30

CPC classification number: G06F17/30256 ,  G06F17/30247 ,  G06F17/30277 ,  G06F17/3053 ,  G06F17/30542 ,  G06F17/30867

Abstract: A system and computer-implemented method for associating images with semantic entities and providing search results using the semantic entities. An image database contains one or more source images associated with one or more images labels. A computer may generate one or more documents containing the labels associated with each image. Analysis may be performed on the one or more documents to associate the source images with semantic entities. The semantic entities may be used to provide search results. In response to receiving a target image as a search query, the target image may be compared with the source images to identify similar images. The semantic entities associated with the similar images may be used to determine a semantic entity for the target image. The semantic entity for the target image may be used to provide search results in response to the search initiated by the target image.