公开(公告)号：US20240104851A1

公开(公告)日：2024-03-28

申请号：US17950865

申请日：2022-09-22

Applicant: MFTB Holdco, Inc.

Inventor： Manjunath Narayana ,  Eric M. Penner ,  Ivaylo Boyadzhiev ,  Sing Bing Kang

IPC: G06T19/00 ,  G06F3/04842

CPC classification number: G06T19/003 ,  G06F3/04842 ,  G06T19/006

Abstract: Techniques are described for using computing devices to perform automated operations for using generated building information to further generate and present visual data enhancements on images that are captured by and displayed on a mobile device in the building (e.g., concurrent with capture of the images by a camera of the mobile device, such as in a real-time or near-real-time manner with respect to image capture), such as using descriptive information about a building that is generated from analysis of acquired building images and optionally other building information (e.g., floor plans), and such as to improve navigation of the building (e.g., for autonomous vehicles) and provide other functionality as the mobile device moves through the building. The descriptive building information may include structural elements and other objects identified in the building and other determined attributes of the building, and automatically generated textual descriptions of the objects and other attributes.

公开(公告)号：US20240096097A1

公开(公告)日：2024-03-21

申请号：US17897147

申请日：2022-08-27

Applicant: MFTB Holdco, Inc.

Inventor： Eric M. Penner ,  Naji Khosravan ,  Sing Bing Kang ,  Lichen Wang ,  Zachary S. Bessinger

IPC: G06V20/00 ,  G06N5/02 ,  G06N20/00 ,  G06V10/82

CPC classification number: G06V20/36 ,  G06N5/022 ,  G06N20/00 ,  G06V10/82

Abstract: Techniques are described for using computing devices to perform automated operations for automatically generating information about attributes of buildings from automated analysis of building information that includes floor plans and acquired building images and to subsequently using the generated building information in one or more further automated manners. In some situations, such automated generation of building information includes automatically determining objects in a building and other attributes of the building, and automatically generating descriptions about the determined building attributes. Information about such determined attributes and generated descriptions may be used in various automated manners, including for updating and/or validating information in existing building descriptions, for determining matching buildings that have similarities to indicated building descriptions or other specified criteria, for controlling device navigation (e.g., autonomous vehicles), for display on client devices in corresponding graphical user interfaces, etc.

公开(公告)号：US11842464B2

公开(公告)日：2023-12-12

申请号：US17482325

申请日：2021-09-22

Applicant: MFTB Holdco, Inc.

Inventor： Naji Khosravan ,  Sing Bing Kang ,  Ivaylo Boyadzhiev

IPC: G06T5/00 ,  G06F30/13 ,  H04N23/698 ,  G06T5/50

CPC classification number: G06T5/003 ,  G06F30/13 ,  G06T5/009 ,  G06T5/50 ,  H04N23/698 ,  G06T2207/20172

Abstract: Techniques are described for using computing devices to perform automated operations to generate mapping information of a defined area via analysis of visual data of images, including by using attribute information exchanged between paired or otherwise grouped images of multiple types to generate enhanced images, and for using the generated mapping information in further automated manners, including to use the generated mapping information for automated navigation and/or to display or otherwise present the generated mapping information. In some situations, the defined area includes an interior of a multi-room building, and the generated information includes at least one or more enhanced images and/or a partial floor plan and/or other modeled representation of the building, with the generating performed in some cases without having measured depth information about distances from the images' acquisition locations to walls or other objects in the surrounding building.

公开(公告)号：US11632602B2

公开(公告)日：2023-04-18

申请号：US17573465

申请日：2022-01-11

Applicant: MFTB Holdco, Inc.

Inventor： Sean P. Cier ,  Sing Bing Kang ,  Mitchell David Dawson ,  Pierre Moulon

IPC: H04N5/445 ,  H04N23/698 ,  G06T7/50 ,  H04N23/53 ,  H04N23/68

Abstract: Techniques are described for using multiple devices to automatically determine the acquisition location of an image from a camera device, such as within a building interior and by using data from the multiple devices (e.g., visual data from the camera device's image, and additional data captured by a separate mobile computing device in the same area as the camera device), and for subsequently using determined image acquisition location information in one or more further automated manners. The image may be a panorama image or of another type, and the determined acquisition location for such an image may be at least a location on the building's floor plan—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.