-
1.
公开(公告)号:US12045951B2
公开(公告)日:2024-07-23
申请号:US17564054
申请日:2021-12-28
Applicant: MFTB Holdco, Inc.
Inventor: Will Adrian Hutchcroft , Yuguang Li , Zhiqiang Wan , Ivaylo Boyadzhiev
Abstract: Techniques are described for automated operations to analyze visual data from images acquired in multiple rooms of a building to generate multiple types of building information (e.g., to include a floor plan for the building), such as by using a trained neural network to jointly generate the multiple types of building information by combining visual data from pairs of the images, and for subsequently using the generated building information in one or more further automated manners, with the building information generation further performed in some cases without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room. The automated operations may include generating some types of building information with respect to each image pixel column, and other types of building information by combining data from both images of a pair.
-
公开(公告)号:US11797159B2
公开(公告)日:2023-10-24
申请号:US18099608
申请日:2023-01-20
Applicant: MFTB Holdco, Inc.
Inventor: Yuguang Li , Pierre Moulon , Lambert E. Wixson , Christopher Buehler , Ivaylo Boyadzhiev
IPC: G06F3/0484 , H04W4/024 , G06T19/00
CPC classification number: G06F3/0484 , G06T19/00 , H04W4/024 , G06T2210/04
Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of generating a floor plan for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding GUI (graphical user interface). In some cases, the MIGM system interacts with an MIGM system operator user, such as by displaying a GUI showing information related to the images and/or a floor plan being generated, and by receiving and using input submitted by the user via the GUI to assist with the generating of the floor plan, such as to specify interconnections between particular rooms via particular inter-room wall openings of the rooms.
-
3.
公开(公告)号:US12175562B2
公开(公告)日:2024-12-24
申请号:US18114951
申请日:2023-02-27
Applicant: MFTB Holdco, Inc.
Inventor: Will A. Hutchcroft , Yuguang Li , Manjunath Narayana , Negar Nejatishahidin
Abstract: Techniques are described for automated operations to analyze visual data from images acquired in multiple rooms of a building to generate one or more types of building information (e.g., global inter-image pose data, a floor plan for the building, etc.), such as by simultaneously or otherwise concurrently analyzing groups of three or more images having at least pairwise visual overlap between pairs of those images to determine information that includes global inter-image pose and structural element locations, and for subsequently using the generated building information in one or more further automated manners, with the building information generation further performed in some cases without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room.
-
公开(公告)号:US20230316660A1
公开(公告)日:2023-10-05
申请号:US18208271
申请日:2023-06-10
Applicant: MFTB Holdco, Inc.
Inventor: Yuguang Li , Ivaylo Boyadzhiev , Romualdo Impas
IPC: G06T19/00 , G06T17/05 , G06F3/0482 , G06T15/50
CPC classification number: G06T19/003 , G06T17/05 , G06T19/006 , G06F3/0482 , G06T15/506
Abstract: Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building's interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house's interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.
-
公开(公告)号:US20230161463A1
公开(公告)日:2023-05-25
申请号:US18099608
申请日:2023-01-20
Applicant: MFTB Holdco, Inc.
Inventor: Yuguang Li , Pierre Moulon , Lambert E. Wixson , Christopher Buehler , Ivaylo Boyadzhiev
IPC: G06F3/0484 , H04W4/024 , G06T19/00
CPC classification number: G06F3/0484 , H04W4/024 , G06T19/00 , G06T2210/04
Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of generating a floor plan for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding GUI (graphical user interface). In some cases, the MIGM system interacts with an MIGM system operator user, such as by displaying a GUI showing information related to the images and/or a floor plan being generated, and by receiving and using input submitted by the user via the GUI to assist with the generating of the floor plan, such as to specify interconnections between particular rooms via particular inter-room wall openings of the rooms.
-
公开(公告)号:US11645781B2
公开(公告)日:2023-05-09
申请号:US17962299
申请日:2022-10-07
Applicant: MFTB Holdco, Inc.
Inventor: Yuguang Li , Will A. Hutchcroft , Naji Khosravan , Ivaylo Boyadzhiev
CPC classification number: G06T7/74 , G06F18/22 , G06T7/50 , G06T11/00 , G06V10/44 , G06V10/7515 , G06V20/00 , H04N23/698 , G06T2207/10028 , G06T2207/20084 , G06T2207/20164 , G06T2207/30244 , G06V2201/10
Abstract: Techniques are described for computing devices to perform automated operations to determine the acquisition locations of images, such as within a building interior based on automatically determined shapes of rooms of the building, and for using the determined image acquisition location information in further automated manners. The image may be a panorama image or of another type (e.g., a rectilinear perspective image) and acquired at an acquisition location in a multi-room building's interior, and the determined acquisition location for such an image may be at least a location on the building's floor plan and optionally an orientation/direction for at least a part of the image—in addition, the automated image acquisition location determination may be further performed without having or using information from any depth sensors or other distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding building.
-
公开(公告)号:US20230138762A1
公开(公告)日:2023-05-04
申请号:US17585433
申请日:2022-01-26
Applicant: MFTB Holdco, Inc.
Inventor: John W. Lambert , Yuguang Li , Ivaylo Boyadzhiev , Lambert E. Wixson
Abstract: Techniques are described for automated operations to analyze visual data from panorama images captured in multiple rooms of a building and having little-to-no visual overlap in order to generate a floor plan for the building, and subsequently using the generated floor plan in one or more further automated manners, with the floor plan generation further performed in some cases without having or using information from any distance-measuring devices about distances from an image's acquisition location to walls or other objects in the surrounding room. The automated operations may include identifying and aligning pairs of target images acquired at acquisition locations proximate to each other, refining the alignment of inter-image directions and acquisition locations into a global alignment using a common coordinate system, and then using information identified from the images' visual data that includes structural room layouts to generate the floor plan of the building.
-
公开(公告)号:US11935196B2
公开(公告)日:2024-03-19
申请号:US18208271
申请日:2023-06-10
Applicant: MFTB Holdco, Inc.
Inventor: Yuguang Li , Ivaylo Boyadzhiev , Romualdo Impas
IPC: G06T19/00 , G06F3/0482 , G06T15/50 , G06T17/05
CPC classification number: G06T19/003 , G06F3/0482 , G06T15/506 , G06T17/05 , G06T19/006
Abstract: Techniques are described for using computing devices to perform automated operations related to providing visual information of multiple types in an integrated manner about a building or other defined area. The techniques may include generating and presenting a GUI (graphical user interface) on a client device that includes a computer model of the building's interior with one or more first types of information (e.g., in a first pane of the GUI), and simultaneously presenting other types of related information about the building interior (e.g., in additional separate GUI pane(s)) that is coordinated with the first type(s) of information being currently displayed. The computer model may be a 3D (three-dimensional) or 2.5D representation generated after the house is built and showing the actual house's interior (e.g., walls, furniture, etc.), and may be displayed to a user of a client computing device in a displayed GUI with various user-selectable controls.
-
公开(公告)号:US11592969B2
公开(公告)日:2023-02-28
申请号:US17069800
申请日:2020-10-13
Applicant: MFTB Holdco, Inc.
Inventor: Yuguang Li , Pierre Moulon , Lambert E. Wixson , Christopher Buehler , Ivaylo Boyadzhiev
IPC: G06F3/0484 , H04W4/024 , G06T19/00
Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of generating a floor plan for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding GUI (graphical user interface). In some cases, the MIGM system interacts with an MIGM system operator user, such as by displaying a GUI showing information related to the images and/or a floor plan being generated, and by receiving and using input submitted by the user via the GUI to assist with the generating of the floor plan, such as to specify interconnections between particular rooms via particular inter-room wall openings of the rooms.
-
公开(公告)号:US12260156B2
公开(公告)日:2025-03-25
申请号:US17872914
申请日:2022-07-25
Applicant: MFTB Holdco, Inc.
Inventor: Zhiqiang Wan , Will A. Hutchcroft , Manjunath Narayana , Ivaylo Boyadzhiev , Yuguang Li
Abstract: Techniques are described for computing devices to perform automated operations related to using images acquired in a building as part of an automated generation process of a floor plan or other mapping information for the building, in some cases without using depth information from depth-sensing equipment about distances from the images' acquisition locations to objects in the surrounding building, and for subsequent use in further automated manners, such as controlling navigation of mobile devices and/or for display to end users in a corresponding graphical user interface. The automated analysis and assessment of the building images may, for example, include incrementally generating partial versions of the mapping information, determining acquisition instructions related to further acquisition of additional images and/or other types of data (e.g., to reduce uncertainty associated with portions of the partial mapping information or otherwise obtain missing data), and providing corresponding guidance in or more manners.
-
-
-
-
-
-
-
-
-