-
1.
公开(公告)号:US20240179416A1
公开(公告)日:2024-05-30
申请号:US18435954
申请日:2024-02-07
申请人: Matterport, Inc.
发明人: David Alan Gausebeck , Kirk Stromberg , Louis D. Marzano , David Proctor , Naoto Sakakibara , Simeon Trieu , Kevin Kane , Simon Wynn
IPC分类号: H04N23/698 , H04N5/222 , H04N5/265 , H04N23/90
CPC分类号: H04N23/698 , H04N5/2226 , H04N5/265 , H04N23/90
摘要: An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene. The image capture device captures, while pointed in the second direction, a plurality of images at different exposures in a second FOV that overlaps the first FOV of the 360-degree scene. The depth information capture device and the image capture device are rotated by the drive train about the first axis from the second direction to a third direction. The depth information capture device, while being rotated from the second direction to the third direction, captures depth information for a second portion of the 360-degree scene. The image capture device, while pointed in the third direction, captures a plurality of images at different exposures in a third FOV that overlaps the second FOV of the 360-degree scene.
-
公开(公告)号:US20230199316A1
公开(公告)日:2023-06-22
申请号:US17644910
申请日:2021-12-17
申请人: Matterport, Inc.
CPC分类号: H04N5/23299 , H04N5/2224 , G03B17/566 , G03B17/561
摘要: An example system comprises a base with a bottom end and a top end opposite the bottom end, a motor within the base, the motor being coupled to a rotational component of the base and configured to turn the rotational component about an axis of rotation, the rotational component being at the top end of the base, the axis of rotation being perpendicular to the top end of the base, and an arm coupled to the rotational component, the arm configured to move a holding member above the top of the base, the holding member configurable to hold a digital device above the top end of the base, the arm being adjustable to position and tilt the holding member, the rotational component being capable of turning the arm and the holding member, the arm configured to tilt the holding member at a first angle relative to the arm.
-
公开(公告)号:US11263823B2
公开(公告)日:2022-03-01
申请号:US16141649
申请日:2018-09-25
申请人: Matterport, Inc.
IPC分类号: G06T19/20 , H04N13/10 , H04N13/246 , H04N13/204 , H04N13/106 , H04N13/156 , G06T7/521 , G06T19/00 , G06T17/00 , G06T7/593 , H04N13/271 , G06T7/579 , H04N13/00
摘要: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises employing, by a system comprising a processor, one or more three-dimensional data from two-dimensional data (3D-from-2D) neural network models to derive three-dimensional data from one or more two-dimensional images captured of an object or environment from a current perspective of the object or environment viewed on or through a display of the device. The method further comprises, determining, by the system, a position for integrating a graphical data object on or within a representation of the object or environment viewed on or through the display based on the current perspective and the three-dimensional data.
-
公开(公告)号:US20180293793A1
公开(公告)日:2018-10-11
申请号:US16007566
申请日:2018-06-13
申请人: Matterport, Inc.
IPC分类号: G06T17/20 , G06T3/40 , H04N21/2362
CPC分类号: G06T17/20 , G06T3/40 , G06T2210/04 , G06T2210/08 , G06T2210/36 , H04N21/2362
摘要: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.
-
公开(公告)号:US10026224B2
公开(公告)日:2018-07-17
申请号:US15187611
申请日:2016-06-20
申请人: Matterport, Inc.
IPC分类号: G06T17/20 , G06T3/40 , H04N21/2362
摘要: Systems and techniques for processing and/or transmitting three-dimensional (3D) data are presented. A partitioning component receives captured 3D data associated with a 3D model of an interior environment and partitions the captured 3D data into at least one data chunk associated with at least a first level of detail and a second level of detail. A data component stores 3D data including at least the first level of detail and the second level of detail for the at least one data chunk. An output component transmits a portion of data from the at least one data chunk that is associated with the first level of detail or the second level of detail to a remote client device based on information associated with the first level of detail and the second level of detail.
-
公开(公告)号:US12056837B2
公开(公告)日:2024-08-06
申请号:US17654989
申请日:2022-03-15
申请人: Matterport, Inc.
发明人: David Alan Gausebeck
IPC分类号: G06T19/20 , G06T7/521 , G06T7/579 , G06T7/593 , G06T17/00 , G06T19/00 , H04N13/10 , H04N13/106 , H04N13/156 , H04N13/204 , H04N13/246 , H04N13/271 , H04N13/00
CPC分类号: G06T19/20 , G06T7/521 , G06T7/579 , G06T7/593 , G06T17/00 , G06T19/006 , H04N13/10 , H04N13/106 , H04N13/156 , H04N13/204 , H04N13/246 , H04N13/271 , G06T2207/10016 , G06T2207/10024 , G06T2207/10052 , G06T2210/04 , H04N2013/0081 , H04N2213/001
摘要: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises receiving, by a system comprising a processor, a panoramic image, and employing, by the system, a three-dimensional data from two-dimensional data (3D-from-2D) convolutional neural network model to derive three-dimensional data from the panoramic image, wherein the 3D-from-2D convolutional neural network model employs convolutional layers that wrap around the panoramic image as projected on a two-dimensional plane to facilitate deriving the three-dimensional data.
-
公开(公告)号:US11852732B2
公开(公告)日:2023-12-26
申请号:US18295258
申请日:2023-04-03
申请人: Matterport, Inc.
发明人: David Alan Gausebeck , Kirk Stromberg , Louis D. Marzano , David Proctor , Naoto Sakakibara , Simeon Trieu , Kevin Kane , Simon Wynn
IPC分类号: G01S17/931 , G01S17/89 , G01S7/481 , G03B37/00 , H04N23/698
CPC分类号: G01S17/931 , G01S7/4813 , G01S7/4815 , G01S17/89 , G03B37/00 , H04N23/698
摘要: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.
-
公开(公告)号:US20230306688A1
公开(公告)日:2023-09-28
申请号:US18171053
申请日:2023-02-17
申请人: Matterport, Inc.
发明人: Matthew Tschudy Bell , David Alan Gausebeck , Gregory William Coombe , Daniel Ford , William John Brown
CPC分类号: G06T19/003 , G06T13/80 , G06T15/20
摘要: Systems and methods for generating three-dimensional models with correlated three-dimensional and two dimensional imagery data are provided. In particular, imagery data can be captured in two dimensions and three dimensions. Imagery data can be transformed into models. Two-dimensional data and three-dimensional data can be correlated within models. Two-dimensional data can be selected for display within a three-dimensional model. Modifications can be made to the three-dimensional model and can be displayed within a three-dimensional model or within two-dimensional data. Models can transition between two dimensional imagery data and three dimensional imagery data.
-
公开(公告)号:US20230243978A1
公开(公告)日:2023-08-03
申请号:US18295258
申请日:2023-04-03
申请人: Matterport, Inc.
发明人: David Alan Gausebeck , Kirk Stromberg , Louis D. Marzano , David Proctor , Naoto Sakakibara , Simeon Trieu , Kevin Kane , Simon Wynn
IPC分类号: G01S17/931 , G01S17/89 , G01S7/481 , G03B37/00 , H04N23/698
CPC分类号: G01S17/931 , G01S17/89 , G01S7/4813 , G03B37/00 , G01S7/4815 , H04N23/698
摘要: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.
-
公开(公告)号:US11282287B2
公开(公告)日:2022-03-22
申请号:US16141630
申请日:2018-09-25
申请人: Matterport, Inc.
发明人: David Alan Gausebeck
IPC分类号: G06T19/20 , H04N13/10 , H04N13/246 , H04N13/204 , H04N13/106 , H04N13/156 , G06T7/521 , G06T19/00 , G06T17/00 , G06T7/593 , H04N13/271 , G06T7/579 , H04N13/00
摘要: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises receiving, by a system comprising a processor, a panoramic image, and employing, by the system, a three-dimensional data from two-dimensional data (3D-from-2D) convolutional neural network model to derive three-dimensional data from the panoramic image, wherein the 3D-from-2D convolutional neural network model employs convolutional layers that wrap around the panoramic image as projected on a two-dimensional plane to facilitate deriving the three-dimensional data.
-
-
-
-
-
-
-
-
-