-
公开(公告)号:US20230245391A1
公开(公告)日:2023-08-03
申请号:US18131295
申请日:2023-04-05
申请人: STREEM, INC.
发明人: SEAN M. ADKINSON , FLORA PONJOU TASSE , PAVAN K. KAMARAJU , GHISLAIN FOUODJI TASSE , RYAN R. FINK
CPC分类号: G06T17/20 , G06T15/04 , G06T7/50 , G06N3/04 , G06T7/70 , G06T2207/10028 , G06T2207/20084
摘要: Embodiments include systems and methods for creation of a 3D mesh from a video stream or a sequence of frames. A sparse point cloud is first created from the video stream, which is then densified per frame by comparison with spatially proximate frames. A 3D mesh is then created from the densified depth maps, and the mesh is textured by projecting the images from the video stream or sequence of frames onto the mesh. Metric scale of the depth maps may be estimated where direct measurements are not able to be measured or calculated using a machine learning depth estimation network.
-
公开(公告)号:US20220138979A1
公开(公告)日:2022-05-05
申请号:US17090281
申请日:2020-11-05
申请人: STREEM, INC.
摘要: Embodiments include systems and methods for remotely measuring distances in an environment captured by a device. A device captures a video stream of a device along with AR data that may include camera pose information and/or depth information, and transmits the video stream and AR data to a remote device. The remote device receives a selection of a first point and a second point within the video stream and, using the AR data, calculates a distance between the first and second points. The first and second points may be at different locations not simultaneously in view of the device. Other embodiments may capture additional points to compute areas and/or volumes.
-
公开(公告)号:US11640694B2
公开(公告)日:2023-05-02
申请号:US17208943
申请日:2021-03-22
申请人: STREEM, INC.
发明人: Sean M. Adkinson , Flora Ponjou Tasse , Pavan K. Kamaraju , Ghislain Fouodji Tasse , Ryan R. Fink
摘要: Embodiments include systems and methods for creation of a 3D mesh from a video stream or a sequence of frames. A sparse point cloud is first created from the video stream, which is then densified per frame by comparison with spatially proximate frames. A 3D mesh is then created from the densified depth maps, and the mesh is textured by projecting the images from the video stream or sequence of frames onto the mesh. Metric scale of the depth maps may be estimated where direct measurements are not able to be measured or calculated using a machine learning depth estimation network.
-
公开(公告)号:US11270505B2
公开(公告)日:2022-03-08
申请号:US16881835
申请日:2020-05-22
申请人: STREEM, INC.
发明人: Flora Ponjou Tasse , Pavan Kumar Kamaraju , Ghislain Fouodji Tasse , Ryan R. Fink , Sean M. Adkinson
摘要: Embodiments include systems and methods for generating a 3D mesh from a video stream or other image captured contemporaneously with AR data. The AR data is used to create a depth map, which is then fused with images from frames of the video to form a full 3D mesh. The images and depth map can also be used with an object detection algorithm to recognize 3D objects within the 3D mesh. Methods for fingerprinting the video with AR data captured contemporaneously with each frame are disclosed.
-
公开(公告)号:US10785269B2
公开(公告)日:2020-09-22
申请号:US16195595
申请日:2018-11-19
申请人: STREEM, INC.
发明人: Ryan R. Fink , Sean M. Adkinson
摘要: Methods and systems for the remote delivery of professional services, using augmented reality (AR), are disclosed. In embodiments, a user transmits an image or video to a server, which provides a list of professionals on the basis of object recognition performed on the image or video. The user selects a professional, and the server initiates a video session between a user device and a professional device, where the professional can superimpose one or more AR objects on the video, to be displayed on the user device.
-
公开(公告)号:US20220189118A1
公开(公告)日:2022-06-16
申请号:US17689472
申请日:2022-03-08
申请人: STREEM, INC.
发明人: Flora Ponjou Tasse , Pavan Kumar Kamaraju , Ghislain Fouodji Tasse , Ryan R. Fink , Sean M. Adkinson
摘要: Embodiments include systems and methods for generating a 3D mesh from a video stream or other image captured contemporaneously with AR data. The AR data is used to create a depth map, which is then fused with images from frames of the video to form a full 3D mesh. The images and depth map can also be used with an object detection algorithm to recognize 3D objects within the 3D mesh. Methods for fingerprinting the video with AR data captured contemporaneously with each frame are disclosed.
-
公开(公告)号:US11323657B2
公开(公告)日:2022-05-03
申请号:US17001084
申请日:2020-08-24
申请人: STREEM, INC.
发明人: Ryan R. Fink , Sean M. Adkinson
摘要: Methods and systems for the remote delivery of professional services, using augmented reality (AR), are disclosed. In embodiments, a user scans or acquires a physical marker, such as an optical code or radio beacon. The physical marker provides information to the user's device to allow it to connect to a server. The physical marker may also provide contextual data, possibly in conjunction with contextual data from the user's device. The server then provides a list of professionals on the basis of the contextual data. The user selects a professional, and the server initiates a video session between a user device and a professional device, where the professional can superimpose one or more AR objects on the video, to be displayed on the user device.
-
公开(公告)号:US20220129228A1
公开(公告)日:2022-04-28
申请号:US17079080
申请日:2020-10-23
申请人: STREEM, INC.
发明人: ZACHARY BABB
摘要: Multiple devices may use cameras, sensors, and other inputs to record characteristics of an environment and generate an Augmented Reality (AR) model of the environment. Although devices may implement AR models in different incompatible systems, such as using positioning systems with different scales, unit sizes, etc., one or more devices may coordinate to determine one or more transform to be applied by one or more devices to establish a common framework for referencing AR objects in the models for the environment. With the common framework, and a language to facilitate establishing the common framework, devices may share rich content between the devices. This, for example, allows a tablet device presenting an AR space to “grab” an object out of a display present in the environment, and place the grabbed object into the AR space while maintaining proper relative dimensions and other characteristics of the object after the transfer from one space to the other.
-
公开(公告)号:US20210295599A1
公开(公告)日:2021-09-23
申请号:US17208943
申请日:2021-03-22
申请人: STREEM, INC.
发明人: SEAN M. ADKINSON , FLORA PONJOU TASSE , PAVAN K. KAMAJARU , GHISLAIN FOUODJI TASSE , RYAN R. FINK
摘要: Embodiments include systems and methods for creation of a 3D mesh from a video stream or a sequence of frames. A sparse point cloud is first created from the video stream, which is then densified per frame by comparison with spatially proximate frames. A 3D mesh is then created from the densified depth maps, and the mesh is textured by projecting the images from the video stream or sequence of frames onto the mesh. Metric scale of the depth maps may be estimated where direct measurements are not able to be measured or calculated using a machine learning depth estimation network.
-
公开(公告)号:US10785443B2
公开(公告)日:2020-09-22
申请号:US16222596
申请日:2018-12-17
申请人: STREEM, INC.
发明人: Ryan R. Fink , Sean M. Adkinson , Trey Trahin
IPC分类号: H04N7/08 , G06T11/00 , G06K9/00 , G06T7/70 , H04N21/234 , H04L29/06 , H04N21/81 , H04N21/8547 , H04N21/488 , H04L29/08
摘要: A platform for synchronizing augmented reality (AR) views and information between two or more network connected devices is disclosed. A first device captures a video stream and associated spatial information, and transmits the video stream and spatial information to a second device. A user of the second device views the video stream, and inserts one or more AR objects into the video stream, with reference to the spatial information. The second device transmits the AR objects and spatial information references to the first device, which then renders the one or more AR objects into the video stream, using the spatial information references to locate the AR objects in each video stream frame.
-
-
-
-
-
-
-
-
-