-
公开(公告)号:US20240267481A1
公开(公告)日:2024-08-08
申请号:US18634975
申请日:2024-04-14
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef HOLZER , Matteo MUNARO , Abhishek KAR , Alexander Jay Bruen TREVOR , Krunal Ketan CHANDE , Michelle Jung-Ah HO , Radu Bogdan RUSU
CPC分类号: H04N5/2621 , G06V10/22 , G06V20/10 , G06V20/40 , H04N23/611 , H04N23/62 , H04N23/683
摘要: Provided are mechanisms and processes for scene-aware selection of filters and effects for visual digital media content. In one example, a digital media item is analyzed with a processor to identify one or more characteristics associated with the digital media item, where the characteristics include a physical object represented in the digital media item. Based on the identified characteristics, a digital media modification is selected from a plurality of digital media modifications for application to the digital media item. The digital media modification may then be provided for presentation in a user interface for selection by a user.
-
公开(公告)号:US20240257445A1
公开(公告)日:2024-08-01
申请号:US18633446
申请日:2024-04-11
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef HOLZER , Abhishek KAR , Matteo MUNARO , Pavel HANCHAR , Radu Bogdan RUSU , Santi ARANO
IPC分类号: G06T15/20 , G01C21/32 , G06F9/451 , G06F16/29 , G06F17/18 , G06F30/15 , G06N3/02 , G06Q30/02 , G06T7/00 , G06T7/593 , G06T7/70 , G06T15/10 , G06T17/00 , G06T19/00 , H04N13/00 , H04N13/243 , H04N13/271 , H04N23/63
CPC分类号: G06T15/205 , G01C21/32 , G06F9/453 , G06F16/29 , G06F17/18 , G06F30/15 , G06N3/02 , G06Q30/0278 , G06T7/0002 , G06T7/0004 , G06T7/593 , G06T7/70 , G06T15/10 , G06T17/00 , G06T19/003 , G06T19/006 , H04N13/243 , H04N13/271 , H04N23/633 , G06T2200/08 , G06T2200/24 , G06T2207/10016 , G06T2207/10028 , G06T2207/20076 , G06T2207/20081 , G06T2207/20084 , G06T2207/20224 , G06T2207/30108 , G06T2207/30244 , G06T2207/30248 , H04N2013/0081
摘要: A plurality of images may be analyzed to determine an object model. The object model may have a plurality of components, and each of the images may correspond with one or more of the components. Component condition information may be determined for one or more of the components based on the images. The component condition information may indicate damage incurred by the object portion corresponding with the component.
-
公开(公告)号:US20240211511A1
公开(公告)日:2024-06-27
申请号:US18601914
申请日:2024-03-11
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef Holzer , Abhishek Kar , Alexander Jay Bruen Trevor , Pantelis Kalogiros , Ioannis Spanos , Radu Bogdan Rusu
IPC分类号: G06F16/583 , G06V10/10 , G06V20/20 , G06V20/64
CPC分类号: G06F16/5838 , G06V10/17 , G06V20/20 , G06V20/64
摘要: Provided are mechanisms and processes for performing visual search using multi-view digital media representations, such as surround views. In one example, a process includes receiving a visual search query that includes a surround view of an object to be searched, where the surround view includes spatial information, scale information, and different viewpoint images of the object. The surround view is compared to stored surround views by comparing spatial information and scale information of the surround view to spatial information and scale information of the stored surround views. A correspondence measure is then generated indicating the degree of similarity between the surround view and a possible match. At least one search result is then transmitted with a corresponding image in response to the visual search query.
-
公开(公告)号:US11972556B2
公开(公告)日:2024-04-30
申请号:US18068454
申请日:2022-12-19
申请人: Fyusion, Inc.
IPC分类号: G06T7/00 , G06T3/4038 , G06T5/50 , G06V10/44 , G06V10/80 , G06V20/20 , G06V20/64 , H04N23/45
CPC分类号: G06T7/001 , G06T3/4038 , G06T5/50 , G06T7/0004 , G06V10/44 , G06V10/454 , G06V10/803 , G06V20/20 , G06V20/647 , H04N23/45
摘要: A background scenery portion may be identified in each of a plurality of image sets of an object, where each image set includes images captured simultaneously from different cameras. A correspondence between the image sets may determined, where the correspondence tracks control points associated with the object and present in multiple images. A multi-view interactive digital media representation of the object that is navigable in one or more dimensions and that includes the image sets may be generated and stored.
-
公开(公告)号:US20240098233A1
公开(公告)日:2024-03-21
申请号:US18520442
申请日:2023-11-27
申请人: Fyusion, Inc.
发明人: Alexander Jay Bruen Trevor , Chris Beall , Vladimir Glavtchev , Stefan Johannes Josef Holzer , Radu Bogdan Rusu
IPC分类号: H04N13/117 , G01B11/24 , G01B21/22 , G06T7/00 , H04N13/398 , H04N23/62 , H04N23/698 , H04N23/90 , H04N25/40
CPC分类号: H04N13/117 , G01B11/24 , G01B21/22 , G06T7/00 , H04N13/398 , H04N23/62 , H04N23/698 , H04N23/90 , H04N25/41
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The determined angular views can be used to select from among the live images. The multi-view interactive digital media representation can include a plurality of images where each of the plurality of images includes the object from a different camera view. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
-
公开(公告)号:US11887256B2
公开(公告)日:2024-01-30
申请号:US17516136
申请日:2021-11-01
申请人: Fyusion, Inc.
发明人: Tobias Bertel , Yusuke Tomoto , Srinivas Rao , Krunal Ketan Chande , Rodrigo Ortiz-Cayon , Stefan Johannes Josef Holzer , Christian Richardt
CPC分类号: G06T17/20 , G06F18/217 , G06N3/045 , G06T15/04 , G06V10/751
摘要: Novel images may be generated using an image generator implemented on a processor. The image generator may receive as input neural features selected from a neural texture atlas. The image generator may also receive as input one or more position guides identifying position information for a plurality of input image pixels. The novel images may be evaluated using an image discriminator to determine a plurality of optimization values by comparing each of the plurality of novel images with a respective one of a corresponding plurality of input images. Each of the novel images may be generated from a respective camera pose relative to an object identical to that of the respective one of the corresponding plurality of input images. The image generator and the neural features may be updated based on the optimization values and stored on a storage device.
-
公开(公告)号:US11876948B2
公开(公告)日:2024-01-16
申请号:US17814820
申请日:2022-07-25
申请人: Fyusion, Inc.
发明人: Alexander Jay Bruen Trevor , Chris Beall , Vladimir Glavtchev , Stefan Johannes Josef Holzer , Radu Bogdan Rusu
IPC分类号: H04N13/117 , G01B21/22 , H04N13/398 , G01B11/24 , H04N23/62 , H04N23/90 , H04N23/698 , H04N25/40 , G06T7/00
CPC分类号: H04N13/117 , G01B11/24 , G01B21/22 , G06T7/00 , H04N13/398 , H04N23/62 , H04N23/698 , H04N23/90 , H04N25/41
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The determined angular views can be used to select from among the live images. The multi-view interactive digital media representation can include a plurality of images where each of the plurality of images includes the object from a different camera view. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
-
公开(公告)号:US11783443B2
公开(公告)日:2023-10-10
申请号:US16518558
申请日:2019-07-22
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef Holzer , Matteo Munaro , Martin Markus Hubert Wawro , Abhishek Kar , Pavel Hanchar , Krunal Ketan Chande , Radu Bogdan Rusu
CPC分类号: G06T3/0037 , G06T7/70 , G06T2207/20044 , G06T2207/30244 , G06T2207/30248
摘要: According to various embodiments, component information may be identified for each input image of an object. The component information may indicate a portion of the input image in which a particular component of the object is depicted. A viewpoint may be determined for each input image that indicates a camera pose for the input image relative to the object. A three-dimensional skeleton of the object may be determined based on the viewpoints and the component information. A multi-view panel corresponding to the designated component of the object that is navigable in three dimensions and that the portions of the input images in which the designated component of the object is depicted may be stored on a storage device.
-
公开(公告)号:US11776142B2
公开(公告)日:2023-10-03
申请号:US17144831
申请日:2021-01-08
申请人: Fyusion, Inc.
CPC分类号: G06T7/38 , G06N3/04 , G06T7/33 , G06T7/97 , G06T15/205 , G06T17/20 , G06T19/006 , H04N23/64 , G06T2219/004
摘要: Mappings are determined between viewpoints of an object and an object model representing the object. Each mapping identifies a location on the object model corresponding with a portion of the object captured in one of the viewpoints. Tags for the object model are created based on the mappings, where each tag links one of the viewpoints to one of the locations on the object model. A user interface that includes the object model and the tags is provided for presentation on a display screen in a user interface. One of the viewpoints is presented in the user interface when the corresponding tag is selected in the object model.
-
10.
公开(公告)号:US20230217001A1
公开(公告)日:2023-07-06
申请号:US18183917
申请日:2023-03-14
申请人: Fyusion, Inc.
IPC分类号: H04N13/221 , H04N13/344 , H04N13/275 , H04N13/178 , H04N13/189 , H04N13/279 , H04N13/243 , H04N13/366 , G06T7/285 , G06T17/00 , H04N13/117
CPC分类号: H04N13/221 , H04N13/344 , H04N13/275 , H04N13/178 , H04N13/189 , H04N13/279 , H04N13/243 , H04N13/366 , G06T7/285 , G06T17/00 , H04N13/117 , G06T2219/2008 , G06T2207/10021 , G06T2207/30252
摘要: Various embodiments describe systems and processes for capturing and generating multi-view interactive digital media representations (MIDMRs). In one aspect, a method for automatically generating a MIDMR comprises obtaining a first MIDMR and a second MIDMR. The first MIDMR includes a convex or concave motion capture using a recording device and is a general object MIDMR. The second MIDMR is a specific feature MIDMR. The first and second MIDMRs may be obtained using different capture motions. A third MIDMR is generated from the first and second MIDMRs, and is a combined embedded MIDMR. The combined embedded MIDMR may comprise the second MIDMR being embedded in the first MIDMR, forming an embedded second MIDMR. The third MIDMR may include a general view in which the first MIDMR is displayed for interactive viewing by a user on a user device. The embedded second MIDMR may not be viewable in the general view.
-
-
-
-
-
-
-
-
-