-
公开(公告)号:US20190158741A1
公开(公告)日:2019-05-23
申请号:US16257601
申请日:2019-01-25
申请人: Fyusion, Inc.
IPC分类号: H04N5/232 , H04N13/189 , H04N5/265
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The determined angular views can be used to select from among the live images and determine when a three hundred sixty degree view of the object has been captured. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation, such as a three hundred sixty degree rotation, through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
-
公开(公告)号:US20190156559A1
公开(公告)日:2019-05-23
申请号:US16237516
申请日:2018-12-31
申请人: Fyusion, Inc.
IPC分类号: G06T15/20 , G06F16/583 , G06F16/738 , G06F16/532 , G06T17/00 , H04N5/265 , H04N13/279 , G06F3/0484 , H04N5/232 , H04N13/282 , G06T3/40
CPC分类号: G06T15/205 , G06F3/04842 , G06F16/532 , G06F16/5838 , G06F16/738 , G06T3/4038 , G06T17/00 , G06T2207/10021 , G06T2207/20221 , G06T2215/12 , G06T2215/16 , H04N5/23238 , H04N5/265 , H04N13/279 , H04N13/282
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view. In particular embodiments, a surround view can be generated by combining a panoramic view of an object with a panoramic view of a distant scene, such that the object panorama is placed in a foreground position relative to the distant scene panorama. Such combined panoramas can enhance the interactive and immersive viewing experience of the surround view.
-
公开(公告)号:US20190116322A1
公开(公告)日:2019-04-18
申请号:US15936131
申请日:2018-03-26
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef Holzer , Radu Bogdan Rusu , Stephen David Miller , Pantelis Kalogiros , Matteo Munaro , Alexander Jay Bruen Trevor , Nico Gregor Sebastian Blodow , Luo Yi Tan , Mike Penz , Martin Markus Hubert Wawro , Matthias Reso , Chris Beall , Yusuke Tomoto , Krunal Ketan Chande
IPC分类号: H04N5/272 , G06K9/00 , H04N5/232 , G06T7/11 , G06T7/194 , G06T13/40 , H04N5/265 , H04N13/282
CPC分类号: H04N5/272 , G06K9/00369 , G06K9/00671 , G06T7/11 , G06T7/194 , G06T13/40 , G06T19/006 , G06T2207/10016 , G06T2207/30196 , H04N5/23216 , H04N5/265 , H04N13/111 , H04N13/279 , H04N13/282 , H04N2005/2726
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.
-
公开(公告)号:US20190096137A1
公开(公告)日:2019-03-28
申请号:US16186994
申请日:2018-11-12
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef Holzer , Alexander Jay Bruen Trevor , Martin Saelzle , Stephen David Miller , Radu Bogdan Rusu
CPC分类号: G06T19/006 , G06F3/011 , G06T7/20 , G06T7/246 , G06T7/33 , G06T7/55 , G06T7/70 , G06T11/00 , G06T2200/32 , G06T2207/10016 , G06T2207/10024 , G06T2207/20221
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view for presentation on a device. A real object can be tracked in the live image data for the purposes of creating a surround view using a number of tracking points. As a camera is moved around the real object, virtual objects can be rendered into live image data to create synthetic images where a position of the tracking points can be used to position the virtual object in the synthetic image. The synthetic images can be output in real-time. Further, virtual objects in the synthetic images can be incorporated into surround views.
-
公开(公告)号:US10200677B2
公开(公告)日:2019-02-05
申请号:US15601874
申请日:2017-05-22
申请人: Fyusion, Inc.
IPC分类号: H04N5/232 , H04N13/282 , G06T7/73
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation can be generated from live images captured from a camera. The live images can include an object. An angular view of the object captured in the live images can be estimated using sensor data from an inertial measurement unit. The multi-view interactive digital media representation can include a plurality of images where each of the plurality of images includes the object from a different camera view. When the plurality of images is output to a display, the object can appear to undergo a 3-D rotation through the determined angular view where the 3-D rotation of the object is generated without a 3-D polygon model of the object.
-
公开(公告)号:US20180341808A1
公开(公告)日:2018-11-29
申请号:US15604938
申请日:2017-05-25
申请人: Fyusion, Inc.
摘要: Provided are mechanisms and processes for visual feature tagging in multi-view interactive digital media representations (MIDMRs). In one example, a process includes receiving a visual feature tagging request that includes an MIDMR of an object to be searched, where the MIDMR includes spatial information, scale information, and different viewpoint images of the object. A visual feature in the MIDMR is identified, and visual feature correspondence information is created that links information identifying the visual feature with locations in the viewpoint images. At least one image associated with the MIDMR is transmitted in response to the feature tagging request.
-
37.
公开(公告)号:US20180227569A1
公开(公告)日:2018-08-09
申请号:US15607334
申请日:2017-05-26
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef HOLZER , Stephen David Miller , Pantelis Kalogiros , George Haber , Radu Bogdan Rusu
IPC分类号: H04N13/04 , H04N13/00 , G06F17/30 , G06F3/0346 , G09G3/00
CPC分类号: H04N13/395 , G06F1/1694 , G06F3/04845 , G06F16/212 , H04N5/247 , H04N13/117
摘要: Various embodiments disclosed herein relate to systems and methods for analyzing and manipulating images and video. Methods as disclosed herein may include retrieving, using a processor, a multi-view interactive digital media representation (MIDMR) from a storage location, the MIDMR including a content model and a context model, the content model characterizing an object, and the context model characterizing scenery surrounding the object. The methods may also include receiving, using the processor, at least one dynamic content input associated with the retrieved MIDMR, the dynamic content input being received while a user is interacting with the MIDMR. The methods may further include implementing, using the processor, one or more modifications associated with the MIDMR based, at least in part, on the received at least one dynamic content input, the one or more modifications modifying a presentation and functionality of the MIDMR.
-
公开(公告)号:US20180227482A1
公开(公告)日:2018-08-09
申请号:US15427030
申请日:2017-02-07
申请人: Fyusion, Inc.
发明人: Stefan Johannes Josef HOLZER , Matteo Munaro , Abhishek Kar , Alexander Jay Bruen Trevor , Krunal Ketan Chande , Michelle Jung-Ah Ho , Radu Bogdan Rusu
CPC分类号: H04N5/2621 , G06K9/00664 , G06K9/00711 , G06K9/2054 , H04N5/23216 , H04N5/23219 , H04N5/23267
摘要: Provided are mechanisms and processes for scene-aware selection of filters and effects for visual digital media content. In one example, a digital media item is analyzed with a processor to identify one or more characteristics associated with the digital media item, where the characteristics include a physical object represented in the digital media item. Based on the identified characteristics, a digital media modification is selected from a plurality of digital media modifications for application to the digital media item. The digital media modification may then be provided for presentation in a user interface for selection by a user.
-
公开(公告)号:US10026219B2
公开(公告)日:2018-07-17
申请号:US15802437
申请日:2017-11-02
申请人: Fyusion, Inc.
IPC分类号: G06T15/00 , G06T15/20 , G06T17/00 , H04N13/279 , H04N13/282 , H04N5/232 , G06F17/30 , G06F3/0484 , G06T3/40 , H04N5/265
摘要: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view. In particular embodiments, a surround view can be generated by combining a panoramic view of an object with a panoramic view of a distant scene, such that the object panorama is placed in a foreground position relative to the distant scene panorama. Such combined panoramas can enhance the interactive and immersive viewing experience of the surround view.
-
公开(公告)号:US09940541B2
公开(公告)日:2018-04-10
申请号:US14800638
申请日:2015-07-15
申请人: Fyusion, Inc.
CPC分类号: G06K9/6201 , G06K9/00664 , G06T15/205 , H04N13/111 , H04N2013/0085
摘要: Various embodiments of the present invention relate generally to systems and processes for artificially rendering images using interpolation of tracked control points. According to particular embodiments, a set of control points is tracked between a first frame and a second frame, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. An artificially rendered image corresponding to a third location is then generated by interpolating individual control points for the third location using the set of control points and interpolating pixel locations using the individual control points. The individual control points are used to transform image data.
-
-
-
-
-
-
-
-
-