-
公开(公告)号:US11087137B2
公开(公告)日:2021-08-10
申请号:US16278377
申请日:2019-02-18
发明人: Vinay Polavarapu , Christian Egeler , Sergey Virodov , William Patrick Dildine , Adwait Ashish Murudkar , Paul Duree , Gang Lin , Paul Cannon , Alexander Zilbershtein , Pai Moodlagiri
摘要: An exemplary object identification system detects, based on a machine learning model, an object depicted within a video frame. The system identifies, based on the detecting of the object, a class label of the object and a region of interest, within the video frame, of the object. The system identifies, within the region of interest of the object, set of features of the object. The system compares the set of features of the object with a plurality of predefined features within a data store associated with the class label of the object. The system determines, based on the comparing of the set of features of the object with the plurality of predefined features within the data store, whether the object is configured to trigger an augmentation of video content associated with the video frame. Corresponding methods and systems are also disclosed.
-
公开(公告)号:US20200120370A1
公开(公告)日:2020-04-16
申请号:US16710602
申请日:2019-12-11
IPC分类号: H04N21/234 , H04N21/854 , H04N21/81 , H04N21/236 , H04N21/235 , H04N21/222 , H04N5/92 , G11B27/34 , G11B27/036 , G06T19/00 , H04N13/366 , H04N13/161 , H04N13/324 , H04N13/204 , H04N13/189 , G06F3/01
摘要: An exemplary virtual reality system provides an experience selection data structure to a media player device. The experience selection data structure comprises a plurality of entries each corresponding to a different virtual reality dataset, and each virtual reality dataset is customized to a different virtual reality experience associated with a different virtual viewpoint positioned at a different location with respect to a three-dimensional (3D) scene. The virtual reality system detects that the media player device selects an entry from the plurality of entries by way of the experience selection data structure. The selected entry corresponds to a particular virtual reality dataset customized to a particular virtual reality experience. Thus, in response to the detecting, the virtual reality system provides the particular virtual reality dataset to the media player device. Corresponding methods and systems, including details regarding corresponding media player devices, are also disclosed.
-
">
公开(公告)号:US20180350134A1
公开(公告)日:2018-12-06
申请号:US15610586
申请日:2017-05-31
摘要: An exemplary method includes a virtual reality content rendering system receiving two-dimensional (“2D”) color data and depth data captured by a plurality of capture devices disposed at different vantage points in relation to a three-dimensional (“3D”) scene, receiving metadata, generating, for each vantage point associated with each respective capture device included in the plurality of capture devices, and based on the metadata and the depth data, a partial 3D mesh projected into a virtual 3D space to produce a partial representation of the 3D scene in the virtual 3D space, and generating, based on the partial 3D meshes projected into the virtual 3D space, and from an arbitrary viewpoint within the virtual 3D space, an image view of the virtual 3D space. The generating of the image view may comprise accumulating the partial 3D meshes projected into the virtual 3D space.
-
公开(公告)号:US11055917B2
公开(公告)日:2021-07-06
申请号:US16296801
申请日:2019-03-08
IPC分类号: G06T19/00 , G06T15/20 , H04N13/111 , H04N13/282
摘要: An exemplary virtualized projection generation system receives a first frame sequence that includes frames depicting a real-world scene in accordance with a first set of capture parameters associated with a first view of the real-world scene. The virtualized projection generation system identifies a second set of capture parameters distinct from the first set of capture parameters and associated with a second view of the real-world scene distinct from the first view. Based on the first frame sequence, the virtualized projection generation system renders a second frame sequence that includes frames depicting the real-world scene in accordance with the second set of capture parameters associated with the second view of the real-world scene. Corresponding methods and systems are also disclosed.
-
公开(公告)号:US10785513B2
公开(公告)日:2020-09-22
申请号:US16600284
申请日:2019-10-11
发明人: Michael Lodato , Rene Sepulveda , Pai Moodlagiri , Denny Breitenfeld , Syed Meeran Kamal , Mohammad Raheel Khalid , Xavier Hansen
IPC分类号: H04N13/00 , H04N21/2368 , H04N7/01 , H04N5/38 , H04N5/247 , G06T7/90 , G06T7/55 , H04N5/232 , G01B11/245 , H04N21/236 , H04N21/2343
摘要: An exemplary method includes a media content provider system acquiring, from a plurality of capture devices physically disposed at different vantage points in relation to a scene, a distinct set of two-dimensional (2D) color data and depth data (2D data) for each capture device included in the plurality of capture devices, each distinct set of 2D data representing a distinct unmeshed view of the scene as captured from a respective vantage point of a respective capture device included in the plurality of capture devices, acquiring metadata for each distinct set of 2D data, packaging each distinct set of 2D data into a transport stream such that the transport stream includes data representing each distinct unmeshed view of the scene as captured from each respective vantage point of each respective capture device, and providing the metadata and the transport stream for streaming to a media player device.
-
6.
公开(公告)号:US10484727B2
公开(公告)日:2019-11-19
申请号:US15995719
申请日:2018-06-01
发明人: Michael Lodato , Rene Sepulveda , Pai Moodlagiri , Denny Breitenfeld , Syed Meeran Kamal , Mohammad Raheel Khalid , Xavier Hansen
IPC分类号: H04N13/00 , H04N21/2368 , H04N7/01 , H04N5/38 , H04N5/247 , G06T7/90 , G06T7/55 , H04N5/232 , G01B11/245 , H04N21/236 , H04N21/2343
摘要: An exemplary method includes a virtual reality media provider system acquiring, from a plurality of capture devices physically disposed at different vantage points in relation to a scene, a distinct set of two-dimensional (2D) color data and depth data (2D data) for each capture device included in the plurality of capture devices, each distinct set of 2D data representing a distinct unmeshed view of the scene from a respective vantage point of a respective capture device included in the plurality of capture devices, acquiring metadata for each distinct set of 2D data, packaging each distinct set of 2D data into a transport stream such that the transport stream includes data representing each distinct unmeshed view of the scene from each respective vantage point of each respective capture device, and providing the metadata and the transport stream for streaming to a media player device.
-
公开(公告)号:US20190206138A1
公开(公告)日:2019-07-04
申请号:US16296801
申请日:2019-03-08
IPC分类号: G06T19/00 , G06T15/20 , H04N13/111 , H04N13/282
CPC分类号: G06T19/006 , G06T15/20 , G06T15/205 , H04N13/111 , H04N13/282
摘要: An exemplary virtualized projection generation system receives a first frame sequence that includes frames depicting a real-world scene in accordance with a first set of capture parameters associated with a first view of the real-world scene. The virtualized projection generation system identifies a second set of capture parameters distinct from the first set of capture parameters and associated with a second view of the real-world scene distinct from the first view. Based on the first frame sequence, the virtualized projection generation system renders a second frame sequence that includes frames depicting the real-world scene in accordance with the second set of capture parameters associated with the second view of the real-world scene. Corresponding methods and systems are also disclosed.
-
8.
公开(公告)号:US11197038B2
公开(公告)日:2021-12-07
申请号:US16926433
申请日:2020-07-10
IPC分类号: H04N21/234 , G06F3/01 , H04N13/189 , H04N13/204 , H04N13/324 , H04N13/161 , H04N13/366 , G06T19/00 , G11B27/036 , G11B27/34 , H04N5/92 , H04N21/222 , H04N21/235 , H04N21/236 , H04N21/81 , H04N21/854
摘要: An exemplary virtual reality system includes a management device, a synchronization device, and a gatekeeper device communicatively coupled to the management device and the synchronization device by way of a network. The gatekeeper device is configured to receive, at a particular time, a frame of a surface data frame sequence that the gatekeeper device is responsible for processing. The gatekeeper device is also configured to transmit, to the synchronization device, the particular time at which the gatekeeper device received the frame, and to receive, from the synchronization device, a timeframe during which the gatekeeper device is to transmit the frame. The gatekeeper device is further configured to transmit, to the management device during the timeframe received from the synchronization device, the frame of the surface data frame sequence. Corresponding systems and methods are also disclosed.
-
公开(公告)号:US20200265238A1
公开(公告)日:2020-08-20
申请号:US16278377
申请日:2019-02-18
发明人: Vinay Polavarapu , Christian Egeler , Sergey Virodov , William Patrick Dildine , Adwait Ashish Murudkar , Paul Duree , Gang Lin , Paul Cannon , Alexander Zilbershtein , Pai Moodlagiri
摘要: An exemplary object identification system detects, based on a machine learning model, an object depicted within a video frame. The system identifies, based on the detecting of the object, a class label of the object and a region of interest, within the video frame, of the object. The system identifies, within the region of interest of the object, set of features of the object. The system compares the set of features of the object with a plurality of predefined features within a data store associated with the class label of the object. The system determines, based on the comparing of the set of features of the object with the plurality of predefined features within the data store, whether the object is configured to trigger an augmentation of video content associated with the video frame. Corresponding methods and systems are also disclosed.
-
公开(公告)号:US10699749B2
公开(公告)日:2020-06-30
申请号:US16267227
申请日:2019-02-04
发明人: Michael Lodato , Pai Moodlagiri , Rene Sepulveda
IPC分类号: G11B27/036 , G11B27/10 , H04N13/161 , H04N13/189 , H04N13/204 , H04N13/366 , H04N19/597 , H04N13/257 , H04N13/324 , H04N21/236 , H04N21/81 , H04N21/218 , H04N21/472 , H04N9/82 , G06T19/00 , H04N5/92
摘要: An exemplary virtual reality system accesses metadata describing a plurality of frame sequences that each include two-dimensional color data frames and depth data frames that depict a different view of a three-dimensional (3D) scene. The virtual reality system identifies a set of experience parameters defining a particular virtual reality experience associated with the 3D scene and that is to be experienced by a user using a media player device. Based on the metadata and the set of experience parameters, the virtual reality system selects frame sequences from the plurality of frame sequences for inclusion in a frame sequence subset that is customized to the particular virtual reality experience and that collectively includes data sufficient to allow the media player device to generate a virtual 3D representation of the 3D scene. The virtual reality system also provides the selected frame sequences of the frame sequence subset to the media player device.
-
-
-
-
-
-
-
-
-