公开(公告)号：US11483629B2

公开(公告)日：2022-10-25

申请号：US16961752

申请日：2019-01-15

Applicant: Nokia Technologies Oy

Inventor： Sujeet Mate ,  Igor Curcio ,  Kashyap Kammachi Sreedhar

IPC: H04N21/81 ,  A63F13/355 ,  A63F13/5255 ,  A63F13/65 ,  G06T19/00

Abstract: Methods and apparatuses are disclosed for providing virtual content based on user context. An example apparatus comprises means providing a plurality of virtual content data sets for transmission to a remote user device, the data sets representing virtual content in relation to a common scene and each covering a different respective region of said scene. The apparatus may also comprise means for transmitting one or more of the data sets to the remote user device for consumption. The apparatus may also comprise means for transmitting to the remote user device auxiliary data, the auxiliary data being usable to cause the remote user device to switch from consuming a current data set representing a current region of said scene to a different set of virtual content data representing a different region of said scene, the switching being based at least partly on a determined context of the remote user device.

公开(公告)号：US11094130B2

公开(公告)日：2021-08-17

申请号：US16745770

申请日：2020-01-17

Applicant: Nokia Technologies Oy

Inventor： Igor Curcio ,  Sujeet Mate ,  Kashyap Kammachi Sreedhar ,  Emre Aksu ,  Miska Hannuksela ,  Ari Hourunranta

IPC: G06T19/00 ,  G06F3/01 ,  H04N13/161 ,  H04N13/111

Abstract: The embodiments relate to a method, and a technical equipment for implementing the method. The method comprises generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content; and indicating in the bitstream a definition for an external media to be overlaid on the omnidirectional visual media content during rendering; wherein the definition comprises at least an overlay placement information for the external media on the omnidirectional visual media content. The embodiments also relate to a method and technical equipment for decoding the bitstream.

公开(公告)号：US20210067840A1

公开(公告)日：2021-03-04

申请号：US16961752

申请日：2019-01-15

Applicant: Nokia Technologies Oy

Inventor： Sujeet Mate ,  Igor Curcio ,  Kashyap Kammachi Sreedhar

IPC: H04N21/81 ,  A63F13/355 ,  A63F13/5255 ,  A63F13/65 ,  G06T19/00

Abstract: Methods and apparatuses are disclosed for providing virtual content based on user context. An example apparatus comprises means providing a plurality of virtual content data sets for transmission to a remote user device, the data sets representing virtual content in relation to a common scene and each covering a different respective region of said scene. The apparatus may also comprise means for transmitting one or more of the data sets to the remote user device for consumption. The apparatus may also comprise means for transmitting to the remote user device auxiliary data, the auxiliary data being usable to cause the remote user device to switch from consuming a current data set representing a current region of said scene to a different set of virtual content data representing a different region of said scene, the switching being based at least partly on a determined context of the remote device.

公开(公告)号：US11909983B2

公开(公告)日：2024-02-20

申请号：US17433034

申请日：2020-02-19

Applicant: Nokia Technologies Oy

Inventor： Miska Hannuksela ,  Igor Curcio ,  Sujeet Shyamsundar Mate ,  Emre Aksu ,  Ari Hourunranta

IPC: H04N19/105 ,  H04N19/159 ,  H04N19/172 ,  H04N19/146

CPC classification number: H04N19/146 ,  H04N19/105 ,  H04N19/159 ,  H04N19/172

Abstract: A method comprising: encoding video media content into at least a first representation and a second representation, wherein the first representation comprises a switchable inter-coded picture, wherein the switchable picture has a first characteristic that no pictures preceding the switchable picture in decoding order are used as reference pictures for any non-switchable pictures following the switchable picture in decoding order; and the second representation comprises one or more decoder reset pictures aligned with the switchable pictures of the first representation, wherein the frame rate of the second representation is smaller than or equal to the frame rate of the first representation and the resolutions of the first and the second representation are equal.

公开(公告)号：US11689705B2

公开(公告)日：2023-06-27

申请号：US16961203

申请日：2019-01-14

Applicant: Nokia Technologies Oy

Inventor： Kashyap Kammachi Sreedhar ,  Igor Curcio ,  Miska Hannuksela

IPC: H04N13/161 ,  H04N13/172 ,  H04N13/156 ,  H04N13/111

CPC classification number: H04N13/161 ,  H04N13/111 ,  H04N13/156 ,  H04N13/172

Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments an encoding method comprises obtaining information of a region (63) for overlaying at least a part of an omnidirectional video (61), information of a current viewport (62) in the omnidirectional video (61), and information of an overlaying method to determine whether to overlay a part of the current viewport (62) or the whole current viewport (62) by the overlaying region (63). The method may further comprise encoding information of the overlaying region (63), the current viewport (62) and the overlaying method. In some embodiments a decoding method comprises receiving and decoding information of a region (63) for overlaying at least a part of an omnidirectional video (61), information of a current viewport (62) in the omnidirectional video (61), and information of an overlaying method to determine whether to overlay a part of the current viewport (62) or the whole current viewport (62) by the overlaying region (63). The method may further comprise examining the decoded information of the overlaying method. If the examining reveals that the overlaying method is a partial overlaying method, overlaying a part of the image information of the current viewport (62) by the image information of the overlaying region (63), or if the examining reveals that the overlaying method is a whole overlaying method, overlaying the whole current viewport (62) by the image information of the overlaying region (63).

公开(公告)号：US20200374505A1

公开(公告)日：2020-11-26

申请号：US16961203

申请日：2019-01-14

Applicant: Nokia Technologies Oy

Inventor： Kashyap Kammachi Sreedhar ,  Igor Curcio ,  Miska Hannuksela

IPC: H04N13/161 ,  H04N13/111 ,  H04N13/156 ,  H04N13/172

Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments an encoding method comprises obtaining information of a region (63) for overlaying at least a part of an omnidirectional video (61), information of a current viewport (62) in the omnidirectional video (61), and information of an overlaying method to determine whether to overlay a part of the current viewport (62) or the whole current viewport (62) by the overlaying region (63). The method may further comprise encoding information of the overlaying region (63), the current viewport (62) and the overlaying method. In some embodiments a decoding method comprises receiving and decoding information of a region (63) for overlaying at least a part of an omnidirectional video (61), information of a current viewport (62) in the omnidirectional video (61), and information of an overlaying method to determine whether to overlay a part of the current viewport (62) or the whole current viewport (62) by the overlaying region (63). The method may further comprise examining the decoded information of the overlaying method. If the examining reveals that the overlaying method is a partial overlaying method, overlaying a part of the image information of the current viewport (62) by the image information of the overlaying region (63), or if the examining reveals that the overlaying method is a whole overlaying method, overlaying the whole current viewport (62) by the image information of the overlaying region (63).

公开(公告)号：US12177531B2

公开(公告)日：2024-12-24

申请号：US17779656

申请日：2020-11-17

Applicant: Nokia Technologies Oy

Inventor： Saba Ahsan ,  Igor Curcio

IPC: H04N21/6587 ,  H04N19/597 ,  H04N21/218

Abstract: The embodiments relate to a method including generating a bitstream defining a presentation including an omnidirectional visual media content; encoding into the bitstream a parameter to indicate viewport-control options for viewing the presentation, wherein the viewport-control options includes options controllable by a receiving device and options not-controllable by the receiving device and sending the bitstream to the receiver device; receiving one of the indicated viewport-control options from the receiver device as a response; streaming the presentation to the receiver device; when the response has included an indication on a viewport-control controllable by the receiving device, the method also includes receiving information on viewport definitions from the receiver device during streaming of the presentation and adapting the presentation accordingly; when the response has included an indication on a viewport-control not-controllable by the receiving device, the presentation is streamed to the receiver device according to the viewport-control specified in the response.

公开(公告)号：US11805303B2

公开(公告)日：2023-10-31

申请号：US17296900

申请日：2019-12-30

Applicant: Nokia Technologies Oy

Inventor： Igor Curcio ,  Miska Hannuksela ,  Sujeet Shyamsundar Mate ,  Emre Aksu ,  Ari Hourunranta

IPC: H04N21/845 ,  H04N21/231 ,  H04N21/442 ,  H04N21/462 ,  H04N21/4728

CPC classification number: H04N21/8456 ,  H04N21/23109 ,  H04N21/44209 ,  H04N21/462 ,  H04N21/4728

Abstract: A method, apparatus and computer program product to signal and store various segment properties in omnidirectional media, including sizes, priority ranks, and the like. The method, apparatus and computer program product access one or more media segments (30). The one or more media segments includes media data configured for streaming playback. The method, apparatus and computer program product access size information (32) or priority rank information of one or more tiles for each of the one or more media segments. The method, apparatus and computer program product encode the size information (34) or priority rank information for each of the one or more media segments in a media file within one or more metadata tracks associated with the one or more media segments or one or more sub-segments associated with the one or more media segments.

公开(公告)号：US11651752B2

公开(公告)日：2023-05-16

申请号：US17057815

申请日：2019-05-31

Applicant: Nokia Technologies Oy

Inventor： Kashyap Kammachi-Sreedhar ,  Igor Curcio ,  Miska Hannuksela ,  Sujeet Shyamsundar Mate ,  Emre Aksu

IPC: G09G5/377 ,  G06F3/01 ,  H04N21/431 ,  H04N21/435 ,  H04N21/81

CPC classification number: G09G5/377 ,  G06F3/011 ,  G09G2340/125 ,  G09G2354/00 ,  G09G2370/20 ,  H04N21/435 ,  H04N21/4316 ,  H04N21/816

Abstract: A method, apparatus and computer program product describing groups of overlays, such as semantically correlated overlays, to background media content. In the context of a method, a group of overlays to background media content is defined by metadata (60). The overlays include semantically correlated overlays having alternative overlays representing content with different levels of detail or overlays providing different choices of content. The method also includes receiving client selection of a respective overlay from a group of overlays (62). In response to the client selection, the method causes the respective overlay to be provided. The respective overlay is received (64) for presentation concurrent with background media content (68).

公开(公告)号：US11587200B2

公开(公告)日：2023-02-21

申请号：US17267934

申请日：2019-09-20

Applicant: Nokia Technologies Oy

Inventor： Sujeet Shyamsundar Mate ,  Igor Curcio ,  Miska Hannuksela ,  Emre Aksu ,  Kashyap Kammachi Sreedhar

IPC: G06T3/00 ,  G06T11/00 ,  H04N21/43

Abstract: A method, apparatus and computer program product enable multiple timeline support in playback of omnidirectional media content with overlay. The method, apparatus and computer program product receive a visual overlay configured to be rendered as a multi-layer visual content with an omnidirectional media content file (30). The omnidirectional media content file is associated with a first presentation timeline. The visual overlay is associated with a second presentation timeline. The method, apparatus and computer program product construct an overlay behavior definition file associated with the visual overlay (32). The overlay behavior definition file indicates a behavior of the second presentation timeline with respect to the first presentation in an instance that a pre-defined user interaction switch occurs during a playback of the omnidirectional media content file.