Multi-user extended reality streaming method and system

    公开(公告)号:US20240070978A1

    公开(公告)日:2024-02-29

    申请号:US18453871

    申请日:2023-08-22

    Abstract: A multi-user extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and at least one XR device is described. The XR streaming method comprises the steps of



    streaming, by means of a first XR application instance of the plurality of XR application instances, first XR images to the at least one XR device, wherein the first XR images streamed by the first XR application instance are associated with a first XR application;
    streaming, by means of a second XR application instance of the plurality of XR application instances, second XR images to the at least one XR device, wherein the second XR images streamed by the second XR application instance are associated with a second XR application, wherein the second XR application is a multi-user XR application; and
    blending, by means of the at least one XR device, the first XR images received from the first XR application instance with the second XR images received from the second XR application instance, thereby obtaining blended XR images to be displayed on the at least one XR device.




    Further, an XR streaming system is described.

    Extended Reality Streaming with Integrated Copyright Protection

    公开(公告)号:US20230401291A1

    公开(公告)日:2023-12-14

    申请号:US18322147

    申请日:2023-05-23

    CPC classification number: G06F21/10 G06F2221/0711

    Abstract: An extended reality (XR) streaming system with integrated copyright protection is described. The XR streaming system comprises an asset database and at least one XR streaming instance. The asset database is configured to store asset data that is associated with a plurality of different digital assets, wherein the asset data comprises rendering data and copyright data associated with each digital asset. The rendering data corresponds to data that is necessary for the at least one XR streaming instance to render an XR image associated with the respective digital asset. The XR streaming instance is configured to generate an asset request, wherein the asset request corresponds to a request for a particular digital asset. The asset database is configured to transmit the rendering data associated with the requested digital asset to the at least one XR streaming instance based on the asset request and based on the copyright data. The at least one XR streaming instance is configured to generate an XR image stream based on the transmitted rendering data.

    Multi-viewer XR streaming method and XR streaming system

    公开(公告)号:US20240129350A1

    公开(公告)日:2024-04-18

    申请号:US18481712

    申请日:2023-10-05

    CPC classification number: H04L65/60 G01S5/0284 G06T19/006

    Abstract: A multi-viewer extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and a plurality of XR devices is described. The multi-viewer XR streaming method comprises the steps of



    streaming, by means of a first XR application instance of the plurality of XR application instances, first XR images to at least one XR device, wherein the first XR images correspond to virtual content viewed from a first spectator position;
    determining a position of the at least one XR device relative to the first spectator position; and
    reprojecting, by means of the at least one XR device, the first XR images based on the determined position of the at least one XR device.




    Further, an XR streaming system is described.

    Extended reality streaming method and system

    公开(公告)号:US20240070977A1

    公开(公告)日:2024-02-29

    申请号:US18453828

    申请日:2023-08-22

    Abstract: An extended reality (XR) streaming method of streaming XR images between a plurality of XR application instances and an XR device is described. The XR streaming method comprises the following steps:



    streaming, by means of a first XR application instance of the plurality of XR application instances, first XR images to the XR device, wherein the first XR images streamed by the first XR application instance are associated with a first XR application;
    streaming, by means of a second XR application instance of the plurality of XR application instances, second XR images to the XR device, wherein the second XR images streamed by the second XR application instance are associated with a second XR application; and
    blending, by means of the XR device, the first XR images received from the first XR application instance with the second XR images received from the second XR application instance, thereby obtaining blended XR images to be displayed on the XR device.




    Further, an XR streaming system is described.

    XR streaming method and XR streaming system
    5.
    发明公开

    公开(公告)号:US20230410420A1

    公开(公告)日:2023-12-21

    申请号:US18316590

    申请日:2023-05-12

    CPC classification number: G06T17/00

    Abstract: An extended reality (XR) streaming method for streaming XR images between a plurality of XR application instances and an XR device is described. The XR streaming method comprises the steps of



    streaming, by means of a first XR application instance of the plurality of XR application instances, XR images to the XR device, wherein the XR images are associated with an XR application;
    establishing a communication connection between a second XR application instance of the plurality of XR application instances and the XR device, wherein the second XR application instance is currently inactive;
    streaming, by means of the second XR application instance, XR images to the XR device; and
    terminating a communication connection between the XR device and the first XR application instance after the communication connection between the second XR application instance and the XR device has been established.

    Reprojection method of generating reprojected image data, XR projection system, and machine-learning circuit

    公开(公告)号:US20230316636A1

    公开(公告)日:2023-10-05

    申请号:US18191978

    申请日:2023-03-29

    CPC classification number: G06T15/205 G06N3/091

    Abstract: A reprojection method for generating reprojected image data to be displayed on an XR device is described. The reprojection method comprises the steps of:



    determining momentary position data;
    generating preliminary image data based on the momentary position data;
    determining updated position data;
    inputting the momentary position data, the preliminary image data, and the updated position data into a machine-learning circuit, wherein the machine-learning circuit comprises a machine-learning model that is pre-trained to reproject the preliminary image data based on the momentary position data, the preliminary image data, and the updated position data; and
    reprojecting the preliminary image data by means of the machine-learning circuit, thereby generating reprojected image data, wherein the reprojected image data corresponds to at least one reprojected XR image to be displayed on the XR device.

    XR streaming method and XR streaming system
    7.
    发明公开

    公开(公告)号:US20240121285A1

    公开(公告)日:2024-04-11

    申请号:US18481676

    申请日:2023-10-05

    CPC classification number: H04L65/61 H04L67/131

    Abstract: An extended reality (XR) streaming method of streaming XR images to an XR device is described. The XR streaming method comprises the steps of



    generating, by means of an XR application instance, virtual content to be rendered;
    partitioning, by means of the XR application instance, the virtual content to be rendered into a plurality of rendering jobs;
    forwarding the plurality of rendering jobs to at least two rendering instances, wherein the at least two rendering instances comprise a first rendering instance and a second rendering instance;
    generating, by means of the first rendering instance, first XR images based on the corresponding rendering job received from the XR application instance;
    generating, by means of the second rendering instance, second XR images based on the corresponding rendering job received from the XR application instance; and
    blending, by means of a merging instance, the first XR images with the second XR images, thereby obtaining blended XR images to be displayed on the XR device.




    Further, an XR streaming system is described.

    Computer-implemented method of generating augmented image data, computer-implemented streaming method, image streaming system, and augmented image data stream

    公开(公告)号:US20230326050A1

    公开(公告)日:2023-10-12

    申请号:US18192025

    申请日:2023-03-29

    CPC classification number: G06T7/50 G06T7/90 G06T9/00 G06V10/56 G06T2207/10024

    Abstract: A computer-implemented method of generating augmented image data comprising depth information is described. The method comprises the steps of:

    generating or receiving image data, wherein the image data comprises at least one frame having a first predetermined bit length, wherein the at least one frame comprises color information associated with pixels of at least one image;
    generating or receiving depth data, wherein the depth data comprises depth information associated with the pixels of the at least one image; and
    generating at least one augmented frame based on the image data and based on the depth data, wherein the at least one augmented frame comprises a color frame portion and a frame extension attached to the color frame portion.

    The color frame portion corresponds to the at least one frame and has the first predetermined bit length. The color frame portion comprises the color information associated with the pixels of the at least one image. The frame extension has a second predetermined bit length, and wherein the frame extension comprises the depth information associated with the pixels of the at least one image.

Patent Agency Ranking