SEPARATION OF GRAPHICS FROM NATURAL VIDEO IN STREAMING VIDEO CONTENT

    公开(公告)号:US20230122454A1

    公开(公告)日:2023-04-20

    申请号:US18072420

    申请日:2022-11-30

    Abstract: Aspects of the subject disclosure may include, for example, a method that includes obtaining, by a processing system including a processor, video frames over a network; the processing system uses a machine learning algorithm to identify in each frame a first region comprising a natural image and a second region comprising a synthetic graphic image. The processing system separates the natural image from the synthetic graphic image to generate a natural video and a graphics video, encodes the natural video, and processes the graphics video to generate instructions for rendering graphic images at a client system. The client system performs a decoding procedure for the encoded video, a rendering procedure for client-side graphics in accordance with the instructions, and a compositing procedure to obtain a presentable video stream including the natural image and a client-side graphic corresponding to the synthetic graphic image. Other embodiments are disclosed.

    System and method for visual rendering based on sparse samples with predicted motion

    公开(公告)号:US10785489B2

    公开(公告)日:2020-09-22

    申请号:US16277562

    申请日:2019-02-15

    Applicant: DMAI, Inc.

    Inventor: Jeremy Nelson

    Abstract: The present teaching relates to method, system, medium, and implementations for rendering a moving object. An object data package related to a moving object appearing in a monitored scene with respect to a first time instance is first received and features characterizing the moving object at the first time instance are extracted from the package, that are estimated at a monitoring rate and include a current position of the object and a current motion vector at the first time instance. Information associated with a previously rendered object at a previously rendered position at a previous time instance is retrieved and a next rendering position of the object is determined based on the current position, the current motion vector, and a rendering rate lower than the monitoring rate. The object is rendered at the next rendering position based on a motion vector and the information associated with the previously rendered object.

    MIXED REALITY CODING WITH OVERLAYS
    3.
    发明申请

    公开(公告)号:US20190228544A1

    公开(公告)日:2019-07-25

    申请号:US16259473

    申请日:2019-01-28

    Abstract: A system includes a camera to capture real world content and a semiconductor package apparatus. The semiconductor package apparatus includes a substrate and logic. The logic includes a graphics pipeline to generate rendered content, a base layer encoder to encode real world content into a base layer and a first layer encoder to encode rendered content into a first non-base layer, a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content, and a transmitter to transmit the single output signal. The system further includes a second layer encoder to encode map data into a second non-base layer. The multiplexer to interleave the second non-base layer with the first non-base layer and the base layer. The first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures.

    Hybrid video and graphics system with automatic content detection process, and other circuits, processes, and systems
    6.
    发明授权
    Hybrid video and graphics system with automatic content detection process, and other circuits, processes, and systems 有权
    具有自动内容检测过程的混合视频和图形系统,以及其他电路,过程和系统

    公开(公告)号:US09578336B2

    公开(公告)日:2017-02-21

    申请号:US13490639

    申请日:2012-06-07

    Abstract: A computing device (300) includes a storage (325) that over time is operable to include video and graphics content and the storage has a first set of instructions representing lossy video compression (130) and a second set of instructions representing lossless compression (120); and a processor (320) coupled with said storage (325), and said processor (320) operable to electronically analyze (110) at least a portion of the content for motion based on magnitudes of motion vectors and, on detection of a significant amount of motion, further operable to activate the first set of instructions (130) to compress at least the motion video, and otherwise to activate the second set of instructions representing lossless compression (120) to compress at least the graphics. Other devices, systems, and processes are disclosed.

    Abstract translation: 计算设备(300)包括存储器(325),其随着时间可操作以包括视频和图形内容,并且存储具有表示有损视频压缩(130)的第一组指令和表示无损压缩的第二组指令(120 ); 以及与所述存储器(325)耦合的处理器(320),并且所述处理器(320)可操作以基于运动向量的大小电子地分析(110)所述内容的至少一部分以用于运动,并且在检测到大量 的运动,进一步可操作以激活第一组指令(130)以至少压缩运动视频,否则激活表示无损压缩(120)的第二组指令来至少压缩图形。 公开了其他设备,系统和过程。

    Methods and systems for differentiating synthetic and non-synthetic images
    7.
    发明授权
    Methods and systems for differentiating synthetic and non-synthetic images 有权
    用于区分合成和非合成图像的方法和系统

    公开(公告)号:US09558422B2

    公开(公告)日:2017-01-31

    申请号:US15004656

    申请日:2016-01-22

    Applicant: Facebook, Inc.

    Abstract: The techniques introduced here include a system and method for transcoding multimedia content based on the results of content analysis. The determination of specific transcoding parameters, used for transcoding multimedia content, can be performed by utilizing the results of content analysis of the multimedia content. One of the results of the content analysis is the determination of image type of any images included in the multimedia content. The content analysis uses one or more of several techniques, including analyzing content metadata, examining colors of contiguous pixels in the content, using histogram analysis, using compression distortion analysis, analyzing image edges, or examining user provided inputs. Transcoding the multimedia content can include adapting the content to the constraints in delivery and display, processing and storage of user computing devices.

    Abstract translation: 这里介绍的技术包括基于内容分析结果对多媒体内容进行代码转换的系统和方法。 可以通过利用多媒体内容的内容分析结果来执行用于代码转换多媒体内容的特定代码转换参数的确定。 内容分析的结果之一是确定包含在多媒体内容中的任何图像的图像类型。 内容分析使用几种技术中的一种或多种,​​包括分析内容元数据,使用直方图分析,使用压缩失真分析,分析图像边缘或检查用户提供的输入来检查内容中连续像素的颜色。 多媒体内容的转码可以包括使内容适应于用户计算设备的传送和显示,处理和存储中的约束。

    Method and mechanism for performing both server-side and client-side rendering of visual data
    8.
    发明授权
    Method and mechanism for performing both server-side and client-side rendering of visual data 有权
    执行视觉数据的服务器端和客户端渲染的方法和机制

    公开(公告)号:US09240030B2

    公开(公告)日:2016-01-19

    申请号:US13491930

    申请日:2012-06-08

    CPC classification number: G06T1/20 G06T9/00 G06T2200/16 H04N19/27

    Abstract: Disclosed is an approach for providing an improved approach for rendering graphics that can utilize both server-side rendering and client-side rendering for the same display frame. In this way, the different visual objects within the same frame can be rendered using either approach, either at the server or at the client.

    Abstract translation: 公开了一种用于提供用于渲染图形的改进方法的方法,其可以利用用于相同显示帧的服务器侧渲染和客户端侧渲染。 以这种方式,可以使用任一方法在服务器或客户机上呈现同一帧内的不同视觉对象。

    ADVANCED SCREEN CONTENT CODING WITH IMPROVED COLOR TABLE AND INDEX MAP CODING METHODS
    9.
    发明申请
    ADVANCED SCREEN CONTENT CODING WITH IMPROVED COLOR TABLE AND INDEX MAP CODING METHODS 审中-公开
    高级屏幕内容编码与改进的颜色表和索引地图编码方法

    公开(公告)号:US20150271505A1

    公开(公告)日:2015-09-24

    申请号:US14664284

    申请日:2015-03-20

    CPC classification number: H04N19/27 H04N19/176 H04N19/463 H04N19/593

    Abstract: An apparatus is configured to perform a method for screen content encoding. The method includes deriving a palette table and a color index map based on a coding unit (CU). The method also includes encoding the palette table and encoding the color index map. The method further includes combining the encoded palette table and the encoded color index map for transmission to a receiver, where the palette table and index map are decoded to reconstruct a pixel block.

    Abstract translation: 一种装置被配置为执行屏幕内容编码的方法。 该方法包括基于编码单元(CU)导出调色板表和颜色索引图。 该方法还包括编码调色板表并编码颜色索引图。 该方法还包括将编码的调色板表和编码的颜色索引图组合以便传输到接收器,其中调色板表和索引图被解码以重建像素块。

    Moving image decoder and moving image decoding method
    10.
    发明授权
    Moving image decoder and moving image decoding method 有权
    运动图像解码器和运动图像解码方法

    公开(公告)号:US08982966B2

    公开(公告)日:2015-03-17

    申请号:US13371225

    申请日:2012-02-10

    Applicant: Emi Maruyama

    Inventor: Emi Maruyama

    Abstract: In one embodiment, there is provided a moving image decoder for decoding a compression-coded moving image stream. The decoder includes: a deblocking filter configured to perform deblocking filter processing on each of frames to be decoded; a load detector configured to detect a magnitude of internal processing loads occurring inside a video player, including a processing load for decoding; a determination module configured to determine whether to bypass the deblocking filter processing, depending on the magnitude of the internal processing loads. The deblocking filter is configured to bypass the deblocking filter processing, if the magnitude of the internal processing loads is bigger than a threshold value and a processing subject block of the frame is decoded using inter-view prediction.

    Abstract translation: 在一个实施例中,提供了一种用于对压缩编码的运动图像流进行解码的运动图像解码器。 解码器包括:去块滤波器,被配置为对要解码的每个帧执行去块滤波处理; 负载检测器,被配置为检测视频播放器内发生的内部处理负载的大小,包括用于解码的处理负载; 确定模块,被配置为根据内部处理负载的大小来确定是否绕过去块滤波器处理。 如果内部处理负载的大小大于阈值,并且使用视角间预测对帧的处理对象块进行解码,则去块滤波器被配置为绕过去块滤波处理。

Patent Agency Ranking