Actor-replacement system for videos

    公开(公告)号:US12014753B1

    公开(公告)日:2024-06-18

    申请号:US18349551

    申请日:2023-07-10

    Applicant: Roku, Inc.

    CPC classification number: G11B27/036 G06T7/70 G06T2207/10016 G06T2207/30196

    Abstract: In one aspect, an example method includes (i) estimating, using a skeletal detection model, a pose of an original actor for each of multiple frames of a video; (ii) obtaining, for each of a plurality of the estimated poses, a respective image of a replacement actor; (iii) obtaining replacement speech in the replacement actor's voice that corresponds to speech of the original actor in the video; (iv) generating, using the estimated poses, the images of the replacement actor, and the replacement speech, synthetic frames corresponding to the multiple frames of the video that depict the replacement actor in place of the original actor, with the synthetic frames including facial expressions for the replacement actor that temporally align with the replacement speech; and (iv) combining the synthetic frames and the replacement speech so as to obtain a synthetic video that replaces the original actor with the replacement actor.

    Dynamic control of media-content presentation based on user presence and/or user profile

    公开(公告)号:US11985385B1

    公开(公告)日:2024-05-14

    申请号:US18107675

    申请日:2023-02-09

    Applicant: Roku, Inc.

    CPC classification number: H04N21/44218 H04N21/4415 H04N21/4821

    Abstract: A method and system for controlling media-content presentation based on user presence and/or user profile. An example method includes a computing system determining a quantity of users present at a media-presentation device, the quantity being at least one. Further, the example method includes, based on the determining, the computing system using the determined quantity of users present at the media-presentation device as a basis to control what media content a media player outputs for presentation by the media-presentation device. For instance, based on the determined quantity of users the computing system could tailor a graphical user interface (GUI) that the media player outputs for presentation by the media-presentation device, such as by tailoring a set of channel options that a channel-selection GUI provides, among other possibilities.

    Video system with scene-based object insertion feature

    公开(公告)号:US11769312B1

    公开(公告)日:2023-09-26

    申请号:US18177849

    申请日:2023-03-03

    Applicant: Roku, Inc.

    Abstract: In one aspect, an example method includes (i) obtaining video that depicts an area across multiple frames of the video, wherein the area is part of a scene of the video, and wherein the area is suitable for having an object inserted therein; (ii) detecting the area within the obtained video and determining area characteristic data associated with the detected area; (iii) determining scene attribute data associated with the scene; (iv) using at least the determined area characteristic data and the determined scene attribute data as a basis to select an object from among a set of multiple candidate objects; (v) inserting into the detected area the selected object to generate video that is a modified version of the obtained video; and (vi) outputting for presentation the generated video.

    Method and System for Controlling Lighting in a Viewing Area of a Content-Presentation Device

    公开(公告)号:US20250039489A1

    公开(公告)日:2025-01-30

    申请号:US18918740

    申请日:2024-10-17

    Applicant: Roku, Inc.

    Abstract: In one aspect, a method includes receiving video content comprising a first data portion comprising parameters that control a visual appearance of frames of video content presented by a content-presentation device. The content-presentation device is communicatively coupled to a light unit that is (i) present in a viewing area of the content-presentation device and (ii) configured to provide ambient light in the viewing area. The method also includes extracting, from the received video content, a second data portion, separate from the first data portion, specifying one or more light control parameters that a controller associated with the light unit is configured to interpret as instructions for controlling the light unit. The method also includes transmitting the extracted second data portion to the controller to facilitate the controller controlling the light unit according to the specified one or more light control parameters.

    Content System with Summary-Based Content Generation Feature

    公开(公告)号:US20240406521A1

    公开(公告)日:2024-12-05

    申请号:US18328560

    申请日:2023-06-02

    Applicant: Roku, Inc.

    Abstract: In one aspect, an example method includes (i) obtaining first media content; (ii) obtaining plot data associated with the obtained first media content; (iii) obtaining user profile data associated with a user; (iv) identifying from the obtained first media content, a first set of segments; (v) using at least the obtained plot data, the obtained user profile data, and segment data associated with each segment, to determine segment relevance data for each such segment; (vi) using at least the determined segment relevance data for the segments as a basis to select, from among the identified first set of segments, a second set of segments; (vii) using at least the selected second set of segments to generate second media content, wherein the generated second media content is shorter in duration than the obtained first media content; and (viii) outputting for presentation the generated second media content.

    Method and system for controlling lighting in a viewing area of a content-presentation device

    公开(公告)号:US12149772B2

    公开(公告)日:2024-11-19

    申请号:US18319024

    申请日:2023-05-17

    Applicant: Roku, Inc.

    Abstract: In one aspect, a method includes receiving video content comprising a first data portion comprising parameters that control a visual appearance of frames of video content presented by a content-presentation device. The content-presentation device is communicatively coupled to a light unit that is (i) present in a viewing area of the content-presentation device and (ii) configured to provide ambient light in the viewing area. The method also includes extracting, from the received video content, a second data portion, separate from the first data portion, specifying one or more light control parameters that a controller associated with the light unit is configured to interpret as instructions for controlling the light unit. The method also includes transmitting the extracted second data portion to the controller to facilitate the controller controlling the light unit according to the specified one or more light control parameters.

    Content system with event identification and audio-based editing feature

    公开(公告)号:US12142300B2

    公开(公告)日:2024-11-12

    申请号:US18051568

    申请日:2022-11-01

    Applicant: Roku, Inc.

    Abstract: In one aspect, an example method includes (i) obtaining, by a computing system, video data representing video content; (ii) analyzing, by the computing system, the video data to identify an event that is a subject of the video content; (iii) using, by the computing system, the identified event as a basis to select audio content; and (iv) performing, by the computing system, an operation that facilitates editing the video content to include the selected audio content.

    Methods and systems for determining creation attributes of video content

    公开(公告)号:US12137279B2

    公开(公告)日:2024-11-05

    申请号:US18480680

    申请日:2023-10-04

    Applicant: Roku, Inc.

    Abstract: In one aspect, an example method includes (i) receiving, from a content-distribution system, video comprising a watermark; (ii) extracting the watermark from the video; (iii) based on the extracted watermark, determining a content-creation attribute of the video that indicates a process by which the video was created, wherein the determining comprises using the watermark to select the content-creation attribute from among a set of two or more content-creation attributes comprising organically-generated video and synthetically-generated video; and (iv) in response to determining the content-creation attribute of the video, causing a content-presentation device to perform an action.

    Actor-Replacement System for Videos
    30.
    发明公开

    公开(公告)号:US20240304219A1

    公开(公告)日:2024-09-12

    申请号:US18666243

    申请日:2024-05-16

    Applicant: Roku, Inc.

    CPC classification number: G11B27/036 G06T7/70 G06T2207/10016 G06T2207/30196

    Abstract: In one aspect, an example method includes (i) estimating, using a skeletal detection model, a pose of an original actor for each of multiple frames of a video; (ii) obtaining, for each of a plurality of the estimated poses, a respective image of a replacement actor; (iii) obtaining replacement speech in the replacement actor's voice that corresponds to speech of the original actor in the video; (iv) generating, using the estimated poses, the images of the replacement actor, and the replacement speech, synthetic frames corresponding to the multiple frames of the video that depict the replacement actor in place of the original actor, with the synthetic frames including facial expressions for the replacement actor that temporally align with the replacement speech; and (iv) combining the synthetic frames and the replacement speech so as to obtain a synthetic video that replaces the original actor with the replacement actor.

Patent Agency Ranking