公开(公告)号：US20240298045A1

公开(公告)日：2024-09-05

申请号：US18177897

申请日：2023-03-03

Applicant: Roku, Inc.

Inventor： Shashank C. Merchant ,  Prateek Tandon ,  Michael Cutter ,  Sunil Ramesh ,  Karina Levitian

IPC: H04N21/234 ,  H04N21/25 ,  H04N21/258 ,  H04N21/2668 ,  H04N21/81 ,  H04N21/854

CPC classification number: H04N21/23412 ,  H04N21/23418 ,  H04N21/251 ,  H04N21/25883 ,  H04N21/2668 ,  H04N21/8146 ,  H04N21/854

Abstract: In one aspect, an example method includes (i) obtaining video that depicts an object across multiple frames of the video; (ii) detecting the object within the obtained video and determining object characteristic data associated with the detected object; (iii) determining user profile data associated with a viewer of the video; (iv) using at least the determined object characteristic data and the determined user profile data as a basis to select a replacement object from among a set of multiple candidate replacement objects; (v) replacing the detected object with the selected replacement object to generate video that is a modified version of the obtained video; and (vi) outputting for presentation the generated video.

公开(公告)号：US20240245956A1

公开(公告)日：2024-07-25

申请号：US18597475

申请日：2024-03-06

Applicant: Roku, Inc.

Inventor： Karina Levitian ,  Sunil Ramesh ,  Michael Cutter ,  Preethi Parasseri Narayanan

IPC: A63B24/00 ,  A63B71/06 ,  G06T7/292 ,  G06T13/40 ,  G06T13/80

CPC classification number: A63B24/0075 ,  A63B71/0622 ,  G06T7/292 ,  G06T13/40 ,  G06T13/80 ,  A63B2024/0068 ,  A63B2024/0096 ,  A63B2071/0625 ,  A63B2071/0647 ,  A63B2220/05 ,  A63B2220/17 ,  A63B2220/40 ,  A63B2220/806 ,  A63B2220/836 ,  A63B2225/20 ,  A63B2225/74 ,  A63B2230/06 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: In one aspect, an example method includes (i) receiving, from one or more cameras in a viewing environment of a content-presentation device, video of a user performing a fitness exercise in the viewing environment; (ii) using the received video and a skeletal detection model to estimate skeletal movement of the user; (iii) generating a synthetic video representing the user moving according to the estimated skeletal movement; (iv) based on a comparison of the estimated skeletal movement with predefined reference skeletal movement representing desired skeletal movement for the fitness exercise, and while the user is performing the fitness exercise, continually calculating a metric representing a difference between the estimated skeletal movement and the reference skeletal movement; and (v) causing the content-presentation device to concurrently display the generated synthetic video, a reference video representing the reference skeletal movement, and an indication of the metric.

公开(公告)号：US12014753B1

公开(公告)日：2024-06-18

申请号：US18349551

申请日：2023-07-10

Applicant: Roku, Inc.

Inventor： Sunil Ramesh ,  Michael Cutter ,  Karina Levitian

IPC: G11B27/00 ,  G06T7/70 ,  G11B27/036

CPC classification number: G11B27/036 ,  G06T7/70 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: In one aspect, an example method includes (i) estimating, using a skeletal detection model, a pose of an original actor for each of multiple frames of a video; (ii) obtaining, for each of a plurality of the estimated poses, a respective image of a replacement actor; (iii) obtaining replacement speech in the replacement actor's voice that corresponds to speech of the original actor in the video; (iv) generating, using the estimated poses, the images of the replacement actor, and the replacement speech, synthetic frames corresponding to the multiple frames of the video that depict the replacement actor in place of the original actor, with the synthetic frames including facial expressions for the replacement actor that temporally align with the replacement speech; and (iv) combining the synthetic frames and the replacement speech so as to obtain a synthetic video that replaces the original actor with the replacement actor.

公开(公告)号：US11985385B1

公开(公告)日：2024-05-14

申请号：US18107675

申请日：2023-02-09

Applicant: Roku, Inc.

Inventor： Sunil Ramesh ,  Michael Cutter ,  Ronica Jethwa

IPC: H04N21/442 ,  H04N21/4415 ,  H04N21/482

CPC classification number: H04N21/44218 ,  H04N21/4415 ,  H04N21/4821

Abstract: A method and system for controlling media-content presentation based on user presence and/or user profile. An example method includes a computing system determining a quantity of users present at a media-presentation device, the quantity being at least one. Further, the example method includes, based on the determining, the computing system using the determined quantity of users present at the media-presentation device as a basis to control what media content a media player outputs for presentation by the media-presentation device. For instance, based on the determined quantity of users the computing system could tailor a graphical user interface (GUI) that the media player outputs for presentation by the media-presentation device, such as by tailoring a set of channel options that a channel-selection GUI provides, among other possibilities.

公开(公告)号：US11868538B1

公开(公告)日：2024-01-09

申请号：US17973150

申请日：2022-10-25

Applicant: Roku, Inc.

Inventor： Michael Cutter ,  Sunil Ramesh ,  Karina Levitian

IPC: G06F3/00 ,  G06V10/764 ,  G06V40/20 ,  G06V20/52 ,  G06T7/70 ,  H04N23/90 ,  G06F3/01

CPC classification number: G06F3/017 ,  G06T7/70 ,  G06V10/764 ,  G06V20/52 ,  G06V40/20 ,  H04N23/90 ,  G06T2207/30196 ,  G06T2207/30232 ,  G06T2207/30244

Abstract: In one aspect, an example method includes (i) receiving, by a computing system and from an input device associated with the computing system, a command to map a customized gesture with a particular action of a plurality of actions that a media player is configured to perform; (ii) in response to receiving the command, monitoring, by the computing system and using a camera, a viewing environment of the media player to detect performance by a person of the customized gesture; and (iii) in response to detecting performance of the customized gesture: generating, by the computing system, a classification for use by the computing system for detecting the customized gesture, and storing, by the computing system, in memory, mapping data that correlates the detected customized gesture with the particular action.

公开(公告)号：US11769312B1

公开(公告)日：2023-09-26

申请号：US18177849

申请日：2023-03-03

Applicant: Roku, Inc.

Inventor： Sunil Ramesh ,  Michael Cutter ,  Karina Levitian

IPC: G06T19/20 ,  G06V20/40 ,  G06V10/70 ,  G06T15/50 ,  G06T15/10

CPC classification number: G06T19/20 ,  G06T15/10 ,  G06T15/503 ,  G06V10/70 ,  G06V20/41 ,  G06T2219/2016 ,  G06V2201/10

Abstract: In one aspect, an example method includes (i) obtaining video that depicts an area across multiple frames of the video, wherein the area is part of a scene of the video, and wherein the area is suitable for having an object inserted therein; (ii) detecting the area within the obtained video and determining area characteristic data associated with the detected area; (iii) determining scene attribute data associated with the scene; (iv) using at least the determined area characteristic data and the determined scene attribute data as a basis to select an object from among a set of multiple candidate objects; (v) inserting into the detected area the selected object to generate video that is a modified version of the obtained video; and (vi) outputting for presentation the generated video.

公开(公告)号：US12260882B2

公开(公告)日：2025-03-25

申请号：US18666243

申请日：2024-05-16

Applicant: Roku, Inc.

Inventor： Sunil Ramesh ,  Michael Cutter ,  Karina Levitian

IPC: G11B27/00 ,  G06T7/00 ,  G11B27/036 ,  G06T7/70

Abstract: In one aspect, an example method includes (i) estimating, using a skeletal detection model, a pose of an original actor for each of multiple frames of a video; (ii) obtaining, for each of a plurality of the estimated poses, a respective image of a replacement actor; (iii) obtaining replacement speech in the replacement actor's voice that corresponds to speech of the original actor in the video; (iv) generating, using the estimated poses, the images of the replacement actor, and the replacement speech, synthetic frames corresponding to the multiple frames of the video that depict the replacement actor in place of the original actor, with the synthetic frames including facial expressions for the replacement actor that temporally align with the replacement speech; and (iv) combining the synthetic frames and the replacement speech so as to obtain a synthetic video that replaces the original actor with the replacement actor.

公开(公告)号：US12256175B2

公开(公告)日：2025-03-18

申请号：US18065026

申请日：2022-12-13

Applicant: Roku, Inc.

Inventor： Sunil Ramesh ,  Michael Cutter ,  Karina Levitian

IPC: G06T13/40 ,  G06T13/20 ,  G06V10/774 ,  G06V10/80 ,  G06V10/82 ,  G06V40/16 ,  H04N7/15

Abstract: In one aspect, an example method includes (i) receiving audio from a first client device engaged in a communication session with a second client device, the audio comprising one or more words spoken by a user of the first client device; (ii) using the audio and a facial feature model to estimate facial movement that corresponds to the one or more words spoken by the user; (iii) generating a synthetic video depicting an avatar of the user moving according to the estimated facial movement; and (iv) in response to generating the synthetic video, causing the second client device to present the synthetic video synchronized with the audio.

公开(公告)号：US20250037742A1

公开(公告)日：2025-01-30

申请号：US18913452

申请日：2024-10-11

Applicant: Roku, Inc.

Inventor： Michael Cutter ,  Sunil Ramesh ,  Karina Levitian

IPC: G11B27/036 ,  G06V20/40

Abstract: In one aspect, an example method includes (i) obtaining, by a computing system, video data representing video content; (ii) analyzing, by the computing system, the video data to identify an event that is a subject of the video content; (iii) using, by the computing system, the identified event as a basis to select audio content; and (iv) performing, by the computing system, an operation that facilitates editing the video content to include the selected audio content.

公开(公告)号：US20240430543A1

公开(公告)日：2024-12-26

申请号：US18586269

申请日：2024-02-23

Applicant: Roku, Inc.

Inventor： Sunil Ramesh ,  Michael Cutter

IPC: H04N21/845 ,  H04N21/422 ,  H04N21/442 ,  H04N21/81

Abstract: In one aspect, disclosed is an example method for use in connection with a media-presentation device having an associated presentation area, the method including: (i) obtaining presentation area data associated with the presentation area; (ii) determining that the obtained presentation area data satisfies each and every condition of a condition set; (iii) responsive to at least determining that the obtained presentation area data satisfies each and every condition of the condition set, identifying an upcoming media segment insertion point within a media program; and (iv) facilitating the media-presentation device outputting for presentation a media segment starting at the identified media segment insertion point within the media program.