公开(公告)号：US12132955B2

公开(公告)日：2024-10-29

申请号：US18218865

申请日：2023-07-06

Applicant: ROKU, INC.

Inventor： Kurt R. Thielen ,  Peter Dunker ,  Markus K. Cremer ,  Steven D. Scherf ,  Shashank Merchant

IPC: H04N21/44 ,  H04N21/234 ,  H04N21/262 ,  H04N21/431 ,  H04N21/432 ,  H04N21/4415 ,  H04N21/442 ,  H04N21/462 ,  H04N21/488

CPC classification number: H04N21/44016 ,  H04N21/23424 ,  H04N21/26241 ,  H04N21/4316 ,  H04N21/4325 ,  H04N21/4415 ,  H04N21/44231 ,  H04N21/4622 ,  H04N21/4882

Abstract: In one aspect, an example method includes (i) identifying, by a playback device, a media device that provides media content to the playback device; (ii) providing, by the playback device, replacement media content for display; (iii) determining, by the playback device, that while the playback device is displaying the replacement media content a remote control transmitted an instruction to the identified media device; (iv) determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device; and (v) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

公开(公告)号：US11962846B2

公开(公告)日：2024-04-16

申请号：US17644120

申请日：2021-12-14

Applicant: Roku, Inc.

Inventor： Shashank Merchant ,  Do Phuoc Hoang Tuong Lan

IPC: H04N21/4402 ,  G06F16/783 ,  H04N21/4627 ,  H04N21/485

CPC classification number: H04N21/440245 ,  G06F16/783 ,  H04N21/4627 ,  H04N21/4852 ,  H04N21/4854

Abstract: The disclosure provides for use of steganographically-encoded data as a basis to control content modification. A server could determine through a fingerprint comparison that a portion of media content on a channel being rendered by a content presentation device matches at least one modifiable-content segment, such as at least one replaceable ad. The server could then use watermark data encoded in the media content of the channel as a basis to determine an actual identity of a modifiable-content segment present on the channel, so as to then control content modification.

公开(公告)号：US11869261B2

公开(公告)日：2024-01-09

申请号：US18172755

申请日：2023-02-22

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Sunil Suresh Kulkarni ,  Mihailo M. Stojancic ,  Shashank Merchant ,  Peter Wendt

IPC: G10L21/0272 ,  G06V30/18 ,  G06T7/246 ,  G06T7/215 ,  G06F16/00 ,  G06T7/254 ,  G06F16/45 ,  G06F16/48 ,  G06V20/40 ,  G06F18/22 ,  G06V20/62 ,  G06V10/50 ,  G10L15/02 ,  G10L15/06 ,  G10L15/10 ,  G10L15/14 ,  G10L15/20 ,  G10L21/0232 ,  G10L25/81 ,  G06F16/906 ,  G06F16/44 ,  G06V30/10 ,  G10L21/0216

CPC classification number: G06V30/18086 ,  G06F16/00 ,  G06F16/45 ,  G06F16/48 ,  G06F18/22 ,  G06T7/215 ,  G06T7/248 ,  G06T7/254 ,  G06V10/50 ,  G06V20/41 ,  G06V20/46 ,  G06V20/49 ,  G06V20/635 ,  G10L15/02 ,  G10L15/063 ,  G10L15/10 ,  G10L15/142 ,  G10L15/20 ,  G10L21/0232 ,  G10L25/81 ,  G06F16/44 ,  G06F16/906 ,  G06T2207/10016 ,  G06T2207/20004 ,  G06T2207/20224 ,  G06V30/10 ,  G10L2015/025 ,  G10L2021/02166

Abstract: Audio distortion compensation methods to improve accuracy and efficiency of audio content identification are described. The method is also applicable to speech recognition. Methods to detect the interference from speakers and sources, and distortion to audio from environment and devices, are discussed. Additional methods to detect distortion to the content after performing search and correlation are illustrated. The causes of actual distortion at each client are measured and registered and learnt to generate rules for determining likely distortion and interference sources. The learnt rules are applied at the client, and likely distortions that are detected are compensated or heavily distorted sections are ignored at audio level or signature and feature level based on compute resources available. Further methods to subtract the likely distortions in the query at both audio level and after processing at signature and feature level are described.

公开(公告)号：US11803591B2

公开(公告)日：2023-10-31

申请号：US17673281

申请日：2022-02-16

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Mihailo M. Stojancic ,  Shashank Merchant

IPC: G06F16/00 ,  G06F16/783 ,  G06F16/71 ,  G06F16/901 ,  G06T7/11 ,  G06T7/12 ,  G06T7/162 ,  G06V20/40 ,  G06T7/10

CPC classification number: G06F16/7837 ,  G06F16/71 ,  G06F16/7847 ,  G06F16/7854 ,  G06F16/9014 ,  G06T7/10 ,  G06T7/11 ,  G06T7/12 ,  G06T7/162 ,  G06V20/40 ,  G06V20/41 ,  G06V20/48 ,  G06T2207/10016 ,  G06T2207/20021 ,  G06V20/44

Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

公开(公告)号：US11765426B2

公开(公告)日：2023-09-19

申请号：US17649002

申请日：2022-01-26

Applicant: Roku, Inc.

Inventor： Kurt R. Thielen ,  Peter Dunker ,  Markus K. Cremer ,  Steven D. Scherf ,  Shashank Merchant

IPC: H04N21/44 ,  H04N21/431 ,  H04N21/234 ,  H04N21/488 ,  H04N21/4415 ,  H04N21/262 ,  H04N21/432 ,  H04N21/442 ,  H04N21/462

CPC classification number: H04N21/44016 ,  H04N21/23424 ,  H04N21/26241 ,  H04N21/4316 ,  H04N21/4325 ,  H04N21/4415 ,  H04N21/44231 ,  H04N21/4622 ,  H04N21/4882

Abstract: In one aspect, an example method includes (i) identifying, by a playback device, a media device based on a control message received from the media device by way of an audio and/or video interface, where the media device provides media content to the playback device; (ii) providing, by the playback device, replacement media content for display; (iii) determining, by the playback device, that while the playback device is displaying the replacement media content a remote control transmitted an instruction to the identified media device; (iv) determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device; and (v) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

公开(公告)号：US11748055B2

公开(公告)日：2023-09-05

申请号：US17750012

申请日：2022-05-20

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Robert Coover ,  Todd J. Hodges ,  Joshua Ernest Morris

IPC: H04N21/439 ,  G06F3/16 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

CPC classification number: G06F3/165 ,  G06N3/08 ,  H03G3/24 ,  H03G3/3005 ,  H03G3/3089 ,  H04N5/147 ,  H04N21/439 ,  H04N21/812

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, with the first portion having a first length; (ii) switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source; (iii) based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content while the playback device presents the second media content, with the second portions having a second length that is shorter than the first length; and (iv) while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.

公开(公告)号：US20230276090A1

公开(公告)日：2023-08-31

申请号：US18309989

申请日：2023-05-01

Applicant: ROKU, INC.

Inventor： Andreas Schmidt ,  Shashank Merchant ,  Markus Kurt Peter Cremer

IPC: H04N21/2668 ,  H04N21/431 ,  H04N21/81 ,  H04N21/234 ,  H04N21/442 ,  H04N21/654

CPC classification number: H04N21/2668 ,  H04N21/4314 ,  H04N21/8153 ,  H04N21/23424 ,  H04N21/44204 ,  H04N21/654

Abstract: Disclosed is a method that includes a media presentation device (i) generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the device over a network to a server, (ii) responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and (iii) responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

公开(公告)号：US11638058B2

公开(公告)日：2023-04-25

申请号：US17644658

申请日：2021-12-16

Applicant: Roku, Inc.

Inventor： Andreas Schmidt ,  Shashank Merchant ,  Markus Kurt Peter Cremer

IPC: H04N21/234 ,  H04N21/2668 ,  H04N21/431 ,  H04N21/81 ,  H04N21/442 ,  H04N21/654

Abstract: Disclosed is a method including (i) detecting that query fingerprint data representing frames of video content being rendered by a media presentation device matches reference fingerprint data representing frames of multiple channels of video content, including detecting that the query fingerprint data matches multiple instances of reference fingerprint data each representing frames of a different respective channel in the multiple channels of video content, and (ii) responsive to at least the detecting that the query fingerprint data representing the frames of the video content being rendered by the device matches the reference fingerprint data representing the frames of the multiple channels of video content, configuring the device with channel-icon fingerprint data representing channel icons of the multiple channels of video content, to enable the device to perform channel-icon fingerprint matching to determine which channel of the multiple channels is being rendered by the device.

公开(公告)号：US11556304B2

公开(公告)日：2023-01-17

申请号：US17350557

申请日：2021-06-17

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Robert Coover ,  Todd J. Hodges ,  Joshua Ernest Morris

IPC: G06F3/16 ,  H04N21/439 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a loudness level of first media content that the playback device is receiving from a first source; (ii) comparing, by the playback device, the determined loudness level of the first media content with a reference loudness level indicated by a loudness level profile for the first media content; (iii) determining, by the playback device, a target volume level for the playback device based on a difference between the determined loudness level of the first media content and the reference loudness level; and (iv) while the playback device presents second media content from a second source in place of the first media content, adjusting, by the playback device, a volume of the playback device toward the target volume level.

公开(公告)号：US11455328B2

公开(公告)日：2022-09-27

申请号：US16869214

申请日：2020-05-07

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Jose Pio Pereira ,  Shashank Merchant ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06V10/46 ,  G06V20/40

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.