公开(公告)号：US20210409794A1

公开(公告)日：2021-12-30

申请号：US17180231

申请日：2021-02-19

Applicant: Roku, Inc.

Inventor： Shashank Merchant ,  Bruce William Randall ,  Brian Johnson ,  Chungwon Seo ,  Seunghyeong Lee ,  Paul Jeffrey Holmquist

IPC: H04N21/234 ,  H04N21/2343 ,  H04N21/84 ,  H04N21/845

Abstract: One high-level aspect of a content-modification system and related methods may involve facilitating content modification by a content-presentation device of received broadcast content in a controlled manner, while under circumstances in which some events that can impact timing may be unpredictable. In particular, certain operations by a content-presentation device may involve matching received content with specific expected content as determined by one or another component of the content-modification system, in order to confirm proper conditions are met for the content-presentation device to proceed with, or continue, content-modification operations. It can happen the matching procedure becomes subject or susceptible to timing irregularities, or jitter. In some instances, jitter may impact the ability to derive the benefits of content modification. Accordingly, example embodiments herein are directed to systems and method for compensation and/or mitigating the effects of jitter.

公开(公告)号：USRE48791E1

公开(公告)日：2021-10-26

申请号：US16597648

申请日：2019-10-09

Applicant: Roku, Inc.

Inventor： Sunil Suresh Kulkarni ,  Jose Pio Pereira ,  Pradipkumar Dineshbhai Gajjar ,  Shashank Merchant ,  Prashant Ramanathan ,  Mihailo M. Stojancic

IPC: G06F16/783 ,  G06F16/43 ,  G06F16/245 ,  G06F16/22 ,  G06F16/951

Abstract: An architecture for a multimedia search system is described. To perform similarity matching of multimedia query frames against reference content, reference database comprising of a cluster index using cluster keys to perform similarity matching and a multimedia index to perform sequence matching is built. Methods to update and maintain the reference database that enables addition and removal of the multimedia contents, including portions of multimedia content, from the reference database in a running system are described. Hierarchical multi-level partitioning methods to organize the reference database are presented. Smart partitioning of the reference multimedia content according to the nature of the multimedia content, and according to the popularity among the social media, that supports scalable fast multimedia identification is also presented. A caching mechanism for multimedia search queries in a centralized or in a decentralized distributed system and a client based local multimedia search system enabling multimedia tracking are described.

公开(公告)号：US20210311697A1

公开(公告)日：2021-10-07

申请号：US17350557

申请日：2021-06-17

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Robert Coover ,  Todd J. Hodges ,  Joshua Ernest Morris

IPC: G06F3/16 ,  H04N21/439 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a loudness level of first media content that the playback device is receiving from a first source; (ii) comparing, by the playback device, the determined loudness level of the first media content with a reference loudness level indicated by a loudness level profile for the first media content; (iii) determining, by the playback device, a target volume level for the playback device based on a difference between the determined loudness level of the first media content and the reference loudness level; and (iv) while the playback device presents second media content from a second source in place of the first media content, adjusting, by the playback device, a volume of the playback device toward the target volume level.

公开(公告)号：US11140439B2

公开(公告)日：2021-10-05

申请号：US16441967

申请日：2019-06-14

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Jose Pio Pereira ,  Oleksiy Bolgarov

IPC: H04N21/439 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845 ,  H04N1/32

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US11126654B1

公开(公告)日：2021-09-21

申请号：US17017589

申请日：2020-09-10

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Mihailo M. Stojancic ,  Shashank Merchant

IPC: G06F16/783 ,  G06F16/901 ,  G06K9/00 ,  G06T7/11 ,  G06T7/12 ,  G06T7/162 ,  G06T7/10 ,  G06F16/71

Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

公开(公告)号：US11095944B2

公开(公告)日：2021-08-17

申请号：US16996701

申请日：2020-08-18

Applicant: Roku, Inc.

Inventor： Andrew Laurence Ashbacher ,  Steven Michael Cormie ,  John L Haynes, III ,  Shashank Merchant ,  Benjamin J. Ropke ,  Markus Kurt Peter Cremer

IPC: H04N21/462 ,  G06F16/735 ,  H04N21/431 ,  H04N21/435

Abstract: In one aspect, a method includes (i) accessing, by a computing system, broadcast-schedule data associated with a channel; (ii) using, by the computing system, the accessed broadcast-schedule data to identify an upcoming content-modification opportunity on the channel; (iii) determining, by the computing system, that a content-presentation device is receiving content on the channel; (iv) determining, by the computing system, a content-transmission delay associated with the content-presentation device and the channel; and (v) causing, by the computing system, the content-presentation device to perform an action to facilitate the content-presentation device performing, during a time-period that accounts for the determined content-transmission delay, a content-modification operation related to the identified upcoming content-modification opportunity on the channel.

公开(公告)号：US11042585B2

公开(公告)日：2021-06-22

申请号：US16367921

申请日：2019-03-28

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Jose Pio Pereira ,  Shashank Merchant ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US20250047924A1

公开(公告)日：2025-02-06

申请号：US18364169

申请日：2023-08-02

Applicant: Roku, Inc.

Inventor： Shashank Merchant

IPC: H04N21/2668 ,  H04N21/234 ,  H04N21/25 ,  H04N21/258 ,  H04N21/431

Abstract: Provided herein are system, apparatus, article of manufacture, method and/or computer program product, and/or combinations and sub-combinations thereof, for utilizing a personalized content system to enhance an effectiveness of content being shown to the user via personalized content associated with the content. This method allows the platform to present the most relevant personalized in-channel content to the users, in a user interface, which then correspondingly helps drive user interest. This method scans content to identify objects of interest located within the content, generates a query based on the identified objects of interest and a user profile, searches content sources for related content, associates the related content with an occurrence of a corresponding identified object of interest within the content and communicates, to the user device, the content and the related content for instantiation through a user interface of the user device.

公开(公告)号：US12149768B2

公开(公告)日：2024-11-19

申请号：US18309989

申请日：2023-05-01

Applicant: ROKU, INC.

Inventor： Andreas Schmidt ,  Shashank Merchant ,  Markus Kurt Peter Cremer

IPC: H04N21/2668 ,  H04N21/234 ,  H04N21/431 ,  H04N21/442 ,  H04N21/654 ,  H04N21/81

Abstract: Disclosed is a method that includes a media presentation device (i) generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the device over a network to a server, (ii) responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and (iii) responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

公开(公告)号：US11895370B2

公开(公告)日：2024-02-06

申请号：US17706417

申请日：2022-03-28

Applicant: Roku, Inc.

Inventor： Kurt R. Thielen ,  Shashank Merchant ,  Peter Dunker ,  Markus K. Cremer ,  Chungwon Seo ,  Seunghyeong Lee ,  Steven D Scherf

IPC: H04N21/472 ,  H04N9/87 ,  H04N21/44 ,  H04N21/81 ,  H04N21/431

CPC classification number: H04N21/47217 ,  H04N9/8715 ,  H04N21/4312 ,  H04N21/44016 ,  H04N21/812 ,  H04N21/8146

Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device that while the playback device is displaying the replacement media content a remote control transmitted an instruction to a media device that provides media content to the playback device; (iii) determining, by the playback device, a playback-modification action corresponding to the instruction and the media device; and (iv) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.