公开(公告)号：US11722721B2

公开(公告)日：2023-08-08

申请号：US17644660

申请日：2021-12-16

Applicant: Roku, Inc.

Inventor： Andreas Schmidt ,  Shashank Merchant ,  Markus Kurt Peter Cremer

IPC: H04N21/2668 ,  H04N21/431 ,  H04N21/81 ,  H04N21/234 ,  H04N21/442 ,  H04N21/654

CPC classification number: H04N21/2668 ,  H04N21/23424 ,  H04N21/4314 ,  H04N21/44204 ,  H04N21/654 ,  H04N21/8153

Abstract: Disclosed is a method that includes a media presentation device (i) generating query fingerprint data representing video frames of a channel being rendered by the media presentation device, and transmitting the generated query fingerprint data from the device over a network to a server, (ii) responsive to transmitting the query fingerprint data to the server, receiving, from the server, channel-icon fingerprint data representing channel icons of multiple channels selected based at least on the server having detected that the query fingerprint data representing the video frames of the channel being rendered by the media presentation device matches the reference fingerprint data representing the frames of the multiple channels of video content, and (iii) responsive to receiving the channel-icon fingerprint data from the server, performing channel-icon fingerprint matching to determine which channel in the multiple channels is the channel being rendered by the media presentation device.

公开(公告)号：US11706481B2

公开(公告)日：2023-07-18

申请号：US16441987

申请日：2019-06-14

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Daniel H. Eakins ,  Shashank Merchant ,  Prashant Ramanathan ,  Jose Pio Pereira

IPC: H04N21/439 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845 ,  H04N1/32 ,  H04N21/43

CPC classification number: H04N21/4394 ,  G10H1/0008 ,  H04N1/32 ,  H04N21/41407 ,  H04N21/4223 ,  H04N21/42203 ,  H04N21/439 ,  H04N21/4332 ,  H04N21/43072 ,  H04N21/8352 ,  H04N21/84 ,  H04N21/8456 ,  G10H2210/041 ,  G10H2210/051 ,  G10H2240/141 ,  G10H2250/235

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US11528514B2

公开(公告)日：2022-12-13

申请号：US17180213

申请日：2021-02-19

Applicant: Roku, Inc.

Inventor： Shashank Merchant ,  Bruce William Randall ,  Brian Johnson ,  Chungwon Seo ,  Seunghyeong Lee ,  Paul Jeffrey Holmquist

IPC: H04N21/234 ,  H04N21/2343 ,  H04N21/845 ,  H04N21/84

Abstract: One high-level aspect of a content-modification system and related methods may involve facilitating content modification by a content-presentation device of received broadcast content in a controlled manner, while under circumstances in which some events that can impact timing may be unpredictable. In particular, certain operations by a content-presentation device may involve matching received content with specific expected content as determined by one or another component of the content-modification system, in order to confirm proper conditions are met for the content-presentation device to proceed with, or continue, content-modification operations. It can happen the matching procedure becomes subject or susceptible to timing irregularities, or jitter. In some instances, jitter may impact the ability to derive the benefits of content modification. Accordingly, example embodiments herein are directed to systems and method for compensation and/or mitigating the effects of jitter.

公开(公告)号：US11347470B2

公开(公告)日：2022-05-31

申请号：US16673859

申请日：2019-11-04

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Aneesh Vartakavi

IPC: H04N21/439 ,  H04N21/81 ,  H03G3/24 ,  H04N5/14 ,  G06F3/16 ,  H03G3/30 ,  G06N3/08

Abstract: In one aspect, an example method includes (i) presenting first media content from a first source; (ii) encountering a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining a first loudness level of the first media content; (iv) determining a second loudness level of the second media content; (v) based on a difference between the first loudness level and the second loudness level, adjusting a loudness level of the second media content so as to generate modified media content having a third loudness level that is different from the second loudness level; and (vi) responsive to encountering the trigger, presenting the modified media content having the third loudness level.

公开(公告)号：US11334615B2

公开(公告)日：2022-05-17

申请号：US16553658

申请日：2019-08-28

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Jose Pio Pereira ,  Shashank Merchant ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06V10/46 ,  G06V20/40

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11303870B2

公开(公告)日：2022-04-12

申请号：US17003203

申请日：2020-08-26

Applicant: Roku, Inc.

Inventor： Kurt R. Thielen ,  Shashank Merchant ,  Peter Dunker ,  Markus K. Cremer ,  Chungwon Seo ,  Seunghyeong Lee ,  Steven D. Scherf

IPC: H04N9/87 ,  H04N21/431 ,  H04N21/485 ,  H04N21/81 ,  H04N21/482 ,  H04N21/472

Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device, that a remote control transmitted to the playback device an instruction configured to cause a modification to operation of the playback device while the playback device displays the replacement media content; (iii) determining, by the playback device based on the instruction, an overlay that the playback device is configured to provide for display in conjunction with the modification; (iv) determining, by the playback device, a region within a display of the playback device corresponding to the overlay; and (v) modifying, by the playback device, a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.

公开(公告)号：US11288312B2

公开(公告)日：2022-03-29

申请号：US16442006

申请日：2019-06-14

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Mihailo M. Stojancic ,  Shashank Merchant

IPC: G06F16/00 ,  G06F16/783 ,  G06F16/71 ,  G06F16/901 ,  G06K9/00 ,  G06T7/11 ,  G06T7/12 ,  G06T7/162 ,  G06T7/10

Abstract: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

公开(公告)号：US11245958B2

公开(公告)日：2022-02-08

申请号：US16433530

申请日：2019-06-06

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant

IPC: H04N21/439 ,  H04N21/81 ,  H04N21/44 ,  H04N21/462 ,  H04N21/442 ,  G06Q30/02

Abstract: In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.

公开(公告)号：US11228798B1

公开(公告)日：2022-01-18

申请号：US17180242

申请日：2021-02-19

Applicant: Roku, Inc.

Inventor： Shashank Merchant ,  Bruce William Randall ,  Brian Johnson ,  Chungwon Seo ,  Seunghyeong Lee ,  Paul Jeffrey Holmquist

IPC: H04N7/173 ,  H04N21/43 ,  G06K9/62 ,  H04N21/4402 ,  H04N21/8547 ,  H04N21/438 ,  G06K9/00

Abstract: One high-level aspect of a content-modification system and related methods may involve facilitating content modification by a content-presentation device of received broadcast content in a controlled manner, while under circumstances in which some events that can impact timing may be unpredictable. In particular, certain operations by a content-presentation device may involve matching received content with specific expected content as determined by one or another component of the content-modification system, in order to confirm proper conditions are met for the content-presentation device to proceed with, or continue, content-modification operations. It can happen the matching procedure becomes subject or susceptible to timing irregularities, or jitter. In some instances, jitter may impact the ability to derive the benefits of content modification. Accordingly, example embodiments herein are directed to systems and method for compensation and/or mitigating the effects of jitter.

公开(公告)号：US20210409795A1

公开(公告)日：2021-12-30

申请号：US17180289

申请日：2021-02-19

Applicant: Roku, Inc.

Inventor： Shashank Merchant ,  Bruce William Randall ,  Brian Johnson ,  Chungwon Seo ,  Seunghyeong Lee ,  Paul Jeffrey Holmquist

IPC: H04N21/234 ,  H04N21/2343 ,  H04N21/84 ,  H04N21/845

Abstract: One high-level aspect of a content-modification system and related methods may involve facilitating content modification by a content-presentation device of received broadcast content in a controlled manner, while under circumstances in which some events that can impact timing may be unpredictable. In particular, certain operations by a content-presentation device may involve matching received content with specific expected content as determined by one or another component of the content-modification system, in order to confirm proper conditions are met for the content-presentation device to proceed with, or continue, content-modification operations. It can happen the matching procedure becomes subject or susceptible to timing irregularities, or jitter. In some instances, jitter may impact the ability to derive the benefits of content modification. Accordingly, example embodiments herein are directed to systems and method for compensation and/or mitigating the effects of jitter.