公开(公告)号：US11445242B2

公开(公告)日：2022-09-13

申请号：US16441996

申请日：2019-06-14

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Daniel H. Eakins ,  Shashank Merchant ,  Prashant Ramanathan ,  Jose Pio Pereira

IPC: H04H20/14 ,  H04H60/29 ,  H04N21/439 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845 ,  H04N1/32 ,  H04N21/43

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US20220276831A1

公开(公告)日：2022-09-01

申请号：US17750012

申请日：2022-05-20

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Robert Coover ,  Todd J. Hodges ,  Joshua Ernest Morris

IPC: G06F3/16 ,  H04N21/439 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, with the first portion having a first length; (ii) switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source; (iii) based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content while the playback device presents the second media content, with the second portions having a second length that is shorter than the first length; and (iv) while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.

公开(公告)号：US20220253275A1

公开(公告)日：2022-08-11

申请号：US17730515

申请日：2022-04-27

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Aneesh Vartakavi

IPC: G06F3/16 ,  H04N21/439 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

Abstract: In one aspect, an example method includes (i) presenting first media content from a first source; (ii) encountering a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining a first loudness level of the first media content; (iv) determining a second loudness level of the second media content; (v) based on a difference between the first loudness level and the second loudness level, adjusting a loudness level of the second media content so as to generate modified media content having a third loudness level that is different from the second loudness level; and (vi) responsive to encountering the trigger, presenting the modified media content having the third loudness level.

公开(公告)号：US11372617B2

公开(公告)日：2022-06-28

申请号：US17325075

申请日：2021-05-19

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Robert Coover ,  Todd J. Hodges ,  Joshua Ernest Morris

IPC: H04N21/439 ,  G06F3/16 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, with the first portion having a first length; (ii) switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source; (iii) based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content while the playback device presents the second media content, with the second portions having a second length that is shorter than the first length; and (iv) while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.

公开(公告)号：US20220201265A1

公开(公告)日：2022-06-23

申请号：US17692786

申请日：2022-03-11

Applicant: Roku, Inc.

Inventor： Kurt R. Thielen ,  Shashank Merchant ,  Peter Dunker ,  Markus K. Cremer ,  Chungwon Seo ,  Seunghyeong Lee ,  Steven D. Scherf

IPC: H04N9/87 ,  H04N21/431 ,  H04N21/485 ,  H04N21/81 ,  H04N21/482 ,  H04N21/472

Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device, that a remote control transmitted to the playback device an instruction configured to cause a modification to operation of the playback device while the playback device displays the replacement media content; (iii) determining, by the playback device based on the instruction, an overlay that the playback device is configured to provide for display in conjunction with the modification; (iv) determining, by the playback device, a region within a display of the playback device corresponding to the overlay; and (v) modifying, by the playback device, a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.

公开(公告)号：US11336952B2

公开(公告)日：2022-05-17

申请号：US15053064

申请日：2016-02-25

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Jose Pio Pereira ,  Peter Wendt ,  Shashank Merchant ,  Sunil Suresh Kulkarni

IPC: H04N21/43 ,  H04N1/32 ,  H04N21/439 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US11323777B2

公开(公告)日：2022-05-03

申请号：US17003211

申请日：2020-08-26

Applicant: Roku, Inc.

Inventor： Kurt R. Thielen ,  Shashank Merchant ,  Peter Dunker ,  Markus K. Cremer ,  Chungwon Seo ,  Seunghyeong Lee ,  Steven D. Scherf

IPC: H04N21/47 ,  H04N21/472 ,  H04N9/87 ,  H04N21/44 ,  H04N21/81 ,  H04N21/431

Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device that while the playback device is displaying the replacement media content a remote control transmitted an instruction to a media device that provides media content to the playback device; (iii) determining, by the playback device, a playback-modification action corresponding to the instruction and the media device; and (iv) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

公开(公告)号：US11234050B2

公开(公告)日：2022-01-25

申请号：US15929225

申请日：2020-02-14

Applicant: Roku, Inc.

Inventor： Shashank Merchant ,  Do Phuoc Hoang Tuong Lan

IPC: H04N21/4402 ,  H04N21/4627 ,  G06F16/783 ,  H04N21/485

Abstract: The disclosure provides for use of steganographically-encoded data as a basis to control content modification. A server could determine through a fingerprint comparison that a portion of media content on a channel being rendered by a content presentation device matches at least one modifiable-content segment, such as at least one replaceable ad. The server could then use watermark data encoded in the media content of the channel as a basis to determine an actual identity of a modifiable-content segment present on the channel, so as to then control content modification.

公开(公告)号：US11163818B2

公开(公告)日：2021-11-02

申请号：US16387443

申请日：2019-04-17

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Prashant Ramanathan ,  Pradipkumar Dineshbhai Gajjar

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US20210271448A1

公开(公告)日：2021-09-02

申请号：US17325075

申请日：2021-05-19

Applicant: Roku, Inc.

Inventor： Markus K. Cremer ,  Shashank Merchant ,  Robert Coover ,  Todd J. Hodges ,  Joshua Ernest Morris

IPC: G06F3/16 ,  H04N21/439 ,  H04N21/81 ,  H03G3/24 ,  H03G3/30 ,  G06N3/08 ,  H04N5/14

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a first loudness level of a first portion of first media content from a first source while the playback device presents the first media content, with the first portion having a first length; (ii) switching, by the playback device, from presenting the first media content from the first source to presenting second media content from a second source; (iii) based on the switching, determining, by the playback device, second loudness levels of second portions of the first media content while the playback device presents the second media content, with the second portions having a second length that is shorter than the first length; and (iv) while the playback device presents the second media content, adjusting, by the playback device, a volume of the playback device based on one or more of the second loudness levels.