公开(公告)号：US11188587B2

公开(公告)日：2021-11-30

申请号：US16387456

申请日：2019-04-17

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Prashant Ramanathan ,  Pradipkumar Dineshbhai Gajjar

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11455328B2

公开(公告)日：2022-09-27

申请号：US16869214

申请日：2020-05-07

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Jose Pio Pereira ,  Shashank Merchant ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06V10/46 ,  G06V20/40

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11449540B1

公开(公告)日：2022-09-20

申请号：US16874896

申请日：2020-05-15

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/783 ,  G06F16/951 ,  G06F16/28 ,  G06F16/901 ,  G06F16/22 ,  G06V10/46 ,  G06V20/40

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11445242B2

公开(公告)日：2022-09-13

申请号：US16441996

申请日：2019-06-14

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Daniel H. Eakins ,  Shashank Merchant ,  Prashant Ramanathan ,  Jose Pio Pereira

IPC: H04H20/14 ,  H04H60/29 ,  H04N21/439 ,  H04N21/8352 ,  G10H1/00 ,  H04N21/414 ,  H04N21/422 ,  H04N21/4223 ,  H04N21/433 ,  H04N21/84 ,  H04N21/845 ,  H04N1/32 ,  H04N21/43

Abstract: A mobile device responds in real time to media content presented on a media device, such as a television. The mobile device captures temporal fragments of audio-video content on its microphone, camera, or both and generates corresponding audio-video query fingerprints. The query fingerprints are transmitted to a search server located remotely or used with a search function on the mobile device for content search and identification. Audio features are extracted and audio signal global onset detection is used for input audio frame alignment. Additional audio feature signatures are generated from local audio frame onsets, audio frame frequency domain entropy, and maximum change in the spectral coefficients. Video frames are analyzed to find a television screen in the frames, and a detected active television quadrilateral is used to generate video fingerprints to be combined with audio fingerprints for more reliable content identification.

公开(公告)号：US11163818B2

公开(公告)日：2021-11-02

申请号：US16387443

申请日：2019-04-17

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Prashant Ramanathan ,  Pradipkumar Dineshbhai Gajjar

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US20210382932A1

公开(公告)日：2021-12-09

申请号：US17408248

申请日：2021-08-20

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Prashant Ramanathan ,  Peter Wendt ,  Jose Pio Pereira

IPC: G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11194854B2

公开(公告)日：2021-12-07

申请号：US16388740

申请日：2019-04-18

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11120068B2

公开(公告)日：2021-09-14

申请号：US16387448

申请日：2019-04-17

Applicant: Roku, Inc.

Inventor： Jose Pio Pereira ,  Sunil Suresh Kulkarni ,  Shashank Merchant ,  Prashant Ramanathan ,  Pradipkumar Dineshbhai Gajjar

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11630858B2

公开(公告)日：2023-04-18

申请号：US17408248

申请日：2021-08-20

Applicant: Roku, Inc.

Inventor： Mihailo M. Stojancic ,  Prashant Ramanathan ,  Peter Wendt ,  Jose Pio Pereira ,  Shashank Merchant

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06V10/46 ,  G06V20/40

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

公开(公告)号：US11194855B2

公开(公告)日：2021-12-07

申请号：US16388750

申请日：2019-04-18

Applicant: Roku, Inc.

Inventor： Prashant Ramanathan ,  Mihailo M. Stojancic

IPC: G06F16/00 ,  G06F16/48 ,  G06F16/41 ,  G06F16/28 ,  G06F16/783 ,  G06F16/951 ,  G06F16/22 ,  G06F16/901 ,  G06K9/00 ,  G06K9/46

Abstract: The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.