Audio cancellation and content recognition of audio received over HDMI/ARC

    公开(公告)号:US11625215B2

    公开(公告)日:2023-04-11

    申请号:US17830869

    申请日:2022-06-02

    申请人: Roku, Inc.

    摘要: Apparatus, systems, and methods are disclosed for cancellation and content recognition of audio received over a High-Definition Multimedia Interface (HDMI)/Audio Return Channel (ARC) port of a display device. The media device receives audio over the HDMI/ARC port from the display device, processes the audio by identifying, decoding, re-encoding, and fingerprinting the audio with identification information, and subsequently streams the audio within the media streaming environment, including to external speakers, such as voice-enabled speakers. Based on the identification information and recognized content of the processed audio, the media device offers additional content for streaming to a user. The media device continuously monitors for spoken voice received over a voice-enabled speaker while the media device simultaneously receives, processes, and streams audio from the display device. By cancelling the part of the streaming audio received simultaneously with the spoken voice received, the media device enables the voice-enabled speaker to distinguish a voice command.

    Identifying audio characteristics of a room using a spread code

    公开(公告)号:US10992336B2

    公开(公告)日:2021-04-27

    申请号:US16133817

    申请日:2018-09-18

    申请人: Roku, Inc.

    摘要: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for identifying audio characteristics of a room using a spread code. In some embodiments, a first electronic device receives a spread spectrum signal from a second electronic device over an audio data channel. The first electronic device determines a time of receipt of the spread spectrum signal based on despreading. The first electronic device calculates an airtime delay based on the time of receipt and a time of transmission of the spread spectrum signal. The first electronic device determines a direction of the second electronic device based on the spread spectrum signal and beam forming techniques. The first electronic device adjusts playback of audiovisual content at the second electronic device and a third electronic device for a location based on the airtime delay and the direction.

    Wireless audio synchronization using a spread code

    公开(公告)号:US10931909B2

    公开(公告)日:2021-02-23

    申请号:US16133813

    申请日:2018-09-18

    申请人: Roku, Inc.

    摘要: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content among multiple speakers. In some embodiments, a first smart speaker receives a spread spectrum signal from a second smart speaker over an audio data channel. The first smart speaker despreads the spread spectrum signal based on a spreading code. The first smart speaker determines a time of receipt of the spread spectrum signal based on the despreading. The first smart speaker receives a time of transmission of the spread spectrum signal. The first smart speaker then calculates a playback delay based on the time of receipt and the time of transmission. Then the first smart speaker controls the playback of the audiovisual content based on the playback delay.

    Automatic Classification of Audio Content as Either Primarily Speech or Primarily Non-speech, to Facilitate Dynamic Application of Dialogue Enhancement

    公开(公告)号:US20230290366A1

    公开(公告)日:2023-09-14

    申请号:US17654339

    申请日:2022-03-10

    申请人: Roku, Inc.

    IPC分类号: G10L21/02 G10L15/08 G10L25/18

    CPC分类号: G10L21/02 G10L15/08 G10L25/18

    摘要: A method for dynamically controlling enhancement of an audio stream is provided, where the audio stream defines a sequence of audio segments over time. Each audio segment defines a waveform having a plurality of waveform attributes. For each audio segment of the sequence of audio segments, the method includes: (i) determining a set of waveform-attribute values of the audio segment's waveform attributes, (ii) computing a first distance between the determined set of waveform-attribute values and a first predefined set of waveform-attribute values representative of speech, and computing a second distance between the determined set of waveform-attribute values and a second predefined set of waveform-attribute values representative of music, (iii) using the computed first and second distances as a basis to classify the audio segment as primarily speech or rather primarily music, and (iv) controlling, based on the classifying, whether or not to enhance the audio segment for output.

    Audio synchronization of a dumb speaker and a smart speaker using a spread code

    公开(公告)号:US10958301B2

    公开(公告)日:2021-03-23

    申请号:US16133811

    申请日:2018-09-18

    申请人: Roku, Inc.

    摘要: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content with a dumb speaker. In some embodiments, a display device transmits a spread spectrum signal to a dumb speaker over a data channel using a spread spectrum code. The display device then receives the spread spectrum signal from the dumb speaker over an audio data channel. The display device despreads the spread spectrum signal based on the spreading code. The display device determines a time of receipt of the spread spectrum signal. The display device calculates an audiovisual output path delay for the dumb speaker based on the time of receipt and a time of transmission. The display device then synchronizes the playback of the audiovisual content at the dumb speaker and a smart speaker based on the audiovisual output path delay.

    Audio Cancellation and Content Recognition of Audio Received Over HDMI/ARC

    公开(公告)号:US20200089464A1

    公开(公告)日:2020-03-19

    申请号:US16133797

    申请日:2018-09-18

    申请人: Roku, Inc

    摘要: Apparatus, systems, and methods are disclosed for cancellation and content recognition of audio received over a High-Definition Multimedia Interface (HDMI)/Audio Return Channel (ARC) port of a display device. The media device receives audio over the HDMI/ARC port from the display device, processes the audio by identifying, decoding, re-encoding, and fingerprinting the audio with identification information, and subsequently streams the audio within the media streaming environment, including to external speakers, such as voice-enabled speakers. Based on the identification information and recognized content of the processed audio, the media device offers additional content for streaming to a user. The media device continuously monitors for spoken voice received over a voice-enabled speaker while the media device simultaneously receives, processes, and streams audio from the display device. By cancelling the part of the streaming audio received simultaneously with the spoken voice received, the media device enables the voice-enabled speaker to distinguish a voice command.

    Managing low frequencies of an output signal

    公开(公告)号:US11743644B2

    公开(公告)日:2023-08-29

    申请号:US17552893

    申请日:2021-12-16

    申请人: Roku, Inc.

    IPC分类号: H04R3/04

    CPC分类号: H04R3/04 G10H2210/066

    摘要: Embodiments included herein generally relate to managing low frequencies of an output signal. For example, a method may include: measuring a sound pressure level (SPL) of a speaker; dynamically selecting a cutoff frequency for operating a first filter configured to provide a first bass component of a bass element of an output signal and a second filter configured to provide a second bass component of the bass element; providing the cutoff frequency to the first filter to configure the first filter to generate the first bass component based on the cutoff frequency; providing the cutoff frequency to the second filter to configure the second filter to generate the second bass component based on the cutoff frequency; and generating an output signal based on at least one of the first and second bass components.

    Audio synchronization of a dumb speaker and a smart speaker using a spread code

    公开(公告)号:US11177851B2

    公开(公告)日:2021-11-16

    申请号:US17188599

    申请日:2021-03-01

    申请人: Roku, Inc.

    摘要: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content with a dumb speaker. In some embodiments, an electronic device transmits a spread spectrum signal to a dumb speaker over a data channel using a spread spectrum code. The electronic device then receives the spread spectrum signal played back auditorily by the dumb speaker. The electronic device despreads the spread spectrum signal based on the spreading code. The electronic device determines a time of receipt of the spread spectrum signal. The electronic device calculates an audiovisual output path delay for the dumb speaker based on the time of receipt and a time of transmission. The electronic device then synchronizes the playback of the audiovisual content at the dumb speaker and another electronic device based on the audiovisual output path delay.

    Identifying electronic devices in a room using a spread code

    公开(公告)号:US11671139B2

    公开(公告)日:2023-06-06

    申请号:US17208479

    申请日:2021-03-22

    申请人: Roku, Inc.

    摘要: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for identifying electronic devices in a room using a spread code. In some embodiments, a first electronic device receives a spread spectrum signal from a second electronic device over an audio data channel. The first electronic device determines a time of receipt of the spread spectrum signal based on despreading. The first electronic device calculates a distance between the first electronic device and the second electronic device based on the time of receipt and a time of transmission. The first electronic device determines the second electronic device is not in the room with the first electronic device based on the calculated distance.

    Audio synchronization of a dumb speaker and a smart speaker using a spread code

    公开(公告)号:US11438025B2

    公开(公告)日:2022-09-06

    申请号:US17506801

    申请日:2021-10-21

    申请人: Roku, Inc.

    摘要: Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for synchronizing playback of audiovisual content with a dumb speaker. In some embodiments, a display device transmits a spread spectrum signal to a dumb speaker over a data channel using a spread spectrum code. The display device then receives the spread spectrum signal from the dumb speaker over an audio data channel. The display device despreads the spread spectrum signal based on the spreading code. The display device determines a time of receipt of the spread spectrum signal. The display device calculates an audiovisual output path delay for the dumb speaker based on the time of receipt and a time of transmission. The display device then synchronizes the playback of the audiovisual content at the dumb speaker and a smart speaker based on the audiovisual output path delay.