Immersive sound for teleoperators

    公开(公告)号:US11480961B1

    公开(公告)日:2022-10-25

    申请号:US16691424

    申请日:2019-11-21

    申请人: Zoox, Inc.

    摘要: Immersive experiences for users are described herein. In an example, audio data from a plurality of audio sensors associated with a vehicle can be received by an audio data processing system. The audio data processing system can combine individual captured audio channels (e.g., from the plurality of audio sensors) into two or more audio channels for output via two or more speakers proximate a user. A first audio channel of the two or more audio channels can be output via a first speaker and second audio channel of the two or more audio channels to be output via a second speaker, wherein output of the first audio channel and the second audio channel causes a resulting sound corresponding to at least a portion of a sound scene associated with the vehicle. In an example, a user computing device operable by the user can receive an input from the user.

    ADAPTIVE CROSS-CORRELATION
    4.
    发明申请

    公开(公告)号:US20220312138A1

    公开(公告)日:2022-09-29

    申请号:US17216491

    申请日:2021-03-29

    申请人: Zoox, Inc.

    IPC分类号: H04R29/00 H04R3/00 H04R1/32

    摘要: Techniques for adaptive cross-correlation are discussed. A first signal is received from a first audio sensor associated with a vehicle and a second signal is received from a second audio sensor associated with the vehicle. Techniques may include determining, based at least in part on the first signal, a first transformed signal in a frequency domain. Additionally, the techniques include determining, based at least in part on the second signal, a second transformed signal in the frequency domain. A parameter can be determined based at least in part on a characteristic associated with at least one of the vehicle, an environment proximate the vehicle, or one or more of the first or second signal. Cross-correlation data can be determined based at least in part on one or more of the first transformed signal, the second transformed signal, or the parameter.

    Adaptive cross-correlation
    6.
    发明授权

    公开(公告)号:US11606659B2

    公开(公告)日:2023-03-14

    申请号:US17216491

    申请日:2021-03-29

    申请人: Zoox, Inc.

    IPC分类号: H04R29/00 H04R1/32 H04R3/00

    摘要: Techniques for adaptive cross-correlation are discussed. A first signal is received from a first audio sensor associated with a vehicle and a second signal is received from a second audio sensor associated with the vehicle. Techniques may include determining, based at least in part on the first signal, a first transformed signal in a frequency domain. Additionally, the techniques include determining, based at least in part on the second signal, a second transformed signal in the frequency domain. A parameter can be determined based at least in part on a characteristic associated with at least one of the vehicle, an environment proximate the vehicle, or one or more of the first or second signal. Cross-correlation data can be determined based at least in part on one or more of the first transformed signal, the second transformed signal, or the parameter.

    DETECTING OCCLUDED OBJECTS USING SOUND

    公开(公告)号:US20210302988A1

    公开(公告)日:2021-09-30

    申请号:US16836632

    申请日:2020-03-31

    申请人: Zoox, Inc.

    摘要: Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.

    Detecting occluded objects using sound

    公开(公告)号:US11625042B2

    公开(公告)日:2023-04-11

    申请号:US16836632

    申请日:2020-03-31

    申请人: Zoox, Inc.

    摘要: Techniques for determining information associated with sounds detected in an environment based on audio data and map data or perception data are discussed herein. A vehicle can use map data and/or perception data to distinguish between multiple audio signals or sounds. A direct source of sound can be distinguished from a reflected source of sound by determining a direction of arrival of sounds and which objects the directions of arrival are associated with in the environment. A reflected sound can be received without receiving a direct sound. Based on the reflected sound and map data or perception data, characteristics of sound in an occluded region of the environment may be determined and used to control the vehicle.