-
公开(公告)号:US12084060B2
公开(公告)日:2024-09-10
申请号:US17478602
申请日:2021-09-17
Applicant: Zoox, Inc.
Inventor: Jonathan Tyler Dowdall , Kratarth Goel , Adam Edward Pollack , Scott M. Purdy , Bharadwaj Raghavan
IPC: G06T7/55 , B60W40/02 , B60W50/06 , B60W60/00 , G01S17/894 , G01S17/931 , G06T7/11 , G06T7/30 , B60W30/095
CPC classification number: B60W40/02 , B60W50/06 , B60W60/0015 , G01S17/894 , G06T7/11 , G06T7/30 , G06T7/55 , B60W30/0956 , B60W2420/408 , G01S17/931 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30252
Abstract: Techniques for utilizing a depth completion algorithm to determine dense depth data are discussed are discussed herein. Two-dimensional image data representing an environment can be captured or otherwise received. Depth data representing the environment can be captured or otherwise received. The depth data can be projected into the image data and processed using the depth completion algorithm. The depth completion algorithm can be utilized to determine the dense depth values based on intensity values of pixels, and other depth values. A vehicle can be controlled based on the determined depth values.
-
公开(公告)号:US12299997B1
公开(公告)日:2025-05-13
申请号:US17952604
申请日:2022-09-26
Applicant: Zoox, Inc.
Inventor: Amir Ghaderi , Jonathan Tyler Dowdall , Derek Xiang Ma
Abstract: Techniques for detecting, locating, and/or classifying objects based on multiple sensor data inputs received from different sensor modalities. The techniques may include receiving sensor data generated by different sensor modalities of a vehicle, the sensor data including at least first sensor data generated by a first sensor modality and second sensor data generated by a second sensor modality. In some examples, the sensor data may be input into a machine-learning pipeline. The machine-learning pipeline may be configured to determine locations of objects in an environment surrounding the vehicle based at least in part on a correlation, by the multi-attention component, of the first sensor data and the second sensor data. The techniques may also include receiving, from the machine-learning pipeline, an output indicating a location of an object in the environment.
-
公开(公告)号:US11851049B1
公开(公告)日:2023-12-26
申请号:US16805250
申请日:2020-02-28
Applicant: Zoox, Inc.
Inventor: Dilip Bethanabhotla , Michael Carsten Bosse , Venkata Subrahmanyam Chandra Sekhar Chebiyyam , Nam Gook Cho , Jonathan Tyler Dowdall , Amanda Brown Prescott , Subasingha Shaminda Subasingha , Sarah Tariq
CPC classification number: B60W30/09 , B60W60/0015 , G05D1/0088 , G10L25/51 , H04R1/08 , B60W2420/54 , B60W2520/10 , B60W2554/4042 , B60W2756/10 , H04R2499/13
Abstract: Techniques for utilizing microphone or audio data to detect and responding to low velocity impacts to a system such as an autonomous vehicle. In some cases, the system may be equipped with a plurality of microphones that may be used to detect impacts that fail to register on the data captured by the vehicle's inertial measurement units and may go undetected by the vehicle's perception system and sensors. In one specific example, the perception system of the autonomous vehicle may identify a period of time in which a potential low velocity impact may occur. The autonomous vehicle may then utilize the microphone or audio data associated with the period of time to determine if an impact occurred.
-
公开(公告)号:US20230091924A1
公开(公告)日:2023-03-23
申请号:US17478602
申请日:2021-09-17
Applicant: Zoox, Inc.
Inventor: Jonathan Tyler Dowdall , Kratarth Goel , Adam Edward Pollack , Scott M. Purdy , Bharadwaj Raghavan
Abstract: Techniques for utilizing a depth completion algorithm to determine dense depth data are discussed are discussed herein. Two-dimensional image data representing an environment can be captured or otherwise received. Depth data representing the environment can be captured or otherwise received. The depth data can be projected into the image data and processed using the depth completion algorithm. The depth completion algorithm can be utilized to determine the dense depth values based on intensity values of pixels, and other depth values. A vehicle can be controlled based on the determined depth values.
-
公开(公告)号:US11480961B1
公开(公告)日:2022-10-25
申请号:US16691424
申请日:2019-11-21
Applicant: Zoox, Inc.
Inventor: Venkata Subrahmanyam Chandra Sekhar Chebiyyam , Nam Gook Cho , Jonathan Tyler Dowdall , Subasingha Shaminda Subasingha
IPC: G05D1/00 , G10L25/51 , H04R1/40 , H04R3/00 , H04R5/02 , H04R5/027 , H04S3/00 , H04S7/00 , H04R5/04 , H04L67/12
Abstract: Immersive experiences for users are described herein. In an example, audio data from a plurality of audio sensors associated with a vehicle can be received by an audio data processing system. The audio data processing system can combine individual captured audio channels (e.g., from the plurality of audio sensors) into two or more audio channels for output via two or more speakers proximate a user. A first audio channel of the two or more audio channels can be output via a first speaker and second audio channel of the two or more audio channels to be output via a second speaker, wherein output of the first audio channel and the second audio channel causes a resulting sound corresponding to at least a portion of a sound scene associated with the vehicle. In an example, a user computing device operable by the user can receive an input from the user.
-
公开(公告)号:US11516613B1
公开(公告)日:2022-11-29
申请号:US17077746
申请日:2020-10-22
Applicant: Zoox, Inc.
Inventor: Venkata Subrahmanyam Chandra Sekhar Chebiyyam , Nam Gook Cho , Jonathan Tyler Dowdall , Subasingha Shaminda Subasingha
Abstract: Techniques for determining information associated with sounds detected in an environment based on audio data are discussed herein. Audio sensors of a vehicle may determine audio data associated with sounds from the environment. Sounds may be caused by objects in the environment such as emergency vehicles, construction zones, non-emergency vehicles, humans, audio speakers, nature, etc. A model may determine a classification of the audio data and/or a probability value representing a likelihood that sound in the audio data is associated with the classification. A direction of arrival may be determined based on receiving classification values from multiple audio sensors of the vehicle, and other actions can be performed or the vehicle can be controlled based on the direction of arrival.
-
公开(公告)号:US11322019B2
公开(公告)日:2022-05-03
申请号:US16661898
申请日:2019-10-23
Applicant: Zoox, Inc.
Inventor: Nam Gook Cho , Subasingha Shaminda Subasingha , Jonathan Tyler Dowdall , Venkata Subrahmanyam Chandra Sekhar Chebiyyam
Abstract: Techniques for determining a direction of arrival of an emergency are discussed. A plurality of audio sensors of a vehicle can receive audio data associated with the vehicle. An audio sensor pair can be selected from the plurality of audio sensors to generate audio data representing sound in an environment of the vehicle. An angular spectrum associated with the audio sensor pair can be determined based on the audio data. A feature associated with the audio data can be determined based on the angular spectrum and/or the audio data itself. A direction of arrival (DoA) value associated with the sound may be determined based on the feature using a machine learned model. An emergency sound (e.g., a siren) can be detected in the audio data and a direction associated with the emergency relative to the vehicle can be determined based on the feature and the DoA value.
-
公开(公告)号:US20210125494A1
公开(公告)日:2021-04-29
申请号:US16661898
申请日:2019-10-23
Applicant: Zoox, Inc.
Inventor: Nam Gook Cho , Subasingha Shaminda Subasingha , Jonathan Tyler Dowdall , Venkata Subrahmanyam Chandra Sekhar Chebiyyam
Abstract: Techniques for determining a direction of arrival of an emergency are discussed. A plurality of audio sensors of a vehicle can receive audio data associated with the vehicle. An audio sensor pair can be selected from the plurality of audio sensors to generate audio data representing sound in an environment of the vehicle. An angular spectrum associated with the audio sensor pair can be determined based on the audio data. A feature associated with the audio data can be determined based on the angular spectrum and/or the audio data itself. A direction of arrival (DoA) value associated with the sound may be determined based on the feature using a machine learned model. An emergency sound (e.g., a siren) can be detected in the audio data and a direction associated with the emergency relative to the vehicle can be determined based on the feature and the DoA value.
-
-
-
-
-
-
-