-
公开(公告)号：US10063965B2
公开(公告)日：2018-08-28
申请号：US15170348
申请日：2016-06-01
Applicant: Google Inc.
Inventor： Chanwoo Kim , Rajeev Conrad Nongpiur , Arun Narayanan
CPC classification number: H04R3/005 , G01S5/18 , G10L25/30 , H04R5/027 , H04R2201/401 , H04R2430/20 , H04S2400/11 , H04S2400/15 , H04S2420/01
Abstract: A system for estimating the location of a stationary or moving sound source includes multiple microphones, which need not be physically aligned in a linear array or a regular geometric pattern in a given environment, an auralizer that generates auralized multi-channel signals based at least on array-related transfer functions and room impulse responses of the microphones as well as signal labels corresponding to the auralized multi-channel signals, a feature extractor that extracts features from the auralized multi-channel signals for efficient processing, and a neural network that can be trained to estimate the location of the sound source based at least on the features extracted from the auralized multi-channel signals and the corresponding signal labels.
-
公开(公告)号：US09860636B1
公开(公告)日：2018-01-02
申请号：US15207707
申请日：2016-07-12
Applicant: Google Inc.
Inventor： Rajeev Conrad Nongpiur
CPC classification number: H04R3/005 , H04R1/02 , H04R1/04 , H04R1/222 , H04R1/326 , H04R1/342 , H04R1/38 , H04R1/406 , H04R5/027 , H04R2201/401 , H04R2201/403 , H04R2430/20 , H04R2499/11
Abstract: Methods and apparatus relating to microphone devices and signal processing techniques are provided. In an example, a microphone device can detect sound, as well as enhance an ability to perceive at least a general direction from which the sound arrives at the microphone device. In an example, a case of the microphone device has an external surface which at least partially defines funnel-shaped surfaces. Each funnel-shaped surface is configured to direct the sound to a respective microphone diaphragm to produce an auralized multi-microphone output. The funnel-shaped surfaces are configured to cause direction-dependent variations in spectral notches and frequency response of the sound as received by the microphone diaphragms. A neural network can device-shape the auralized multi-microphone output to create a binaural output. The binaural output can be auralized with respect to a human listener.
-
公开(公告)号：US20170199934A1
公开(公告)日：2017-07-13
申请号：US14992700
申请日：2016-01-11
Applicant: Google Inc.
Inventor： Rajeev Conrad Nongpiur , Akshay Bapat , Lawrence Wayne Neal
IPC: G06F17/30 , G06F3/16 , G10L19/018
CPC classification number: G06F16/638 , G06F3/165 , G10L25/51 , G10L25/78
Abstract: Summaries of audio or audio-video events are created from audio or audio-video recordings based on the needs of a particular user. The summarized events may have shorter timespans than the actual timespans of audio or audio-video recordings. Audio or audio-video recordings may be provided by one or more recording devices or sensors to a network, such as a cloud. A summarizer is provided in the network, and may include an audio marker, an audio enhancer, and an audio compiler. The audio marker tags segments of an audio or audio-video stream using one or more audio detectors based on user preferences. The audio enhancer may enhance the quality of tagged audio segments by enhancing desired sound features and suppressing undesired sound features. The audio compiler compiles the tagged audio segments based on event scores and generates audio or audio-video summaries for the user.
-
4.发明申请公开(公告)号：US20160364963A1
公开(公告)日：2016-12-15
申请号：US14737678
申请日：2015-06-12
Applicant: Google Inc.
Inventor： Yoky Matsuoka , Rajeev Conrad Nongpiur , Michael Dixon
CPC classification number: G06K9/00771 , G06K9/00979 , G06K9/46 , G06K9/6267 , G08B1/08 , G08B21/0208 , G10L25/27 , G10L25/51 , G10L25/72 , G10L25/78 , H04R3/00 , H04R2410/05
Abstract: This application discloses a method implemented by an electronic device to detect a signature event (e.g., a baby cry event) associated with an audio feature (e.g., baby sound). The electronic device obtains a classifier model from a remote server. The classifier model is determined according to predetermined capabilities of the electronic device and ambient sound characteristics of the electronic device, and distinguishes the audio feature from a plurality of alternative features and ambient noises. When the electronic device obtains audio data, it splits the audio data to a plurality of sound components each associated with a respective frequency or frequency band and including a series of time windows. The electronic device further extracts a feature vector from the sound components, classifies the extracted feature vector to obtain a probability value according to the classifier model, and detects the signature event based on the probability value.
Abstract translation: 本申请公开了一种由电子设备实现的用于检测与音频特征（例如婴儿声音）相关联的签名事件（例如，婴儿哭泣事件）的方法。 电子设备从远程服务器获取分类器模型。 根据电子设备的预定能力和电子设备的环境声音特性来确定分类器模型，并且将音频特征与多个替代特征和环境噪声区分开。 当电子设备获得音频数据时，它将音频数据分割成与各个频率或频带相关联并且包括一系列时间窗口的多个声音分量。 电子设备还从声音分量中提取特征向量，对所提取的特征向量进行分类，根据分类器模型获得概率值，并根据概率值检测签名事件。
-
公开(公告)号：US20180268812A1
公开(公告)日：2018-09-20
申请号：US15458214
申请日：2017-03-14
Applicant: Google Inc.
Inventor： Chanwoo Kim , Rajeev Conrad Nongpiur , Michiel A.U. Bacchiani
CPC classification number: G10L15/22 , G06K9/00255 , G10L15/04 , G10L15/25 , G10L15/265 , G10L25/78 , G10L2015/223
Abstract: Systems and methods are described for improving endpoint detection of a voice query submitted by a user. In some implementations, a synchronized video data and audio data is received. A sequence of frames of the video data that includes images corresponding to lip movement on a face is determined. The audio data is endpointed based on first audio data that corresponds to a first frame of the sequence of frames and second audio data that corresponds to a last frame of the sequence of frames. A transcription of the endpointed audio data is generated by an automated speech recognizer. The generated transcription is then provided for output.
-
Patent Agency Ranking
公开(公告)号：US20180018970A1
公开(公告)日：2018-01-18
申请号：US15211791
申请日：2016-07-15
Applicant: Google Inc.
Inventor： Lawrence Heyl , Rajeev Conrad Nongpiur
IPC: G10L17/18 , G10L21/028 , G10L17/08 , G10L25/57 , G06K9/00
CPC classification number: G10L17/18 , G06K9/00268 , G06K9/00288 , G06K9/00718 , G06K9/6272 , G10L17/06 , G10L17/08 , G10L17/10
Abstract: Apparatus and method for training a neural network for signal recognition in multiple sensory domains, such as audio and video domains, are provided. For example, an identity of a speaker in a video clip may be identified based on audio and video features extracted from the video clip and comparisons of the extracted audio and video features to stored audio and video features with their associated labels obtained from one or more training video clips. In another example, a direction of sound propagation or a location of a sound source in a video clip may be determined based on the audio and video features extracted from the video clip and comparisons of the extracted audio and video features to stored audio and video features with their associated direction or location labels obtained from one or more training video clips.
-
公开(公告)号：US20170325023A1
公开(公告)日：2017-11-09
申请号：US14988047
申请日：2016-01-05
Applicant: Google Inc.
Inventor： Rajeev Conrad Nongpiur
CPC classification number: H04R3/005 , G06N3/08 , G10L25/51 , H04R1/406 , H04R2201/405 , H04R2430/20
Abstract: A neural network is provided for recognition and enhancement of multi-channel sound signals received by multiple microphones, which need not be aligned in a linear array in a given environment. Directions and distances of sound sources may also be detected by the neural network without the need for a beamformer connected to the microphones. The neural network may be trained by knowledge gained from free-field array impulse responses obtained in an anechoic chamber, array impulse responses that model simulated environments of different reverberation times, and array impulse responses obtained in actual environments.
-
公开(公告)号：US20180374477A1
公开(公告)日：2018-12-27
申请号：US15634863
申请日：2017-06-27
Applicant: Google Inc.
Inventor： Chan Woo Kim , Rajeev Conrad Nongpiur , Vijayaditya Peddinti , Michiel Bacchiani
CPC classification number: G10L15/22 , G06T7/60 , G10L15/00 , G10L15/02 , G10L15/063 , G10L15/24 , G10L25/78 , G10L2015/226 , G10L2015/227
Abstract: An example method includes receiving, by a computing system, an indication of one or more audible sounds that are detected by a first sensing device, the one or more audible sounds originating from a user; determining, by the computing system and based at least in part on an indication of one or more signals detected by a second sensing device, a distance between the user and the second sensing device; determining, by the computing system and based at least in part on the indication of the one or more audible sounds, one or more acoustic features that are associated with the one or more audible sounds; and determining, by the computing system, and based at least in part on the one or more acoustic features and the distance between the user and the second sensing device, one or more words that correspond to the audible sounds.
-
公开(公告)号：US09875747B1
公开(公告)日：2018-01-23
申请号：US15211417
申请日：2016-07-15
Applicant: Google Inc.
Inventor： Chanwoo Kim , Rajeev Conrad Nongpiur , Tara Sainath
IPC: G10L19/00 , G10L19/008 , G10L25/30 , G10L25/72
CPC classification number: G10L19/008 , G10L19/0017 , G10L25/30 , G10L25/72
Abstract: A sensor device may include a computing device in communication with multiple microphones. A neural network executing on the computing device may receive audio signals from each microphone. One microphone signal may serve as a reference signal. The neural network may extract differences in signal characteristics of the other microphone signals as compared to the reference signal. The neural network may combine these signal differences into a lossy compressed signal. The sensor device may transmit the lossy compressed signal and the lossless reference signal to a remote neural network executing in a cloud computing environment for decompression and sound recognition analysis.
-
公开(公告)号：US20170353790A1
公开(公告)日：2017-12-07
申请号：US15170924
申请日：2016-06-01
Applicant: Google Inc.
Inventor： Chanwoo Kim , Rajeev Conrad Nongpiur , Ananya Misra
CPC classification number: H04R3/005 , H04R5/027 , H04R29/005 , H04R29/006 , H04R2201/401 , H04R2430/20
Abstract: A method for auralizing a multi-microphone device. Path information for one or more sound paths using dimensions and room reflection coefficients of a simulated room for one of a plurality of microphones included in a multi-microphone device is determined. An array-related transfer functions (ARTFs) for the one of the plurality of microphones is retrieved. The auralized impulse response for the one of the plurality of microphones is generated based at least on the retrieved ARTFs and the determined path information.
-
-
-
-
-
-
-
-
-
Search Results
21
records
(took 0.021 seconds)
