-
1.
公开(公告)号:US08442820B2
公开(公告)日:2013-05-14
申请号:US12628514
申请日:2009-12-01
申请人: Dae Hee Kim , Dai-Jin Kim , Jin Lee , Jong-Ju Shin , Jin-Seok Lee
发明人: Dae Hee Kim , Dai-Jin Kim , Jin Lee , Jong-Ju Shin , Jin-Seok Lee
CPC分类号: G10L15/32 , G01C21/3602 , G01C21/3608 , G06F3/011 , G06K9/00335 , G10L15/25
摘要: The present invention provides a combined lip reading and voice recognition multimodal interface system, which can issue a navigation operation instruction only by voice and lip movements, thus allowing a driver to look ahead during a navigation operation and reducing vehicle accidents related to navigation operations during driving. The combined lip reading and voice recognition multimodal interface system in accordance with the present invention includes: an audio voice input unit; a voice recognition unit; a voice recognition instruction and estimated probability output unit; a lip video image input unit; a lip reading unit; a lip reading recognition instruction output unit; and a voice recognition and lip reading recognition result combining unit that outputs the voice recognition instruction
摘要翻译: 本发明提供了一种组合式唇读和语音识别多模态接口系统,其可以通过语音和唇部运动发出导航操作指令,从而允许驾驶员在导航操作期间向前看,并减少驾驶期间与导航操作相关的车辆事故 。 根据本发明的组合唇读数和语音识别多模态接口系统包括:音频语音输入单元; 语音识别单元; 语音识别指令和估计概率输出单元; 唇视频图像输入单元; 唇读单元; 唇读识别指令输出单元; 以及输出语音识别指令的语音识别和唇读取识别结果组合单元
-
2.
公开(公告)号:US20110071830A1
公开(公告)日:2011-03-24
申请号:US12628514
申请日:2009-12-01
申请人: Dae Hee Kim , Dai-Jin Kim , Jin Lee , Jong-Ju Shin , Jin-Seok Lee
发明人: Dae Hee Kim , Dai-Jin Kim , Jin Lee , Jong-Ju Shin , Jin-Seok Lee
CPC分类号: G10L15/32 , G01C21/3602 , G01C21/3608 , G06F3/011 , G06K9/00335 , G10L15/25
摘要: The present invention provides a combined lip reading and voice recognition multimodal interface system, which can issue a navigation operation instruction only by voice and lip movements, thus allowing a driver to look ahead during a navigation operation and reducing vehicle accidents related to navigation operations during driving. The combined lip reading and voice recognition multimodal interface system in accordance with the present invention includes: an audio voice input unit; a voice recognition unit; a voice recognition instruction and estimated probability output unit; a lip video image input unit; a lip reading unit; a lip reading recognition instruction output unit; and a voice recognition and lip reading recognition result combining unit that outputs the voice recognition instruction
摘要翻译: 本发明提供了一种组合式唇读和语音识别多模态接口系统,其可以通过语音和唇部运动发出导航操作指令,从而允许驾驶员在导航操作期间向前看,并减少驾驶期间与导航操作相关的车辆事故 。 根据本发明的组合唇读数和语音识别多模态接口系统包括:音频语音输入单元; 语音识别单元; 语音识别指令和估计概率输出单元; 唇视频图像输入单元; 唇读单元; 唇读识别指令输出单元; 以及输出语音识别指令的语音识别和唇读取识别结果组合单元
-