Combined lip reading and voice recognition multimodal interface system
    1.
    发明授权
    Combined lip reading and voice recognition multimodal interface system 有权
    组合唇读和语音识别多模态界面系统

    公开(公告)号:US08442820B2

    公开(公告)日:2013-05-14

    申请号:US12628514

    申请日:2009-12-01

    IPC分类号: G10L15/16 G10L15/24

    摘要: The present invention provides a combined lip reading and voice recognition multimodal interface system, which can issue a navigation operation instruction only by voice and lip movements, thus allowing a driver to look ahead during a navigation operation and reducing vehicle accidents related to navigation operations during driving. The combined lip reading and voice recognition multimodal interface system in accordance with the present invention includes: an audio voice input unit; a voice recognition unit; a voice recognition instruction and estimated probability output unit; a lip video image input unit; a lip reading unit; a lip reading recognition instruction output unit; and a voice recognition and lip reading recognition result combining unit that outputs the voice recognition instruction

    摘要翻译: 本发明提供了一种组合式唇读和语音识别多模态接口系统,其可以通过语音和唇部运动发出导航操作指令,从而允许驾驶员在导航操作期间向前看,并减少驾驶期间与导航操作相关的车辆事故 。 根据本发明的组合唇读数和语音识别多模态接口系统包括:音频语音输入单元; 语音识别单元; 语音识别指令和估计概率输出单元; 唇视频图像输入单元; 唇读单元; 唇读识别指令输出单元; 以及输出语音识别指令的语音识别和唇读取识别结果组合单元

    COMBINED LIP READING AND VOICE RECOGNITION MULTIMODAL INTERFACE SYSTEM
    2.
    发明申请
    COMBINED LIP READING AND VOICE RECOGNITION MULTIMODAL INTERFACE SYSTEM 有权
    组合LIP阅读和语音识别多模式接口系统

    公开(公告)号:US20110071830A1

    公开(公告)日:2011-03-24

    申请号:US12628514

    申请日:2009-12-01

    摘要: The present invention provides a combined lip reading and voice recognition multimodal interface system, which can issue a navigation operation instruction only by voice and lip movements, thus allowing a driver to look ahead during a navigation operation and reducing vehicle accidents related to navigation operations during driving. The combined lip reading and voice recognition multimodal interface system in accordance with the present invention includes: an audio voice input unit; a voice recognition unit; a voice recognition instruction and estimated probability output unit; a lip video image input unit; a lip reading unit; a lip reading recognition instruction output unit; and a voice recognition and lip reading recognition result combining unit that outputs the voice recognition instruction

    摘要翻译: 本发明提供了一种组合式唇读和语音识别多模态接口系统,其可以通过语音和唇部运动发出导航操作指令,从而允许驾驶员在导航操作期间向前看,并减少驾驶期间与导航操作相关的车辆事故 。 根据本发明的组合唇读数和语音识别多模态接口系统包括:音频语音输入单元; 语音识别单元; 语音识别指令和估计概率输出单元; 唇视频图像输入单元; 唇读单元; 唇读识别指令输出单元; 以及输出语音识别指令的语音识别和唇读取识别结果组合单元