Invention Grant
- Patent Title: Method for automatically identifying sentence boundaries in noisy conversational data
- Patent Title (中): 在嘈杂会话数据中自动识别句子边界的方法
-
Application No.: US11845462Application Date: 2007-08-27
-
Publication No.: US08364485B2Publication Date: 2013-01-29
- Inventor: Tetsuya Nasukawa , Diwakar Punjani , Shourya Roy , L. Venkata Subramaniam , Hironori Takeuchi
- Applicant: Tetsuya Nasukawa , Diwakar Punjani , Shourya Roy , L. Venkata Subramaniam , Hironori Takeuchi
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Cantor Colburn LLP
- Main IPC: G10L15/04
- IPC: G10L15/04

Abstract:
Sentence boundaries in noisy conversational transcription data are automatically identified. Noise and transcription symbols are removed, and a training set is formed with sentence boundaries marked based on long silences or on manual markings in the transcribed data. Frequencies of head and tail n-grams that occur at the beginning and ending of sentences are determined from the training set. N-grams that occur a significant number of times in the middle of sentences in relation to their occurrences at the beginning or ending of sentences are filtered out. A boundary is marked before every head n-gram and after every tail n-gram occurring in the conversational data and remaining after filtering. Turns are identified. A boundary is marked after each turn, unless the turn ends with an impermissible tail word or is an incomplete turn. The marked boundaries in the conversational data identify sentence boundaries.
Public/Granted literature
- US20090063150A1 METHOD FOR AUTOMATICALLY IDENTIFYING SENTENCE BOUNDARIES IN NOISY CONVERSATIONAL DATA Public/Granted day:2009-03-05
Information query