NONVERBAL INFORMATION GENERATION APPARATUS, NONVERBAL INFORMATION GENERATION MODEL LEARNING APPARATUS, METHODS, AND PROGRAMS

    公开(公告)号:US20200372915A1

    公开(公告)日:2020-11-26

    申请号:US16969456

    申请日:2019-02-15

    IPC分类号: G10L15/24 G10L15/06 G10L15/02

    摘要: A nonverbal information generation apparatus includes a nonverbal information generation unit that generates time-information-stamped nonverbal information that corresponds to time-information-stamped text feature quantities and an expression unit that expresses the nonverbal information on the basis of the time-information-stamped text feature quantities and a learned nonverbal information generation model. The time-information-stamped text feature quantities are configured to include feature quantities that have been extracted from text and time information representing times assigned to predetermined units of the text. The nonverbal information is information for controlling the expression unit so as to express behavior corresponding to the text. The nonverbal information generation unit controls the expression unit so that the time-information-stamped nonverbal information is expressed from the expression unit in accordance with time information assigned to the nonverbal information, and controls the expression unit so that the text or voice corresponding to the text that corresponds to the time information is output.

    COMMUNICATION SKILL EVALUATION SYSTEM, DEVICE, METHOD, AND PROGRAM

    公开(公告)号:US20210174702A1

    公开(公告)日:2021-06-10

    申请号:US16762894

    申请日:2018-11-07

    IPC分类号: G09B19/04 G10L15/02 G10L17/22

    摘要: A communication skill evaluation system including: an audio input device; a measurement device; an utterance period detection unit that, based on the audio information input by the audio input device, detects an utterance period and a participant who spoke in each utterance period; a participatory role assignment unit that assigns a participatory role to each participant in accordance with whether or not each participant spoke in each utterance pair composed of two utterances obtained in chronological order from each utterance period; a feature quantity extraction unit that, based on the measurement results by the measurement device, extracts a non-verbal feature quantity for each participant, relating to the non-verbal action at the end of the utterance in each utterance period; and an estimation unit that estimates communication skill for each participant based on a combination, in each utterance period, of the participatory role and the non-verbal feature quantity.

    ESTIMATION DEVICE, ESTIMATION METHOD AND PROGRAM

    公开(公告)号:US20210035600A1

    公开(公告)日:2021-02-04

    申请号:US16967686

    申请日:2019-02-05

    IPC分类号: G10L25/78 G10L25/51

    摘要: In communication performed among multiple participants, at least one of a participant who will start speaking next and a timing thereof is estimated.
    An estimation apparatus includes a head motion information generation unit that acquires head motion information representing head motions of communication participants in a time segment corresponding to an end time of an utterance segment and synchronization information for head motions between the communication participants, and an estimation unit that estimates at least one of the speaker of the next utterance segment following the utterance segment and the next utterance start timing following the utterance segment based on the head motion information and the synchronization information for the head motions between the communication participants.