METHOD FOR SYNTHESIZED SPEECH GENERATION USING EMOTION INFORMATION CORRECTION AND APPARATUS

    公开(公告)号:US20210074261A1

    公开(公告)日:2021-03-11

    申请号:US16928815

    申请日:2020-07-14

    Abstract: A method includes generating first synthesized speech by using text and a first emotion vector configured for the text, extracting a second emotion vector included in the first synthesized speech, determining whether correction of the second emotion information vector is needed by comparing a loss value calculated by using the first emotion information vector and the second emotion information vector with a preconfigured threshold, re-performing speech synthesis by using a third emotion information vector generated by correcting the second emotion information vector, and outputting the generated synthesized speech, thereby configuring emotion information of speech in a more effective manner. A speech synthesis apparatus may be associated with an artificial intelligence module, drone (unmanned aerial vehicle, UAV), robot, augmented reality (AR) devices, virtual reality (VR) devices, devices related to 5G services, and the like.

    GATHERING USER'S SPEECH SAMPLES
    3.
    发明申请

    公开(公告)号:US20210134301A1

    公开(公告)日:2021-05-06

    申请号:US17028527

    申请日:2020-09-22

    Abstract: Disclosed is gathering a user's speech samples. According to an embodiment of the disclosure, a method of gathering learning samples may gather a speaker's speech data obtained while talking on a mobile terminal and text data generated from the speech data and gather training data for generating a speech synthesis model. According to the disclosure, the method of gathering learning samples may be related to artificial intelligence (AI) modules, unmanned aerial vehicles (UAVs), robots, augmented reality (AR) devices, virtual reality (VR) devices, and 5G service-related devices.

    SPEECH SYNTHESIS METHOD BASED ON EMOTION INFORMATION AND APPARATUS THEREFOR

    公开(公告)号:US20200035216A1

    公开(公告)日:2020-01-30

    申请号:US16593404

    申请日:2019-10-04

    Abstract: A speech synthesis method and apparatus based on emotion information are disclosed. A method for performing, by a speech synthesis apparatus, speech synthesis based on emotion information according to an embodiment of the present disclosure includes: receiving data; generating emotion information on the basis of the data; generating metadata corresponding to the emotion information; and transmitting the metadata to a speech synthesis engine, wherein the metadata is described in the form of a markup language, and the markup language includes a speech synthesis markup language (SSML). According to the present disclosure, an intelligent computing device constituting a speech synthesis apparatus may be related with an artificial intelligence module, drone (unmanned aerial vehicle, UAV), robot, augmented reality (AR) devices, virtual reality (VR) devices, devices related to 5G services, and the like.

    ARTIFICIAL INTELLIGENCE APPARATUS FOR CORRECTING SYNTHESIZED SPEECH AND METHOD THEREOF

    公开(公告)号:US20200058290A1

    公开(公告)日:2020-02-20

    申请号:US16660947

    申请日:2019-10-23

    Abstract: Disclosed herein is an artificial intelligence apparatus includes a memory configured to store learning target text and human speech of a person who pronounces the text, a processor configured to generate synthesized speech in which the text is pronounced by synthesized sound and extract a synthesized speech feature set including information on a feature pronounced in the synthesized speech and a human speech feature set including information on a feature pronounced in the human speech, and a learning processor configured to train a speech correction model for outputting a corrected speech feature set to allow predetermined synthesized speech to be corrected based on a human pronunciation feature when a synthesized speech feature set extracted from predetermined synthesized speech is input, based on the synthesized speech feature set and the human speech feature set.

    MOBILE TERMINAL AND METHOD OF CONTROLLING THE SAME

    公开(公告)号:US20180309917A1

    公开(公告)日:2018-10-25

    申请号:US15961637

    申请日:2018-04-24

    CPC classification number: H04N5/2258 H04N5/2351

    Abstract: A mobile terminal and a method of controlling the same are provided. The mobile terminal includes a first camera sensor; a second camera sensor; an illuminance sensor sensing an illuminance change on the periphery of the mobile terminal; and a controller controlling image shooting based on the first camera sensor, and controlling the second camera sensor to start the image shooting if the illuminance change sensed by the illuminance sensor is a threshold value or more.

    INSOLE, MOBILE TERMINAL AND METHOD OF CONTROLLING THEREFOR
    10.
    发明申请
    INSOLE, MOBILE TERMINAL AND METHOD OF CONTROLLING THEREFOR 有权
    INSOLE,移动终端及其控制方法

    公开(公告)号:US20160366266A1

    公开(公告)日:2016-12-15

    申请号:US14971748

    申请日:2015-12-16

    Abstract: A mobile terminal including a display unit; a wireless communication unit configured to wirelessly communicate with an insole in a shoe and an external device; and a controller configured to receive a foot gesture input signal from the insole for controlling the mobile terminal or the external device, control the function on the mobile according to the foot gesture input signal in response to the foot gesture input signal being mapped a function of the mobile terminal, and transmit a control signal to the external device to control the function on the external device in response the foot gesture input signal being mapped the function of the external device.

    Abstract translation: 一种包括显示单元的移动终端; 无线通信单元,被配置为与鞋内的鞋垫和外部设备无缝地通信; 以及控制器,被配置为从所述鞋垫接收用于控制所述移动终端或所述外部设备的脚踏手势输入信号,响应于所述脚踏手势输入信号映射了所述手势输入信号的功能,根据所述脚踏手势输入信号来控制所述移动设备上的功能 移动终端,并且响应于脚踏手势输入信号映射到外部设备的功能,向外部设备发送控制信号以控制外部设备上的功能。

Patent Agency Ranking