- 专利标题: LANGUAGE MODEL AND ELECTRONIC DEVICE INCLUDING THE SAME
-
申请号: US17425211申请日: 2021-07-08
-
公开(公告)号: US20220319500A1公开(公告)日: 2022-10-06
- 发明人: Taewoo LEE , Taegyoon KANG , Hogyeong KIM , Minjoong LEE , Seokyeong JUNG , Jiseung JEONG
- 申请人: SAMSUNG ELECTRONICS CO., LTD.
- 申请人地址: KR Suwon-si, Gyeonggi-do
- 专利权人: SAMSUNG ELECTRONICS CO., LTD.
- 当前专利权人: SAMSUNG ELECTRONICS CO., LTD.
- 当前专利权人地址: KR Suwon-si, Gyeonggi-do
- 优先权: KR10-2020-0090924 20200722
- 国际申请: PCT/KR2021/008718 WO 20210708
- 主分类号: G10L15/16
- IPC分类号: G10L15/16 ; G10L15/18 ; G10L15/06
摘要:
Disclosed is an electronic device including processor and memory operatively connected to the processor and storing language model. The electronic device may enter data into the language model, generate an embedding vector in the input embedding layer, add position information to the embedding vector in the positional encoding layer, branch the embedding vector based on domain information, normalize the branched embedding vectors, enter the normalized embedding vectors into the multi-head attention layer, enter output data of the multi-head attention layer into the first layer, normalize pieces of output data of the first layer, enter the normalized pieces of output data of the first layer into the feed-forward layer, enter output data of the feed-forward layer into the second layer and normalize pieces of output data of the second layer, and enter the normalized pieces of output data of the second layer into the linearization layer and the softmax layer to obtain result data. In addition, various embodiments as understood from the specification may be also possible.
公开/授权文献
- US11967308B2 Language model and electronic device including the same 公开/授权日:2024-04-23
信息查询