-
公开(公告)号:US11308169B1
公开(公告)日:2022-04-19
申请号:US16176312
申请日:2018-10-31
Applicant: Meta Platforms, Inc.
Inventor: Emmanouil Koukoumidis , Michael Robert Hanson , Rajen Subba , Heidi Young , Rushin Shah , Jinsong Yu , Benoit F. Dumoulin , Jeremy Gillmor Kahn , Chandrasekhar Iyer
IPC: G06F16/00 , G06F16/951 , G06N20/00 , G06F40/40
Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.
-
公开(公告)号:US11908181B2
公开(公告)日:2024-02-20
申请号:US18164480
申请日:2023-02-03
Applicant: Meta Platforms, Inc.
Inventor: Emmanouil Koukoumidis , Michael Robert Hanson , Rajen Subba , Heidi Young , Rushin Shah , Jinsong Yu , Benoit F. Dumoulin , Jeremy Gillmor Kahn , Chandrasekhar Iyer
IPC: G06F16/00 , G06V10/82 , G06F9/451 , G10L15/18 , G10L15/183 , G10L15/22 , G06F16/338 , G06F16/332 , G06F16/33 , G06N20/00 , G06F16/9535 , G06Q50/00 , H04L67/306 , G06F16/176 , G10L15/06 , G10L15/16 , G06F3/01 , G06F16/9032 , G06F16/2457 , H04L5/02 , G06F3/16 , G06N3/08 , G10L15/26 , G06F16/9038 , G06F16/904 , G06F40/30 , G06F40/40 , G06F16/22 , G06F16/23 , G06F7/14 , H04L43/0882 , H04L43/0894 , H04L12/28 , H04L41/00 , H04L41/22 , H04W12/08 , G10L15/07 , G10L17/22 , G06N3/006 , G10L17/06 , G06F16/248 , G06F16/951 , G06F16/242 , G06F16/2455 , G10L15/02 , G10L15/187 , G06V20/10 , G06V40/20 , G06F40/295 , H04L51/52 , H04L51/216 , H04L67/50 , H04L67/5651 , H04L51/18 , H04L67/75 , G06F16/903 , G06F40/205 , G06F18/2411 , G06N7/01 , G06V10/764 , H04L67/10 , H04L51/046 , G10L13/00 , G10L13/04 , H04L67/53
CPC classification number: G06V10/82 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/167 , G06F7/14 , G06F9/453 , G06F16/176 , G06F16/2255 , G06F16/2365 , G06F16/243 , G06F16/248 , G06F16/24552 , G06F16/24575 , G06F16/24578 , G06F16/338 , G06F16/3323 , G06F16/3329 , G06F16/3344 , G06F16/904 , G06F16/9038 , G06F16/90332 , G06F16/90335 , G06F16/951 , G06F16/9535 , G06F18/2411 , G06F40/205 , G06F40/295 , G06F40/30 , G06F40/40 , G06N3/006 , G06N3/08 , G06N7/01 , G06N20/00 , G06Q50/01 , G06V10/764 , G06V20/10 , G06V40/28 , G10L15/02 , G10L15/063 , G10L15/07 , G10L15/16 , G10L15/183 , G10L15/187 , G10L15/1815 , G10L15/1822 , G10L15/22 , G10L15/26 , G10L17/06 , G10L17/22 , H04L5/02 , H04L12/2816 , H04L41/20 , H04L41/22 , H04L43/0882 , H04L43/0894 , H04L51/18 , H04L51/216 , H04L51/52 , H04L67/306 , H04L67/535 , H04L67/5651 , H04L67/75 , H04W12/08 , G06F2216/13 , G10L13/00 , G10L13/04 , G10L2015/223 , G10L2015/225 , H04L51/046 , H04L67/10 , H04L67/53
Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.
-
公开(公告)号:US20230186618A1
公开(公告)日:2023-06-15
申请号:US18164480
申请日:2023-02-03
Applicant: Meta Platforms, Inc.
Inventor: Emmanouil Koukoumidis , Michael Robert Hanson , Rajen Subba , Heidi Young , Rushin Shah , Jinsong Yu , Benoit F. Dumoulin , Jeremy Gillmor Kahn , Chandrasekhar Iyer
IPC: G06V10/82 , G06F9/451 , G10L15/18 , G10L15/183 , G10L15/22 , G06F16/338 , G06F16/332 , G06F16/33 , G06N20/00 , G06F16/9535 , G06Q50/00 , H04L67/306 , G06F16/176 , G10L15/06 , G10L15/16 , G06F3/01 , G06F16/9032 , G06F16/2457 , H04L51/02 , G06F3/16 , G06N3/08 , G10L15/26 , G06F16/9038 , G06F16/904 , G06F40/30 , G06F40/40 , G06F16/22 , G06F16/23 , G06F7/14 , H04L43/0882 , H04L43/0894 , H04L12/28 , H04L41/00 , H04L41/22 , H04W12/08 , G10L15/07 , G10L17/22 , G06N3/006 , G10L17/06 , G06F16/248 , G06F16/951 , G06F16/242 , G06F16/2455 , G10L15/02 , G10L15/187 , G06V20/10 , G06V40/20 , G06F40/295 , H04L51/52 , H04L51/216 , H04L67/50 , H04L67/5651 , H04L51/18 , H04L67/75 , G06F16/903 , G06F40/205 , G06F18/2411 , G06N7/01 , G06V10/764
CPC classification number: G06V10/82 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/167 , G06F7/14 , G06F9/453 , G06F16/176 , G06F16/243 , G06F16/248 , G06F16/338 , G06F16/904 , G06F16/951 , G06F16/2255 , G06F16/2365 , G06F16/3323 , G06F16/3329 , G06F16/3344 , G06F16/9038 , G06F16/9535 , G06F16/24552 , G06F16/24575 , G06F16/24578 , G06F16/90332 , G06F16/90335 , G06F18/2411 , G06F40/30 , G06F40/40 , G06F40/205 , G06F40/295 , G06N3/006 , G06N3/08 , G06N7/01 , G06N20/00 , G06Q50/01 , G06V10/764 , G06V20/10 , G06V40/28 , G10L15/02 , G10L15/07 , G10L15/16 , G10L15/22 , G10L15/26 , G10L15/063 , G10L15/183 , G10L15/187 , G10L15/1815 , G10L15/1822 , G10L17/06 , G10L17/22 , H04L12/2816 , H04L41/20 , H04L41/22 , H04L43/0882 , H04L43/0894 , H04L51/02 , H04L51/18 , H04L51/52 , H04L51/216 , H04L67/75 , H04L67/306 , H04L67/535 , H04L67/5651 , H04W12/08 , H04L67/10
Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.
-
公开(公告)号:US20220374460A1
公开(公告)日:2022-11-24
申请号:US17870110
申请日:2022-07-21
Applicant: Meta Platforms, Inc.
Inventor: Jinsong Yu , Zhengping Zuo , Guowei Shieh , Fuchun Peng
IPC: G06F16/332 , G06F9/451 , G10L15/18 , G10L15/183 , G10L15/22 , G06F16/338 , G06F16/33 , G06N20/00 , G06F16/9535 , G06Q50/00 , H04L67/306 , G06F16/176 , G10L15/06 , G10L15/16 , G06F3/01 , G06F16/9032 , G06F16/2457 , H04L51/02 , G06F3/16 , G06K9/62 , G06N3/08 , G10L15/26 , G06F16/9038 , G06F16/904 , G06F40/30 , G06F40/40 , G06F16/22 , G06F16/23 , G06F7/14 , H04L43/0882 , H04L43/0894 , H04L12/28 , H04L41/00 , H04L41/22 , H04W12/08 , G10L15/07 , G10L17/22 , G06N3/00 , G10L17/06 , G06F16/248 , G06F16/951 , G06F16/242 , G06F16/2455 , G10L15/02 , G10L15/187 , G06V20/10 , G06V40/20 , G06F40/295 , H04L51/52 , H04L51/216 , H04L67/50 , H04L67/5651 , G06N7/00 , H04L51/18 , H04L67/75
Abstract: In one embodiment, a method includes receiving a user input from a first user at the first client system, determining that the user input is a sharing request to share content, determining multiple second users the sharing request is directed to, determining, for each second user, modalities associated with the respective second user based on the content, a user profile associated with the respective second user, and modalities supported by a second client system the respective second user is currently engaged with, the respective second user being associated with two or more second client systems, and sending, to one or more second client systems currently associated with the second users, instructions for accessing the content based on the determined modalities for each second user.
-
公开(公告)号:US20230245654A1
公开(公告)日:2023-08-03
申请号:US18157413
申请日:2023-01-20
Applicant: Meta Platforms, Inc.
Inventor: Akshat Shrivastava , Shrey Desai , Anchit Gupta , Ali Elkahky , Aleksandr Livshits , Alexander Kolmykov-Zotov , Ahmed Aly , Jinsong Yu , Manali Anand Naik , Shuhui Yang , Baiyang Liu , Surya Teja Appini , Tarun Vir Singh , Hang Su , Jiedan Zhu , Fuchun Peng , Shoubhik Bhattacharya , Kshitiz Malik , Shreyan Bakshi , Akash Bharadwaj , Harish Srinivas , Xiao Yang , Zhuangqun Huang , Gil Keren , Duc Hoang Le , Ahmed Kamal Atwa Mohamed , Zhe Liu , Pranab Mohanty
CPC classification number: G10L15/22 , G10L15/1815 , G10L15/30 , G10L15/063 , G10L15/197 , H04L63/0428 , G10L2015/223 , G10L2015/086
Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.
-
公开(公告)号:US11715289B2
公开(公告)日:2023-08-01
申请号:US17543539
申请日:2021-12-06
Applicant: Meta Platforms, Inc.
Inventor: Emmanouil Koukoumidis , Michael Robert Hanson , Rajen Subba , Heidi Young , Rushin Shah , Jinsong Yu , Benoit F. Dumoulin , Jeremy Gillmor Kahn , Chandrasekhar Iyer
IPC: G06F16/00 , G06V10/82 , G06F9/451 , G10L15/18 , G10L15/183 , G10L15/22 , G06F16/338 , G06F16/332 , G06F16/33 , G06N20/00 , G06F16/9535 , G06Q50/00 , H04L67/306 , G06F16/176 , G10L15/06 , G10L15/16 , G06F3/01 , G06F16/9032 , G06F16/2457 , H04L51/02 , G06F3/16 , G06N3/08 , G10L15/26 , G06F16/9038 , G06F16/904 , G06F40/30 , G06F40/40 , G06F16/22 , G06F16/23 , G06F7/14 , H04L43/0882 , H04L43/0894 , H04L12/28 , H04L41/00 , H04L41/22 , H04W12/08 , G10L15/07 , G10L17/22 , G06N3/006 , G10L17/06 , G06F16/248 , G06F16/951 , G06F16/242 , G06F16/2455 , G10L15/02 , G10L15/187 , G06V20/10 , G06V40/20 , G06F40/295 , H04L51/52 , H04L51/216 , H04L67/50 , H04L67/5651 , H04L51/18 , H04L67/75 , G06F16/903 , G06F40/205 , G06F18/2411 , G06N7/01 , G06V10/764 , H04L67/10 , H04L51/046 , G10L13/00 , G10L13/04 , H04L67/53
CPC classification number: G06V10/82 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/167 , G06F7/14 , G06F9/453 , G06F16/176 , G06F16/2255 , G06F16/2365 , G06F16/243 , G06F16/248 , G06F16/24552 , G06F16/24575 , G06F16/24578 , G06F16/338 , G06F16/3323 , G06F16/3329 , G06F16/3344 , G06F16/904 , G06F16/9038 , G06F16/90332 , G06F16/90335 , G06F16/951 , G06F16/9535 , G06F18/2411 , G06F40/205 , G06F40/295 , G06F40/30 , G06F40/40 , G06N3/006 , G06N3/08 , G06N7/01 , G06N20/00 , G06Q50/01 , G06V10/764 , G06V20/10 , G06V40/28 , G10L15/02 , G10L15/063 , G10L15/07 , G10L15/16 , G10L15/183 , G10L15/187 , G10L15/1815 , G10L15/1822 , G10L15/22 , G10L15/26 , G10L17/06 , G10L17/22 , H04L12/2816 , H04L41/20 , H04L41/22 , H04L43/0882 , H04L43/0894 , H04L51/02 , H04L51/18 , H04L51/216 , H04L51/52 , H04L67/306 , H04L67/535 , H04L67/5651 , H04L67/75 , H04W12/08 , G06F2216/13 , G10L13/00 , G10L13/04 , G10L2015/223 , G10L2015/225 , H04L51/046 , H04L67/10 , H04L67/53
Abstract: In one embodiment, a method includes receiving a user query associated with dialog-intents at a client system, executing tasks corresponding to the dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the tasks, wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and presenting the multi-perspective response at the client system.
-
公开(公告)号:US11429649B2
公开(公告)日:2022-08-30
申请号:US16011062
申请日:2018-06-18
Applicant: Meta Platforms, Inc.
Inventor: Jinsong Yu , Zhengping Zuo , Guowei Shieh , Fuchun Peng
IPC: G06F16/332 , H04L67/306 , G06F9/451 , G10L15/18 , G10L15/183 , G10L15/22 , G06F16/338 , G06F16/33 , G06N20/00 , G06F16/9535 , G06Q50/00 , H04L67/50 , G06F16/176 , G10L15/06 , G10L15/16 , G06F3/01 , G06F16/9032 , G06F16/2457 , H04L51/02 , G06F3/16 , G06K9/62 , G06N3/08 , G10L15/26 , G06F16/9038 , G06F16/904 , G06F40/30 , G06F40/40 , G06F16/22 , G06F16/23 , G06F7/14 , H04L43/0882 , H04L43/0894 , H04L67/5651 , H04L12/28 , H04L41/00 , H04L41/22 , H04W12/08 , G10L15/07 , G10L17/22 , H04L51/00 , G06N3/00 , G10L17/06 , G06F16/248 , G06F16/951 , G06F16/242 , G06F16/2455 , G10L15/02 , G06F16/903 , G06F40/205 , G10L15/187 , G06V20/10 , G06V40/20 , G06F40/295 , H04L51/52 , H04L67/53 , H04L67/10 , H04L51/046 , G10L13/00 , G10L13/04
Abstract: In one embodiment, a method includes receiving a sharing request to share content generated during a current dialog session from a client system associated with a first user, identifying one or more content objects associated with the sharing request based on a natural-language understanding module, wherein the one or more content objects were previously generated during the current dialog session, determining one or more second users the sharing request is directed to based on a user profile associated with first user, and sending instructions for accessing one or more of the identified content objects to one or more client systems associated with the one or more second users.
-
公开(公告)号:US11263276B1
公开(公告)日:2022-03-01
申请号:US16176312
申请日:2018-10-31
Applicant: Meta Platforms, Inc.
Inventor: Emmanouil Koukoumidis , Michael Robert Hanson , Rajen Subba , Heidi Young , Rushin Shah , Jinsong Yu , Benoit F. Dumoulin , Jeremy Gillmor Kahn , Chandrasekhar Iyer
IPC: G06F16/00 , G06F16/951 , G06N20/00 , G06F40/40
Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.
-
公开(公告)号:US11842522B2
公开(公告)日:2023-12-12
申请号:US18164480
申请日:2023-02-03
Applicant: Meta Platforms, Inc.
Inventor: Emmanouil Koukoumidis , Michael Robert Hanson , Rajen Subba , Heidi Young , Rushin Shah , Jinsong Yu , Benoit F. Dumoulin , Jeremy Gillmor Kahn , Chandrasekhar Iyer
IPC: G06F16/00 , G06V10/82 , G06F9/451 , G10L15/18 , G10L15/183 , G10L15/22 , G06F16/338 , G06F16/332 , G06F16/33 , G06N20/00 , G06F16/9535 , G06Q50/00 , H04L67/306 , G06F16/176 , G10L15/06 , G10L15/16 , G06F3/01 , G06F16/9032 , G06F16/2457 , H04L5/02 , G06F3/16 , G06N3/08 , G10L15/26 , G06F16/9038 , G06F16/904 , G06F40/30 , G06F40/40 , G06F16/22 , G06F16/23 , G06F7/14 , H04L43/0882 , H04L43/0894 , H04L12/28 , H04L41/00 , H04L41/22 , H04W12/08 , G10L15/07 , G10L17/22 , G06N3/006 , G10L17/06 , G06F16/248 , G06F16/951 , G06F16/242 , G06F16/2455 , G10L15/02 , G10L15/187 , G06V20/10 , G06V40/20 , G06F40/295 , H04L51/52 , H04L51/216 , H04L67/50 , H04L67/5651 , H04L51/18 , H04L67/75 , G06F16/903 , G06F40/205 , G06F18/2411 , G06N7/01 , G06V10/764 , H04L67/10 , H04L51/046 , G10L13/00 , G10L13/04 , H04L67/53
CPC classification number: G06V10/82 , G06F3/011 , G06F3/013 , G06F3/017 , G06F3/167 , G06F7/14 , G06F9/453 , G06F16/176 , G06F16/2255 , G06F16/2365 , G06F16/243 , G06F16/248 , G06F16/24552 , G06F16/24575 , G06F16/24578 , G06F16/338 , G06F16/3323 , G06F16/3329 , G06F16/3344 , G06F16/904 , G06F16/9038 , G06F16/90332 , G06F16/90335 , G06F16/951 , G06F16/9535 , G06F18/2411 , G06F40/205 , G06F40/295 , G06F40/30 , G06F40/40 , G06N3/006 , G06N3/08 , G06N7/01 , G06N20/00 , G06Q50/01 , G06V10/764 , G06V20/10 , G06V40/28 , G10L15/02 , G10L15/063 , G10L15/07 , G10L15/16 , G10L15/183 , G10L15/187 , G10L15/1815 , G10L15/1822 , G10L15/22 , G10L15/26 , G10L17/06 , G10L17/22 , H04L5/02 , H04L12/2816 , H04L41/20 , H04L41/22 , H04L43/0882 , H04L43/0894 , H04L51/18 , H04L51/216 , H04L51/52 , H04L67/306 , H04L67/535 , H04L67/5651 , H04L67/75 , H04W12/08 , G06F2216/13 , G10L13/00 , G10L13/04 , G10L2015/223 , G10L2015/225 , H04L51/046 , H04L67/10 , H04L67/53
Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.
-
-
-
-
-
-
-
-