公开(公告)号：US11715289B2

公开(公告)日：2023-08-01

申请号：US17543539

申请日：2021-12-06

Applicant: Meta Platforms, Inc.

Inventor： Emmanouil Koukoumidis ,  Michael Robert Hanson ,  Rajen Subba ,  Heidi Young ,  Rushin Shah ,  Jinsong Yu ,  Benoit F. Dumoulin ,  Jeremy Gillmor Kahn ,  Chandrasekhar Iyer

IPC: G06F16/00 ,  G06V10/82 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/332 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L51/02 ,  G06F3/16 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/006 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/50 ,  H04L67/5651 ,  H04L51/18 ,  H04L67/75 ,  G06F16/903 ,  G06F40/205 ,  G06F18/2411 ,  G06N7/01 ,  G06V10/764 ,  H04L67/10 ,  H04L51/046 ,  G10L13/00 ,  G10L13/04 ,  H04L67/53

CPC classification number: G06V10/82 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06F7/14 ,  G06F9/453 ,  G06F16/176 ,  G06F16/2255 ,  G06F16/2365 ,  G06F16/243 ,  G06F16/248 ,  G06F16/24552 ,  G06F16/24575 ,  G06F16/24578 ,  G06F16/338 ,  G06F16/3323 ,  G06F16/3329 ,  G06F16/3344 ,  G06F16/904 ,  G06F16/9038 ,  G06F16/90332 ,  G06F16/90335 ,  G06F16/951 ,  G06F16/9535 ,  G06F18/2411 ,  G06F40/205 ,  G06F40/295 ,  G06F40/30 ,  G06F40/40 ,  G06N3/006 ,  G06N3/08 ,  G06N7/01 ,  G06N20/00 ,  G06Q50/01 ,  G06V10/764 ,  G06V20/10 ,  G06V40/28 ,  G10L15/02 ,  G10L15/063 ,  G10L15/07 ,  G10L15/16 ,  G10L15/183 ,  G10L15/187 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/26 ,  G10L17/06 ,  G10L17/22 ,  H04L12/2816 ,  H04L41/20 ,  H04L41/22 ,  H04L43/0882 ,  H04L43/0894 ,  H04L51/02 ,  H04L51/18 ,  H04L51/216 ,  H04L51/52 ,  H04L67/306 ,  H04L67/535 ,  H04L67/5651 ,  H04L67/75 ,  H04W12/08 ,  G06F2216/13 ,  G10L13/00 ,  G10L13/04 ,  G10L2015/223 ,  G10L2015/225 ,  H04L51/046 ,  H04L67/10 ,  H04L67/53

Abstract: In one embodiment, a method includes receiving a user query associated with dialog-intents at a client system, executing tasks corresponding to the dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the tasks, wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and presenting the multi-perspective response at the client system.

公开(公告)号：US11263276B1

公开(公告)日：2022-03-01

申请号：US16176312

申请日：2018-10-31

Applicant: Meta Platforms, Inc.

Inventor： Emmanouil Koukoumidis ,  Michael Robert Hanson ,  Rajen Subba ,  Heidi Young ,  Rushin Shah ,  Jinsong Yu ,  Benoit F. Dumoulin ,  Jeremy Gillmor Kahn ,  Chandrasekhar Iyer

IPC: G06F16/00 ,  G06F16/951 ,  G06N20/00 ,  G06F40/40

Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.

公开(公告)号：US11842522B2

公开(公告)日：2023-12-12

申请号：US18164480

申请日：2023-02-03

Applicant: Meta Platforms, Inc.

Inventor： Emmanouil Koukoumidis ,  Michael Robert Hanson ,  Rajen Subba ,  Heidi Young ,  Rushin Shah ,  Jinsong Yu ,  Benoit F. Dumoulin ,  Jeremy Gillmor Kahn ,  Chandrasekhar Iyer

IPC: G06F16/00 ,  G06V10/82 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/332 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L5/02 ,  G06F3/16 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/006 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/50 ,  H04L67/5651 ,  H04L51/18 ,  H04L67/75 ,  G06F16/903 ,  G06F40/205 ,  G06F18/2411 ,  G06N7/01 ,  G06V10/764 ,  H04L67/10 ,  H04L51/046 ,  G10L13/00 ,  G10L13/04 ,  H04L67/53

CPC classification number: G06V10/82 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06F7/14 ,  G06F9/453 ,  G06F16/176 ,  G06F16/2255 ,  G06F16/2365 ,  G06F16/243 ,  G06F16/248 ,  G06F16/24552 ,  G06F16/24575 ,  G06F16/24578 ,  G06F16/338 ,  G06F16/3323 ,  G06F16/3329 ,  G06F16/3344 ,  G06F16/904 ,  G06F16/9038 ,  G06F16/90332 ,  G06F16/90335 ,  G06F16/951 ,  G06F16/9535 ,  G06F18/2411 ,  G06F40/205 ,  G06F40/295 ,  G06F40/30 ,  G06F40/40 ,  G06N3/006 ,  G06N3/08 ,  G06N7/01 ,  G06N20/00 ,  G06Q50/01 ,  G06V10/764 ,  G06V20/10 ,  G06V40/28 ,  G10L15/02 ,  G10L15/063 ,  G10L15/07 ,  G10L15/16 ,  G10L15/183 ,  G10L15/187 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/26 ,  G10L17/06 ,  G10L17/22 ,  H04L5/02 ,  H04L12/2816 ,  H04L41/20 ,  H04L41/22 ,  H04L43/0882 ,  H04L43/0894 ,  H04L51/18 ,  H04L51/216 ,  H04L51/52 ,  H04L67/306 ,  H04L67/535 ,  H04L67/5651 ,  H04L67/75 ,  H04W12/08 ,  G06F2216/13 ,  G10L13/00 ,  G10L13/04 ,  G10L2015/223 ,  G10L2015/225 ,  H04L51/046 ,  H04L67/10 ,  H04L67/53

Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.

公开(公告)号：US11308169B1

公开(公告)日：2022-04-19

申请号：US16176312

申请日：2018-10-31

Applicant: Meta Platforms, Inc.

Inventor： Emmanouil Koukoumidis ,  Michael Robert Hanson ,  Rajen Subba ,  Heidi Young ,  Rushin Shah ,  Jinsong Yu ,  Benoit F. Dumoulin ,  Jeremy Gillmor Kahn ,  Chandrasekhar Iyer

IPC: G06F16/00 ,  G06F16/951 ,  G06N20/00 ,  G06F40/40

Abstract: In one embodiment, a method includes receiving a user query from a client system associated with a first user, determining a plurality of dialog-intents, each being associated with a particular agent of a plurality of agents, executing a plurality of tasks corresponding to the user query via the plurality of agents corresponding to the plurality of dialog-intents, receiving a plurality of execution results corresponding to the plurality of tasks from the plurality of agents, respectively, selecting two or more of the plurality of execution results for combination, generating a multi-perspective response based on the selected execution results by a stitching model, wherein the multi-perspective response comprises a natural-language response combining the selected execution results, and sending instructions for presenting the multi-perspective response to the first user to the client system in response to the user query.

公开(公告)号：US11908181B2

公开(公告)日：2024-02-20

申请号：US18164480

申请日：2023-02-03

Applicant: Meta Platforms, Inc.

Inventor： Emmanouil Koukoumidis ,  Michael Robert Hanson ,  Rajen Subba ,  Heidi Young ,  Rushin Shah ,  Jinsong Yu ,  Benoit F. Dumoulin ,  Jeremy Gillmor Kahn ,  Chandrasekhar Iyer

IPC: G06F16/00 ,  G06V10/82 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/332 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L5/02 ,  G06F3/16 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/006 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/50 ,  H04L67/5651 ,  H04L51/18 ,  H04L67/75 ,  G06F16/903 ,  G06F40/205 ,  G06F18/2411 ,  G06N7/01 ,  G06V10/764 ,  H04L67/10 ,  H04L51/046 ,  G10L13/00 ,  G10L13/04 ,  H04L67/53

CPC classification number: G06V10/82 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06F7/14 ,  G06F9/453 ,  G06F16/176 ,  G06F16/2255 ,  G06F16/2365 ,  G06F16/243 ,  G06F16/248 ,  G06F16/24552 ,  G06F16/24575 ,  G06F16/24578 ,  G06F16/338 ,  G06F16/3323 ,  G06F16/3329 ,  G06F16/3344 ,  G06F16/904 ,  G06F16/9038 ,  G06F16/90332 ,  G06F16/90335 ,  G06F16/951 ,  G06F16/9535 ,  G06F18/2411 ,  G06F40/205 ,  G06F40/295 ,  G06F40/30 ,  G06F40/40 ,  G06N3/006 ,  G06N3/08 ,  G06N7/01 ,  G06N20/00 ,  G06Q50/01 ,  G06V10/764 ,  G06V20/10 ,  G06V40/28 ,  G10L15/02 ,  G10L15/063 ,  G10L15/07 ,  G10L15/16 ,  G10L15/183 ,  G10L15/187 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/26 ,  G10L17/06 ,  G10L17/22 ,  H04L5/02 ,  H04L12/2816 ,  H04L41/20 ,  H04L41/22 ,  H04L43/0882 ,  H04L43/0894 ,  H04L51/18 ,  H04L51/216 ,  H04L51/52 ,  H04L67/306 ,  H04L67/535 ,  H04L67/5651 ,  H04L67/75 ,  H04W12/08 ,  G06F2216/13 ,  G10L13/00 ,  G10L13/04 ,  G10L2015/223 ,  G10L2015/225 ,  H04L51/046 ,  H04L67/10 ,  H04L67/53

Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.

公开(公告)号：US20240095544A1

公开(公告)日：2024-03-21

申请号：US16057414

申请日：2018-08-07

Applicant: Meta Platforms, Inc.

Inventor： Jeremy Gillmor Kahn ,  Francislav Penov

IPC: G06N5/02 ,  G06F9/451 ,  G06N7/00

CPC classification number: G06N5/02 ,  G06F9/453 ,  G06N7/005

Abstract: In one embodiment, a method includes receiving a user input by a user from a client system associated with the user at a current time, parsing the user input to identify intents and slots associated with the user input, determining that one or more of the identified intents or slots are volatile based on whether the respective intent or slot resolves to information that is subject to change within a threshold timeframe of the current time, requesting information from an agent to resolve the user input, the information including (1) current information that resolves the intents and slots associated with the user input and (2) volatility information associated with the intents or slots determined to be volatile, generating a response to the user input including the requested information from the agent, and sending, to the client system, instructions for presenting the response to the user.

公开(公告)号：US20230186618A1

公开(公告)日：2023-06-15

申请号：US18164480

申请日：2023-02-03

Applicant: Meta Platforms, Inc.

Inventor： Emmanouil Koukoumidis ,  Michael Robert Hanson ,  Rajen Subba ,  Heidi Young ,  Rushin Shah ,  Jinsong Yu ,  Benoit F. Dumoulin ,  Jeremy Gillmor Kahn ,  Chandrasekhar Iyer

IPC: G06V10/82 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/332 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L51/02 ,  G06F3/16 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/006 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/50 ,  H04L67/5651 ,  H04L51/18 ,  H04L67/75 ,  G06F16/903 ,  G06F40/205 ,  G06F18/2411 ,  G06N7/01 ,  G06V10/764

CPC classification number: G06V10/82 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06F7/14 ,  G06F9/453 ,  G06F16/176 ,  G06F16/243 ,  G06F16/248 ,  G06F16/338 ,  G06F16/904 ,  G06F16/951 ,  G06F16/2255 ,  G06F16/2365 ,  G06F16/3323 ,  G06F16/3329 ,  G06F16/3344 ,  G06F16/9038 ,  G06F16/9535 ,  G06F16/24552 ,  G06F16/24575 ,  G06F16/24578 ,  G06F16/90332 ,  G06F16/90335 ,  G06F18/2411 ,  G06F40/30 ,  G06F40/40 ,  G06F40/205 ,  G06F40/295 ,  G06N3/006 ,  G06N3/08 ,  G06N7/01 ,  G06N20/00 ,  G06Q50/01 ,  G06V10/764 ,  G06V20/10 ,  G06V40/28 ,  G10L15/02 ,  G10L15/07 ,  G10L15/16 ,  G10L15/22 ,  G10L15/26 ,  G10L15/063 ,  G10L15/183 ,  G10L15/187 ,  G10L15/1815 ,  G10L15/1822 ,  G10L17/06 ,  G10L17/22 ,  H04L12/2816 ,  H04L41/20 ,  H04L41/22 ,  H04L43/0882 ,  H04L43/0894 ,  H04L51/02 ,  H04L51/18 ,  H04L51/52 ,  H04L51/216 ,  H04L67/75 ,  H04L67/306 ,  H04L67/535 ,  H04L67/5651 ,  H04W12/08 ,  H04L67/10

Abstract: In one embodiment, a method includes receiving a user query inputted on a head-mounted device from the head-mounted device, wherein the user query corresponds to multiple dialog-intents, executing multiple tasks corresponding to the multiple dialog-intents, generating a multi-perspective response by a stitching model based on two or more of execution results of the multiple tasks, wherein the stitching model combines the two or more of the execution results based on natural language processing, and wherein the multi-perspective response comprises a natural-language response combining the two or more execution results, and sending instructions to the head-mounted device for presenting the multi-perspective response on the head-mounted device.