公开(公告)号：US20250037212A1

公开(公告)日：2025-01-30

申请号：US18883896

申请日：2024-09-12

Applicant: Meta Platforms Technologies, LLC

Inventor： Xiaohu Liu ,  Baiyang Liu ,  Rajen Subba

IPC: G06Q50/00 ,  G06F3/01 ,  G06F3/16 ,  G06F9/451 ,  G06F9/48 ,  G06F9/54 ,  G06F16/332 ,  G06F16/9032 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/295 ,  G06F40/30 ,  G06F40/35 ,  G06F40/56 ,  G06N3/04 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06Q10/109 ,  G06Q30/0601 ,  G06V10/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/30 ,  G06V20/40 ,  G06V40/16 ,  G06V40/20 ,  G10L15/06 ,  G10L15/08 ,  G10L15/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/18 ,  H04L51/212 ,  H04L51/222 ,  H04L51/224 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/14

Abstract: In one embodiment, a method includes establishing a video call between a plurality of client systems, wherein access to an assistant system is persistently maintained during the video call, receiving, from a first client system of the plurality of client systems, a request by a first user to be performed by the assistant system during the video call, wherein the request references one or more activities associated with one or more users associated with the plurality of client systems, analyzing, by a context engine of the assistant system, images of a scene of the video call to identify the one or more activities within the scene, instructing the assistant system to execute the request based on the identified one or more activities, and sending, to one or more of the plurality of client systems, a response to the request while maintaining the video call between the plurality of client systems.

公开(公告)号：US12182883B2

公开(公告)日：2024-12-31

申请号：US17500679

申请日：2021-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Xiaohu Liu ,  Baiyang Liu ,  Rajen Subba

IPC: G06Q50/00 ,  G06F3/01 ,  G06F9/451 ,  G06F9/48 ,  G06F9/54 ,  G06F16/332 ,  G06F16/9032 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/295 ,  G06F40/30 ,  G06F40/35 ,  G06F40/56 ,  G06N3/04 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06Q10/109 ,  G06Q30/0601 ,  G06V10/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/30 ,  G06V40/16 ,  G06V40/20 ,  G10L15/06 ,  G10L15/08 ,  G10L15/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/18 ,  H04L51/212 ,  H04L51/222 ,  H04L51/224 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/14 ,  G06F3/16 ,  G06V20/40

Abstract: In one embodiment, a method includes establishing a video call between a plurality of client systems, wherein access to an assistant system is persistently maintained during the video call, receiving, from a first client system of the plurality of client systems, a request by a first user to be performed by the assistant system during the video call, wherein the request references one or more activities associated with one or more users associated with the plurality of client systems, analyzing, by a context engine of the assistant system, images of a scene of the video call to identify the one or more activities within the scene, instructing the assistant system to execute the request based on the identified one or more activities, and sending, to one or more of the plurality of client systems, a response to the request while maintaining the video call between the plurality of client systems.

公开(公告)号：US12141879B2

公开(公告)日：2024-11-12

申请号：US17500679

申请日：2021-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Xiaohu Liu ,  Baiyang Liu ,  Rajen Subba

IPC: G06Q50/00 ,  G06F3/01 ,  G06F9/451 ,  G06F9/48 ,  G06F9/54 ,  G06F16/332 ,  G06F16/9032 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/295 ,  G06F40/30 ,  G06F40/35 ,  G06F40/56 ,  G06N3/04 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06Q10/109 ,  G06Q30/0601 ,  G06V10/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/30 ,  G06V40/16 ,  G06V40/20 ,  G10L15/06 ,  G10L15/08 ,  G10L15/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/18 ,  H04L51/212 ,  H04L51/222 ,  H04L51/224 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/14 ,  G06F3/16 ,  G06V20/40

Abstract: In one embodiment, a method includes establishing a video call between a plurality of client systems, wherein access to an assistant system is persistently maintained during the video call, receiving, from a first client system of the plurality of client systems, a request by a first user to be performed by the assistant system during the video call, wherein the request references one or more activities associated with one or more users associated with the plurality of client systems, analyzing, by a context engine of the assistant system, images of a scene of the video call to identify the one or more activities within the scene, instructing the assistant system to execute the request based on the identified one or more activities, and sending, to one or more of the plurality of client systems, a response to the request while maintaining the video call between the plurality of client systems.

公开(公告)号：US11669918B2

公开(公告)日：2023-06-06

申请号：US17666349

申请日：2022-02-07

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Paul Anthony Crook ,  Baiyang Liu ,  Pararth Paresh Shah ,  Bing Liu

IPC: G10L15/32 ,  H04L67/306 ,  G06Q50/00 ,  G06F40/30 ,  G06F9/54 ,  G06F40/205 ,  G06F40/242 ,  G06N3/08 ,  G06F16/9536 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G06F40/253 ,  G06N20/00 ,  G06F3/01 ,  G06F16/9032 ,  G06F9/48 ,  G10L15/08 ,  H04N7/14 ,  G06V20/20 ,  G06V20/30 ,  H04L51/52 ,  H04L51/212 ,  H04L67/75 ,  G06F9/451 ,  G06F16/332 ,  G06F40/35 ,  G10L15/06 ,  G10L15/16 ,  G06F18/2321 ,  G06N3/045 ,  G06N3/047 ,  G06V10/764 ,  G06V10/82 ,  G06F3/16 ,  G06V20/40 ,  G06V40/16

CPC classification number: G06Q50/01 ,  G06F3/011 ,  G06F3/013 ,  G06F9/453 ,  G06F9/485 ,  G06F9/4881 ,  G06F9/547 ,  G06F16/3329 ,  G06F16/90332 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/30 ,  G06F40/35 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06V10/764 ,  G06V10/82 ,  G06V20/20 ,  G06V20/30 ,  G10L15/063 ,  G10L15/08 ,  G10L15/16 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/212 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/147 ,  G06F3/017 ,  G06F3/167 ,  G06V20/41 ,  G06V40/174 ,  G06V2201/10 ,  G10L2015/088 ,  G10L2015/223 ,  G10L2015/227

Abstract: In one embodiment, a method includes receiving a user input at a client system, wherein the user input is associated with one or more intents and one or more slots, generating one or more first dialog acts based on the user input, calculating a task-confidence score based on one or more intent-confidence scores associated with the one or more intents, respectively, and one or more slot-confidence scores associated with the one or more slots, respectively, generating one or more second dialog acts modifying the one or more first dialog acts responsive to the task-confidence score being less than a threshold score, and presenting a response to the user input at the client system, wherein the response is based on one or more of the first dialog acts or the second dialog acts.