公开(公告)号：US12141879B2

公开(公告)日：2024-11-12

申请号：US17500679

申请日：2021-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Xiaohu Liu ,  Baiyang Liu ,  Rajen Subba

IPC: G06Q50/00 ,  G06F3/01 ,  G06F9/451 ,  G06F9/48 ,  G06F9/54 ,  G06F16/332 ,  G06F16/9032 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/295 ,  G06F40/30 ,  G06F40/35 ,  G06F40/56 ,  G06N3/04 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06Q10/109 ,  G06Q30/0601 ,  G06V10/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/30 ,  G06V40/16 ,  G06V40/20 ,  G10L15/06 ,  G10L15/08 ,  G10L15/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/18 ,  H04L51/212 ,  H04L51/222 ,  H04L51/224 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/14 ,  G06F3/16 ,  G06V20/40

Abstract: In one embodiment, a method includes establishing a video call between a plurality of client systems, wherein access to an assistant system is persistently maintained during the video call, receiving, from a first client system of the plurality of client systems, a request by a first user to be performed by the assistant system during the video call, wherein the request references one or more activities associated with one or more users associated with the plurality of client systems, analyzing, by a context engine of the assistant system, images of a scene of the video call to identify the one or more activities within the scene, instructing the assistant system to execute the request based on the identified one or more activities, and sending, to one or more of the plurality of client systems, a response to the request while maintaining the video call between the plurality of client systems.

公开(公告)号：US20240104668A1

公开(公告)日：2024-03-28

申请号：US18514597

申请日：2023-11-20

Applicant: Meta Platforms Technologies, LLC

Inventor： Xiaohu Liu ,  Zhiguang Wang ,  Rajen Subba

IPC: G06Q50/00 ,  G06F3/01 ,  G06F9/451 ,  G06F9/48 ,  G06F9/54 ,  G06F16/332 ,  G06F16/9032 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/30 ,  G06F40/35 ,  G06F40/56 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06Q10/109 ,  G06V10/20 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/30 ,  G06V40/16 ,  G06V40/20 ,  G10L15/06 ,  G10L15/08 ,  G10L15/16 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/18 ,  H04L51/212 ,  H04L51/222 ,  H04L51/224 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/14

CPC classification number: G06Q50/01 ,  G06F3/011 ,  G06F3/013 ,  G06F9/453 ,  G06F9/485 ,  G06F9/4881 ,  G06F9/547 ,  G06F16/3329 ,  G06F16/90332 ,  G06F16/9536 ,  G06F18/2321 ,  G06F40/205 ,  G06F40/242 ,  G06F40/253 ,  G06F40/30 ,  G06F40/35 ,  G06F40/56 ,  G06N3/045 ,  G06N3/047 ,  G06N3/08 ,  G06N20/00 ,  G06Q10/109 ,  G06V10/255 ,  G06V10/764 ,  G06V10/82 ,  G06V20/00 ,  G06V20/20 ,  G06V20/30 ,  G06V40/16 ,  G06V40/25 ,  G10L15/063 ,  G10L15/08 ,  G10L15/16 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/30 ,  G10L15/32 ,  H04L51/18 ,  H04L51/212 ,  H04L51/222 ,  H04L51/224 ,  H04L51/52 ,  H04L67/306 ,  H04L67/75 ,  H04N7/147 ,  G06F3/017 ,  G06F3/167 ,  G10L2015/088 ,  G10L2015/223 ,  G10L2015/227

Abstract: In one embodiment, a method includes receiving a first user request at a client system to suspend a first task being executed by an assistant system operating on the client system, suspending the execution of the first task responsive to the first user request, receiving a second user request at the client system, determining that the second user request is a request to resume the suspended first task based on user interactions with the assistant system with respect to one or more entities associated with the first task, and presenting a prompt to resume the first task at the client system.

公开(公告)号：US20230419651A1

公开(公告)日：2023-12-28

申请号：US18449525

申请日：2023-08-14

Applicant: Meta Platforms Technologies, LLC

Inventor： Paul Anthony Crook ,  Francislav P. Penov ,  Rajen Subba ,  Xiaohu Liu

IPC: G06V10/82 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/332 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L51/02 ,  G06F3/16 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/006 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/50 ,  H04L67/5651 ,  H04L51/18 ,  H04L67/75 ,  G06F16/903 ,  G06F40/205 ,  G06F18/2411 ,  G06N7/01 ,  G06V10/764

CPC classification number: G06V10/82 ,  G06F9/453 ,  G10L15/1815 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/3323 ,  G06F16/3344 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/01 ,  H04L67/306 ,  G06F16/176 ,  G10L15/063 ,  G10L15/16 ,  G06F3/011 ,  G06F3/017 ,  G06F16/90332 ,  G06F16/24575 ,  H04L51/02 ,  G06F3/167 ,  G10L15/1822 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/2255 ,  G06F16/2365 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/2816 ,  H04L41/20 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06F16/3329 ,  G06N3/006 ,  G10L17/06 ,  G06F16/24578 ,  G06F16/248 ,  G06F16/951 ,  G06F16/243 ,  G06F16/24552 ,  G06F3/013 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/28 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/535 ,  H04L67/5651 ,  H04L51/18 ,  H04L67/75 ,  G06F16/90335 ,  G06F40/205 ,  G06F18/2411 ,  G06N7/01 ,  G06V10/764 ,  H04L67/10

Abstract: In one embodiment, a method includes receiving a user request from a first user from a client system associated with a first user, wherein the user request comprise a gesture-input from the first user and a speech-input from the first user, determining an intent corresponding to the user request based on the gesture-input by a personalized gesture-classification model associated with the first user, executing one or more tasks based on the determined intent and the speech-input, and sending instructions for presenting execution results of the one or more tasks to the client system responsive the user request.

公开(公告)号：US11442992B1

公开(公告)日：2022-09-13

申请号：US16557055

申请日：2019-08-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Seungwhan Moon ,  Pararth Paresh Shah ,  Anuj Kumar ,  Rajen Subba

IPC: G06F16/9032 ,  G06N20/00 ,  G06Q50/00 ,  G06N3/04 ,  G06F16/901

Abstract: In one embodiment, a method includes receiving a query from a user from a client system associated with the user, accessing a knowledge graph comprising a plurality of nodes and edges connecting the nodes, wherein each node corresponds to an entity and each edge corresponds to a relationship between the entities corresponding to the connected nodes, determining one or more initial entities associated with the query based on the query, selecting one or more candidate nodes by a conversational reasoning model from the knowledge graph corresponding to one or more candidate entities, respectively, wherein each candidate node is selected based on the nodes corresponding to the initial entities, dialog states associated with the query, and a context associated with the query, generating a response based on the initial entities and the candidate entities, and sending instructions for presenting the response to the client system in response to the query.