公开(公告)号：US20240054156A1

公开(公告)日：2024-02-15

申请号：US17512508

申请日：2021-10-27

Applicant: Meta Platforms, Inc.

Inventor： Joshuah Vincent ,  Ruchir Srivastava ,  Leon Zhan ,  Jiayang Tong ,  Zhiguang Wang ,  Guangqiang Dong ,  Zhenpeng Zhou ,  Xin Ming Fan

IPC: H04L12/58 ,  G10L15/22

CPC classification number: H04L51/10 ,  H04L51/046 ,  G10L15/22 ,  G10L2015/223

Abstract: In one embodiment, a method includes receiving a multimodal input from a first client system associated with a first user via an assistant xbot, wherein the multimodal input comprises first images captured by cameras of the first client system and voice inputs by the first user, wherein the voice inputs comprise personalized labels corresponding to the first images, storing the first images and the personalized labels as a first digital memory of the first user, receiving a user request by the first user referencing one or more of the personalized labels from the first client system via the assistant xbot, generating a response for the first user based on the first digital memory and the referenced personalized labels, and sending instructions for presenting the response to the first user to the first client system via the assistant xbot.