公开(公告)号：US20230128422A1

公开(公告)日：2023-04-27

申请号：US18050037

申请日：2022-10-26

Applicant: Meta Platforms, Inc.

Inventor： Mengxi Li ,  Aaron Jackson ,  Julien Philippe Gilbert Odent

IPC: G10L15/22 ,  G10L15/18 ,  G06F3/01 ,  H04R3/00 ,  G06F3/0482 ,  G06V20/20 ,  G06V20/62 ,  G06F40/58 ,  G06F3/16 ,  G10L15/24

Abstract: In one embodiment, a method includes receiving, by a XR display device, a gesture-based input from a first user of the XR display device, processing, using a gesture-detection model, the gesture-based input to identify a first gesture, receiving, by the XR display device, an audio input from the first user, where the audio input includes a first voice command, processing, using a natural-language model, the audio input to identify one or more intents or one or more slots associated with the first voice command, determining whether the identified first gesture matches the first voice command, and executing, responsive to the identified first gesture matching the first voice command and by the XR display device, a first task corresponding to the first voice command based on the identified first gesture and the identified one or more intents or one or more slots.

公开(公告)号：US20220415320A1

公开(公告)日：2022-12-29

申请号：US17745671

申请日：2022-05-16

Applicant: Meta Platforms, Inc.

Inventor： Pujie Zheng ,  Lin Sun ,  Ram Kumar Hariharan ,  Haidong Wang ,  Joshua Saylor McMullen ,  Mengxi Li ,  Long You Cai ,  Keith Diedrick ,  Crystal Annette Nakatsu Sung ,  Xi Chen ,  Stanislav Peshterliev ,  Debojeet Chatterjee ,  Sonal Gupta ,  Vikas Seshagiri Rao Bhardwaj ,  Yashar Mehdad ,  Anuj Kumar ,  Ashish Garg ,  Justin Denney ,  Hakan Inan ,  Iaroslav Markov ,  Surya Teja Appini ,  Bing Liu ,  Shusen Liu ,  Zhiqi Wang ,  Alexander Kolmykov-Zotov

IPC: G10L15/22 ,  G06F40/35

Abstract: In one embodiment, a system includes an automatic speech recognition (ASR) module, a natural-language understanding (NLU) module, a dialog manager, one or more agents, an arbitrator, a delivery system, one or more processors, and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to receive a user input, process the user input using the ASR module, the NLU module, the dialog manager, one or more of the agents, the arbitrator, and the delivery system, and provide a response to the user input.