公开(公告)号：US20230222605A1

公开(公告)日：2023-07-13

申请号：US18185258

申请日：2023-03-16

Applicant: Meta Platforms, Inc.

Inventor： Vivek Natarajan ,  Shawn C.P. Mei ,  Zhengping Zuo

IPC: G10L15/22 ,  G06V40/16 ,  G02B27/01

CPC classification number: G10L15/22 ,  G06V40/172 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/014

Abstract: In one embodiment, a method includes receiving at a head-mounted device a speech input from a user and a visual input captured by cameras of the head-mounted device, wherein the visual input comprises subjects and attributes associated with the subjects, and wherein the speech input comprises a co-reference to one or more of the subjects, resolving entities corresponding to the subjects associated with the co-reference based on the attributes and the co-reference, and presenting a communication content responsive to the speech input and the visual input at the head-mounted device, wherein the communication content comprises information associated with executing results of tasks corresponding to the resolved entities.

公开(公告)号：US11546596B2

公开(公告)日：2023-01-03

申请号：US16724051

申请日：2019-12-20

Applicant: Meta Platforms, Inc.

Inventor： Yaming He ,  Zhengping Zuo

IPC: H04N19/124 ,  H04N19/154 ,  H04N19/132 ,  H04N19/156 ,  H04N19/147 ,  H04N19/177

Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.

公开(公告)号：US11429649B2

公开(公告)日：2022-08-30

申请号：US16011062

申请日：2018-06-18

Applicant: Meta Platforms, Inc.

Inventor： Jinsong Yu ,  Zhengping Zuo ,  Guowei Shieh ,  Fuchun Peng

IPC: G06F16/332 ,  H04L67/306 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/50 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L51/02 ,  G06F3/16 ,  G06K9/62 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L67/5651 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  H04L51/00 ,  G06N3/00 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G06F16/903 ,  G06F40/205 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L67/53 ,  H04L67/10 ,  H04L51/046 ,  G10L13/00 ,  G10L13/04

Abstract: In one embodiment, a method includes receiving a sharing request to share content generated during a current dialog session from a client system associated with a first user, identifying one or more content objects associated with the sharing request based on a natural-language understanding module, wherein the one or more content objects were previously generated during the current dialog session, determining one or more second users the sharing request is directed to based on a user profile associated with first user, and sending instructions for accessing one or more of the identified content objects to one or more client systems associated with the one or more second users.

公开(公告)号：US11676220B2

公开(公告)日：2023-06-13

申请号：US17156964

申请日：2021-01-25

Applicant: Meta Platforms, Inc.

Inventor： Vivek Natarajan ,  Shawn C. P. Mei ,  Zhengping Zuo

IPC: G06F17/30 ,  G06Q50/00 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/332 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L51/02 ,  G06F3/16 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/006 ,  G10L17/06 ,  G06F16/248 ,  G06F16/438 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G06F16/903 ,  G06F40/205 ,  G10L15/187 ,  G06F16/28 ,  G06V20/10 ,  G06V40/20 ,  G06V40/16 ,  H04L51/216 ,  H04L67/75 ,  H04L67/50 ,  H04L67/5651 ,  G06F18/2411 ,  G06V10/82 ,  H04L67/10 ,  H04L51/046 ,  G10L13/00 ,  G10L13/04 ,  H04L67/53

CPC classification number: G06Q50/01 ,  G06F3/011 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06F7/14 ,  G06F9/453 ,  G06F16/176 ,  G06F16/2255 ,  G06F16/2365 ,  G06F16/243 ,  G06F16/248 ,  G06F16/24552 ,  G06F16/24575 ,  G06F16/24578 ,  G06F16/285 ,  G06F16/338 ,  G06F16/3323 ,  G06F16/3329 ,  G06F16/3344 ,  G06F16/4393 ,  G06F16/904 ,  G06F16/9038 ,  G06F16/90332 ,  G06F16/90335 ,  G06F16/951 ,  G06F16/9535 ,  G06F18/2411 ,  G06F40/205 ,  G06F40/30 ,  G06F40/40 ,  G06N3/006 ,  G06N3/08 ,  G06N20/00 ,  G06V10/82 ,  G06V20/10 ,  G06V40/172 ,  G06V40/28 ,  G10L15/02 ,  G10L15/063 ,  G10L15/07 ,  G10L15/16 ,  G10L15/183 ,  G10L15/187 ,  G10L15/1815 ,  G10L15/1822 ,  G10L15/22 ,  G10L15/26 ,  G10L17/06 ,  G10L17/22 ,  H04L12/2816 ,  H04L41/20 ,  H04L41/22 ,  H04L43/0882 ,  H04L43/0894 ,  H04L51/02 ,  H04L51/216 ,  H04L67/306 ,  H04L67/535 ,  H04L67/5651 ,  H04L67/75 ,  H04W12/08 ,  G06F2216/13 ,  G10L13/00 ,  G10L13/04 ,  G10L2015/223 ,  G10L2015/225 ,  H04L51/046 ,  H04L67/10 ,  H04L67/53

Abstract: In one embodiment, a method includes receiving a user input based on a plurality of modalities at the client system, wherein at least one of the modalities of the user input is a visual modality, determining one or more subjects and one or more attributes associated with the one or more subjects, respectively, based on the visual modality of the user input, resolving one or more entities corresponding to the one or more subjects based on the determined one or more attributes, and presenting a communication content at the client system responsive to the user input, wherein the communication content comprises information associated with executing results of one or more tasks corresponding to the one or more resolved entities.

公开(公告)号：US20220374460A1

公开(公告)日：2022-11-24

申请号：US17870110

申请日：2022-07-21

Applicant: Meta Platforms, Inc.

Inventor： Jinsong Yu ,  Zhengping Zuo ,  Guowei Shieh ,  Fuchun Peng

IPC: G06F16/332 ,  G06F9/451 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G06F16/338 ,  G06F16/33 ,  G06N20/00 ,  G06F16/9535 ,  G06Q50/00 ,  H04L67/306 ,  G06F16/176 ,  G10L15/06 ,  G10L15/16 ,  G06F3/01 ,  G06F16/9032 ,  G06F16/2457 ,  H04L51/02 ,  G06F3/16 ,  G06K9/62 ,  G06N3/08 ,  G10L15/26 ,  G06F16/9038 ,  G06F16/904 ,  G06F40/30 ,  G06F40/40 ,  G06F16/22 ,  G06F16/23 ,  G06F7/14 ,  H04L43/0882 ,  H04L43/0894 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04W12/08 ,  G10L15/07 ,  G10L17/22 ,  G06N3/00 ,  G10L17/06 ,  G06F16/248 ,  G06F16/951 ,  G06F16/242 ,  G06F16/2455 ,  G10L15/02 ,  G10L15/187 ,  G06V20/10 ,  G06V40/20 ,  G06F40/295 ,  H04L51/52 ,  H04L51/216 ,  H04L67/50 ,  H04L67/5651 ,  G06N7/00 ,  H04L51/18 ,  H04L67/75

Abstract: In one embodiment, a method includes receiving a user input from a first user at the first client system, determining that the user input is a sharing request to share content, determining multiple second users the sharing request is directed to, determining, for each second user, modalities associated with the respective second user based on the content, a user profile associated with the respective second user, and modalities supported by a second client system the respective second user is currently engaged with, the respective second user being associated with two or more second client systems, and sending, to one or more second client systems currently associated with the second users, instructions for accessing the content based on the determined modalities for each second user.

公开(公告)号：US20220358917A1

公开(公告)日：2022-11-10

申请号：US17336716

申请日：2021-06-02

Applicant: Meta Platforms, Inc.

Inventor： Christophe Chaland ,  Lloyd Hilaiel ,  Zhenhua Cui ,  Krishna Chaitanya Gopisetty Srinivas ,  Rohin Dabas ,  Ian Graves ,  Yuanhui Chen ,  Zhengping Zuo ,  Pramod Gurunath

IPC: G10L15/22

Abstract: In one embodiment, a method includes receiving a voice request from a first user who intends to activate a particular client system among a plurality of client systems that are within listening range of the first user, accessing signals associated with the voice request from each of the client systems, identifying a first client system from the plurality of client systems as being the particular client system the first user intended to activate based on the accessed signals, and instructing the first client system to provide a response from an assistant system responsive to the voice request.

公开(公告)号：US20250069159A1

公开(公告)日：2025-02-27

申请号：US18892786

申请日：2024-09-23

Applicant: Meta Platforms, Inc.

Inventor： Vivek Natarajan ,  Zhengping Zuo ,  Shawn C. P. Mei

IPC: G06Q50/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06F7/14 ,  G06F9/451 ,  G06F16/176 ,  G06F16/22 ,  G06F16/23 ,  G06F16/242 ,  G06F16/2455 ,  G06F16/2457 ,  G06F16/248 ,  G06F16/28 ,  G06F16/33 ,  G06F16/332 ,  G06F16/338 ,  G06F16/438 ,  G06F16/903 ,  G06F16/9032 ,  G06F16/9038 ,  G06F16/904 ,  G06F16/951 ,  G06F16/9535 ,  G06F18/2411 ,  G06F40/205 ,  G06F40/30 ,  G06F40/40 ,  G06N3/006 ,  G06N3/08 ,  G06N20/00 ,  G06V10/82 ,  G06V20/10 ,  G06V20/30 ,  G06V40/16 ,  G06V40/20 ,  G10L13/00 ,  G10L13/04 ,  G10L15/02 ,  G10L15/06 ,  G10L15/07 ,  G10L15/16 ,  G10L15/18 ,  G10L15/183 ,  G10L15/187 ,  G10L15/22 ,  G10L15/26 ,  G10L17/06 ,  G10L17/22 ,  H04L12/28 ,  H04L41/00 ,  H04L41/22 ,  H04L43/0882 ,  H04L43/0894 ,  H04L51/02 ,  H04L51/046 ,  H04L51/216 ,  H04L67/10 ,  H04L67/306 ,  H04L67/50 ,  H04L67/53 ,  H04L67/5651 ,  H04L67/75 ,  H04W12/08

Abstract: In one embodiment, a method includes receiving at a head-mounted device a speech input from a user and a visual input captured by cameras of the head-mounted device, wherein the visual input comprises subjects and attributes associated with the subjects, and wherein the speech input comprises a co-reference to one or more of the subjects, resolving entities corresponding to the subjects associated with the co-reference based on the attributes and the co-reference, and presenting a communication content responsive to the speech input and the visual input at the head-mounted device, wherein the communication content comprises information associated with executing results of tasks corresponding to the resolved entities.