公开(公告)号：US20190355351A1

公开(公告)日：2019-11-21

申请号：US15982851

申请日：2018-05-17

Applicant: QUALCOMM Incorporated

Inventor： Lae-Hoon Kim ,  Yinyi Guo ,  Ravi Choudhary ,  Sunkuk Moon ,  Erik Visser ,  Fatemeh Saki

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L25/63 ,  G06F3/0484

Abstract: A device includes a memory configured to store a user experience evaluation unit. A processor is configured to receive a first user input corresponding to a user command to initiate a particular task, the first user input received via a first sensor. The processor is configured to, after receiving the first user input, receive one or more subsequent user inputs, the one or subsequent user inputs including a second user input received via a second sensor. The processor is configured to initiate a remedial action in response to determining, based on the user experience evaluation unit, that the one or more subsequent user inputs correspond to a negative user experience.

公开(公告)号：US12002455B2

公开(公告)日：2024-06-04

申请号：US17383284

申请日：2021-07-22

Applicant: QUALCOMM Incorporated

Inventor： Arvind Krishna Sridhar ,  Ravi Choudhary ,  Lae-Hoon Kim ,  Erik Visser

IPC: G10L15/16 ,  G06V30/262 ,  G10L15/18 ,  G10L15/22 ,  G06N3/0455 ,  G10L15/183

CPC classification number: G10L15/1815 ,  G06V30/274 ,  G10L15/1822 ,  G10L15/22 ,  G06N3/0455 ,  G10L15/16 ,  G10L15/183

Abstract: A device includes a memory configured to store instructions. The device also includes one or more processors configured to execute the instructions to provide context and one or more items of interest corresponding to the context to a dependency network encoder to generate a semantic-based representation of the context. The one or more processors are also configured to provide the context to a data dependent encoder to generate a context-based representation. The one or more processors are further configured to combine the semantic-based representation and the context-based representation to generate a semantically-augmented representation of the context.

公开(公告)号：US11240058B2

公开(公告)日：2022-02-01

申请号：US16370836

申请日：2019-03-29

Applicant: QUALCOMM Incorporated

Inventor： Ravi Choudhary ,  Yinyi Guo ,  Fatemeh Saki ,  Erik Visser

IPC: H04L12/28 ,  B60K35/00 ,  H04L9/32

Abstract: A device to provide information to a visual interface that is mountable to a vehicle dashboard includes a memory configured to store device information indicative of controllable devices of a building and occupant data indicative of one or more occupants of the building. The device includes a processor configured to receive, in real-time, status information associated with the one or more occupants of the building. The status information includes at least one of dynamic location information or dynamic activity information. The processor is configured to generate an output to provide, at the visual interface device, a visual representation of at least a portion of the building and the status information associated with the one or more occupants. The processor is also configured to generate an instruction to adjust an operation of one or more devices of the controllable devices based on user input.

公开(公告)号：US11348581B2

公开(公告)日：2022-05-31

申请号：US16685946

申请日：2019-11-15

Applicant: QUALCOMM Incorporated

Inventor： Ravi Choudhary ,  Lae-Hoon Kim ,  Sunkuk Moon ,  Yinyi Guo ,  Fatemeh Saki ,  Erik Visser

IPC: G10L15/22 ,  G06F3/16 ,  G06F3/01 ,  G10L15/26 ,  G06F3/038 ,  G06F3/04883 ,  G06F3/0484 ,  G06F9/451 ,  G10L15/20

Abstract: A device for multi-modal user input includes a processor configured to process first data received from a first input device. The first data indicates a first input from a user based on a first input mode. The first input corresponds to a command. The processor is configured to send a feedback message to an output device based on processing the first data. The feedback message instructs the user to provide, based on a second input mode that is different from the first input mode, a second input that identifies a command associated with the first input. The processor is configured to receive second data from a second input device, the second data indicating the second input, and to update a mapping to associate the first input to the command identified by the second input.

公开(公告)号：US20210012770A1

公开(公告)日：2021-01-14

申请号：US16685946

申请日：2019-11-15

Applicant: QUALCOMM Incorporated

Inventor： Ravi Choudhary ,  Lae-Hoon Kim ,  Sunkuk Moon ,  Yinyi Guo ,  Fatemeh Saki ,  Erik Visser

IPC: G10L15/22 ,  G06F3/16 ,  G06F3/01 ,  G10L15/26 ,  G06F3/0484 ,  G06F3/038 ,  G06F3/0488

Abstract: A device for multi-modal user input includes a processor configured to process first data received from a first input device. The first data indicates a first input from a user based on a first input mode. The first input corresponds to a command. The processor is configured to send a feedback message to an output device based on processing the first data. The feedback message instructs the user to provide, based on a second input mode that is different from the first input mode, a second input that identifies a command associated with the first input. The processor is configured to receive second data from a second input device, the second data indicating the second input, and to update a mapping to associate the first input to the command identified by the second input.

公开(公告)号：US11094316B2

公开(公告)日：2021-08-17

申请号：US15972011

申请日：2018-05-04

Applicant: QUALCOMM Incorporated

Inventor： Erik Visser ,  Fatemeh Saki ,  Yinyi Guo ,  Sunkuk Moon ,  Lae-Hoon Kim ,  Ravi Choudhary

IPC: G06F3/16 ,  G10L15/18 ,  G10L15/22 ,  G10L17/04 ,  G10L25/63

Abstract: A device includes a memory configured to store category labels associated with categories of a natural language processing library. A processor is configured to analyze input audio data to generate a text string and to perform natural language processing on at least the text string to generate an output text string including an action associated with a first device, a speaker, a location, or a combination thereof. The processor is configured to compare the input audio data to audio data of the categories to determine whether the input audio data matches any of the categories and, in response to determining that the input audio data does not match any of the categories: create a new category label, associate the new category label with at least a portion of the output text string, update the categories with the new category label, and generate a notification indicating the new category label.

公开(公告)号：US20190341026A1

公开(公告)日：2019-11-07

申请号：US15972011

申请日：2018-05-04

Applicant: QUALCOMM Incorporated

Inventor： Erik Visser ,  Fatemeh Saki ,  Yinyi Guo ,  Sunkuk Moon ,  Lae-Hoon Kim ,  Ravi Choudhary

IPC: G10L15/18 ,  G10L25/63 ,  G06F3/16

Abstract: A device includes a memory configured to store category labels associated with categories of a natural language processing library. A processor is configured to analyze input audio data to generate a text string and to perform natural language processing on at least the text string to generate an output text string including an action associated with a first device, a speaker, a location, or a combination thereof. The processor is configured to compare the input audio data to audio data of the categories to determine whether the input audio data matches any of the categories and, in response to determining that the input audio data does not match any of the categories: create a new category label, associate the new category label with at least a portion of the output text string, update the categories with the new category label, and generate a notification indicating the new category label.