-
1.
公开(公告)号:US20240331697A1
公开(公告)日:2024-10-03
申请号:US18739011
申请日:2024-06-10
发明人: Utku Yabas , Philipp Hubert , Karl Stahl
IPC分类号: G10L15/22 , G06F40/211 , G06F40/284 , G10L15/183 , G10L15/26
CPC分类号: G10L15/22 , G06F40/211 , G06F40/284 , G10L15/183 , G10L15/26 , G10L2015/223
摘要: A user specifies a natural language command to a device. Software on the device generates contextual metadata about the user interface of the device, such as data about all visible elements of the user interface, and sends the contextual metadata along with the natural language command to a natural language understanding engine. The natural language understanding engine parses the natural language query using a stored grammar (e.g., a grammar provided by a maker of the device) and as a result of the parsing identifies information about the command (e.g., the user interface elements referenced by the command) and provides that information to the device. The device uses that provided information to respond to the command.