公开(公告)号：US09338493B2

公开(公告)日：2016-05-10

申请号：US14498503

申请日：2014-09-26

Applicant: Apple Inc.

Inventor： Marcel Van Os ,  Harry J. Saddler ,  Lia T. Napolitano ,  Jonathan H. Russell ,  Patrick M. Lister ,  Rohit Dasari

IPC: H04N21/482 ,  H04N5/46 ,  H04N21/422 ,  H04N21/41 ,  H04N21/443 ,  H04N21/858 ,  H04N21/488 ,  H04N21/84 ,  G06F17/30 ,  G10L15/26 ,  H04N21/431 ,  G09C1/00 ,  H04N21/472

CPC classification number: H04N21/482 ,  G06F17/30823 ,  G09C1/00 ,  G10L15/22 ,  G10L15/26 ,  G10L17/005 ,  G10L17/22 ,  G10L2015/223 ,  H04N21/2541 ,  H04N21/25891 ,  H04N21/4122 ,  H04N21/4126 ,  H04N21/42203 ,  H04N21/4312 ,  H04N21/4316 ,  H04N21/4438 ,  H04N21/4532 ,  H04N21/4627 ,  H04N21/47214 ,  H04N21/4828 ,  H04N21/4882 ,  H04N21/84 ,  H04N21/858

Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. A virtual assistant can interact with a television set-top box to control content shown on a television. Speech input for the virtual assistant can be received from a device with a microphone. User intent can be determined from the speech input, and the virtual assistant can execute tasks according to the user's intent, including causing playback of media on the television. Virtual assistant interactions can be shown on the television in interfaces that expand or contract to occupy a minimal amount of space while conveying desired information. Multiple devices associated with multiple displays can be used to determine user intent from speech input as well as to convey information to users. In some examples, virtual assistant query suggestions can be provided to the user based on media content shown on a display.

Abstract translation: 公开了用于使用虚拟助理控制电视用户交互的系统和过程。 虚拟助手可以与电视机顶盒进行交互，以控制电视上显示的内容。 可以从具有麦克风的设备接收虚拟助理的语音输入。 可以从语音输入确定用户意图，并且虚拟助理可以根据用户的意图执行任务，包括在电视机上播放媒体。 虚拟助手的互动可以在电视上显示在扩展或收缩的界面中，以占用最少的空间，同时传达所需的信息。 可以使用与多个显示器相关联的多个设备来确定来自语音输入的用户意图以及向用户传达信息。 在一些示例中，可以基于显示器上显示的媒体内容向用户提供虚拟助理查询建议。

公开(公告)号：US12175977B2

公开(公告)日：2024-12-24

申请号：US18136710

申请日：2023-04-19

Applicant: Apple Inc.

Inventor： Aram D. Kudurshian ,  Bronwyn Jones ,  Elizabeth Caroline Furches Cranfill ,  Harry J. Saddler

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/683 ,  G06F16/9032 ,  G06F16/951 ,  G10L13/02 ,  G10L15/18 ,  G10L15/30

Abstract: Systems and processes for operating a digital assistant are provided. In one example, a method includes receiving a first speech input from a user. The method further includes identifying context information and determining a user intent based on the first speech input and the context information. The method further includes determining whether the user intent is to perform a task using a searching process or an object managing process. The searching process is configured to search data, and the object managing process is configured to manage objects. The method further includes, in accordance with a determination the user intent is to perform the task using the searching process, performing the task using the searching process; and in accordance with the determination that the user intent is to perform the task using the object managing process, performing the task using the object managing process.

公开(公告)号：US12073147B2

公开(公告)日：2024-08-27

申请号：US17343288

申请日：2021-06-09

Applicant: Apple Inc.

Inventor： David Carson ,  Daniel Keen ,  Evan Dibiase ,  Harry J. Saddler ,  Marco Iacono ,  Stephen O. Lemay ,  Donald W. Pitschel ,  Thomas R. Gruber

IPC: G06F17/00 ,  G06F3/04842 ,  G06F3/16 ,  G06F16/33

CPC classification number: G06F3/167 ,  G06F3/04842 ,  G06F16/3344

Abstract: An electronic device with one or more processors and memory includes a procedure for enabling conversation persistence across two or more instances of a digital assistant. In some embodiments, the device displays a first dialogue in a first instance of a digital assistant user interface. In response to a request to display a user interface different from the digital assistant user interface, the device displays the user interface different from the digital assistant user interface. In response to a request to invoke the digital assistant, the device displays a second instance of the digital assistant user interface, including displaying a second dialogue in the second instance of the digital assistant user interface, where the first dialogue remains available for display in the second instance of the digital assistant user interface.

公开(公告)号：US11955137B2

公开(公告)日：2024-04-09

申请号：US17330145

申请日：2021-05-25

Applicant: Apple Inc.

Inventor： Garrett L. Weinberg ,  Harry J. Saddler

IPC: G10L15/22 ,  G06F3/01 ,  G10L15/08 ,  G10L15/18 ,  G10L25/78

CPC classification number: G10L25/78 ,  G06F3/013 ,  G10L15/083 ,  G10L15/1807 ,  G10L15/22 ,  G10L2015/088 ,  G10L2015/221 ,  G10L2015/223 ,  G10L2025/786

Abstract: Systems and processes for operating an intelligent automated assistant are provided. For example, a first speech input directed to a digital assistant is received from a user. A first response is provided based on the first speech input. A session window is initiated, wherein the session window is associated with a variable speech threshold. A second speech input is received during the session window. In accordance with a determination that the second speech input includes speech directed to the digital assistant, a duration associated with the session window is increased. In accordance with a determination that the variable speech threshold does not exceed a predetermined speech threshold, the session window is ended.

公开(公告)号：US20240005921A1

公开(公告)日：2024-01-04

申请号：US18212499

申请日：2023-06-21

Applicant: Apple Inc.

Inventor： Devin W. Chalmers ,  Brian W. Temple ,  Carlo Eduardo C. Del Mundo ,  Harry J. Saddler ,  Jean-Charles Bernard Marcel Bazin

IPC: G10L15/22 ,  G06V10/20 ,  G06F3/01

CPC classification number: G10L15/22 ,  G06V10/255 ,  G06F3/013 ,  G10L2015/223

Abstract: In one implementation, a method of changing a state of an object is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving a vocal command. The method includes obtaining, using the image sensor, an image of a physical environment. The method includes detecting, in the image of the physical environment, an object based on a visual model of the object stored in the non-transitory memory in association with an object identifier of the object. The method includes generating, based on the vocal command and detection of the object, an instruction including the object identifier of the object. The method includes effectuating the instruction to change a state of the object.

公开(公告)号：US10904611B2

公开(公告)日：2021-01-26

申请号：US15495861

申请日：2017-04-24

Applicant: Apple Inc.

Inventor： Marcel Van Os ,  Harry J. Saddler ,  Lia T. Napolitano ,  Jonathan H. Russell ,  Patrick M. Lister ,  Rohit Dasari

IPC: H04N21/439 ,  H04N21/422 ,  H04N21/41 ,  H04N21/443 ,  H04N21/482 ,  H04N21/858 ,  H04N21/488 ,  H04N21/84 ,  G06F16/73 ,  G06F16/738 ,  G06F16/78 ,  G10L15/26 ,  H04N21/431 ,  G09C1/00 ,  G10L15/22 ,  G06F3/16 ,  G10L17/00 ,  G10L17/22 ,  H04N21/254 ,  H04N21/258 ,  H04N21/45 ,  H04N21/4627 ,  G10L15/18 ,  H04N21/472

Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. In an example process, a virtual assistant can interact with a television set-top box to control content shown on a television display. Speech input for the virtual assistant can be received from a device with a microphone. The speech input can comprise a query associated with content shown on the television display. A user intent of the query can be determined based on one or more of the content shown on the television display and a viewing history of media content. A result of the query can be caused to be displayed based on the determined user intent.

公开(公告)号：US10553209B2

公开(公告)日：2020-02-04

申请号：US14210183

申请日：2014-03-13

Applicant: Apple Inc.

Inventor： Thomas R. Gruber ,  Harry J. Saddler ,  Devrim Varoglu ,  Gencer Cili

IPC: G10L25/48 ,  G10L15/22 ,  G06F17/27 ,  G10L15/08 ,  G10L15/18

Abstract: A method includes outputting an alert corresponding to an information item. In some implementations, the alert is a sound. In some implementations, the alert is ambiguous (e.g., the sound indicates several possible information items). The method further includes receiving a speech input after outputting the alert. The method further includes determining whether the speech input includes a request for information about the alert. The method further includes, in response to determining that the speech input includes a request for information about the alert, providing a first speech output including information about the alert.

公开(公告)号：US10289433B2

公开(公告)日：2019-05-14

申请号：US14502245

申请日：2014-09-30

Applicant: Apple Inc.

Inventor： Harry J. Saddler ,  Nicolas Zeitlin

IPC: G06F3/00 ,  G06F9/451 ,  G10L13/027

Abstract: Systems and processes for generating output dialogs for virtual assistants are provided. An output dialog can be generated from multiple output segments that can each include a string of one or more characters or words. The contents of an output segment can be selected from multiple possible outputs based on a predetermined order, conditional logic, or a random selection. The output segments can be concatenated to form the output dialog. In one example, a dialog generation file that defines the possible outputs for each output segment, an ordering of the output segments within the output dialog, and format for the output dialog can be used to generate the output dialog. The dialog generation file can include any number of functional blocks, which can each output an output segment, that can be arranged hierarchically and in a particular order to generate a desired output dialog.

公开(公告)号：US09668024B2

公开(公告)日：2017-05-30

申请号：US15085465

申请日：2016-03-30

Applicant: Apple Inc.

Inventor： Marcel Van Os ,  Harry J. Saddler ,  Lia T. Napolitano ,  Jonathan H. Russell ,  Patrick M. Lister ,  Rohit Dasari

IPC: H04N21/482 ,  H04N21/422 ,  H04N21/41 ,  H04N21/443 ,  H04N21/858 ,  H04N21/488 ,  H04N21/84 ,  G06F17/30 ,  G10L15/26 ,  H04N21/431 ,  G09C1/00 ,  G10L15/22 ,  G10L17/00 ,  G10L17/22 ,  H04N21/254 ,  H04N21/258 ,  H04N21/45 ,  H04N21/4627 ,  H04N21/472

CPC classification number: H04N21/482 ,  G06F17/30823 ,  G09C1/00 ,  G10L15/22 ,  G10L15/26 ,  G10L17/005 ,  G10L17/22 ,  G10L2015/223 ,  H04N21/2541 ,  H04N21/25891 ,  H04N21/4122 ,  H04N21/4126 ,  H04N21/42203 ,  H04N21/4312 ,  H04N21/4316 ,  H04N21/4438 ,  H04N21/4532 ,  H04N21/4627 ,  H04N21/47214 ,  H04N21/4828 ,  H04N21/4882 ,  H04N21/84 ,  H04N21/858

Abstract: Systems and processes are disclosed for controlling television user interactions using a virtual assistant. A virtual assistant can interact with a television set-top box to control content shown on a television. Speech input for the virtual assistant can be received from a device with a microphone. User intent can be determined from the speech input, and the virtual assistant can execute tasks according to the user's intent, including causing playback of media on the television. Virtual assistant interactions can be shown on the television in interfaces that expand or contract to occupy a minimal amount of space while conveying desired information. Multiple devices associated with multiple displays can be used to determine user intent from speech input as well as to convey information to users. In some examples, virtual assistant query suggestions can be provided to the user based on media content shown on a display.

公开(公告)号：US20130275899A1

公开(公告)日：2013-10-17

申请号：US13913428

申请日：2013-06-08

Applicant: Apple Inc.

Inventor： Emily Clark Schubert ,  Harry J. Saddler ,  Lia T. Napolitano ,  Thomas R. Gruber

IPC: G06F3/0481

CPC classification number: G06F3/0481 ,  B60K35/00 ,  B60K2370/195 ,  B60K2370/569 ,  G10L15/22 ,  H04M1/72577

Abstract: An electronic device receives a first input that corresponds to a request to open a respective application, and in response to receiving the first input, in accordance with a determination that the device is being operated in a limited-distraction context, provides a limited-distraction user interface that includes providing for display fewer selectable user interface objects than are displayed in a non-limited user interface for the respective application, and in accordance with a determination that the device is not being operated in a limited-distraction context, provides a non-limited user interface for the respective application.

Abstract translation: 电子设备接收对应于打开相应应用的请求的第一输入，并且响应于接收到第一输入，根据在有限分散的上下文中操作该设备的确定，提供有限的分心 用户界面，其包括提供显示比在相应应用的非限制用户界面中显示更少的可选用户界面对象，并且根据确定该设备未在有限分散的上下文中操作， 用于各个应用程序的无限用户界面。