公开(公告)号：US20230393796A1

公开(公告)日：2023-12-07

申请号：US18235693

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G06T19/006 ,  H04B5/0025 ,  G06T7/74 ,  G06F3/013 ,  G06F3/017 ,  G02B2027/0187 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20 ,  G06F3/0346

Abstract: In some exemplary processes for controlling an external device using a computer-generated reality interface, a view of a physical environment that includes the external device is provided through the display, and information specifying a function of the external device is received from the external device. While the view of the physical environment is being provided, an affordance corresponding to the function is displayed at a position on the display that overlays at least a portion of the external device.

公开(公告)号：US20210365228A1

公开(公告)日：2021-11-25

申请号：US17394114

申请日：2021-08-04

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06K9/00 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484

Abstract: In some exemplary processes for controlling an external device using a computer-generated reality interface, information specifying a function of the external device is received from the external device. First image data of a physical environment that includes the external device is obtained with one or more image sensors. A representation of the physical environment according to the first image data is displayed on a display. While displaying the representation of the physical environment, second image data identifying a gesture occurring between the display and the external device in the physical environment is obtained with the one or more image sensors. A determination is made as to whether the identified gesture satisfies one or more predetermined criteria associated with the function. In accordance with determining that the identified gesture satisfies one or more predetermined criteria associated with the function, the external device is caused to perform the function.

公开(公告)号：US20240411497A1

公开(公告)日：2024-12-12

申请号：US18811647

申请日：2024-08-21

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/73 ,  G06T19/00 ,  G06V20/20 ,  G06V40/20 ,  H04B5/70

Abstract: In an exemplary process, an electronic device obtains, from an external device, information specifying one or more available functions of the external device, and image data of a physical environment that includes the external device is captured by an image sensor. The electronic device then determines that the image data includes a representation of the external device, and in response, a display concurrently presents a view of the physical environment and a user-activatable virtual object corresponding to a first function of the one or more available functions of the external device, where the user-activatable virtual object is selected from a plurality of candidate user-activatable virtual objects based on the information specifying the one or more available functions of the external device.

公开(公告)号：US20230376261A1

公开(公告)日：2023-11-23

申请号：US18229059

申请日：2023-08-01

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G06T19/006 ,  H04B5/0025 ,  G06T7/74 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20 ,  G02B2027/0187

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causes a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.

公开(公告)号：US20220083303A1

公开(公告)日：2022-03-17

申请号：US17534102

申请日：2021-11-23

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06K9/00 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causing a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.