公开(公告)号：US20220083303A1

公开(公告)日：2022-03-17

申请号：US17534102

申请日：2021-11-23

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06K9/00 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causing a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.

公开(公告)号：US20240411497A1

公开(公告)日：2024-12-12

申请号：US18811647

申请日：2024-08-21

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G02B27/00 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/73 ,  G06T19/00 ,  G06V20/20 ,  G06V40/20 ,  H04B5/70

Abstract: In an exemplary process, an electronic device obtains, from an external device, information specifying one or more available functions of the external device, and image data of a physical environment that includes the external device is captured by an image sensor. The electronic device then determines that the image data includes a representation of the external device, and in response, a display concurrently presents a view of the physical environment and a user-activatable virtual object corresponding to a first function of the one or more available functions of the external device, where the user-activatable virtual object is selected from a plurality of candidate user-activatable virtual objects based on the information specifying the one or more available functions of the external device.

公开(公告)号：US20230376261A1

公开(公告)日：2023-11-23

申请号：US18229059

申请日：2023-08-01

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G06T19/006 ,  H04B5/0025 ,  G06T7/74 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20 ,  G02B2027/0187

Abstract: In an exemplary process for accessing a function of an external device through a computer-generated reality interface, one or more external devices are detected. Image data of a physical environment captured by an image sensor is obtained. The process determines whether the image data includes a representation of a first external device of the one or more detected external devices. In accordance with determining that the image data includes a representation of the first external device, the process causes a display to concurrently display a representation of the physical environment according to the image data, and an affordance corresponding to a function of the first external device, wherein detecting user activation of the displayed affordance causes the first external device to perform an action corresponding to the function.

公开(公告)号：US20230393796A1

公开(公告)日：2023-12-07

申请号：US18235693

申请日：2023-08-18

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G06T19/006 ,  H04B5/0025 ,  G06T7/74 ,  G06F3/013 ,  G06F3/017 ,  G02B2027/0187 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20 ,  G06F3/0346

Abstract: In some exemplary processes for controlling an external device using a computer-generated reality interface, a view of a physical environment that includes the external device is provided through the display, and information specifying a function of the external device is received from the external device. While the view of the physical environment is being provided, an affordance corresponding to the function is displayed at a position on the display that overlays at least a portion of the external device.

公开(公告)号：US20210365228A1

公开(公告)日：2021-11-25

申请号：US17394114

申请日：2021-08-04

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Michael KUHN

IPC: G06F3/14 ,  G06K9/00 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484

Abstract: In some exemplary processes for controlling an external device using a computer-generated reality interface, information specifying a function of the external device is received from the external device. First image data of a physical environment that includes the external device is obtained with one or more image sensors. A representation of the physical environment according to the first image data is displayed on a display. While displaying the representation of the physical environment, second image data identifying a gesture occurring between the display and the external device in the physical environment is obtained with the one or more image sensors. A determination is made as to whether the identified gesture satisfies one or more predetermined criteria associated with the function. In accordance with determining that the identified gesture satisfies one or more predetermined criteria associated with the function, the external device is caused to perform the function.

公开(公告)号：US20190251728A1

公开(公告)日：2019-08-15

申请号：US16276535

申请日：2019-02-14

Applicant: Apple Inc.

Inventor： Justin D. STOYLES ,  Alexandre R. MOHA ,  Nicolas V. SCAPEL ,  Guillaume P. BARLIER ,  Aurelio GUZMAN ,  Bruno M. SOMMER ,  Nina DAMASKY ,  Thibaut WEISE ,  Thomas GOOSSENS ,  Hoan PHAM ,  Brian AMBERG

IPC: G06T13/40 ,  G06K9/00 ,  H04N7/14 ,  G11B27/036 ,  G06T17/20 ,  G06T13/20 ,  G11B27/10

CPC classification number: G06T13/40 ,  G06K9/00228 ,  G06K9/00302 ,  G06T13/205 ,  G06T17/205 ,  G11B27/036 ,  G11B27/10 ,  H04N7/147 ,  H04N2007/145

Abstract: Systems and methods for generating a video of an emoji that has been puppeted using inputs from image, depth, and audio. The inputs can capture facial expressions of a user, eye, eyebrow, mouth, and head movements. A pose, held by the user, can be detected that can be used to generate supplemental animation. The emoji can further be animated using physical properties associated with the emoji and captured movements. An emoji of a dog can have its ears move in response to an up-and-down movement, or a shaking of the head. The video can be sent in a message to one or more recipients. A sending device can render the puppeted video in accordance with hardware and software capabilities of a recipient's computer device.