公开(公告)号：US12086919B2

公开(公告)日：2024-09-10

申请号：US18344294

申请日：2023-06-29

Applicant: Apple Inc.

Inventor： Arthur Y Zhang ,  Ray L. Chang ,  Timothy R. Oriol ,  Ling Su ,  Gurjeet S. Saund ,  Guy Cote ,  Jim C. Chou ,  Hao Pan ,  Tobias Eble ,  Avi Bar-Zeev ,  Sheng Zhang ,  Justin A. Hensley ,  Geoffrey Stahl

IPC: G06T15/00 ,  G06F3/01 ,  G06T3/18 ,  G06T9/00 ,  H04W76/10 ,  H04W88/08

CPC classification number: G06T15/005 ,  G06F3/012 ,  G06T3/18 ,  G06T9/00 ,  H04W76/10 ,  H04W88/08

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

公开(公告)号：US11756269B2

公开(公告)日：2023-09-12

申请号：US17527976

申请日：2021-11-16

Applicant: Apple Inc.

Inventor： Alexis Palangie ,  Avi Bar-Zeev

IPC: G06T19/00 ,  G06T19/20 ,  G06T15/20 ,  G06T7/73

CPC classification number: G06T19/006 ,  G06T7/74 ,  G06T15/205 ,  G06T19/003 ,  G06T19/20 ,  G06T2215/16

Abstract: The present disclosure relates to techniques for providing tangibility visualization of virtual objects within a computer-generated reality (CGR) environment, such as a CGR environment based on virtual reality and/or a CGR environment based on mixed reality. A visual feedback indicating tangibility is provided for a virtual object within a CGR environment that does not correspond to a real, tangible object in the real environment. A visual feedback indicating tangibility is not provided for a virtual representation of a real object within a CGR environment that corresponds to a real, tangible object in the real environment.

公开(公告)号：US11726324B2

公开(公告)日：2023-08-15

申请号：US16448586

申请日：2019-06-21

Applicant: Apple Inc.

Inventor： Fletcher R. Rothkopf ,  David A. Kalinowski ,  Jae Hwang Lee ,  Avi Bar-Zeev ,  Grant H. Mulliken ,  Paul Meade ,  Nathanael D. Parkhill ,  Ray L. Chang ,  Arthur Y. Zhang

IPC: G02B27/01 ,  G09G3/20

CPC classification number: G02B27/017 ,  G09G3/20 ,  G09G2330/022 ,  G09G2330/023

Abstract: A display system includes a head-mounted display unit and a wake control system. The head-mounted display unit provides content to a user and is operable in a low-power state and a high-power state that consumes more power to provide the content to the user than the low-power state. The wake control system determines when to operate in the high-power state. The wake control system may assess a first wake criterion with low power, assess a second wake criterion with higher power than the first wake criterion upon satisfaction of the first wake criterion, and cause the head-mounted display unit to operate in the high-power state upon satisfaction of the second wake criterion.

公开(公告)号：US11714519B2

公开(公告)日：2023-08-01

申请号：US17679943

申请日：2022-02-24

Applicant: Apple Inc.

Inventor： Luis R. Deliz Centeno ,  Avi Bar-Zeev

IPC: G06F3/00 ,  G06F3/01 ,  G06F3/04815 ,  G02B27/00 ,  G06T19/00 ,  G02B27/01

CPC classification number: G06F3/04815 ,  G02B27/0093 ,  G06F3/013 ,  G06T19/003 ,  G02B2027/014 ,  G06F2203/04806

Abstract: Techniques for moving about a computer simulated reality (CSR) setting are disclosed. An example technique includes displaying a current view of the CSR setting, the current view depicting a current location of the CSR setting from a first perspective corresponding to a first determined direction. The technique further includes displaying a user interface element, the user interface element depicting a destination location not visible from the current location, and, in response to receiving input representing selection of the user interface element, modifying the display of the current view to display a destination view depicting the destination location, wherein modifying the display of the current view to display the destination view includes enlarging the user interface element.

公开(公告)号：US11609739B2

公开(公告)日：2023-03-21

申请号：US17056126

申请日：2019-04-24

Applicant: Apple Inc.

Inventor： Rahul Nair ,  Golnaz Abdollahian ,  Avi Bar-Zeev ,  Niranjan Manjunath

IPC: G06F3/16 ,  G06F3/01 ,  G10L15/22 ,  H04R1/40

Abstract: In an exemplary technique for providing audio information, an input is received, and audio information responsive to the received input is provided using a speaker. While providing the audio information, an external sound is detected. If it is determined that the external sound is a communication of a first type, then the provision of the audio information is stopped. If it is determined that the external sound is a communication of a second type, then the provision of the audio information continues.

公开(公告)号：US20220155603A1

公开(公告)日：2022-05-19

申请号：US17665324

申请日：2022-02-04

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/04815 ,  G06T7/70 ,  H04N19/139

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

公开(公告)号：US11132162B2

公开(公告)日：2021-09-28

申请号：US16828852

申请日：2020-03-24

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev ,  Ryan S. Burgoyne ,  Devin W. Chalmers ,  Luis R. Deliz Centeno ,  Rahul Nair ,  Timothy R. Oriol ,  Alexis H. Palangie

IPC: G06F3/048 ,  G06F3/14 ,  G06K9/00 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/0481 ,  G06F3/0484

Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.

公开(公告)号：US11127182B2

公开(公告)日：2021-09-21

申请号：US16833395

申请日：2020-03-27

Applicant: Apple Inc.

Inventor： Seyedkoosha Mirhosseini ,  Avi Bar-Zeev ,  Duncan A. K. Mcroberts

IPC: G06T11/60 ,  G06T7/292 ,  G06T7/246 ,  G06F3/01

Abstract: Techniques for alerting a user, who is immersed in a virtual reality environment, to physical obstacles in their physical environment are disclosed.

公开(公告)号：US20210165229A1

公开(公告)日：2021-06-03

申请号：US17169231

申请日：2021-02-05

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/0481 ,  G06T7/70 ,  H04N19/139

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.

公开(公告)号：US20210051406A1

公开(公告)日：2021-02-18

申请号：US17087878

申请日：2020-11-03

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev

IPC: H04R3/04 ,  H04R1/10 ,  H04R1/02 ,  G02B27/01

Abstract: In one implementation, a method of transforming a sound into a virtual sound for a synthesized reality (SR) setting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a microphone, a speaker, and a display. The method includes displaying, on the display, an image representation of a synthesized reality (SR) setting including a plurality of surfaces associated with an acoustic reverberation property of the SR setting. The method includes recording, via the microphone, a real sound produced in a physical setting. The method further includes generating, using the one or more processors, a virtual sound by transforming the real sound based on the acoustic reverberation property of the SR setting. The method further includes playing, via the speaker, the virtual sound.