公开(公告)号：US20200058152A1

公开(公告)日：2020-02-20

申请号：US16662952

申请日：2019-10-24

Applicant: Apple Inc.

Inventor： Arthur Y. Zhang ,  Ray L. Chang ,  Timothy R. Oriol ,  Ling Su ,  Gurjeet S. Saund ,  Guy Cote ,  Jim C. Chou ,  Hao Pan ,  Tobias Eble ,  Avi Bar-Zeev ,  Sheng Zhang ,  Justin A. Hensley ,  Geoffrey Stahl

IPC: G06T15/00 ,  G06T3/00 ,  G06T9/00 ,  G06F3/01 ,  H04W76/10

Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

公开(公告)号：US12164687B2

公开(公告)日：2024-12-10

申请号：US17395587

申请日：2021-08-06

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev ,  Devin W. Chalmers ,  Fletcher R. Rothkopf ,  Grant H. Mulliken ,  Holly E. Gerhard ,  Lilli I. Jonsson

IPC: G06F3/01 ,  G06F3/147 ,  G06V40/18 ,  G06F3/16

Abstract: One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.

公开(公告)号：US12148111B2

公开(公告)日：2024-11-19

申请号：US18244878

申请日：2023-09-11

Applicant: Apple Inc.

Inventor： Alexis Palangie ,  Avi Bar-Zeev

IPC: G06T19/00 ,  G06T7/73 ,  G06T15/20 ,  G06T19/20

Abstract: The present disclosure relates to techniques for providing tangibility visualization of virtual objects within a computer-generated reality (CGR) environment, such as a CGR environment based on virtual reality and/or a CGR environment based on mixed reality. A visual feedback indicating tangibility is provided for a virtual object within a CGR environment that does not correspond to a real, tangible object in the real environment. A visual feedback indicating tangibility is not provided for a virtual representation of a real object within a CGR environment that corresponds to a real, tangible object in the real environment.

公开(公告)号：US20240007790A1

公开(公告)日：2024-01-04

申请号：US18220982

申请日：2023-07-12

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev

IPC: H04R3/04 ,  G02B27/01 ,  H04R1/02 ,  H04R1/10

CPC classification number: H04R3/04 ,  G02B27/0172 ,  G06T19/006 ,  H04R1/10 ,  H04R1/028

Abstract: In one implementation, a method of transforming a sound into a virtual sound for a synthesized reality (SR) setting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a microphone, a speaker, and a display. The method includes displaying, on the display, an image representation of a synthesized reality (SR) setting including a plurality of surfaces associated with an acoustic reverberation property of the SR setting. The method includes recording, via the microphone, a real sound produced in a physical setting. The method further includes generating, using the one or more processors, a virtual sound by transforming the real sound based on the acoustic reverberation property of the SR setting. The method further includes playing, via the speaker, the virtual sound.

公开(公告)号：US20230332914A1

公开(公告)日：2023-10-19

申请号：US18338193

申请日：2023-06-20

Applicant: Apple Inc.

Inventor： Bruno M. Sommer ,  Avi Bar-Zeev ,  Frank Angermann ,  Stephen E. Pinto ,  Lilli Ing-Marie Jonsson ,  Rahul Nair

IPC: G01C21/36 ,  H04W4/029 ,  G06F3/01 ,  H04R5/04 ,  H04R5/033 ,  H04S7/00 ,  G01S19/42 ,  H04S1/00

CPC classification number: G01C21/3629 ,  G01C21/3688 ,  G01S19/42 ,  G06F3/011 ,  H04R5/033 ,  H04R5/04 ,  H04S1/007 ,  H04S7/304 ,  H04W4/029 ,  H04R2420/07 ,  H04R2499/15 ,  H04S2400/11 ,  H04S2400/13

Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user’s current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.

公开(公告)号：US11743645B2

公开(公告)日：2023-08-29

申请号：US17841527

申请日：2022-06-15

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev

IPC: H03G3/00 ,  H04R3/04 ,  G02B27/01 ,  H04R1/02 ,  H04R1/10 ,  G06T19/00

CPC classification number: H04R3/04 ,  G02B27/0172 ,  H04R1/028 ,  H04R1/10 ,  G06T19/006

Abstract: In one implementation, a method of transforming a sound into a virtual sound for a synthesized reality (SR) setting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a microphone, a speaker, and a display. The method includes displaying, on the display, an image representation of a synthesized reality (SR) setting including a plurality of surfaces associated with an acoustic reverberation property of the SR setting. The method includes recording, via the microphone, a real sound produced in a physical setting. The method further includes generating, using the one or more processors, a virtual sound by transforming the real sound based on the acoustic reverberation property of the SR setting. The method further includes playing, via the speaker, the virtual sound.

公开(公告)号：US11714592B2

公开(公告)日：2023-08-01

申请号：US17486646

申请日：2021-09-27

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev ,  Ryan S. Burgoyne ,  Devin W. Chalmers ,  Luis R. Deliz Centeno ,  Rahul Nair ,  Timothy R. Oriol ,  Alexis H. Palangie

IPC: G06F3/048 ,  G06F3/14 ,  G06T19/00 ,  H04B5/00 ,  G06T7/73 ,  G06F3/01 ,  G06F3/0346 ,  G02B27/00 ,  G02B27/01 ,  G06F3/04815 ,  G06F3/04842 ,  G06V20/20 ,  G06V40/20

CPC classification number: G06F3/1423 ,  G02B27/0093 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/04815 ,  G06F3/04842 ,  G06T7/74 ,  G06T19/006 ,  G06V20/20 ,  G06V40/20 ,  H04B5/0025 ,  G02B2027/0187

Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.

公开(公告)号：US11712628B2

公开(公告)日：2023-08-01

申请号：US17271551

申请日：2019-09-17

Applicant: Apple Inc.

Inventor： Avi Bar-Zeev ,  Alexis Henri Palangie ,  Luis Rafael Deliz Centeno ,  Rahul Nair

IPC: A63F13/75 ,  A63F13/79 ,  A63F13/87 ,  G06F3/01

CPC classification number: A63F13/75 ,  A63F13/79 ,  A63F13/87 ,  G06F3/017 ,  A63F2300/8082

Abstract: In various implementations, methods and devices for attenuation of co-user interactions in SR space are described. In one implementation, a method of attenuating avatars based on a breach of avatar social interaction criteria is performed at a device provided to deliver simulated reality (SR) content. In one implementation, a method of close collaboration in SR setting is performed at a device provided to deliver SR content.

公开(公告)号：US11320958B2

公开(公告)日：2022-05-03

申请号：US17051703

申请日：2019-05-01

Applicant: Apple Inc.

Inventor： Luis R. Deliz Centeno ,  Avi Bar-Zeev

IPC: G06F3/04815 ,  G02B27/00 ,  G06F3/01 ,  G06T19/00 ,  G02B27/01

Abstract: Techniques for moving about a computer simulated reality (CSR) setting are disclosed. An example technique includes displaying a current view of the CSR setting, the current view depicting a current location of the CSR setting from a first perspective corresponding to a first determined direction. The technique further includes displaying a user interface element, the user interface element depicting a destination location not visible from the current location, and, in response to receiving input representing selection of the user interface element, modifying the display of the current view to display a destination view depicting the destination location, wherein modifying the display of the current view to display the destination view includes enlarging the user interface element.

公开(公告)号：US11243402B2

公开(公告)日：2022-02-08

申请号：US17169231

申请日：2021-02-05

Applicant: Apple Inc.

Inventor： Geoffrey Stahl ,  Avi Bar-Zeev

IPC: G06F3/01 ,  G02B27/01 ,  G06F3/0481 ,  G06T7/70 ,  H04N19/139 ,  G06T19/00

Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.