-
公开(公告)号:US12147733B2
公开(公告)日:2024-11-19
申请号:US18389485
申请日:2023-11-14
Applicant: Apple Inc.
Inventor: Rahul Nair , Golnaz Abdollahian , Avi Bar-Zeev , Niranjan Manjunath
Abstract: In an exemplary technique, audio information responsive to received input is provided. While providing the audio information, one or more conditions for stopping the provision of audio information are detected, and in response, the provision of the audio information is stopped. After stopping the provision of the audio information, if the one or more conditions for stopping the provision of audio information have ceased, then resumed audio information is provided, where the resumed audio information includes a rephrased version of a previously provided segment of the audio information.
-
公开(公告)号:US20240160022A1
公开(公告)日:2024-05-16
申请号:US18421780
申请日:2024-01-24
Applicant: Apple Inc.
Inventor: Geoffrey Stahl , Avi Bar-Zeev
IPC: G02B27/01 , G06F3/01 , G06F3/04815 , G06T7/70 , H04N19/139
CPC classification number: G02B27/0172 , G06F3/012 , G06F3/04815 , G06T7/70 , H04N19/139 , G02B2027/0138 , G02B2027/0178 , G06T19/006 , G06T2207/30244
Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.
-
公开(公告)号:US11914152B2
公开(公告)日:2024-02-27
申请号:US17665324
申请日:2022-02-04
Applicant: Apple Inc.
Inventor: Geoffrey Stahl , Avi Bar-Zeev
IPC: G02B27/01 , G06F3/01 , G06F3/04815 , G06T7/70 , H04N19/139 , G06T19/00
CPC classification number: G02B27/0172 , G06F3/012 , G06F3/04815 , G06T7/70 , H04N19/139 , G02B2027/0138 , G02B2027/0178 , G06T19/006 , G06T2207/30244
Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.
-
公开(公告)号:US11734867B2
公开(公告)日:2023-08-22
申请号:US17479489
申请日:2021-09-20
Applicant: Apple Inc.
Inventor: Seyedkoosha Mirhosseini , Avi Bar-Zeev , Duncan A. K. McRoberts
Abstract: Techniques for alerting a user, who is immersed in a virtual reality environment, to physical obstacles in their physical environment are disclosed.
-
公开(公告)号:US11727619B2
公开(公告)日:2023-08-15
申请号:US17352080
申请日:2021-06-18
Applicant: Apple Inc.
Inventor: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
CPC classification number: G06T15/005 , G06F3/012 , G06T3/0093 , G06T9/00 , H04W76/10 , H04W88/08
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US11709068B2
公开(公告)日:2023-07-25
申请号:US16651990
申请日:2018-09-25
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
CPC classification number: G01C21/3629 , G01C21/3688 , G01S19/42 , G06F3/011 , H04R5/033 , H04R5/04 , H04S1/007 , H04S7/304 , H04W4/029 , H04R2420/07 , H04R2499/15 , H04S2400/11 , H04S2400/13
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
公开(公告)号:US20210365116A1
公开(公告)日:2021-11-25
申请号:US17395587
申请日:2021-08-06
Applicant: Apple Inc.
Inventor: Avi Bar-Zeev , Devin W. Chalmers , Fletcher R. Rothkopf , Grant H. Mulliken , Holly E. Gerhard , Lilli I. Jonsson
Abstract: One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.
-
公开(公告)号:US10976817B2
公开(公告)日:2021-04-13
申请号:US16941908
申请日:2020-07-29
Applicant: Apple Inc.
Inventor: Jae Hwang Lee , Avi Bar-Zeev , Fletcher R. Rothkopf
Abstract: In one implementation, a method includes: synthesizing an AR/VR content stream by embedding a plurality of glints provided for eye tracking into one or more content frames of the AR/VR content stream; displaying, via the one or more AR/VR displays, the AR/VR content stream to a user of the HMD; obtaining, via the image sensor, light intensity data corresponding to the one or more content frames of the AR/VR content stream that include the plurality of glints, wherein the light intensity data includes a projection of an eye of the user of the HMD having projected thereon the plurality of glints; and determining an orientation of the eye of the user of the HMD based on the light intensity data.
-
公开(公告)号:US20250085132A1
公开(公告)日:2025-03-13
申请号:US18957331
申请日:2024-11-22
Applicant: Apple Inc.
Inventor: Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
公开(公告)号:US11861265B2
公开(公告)日:2024-01-02
申请号:US18123886
申请日:2023-03-20
Applicant: Apple Inc.
Inventor: Rahul Nair , Golnaz Abdollahian , Avi Bar-Zeev , Niranjan Manjunath
Abstract: In an exemplary technique, speech input including one or more instructions is received. After the speech input has stopped, if it is determined that one or more visual characteristics indicate that further speech input is not expected, a response to the one or more instructions is provided. If it is determined that one or more visual characteristics indicate that further speech input is expected, a response to the one or more instructions is not provided.
-
-
-
-
-
-
-
-
-