-
公开(公告)号：US10914957B1
公开(公告)日：2021-02-09
申请号：US16844869
申请日：2020-04-09
Applicant: Apple Inc.
Inventor： Geoffrey Stahl , Avi Bar-Zeev
IPC: G06T7/70 , G02B27/01 , G06F3/01 , G06F3/0481 , H04N19/139 , G06T19/00
Abstract: A mixed reality system including a head-mounted display (HMD) and a base station. Information collected by HMD sensors may be transmitted to the base via a wired or wireless connection. On the base, a rendering engine renders frames including virtual content based in part on the sensor information, and an encoder compresses the frames according to an encoding protocol before sending the frames to the HMD over the connection. Instead of using a previous frame to estimate motion vectors in the encoder, motion vectors from the HMD and the rendering engine are input to the encoder and used in compressing the frame. The motion vectors may be embedded in the data stream along with the encoded frame data and transmitted to the HMD over the connection. If a frame is not received at the HMD, the HMD may synthesize a frame from a previous frame using the motion vectors.
-
公开(公告)号：US20200264006A1
公开(公告)日：2020-08-20
申请号：US16651990
申请日：2018-09-25
Applicant: Apple Inc.
Inventor： Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
公开(公告)号：US12188777B2
公开(公告)日：2025-01-07
申请号：US18338193
申请日：2023-06-20
Applicant: Apple Inc.
Inventor： Bruno M. Sommer , Avi Bar-Zeev , Frank Angermann , Stephen E. Pinto , Lilli Ing-Marie Jonsson , Rahul Nair
Abstract: Methods and apparatus for spatial audio navigation that may, for example, be implemented by mobile multipurpose devices. A spatial audio navigation system provides navigational information in audio form to direct users to target locations. The system uses directionality of audio played through a binaural audio device to provide navigational cues to the user. A current location, target location, and map information may be input to pathfinding algorithms to determine a real world path between the user's current location and the target location. The system may then use directional audio played through a headset to guide the user on the path from the current location to the target location. The system may implement one or more of several different spatial audio navigation methods to direct a user when following a path using spatial audio-based cues.
-
公开(公告)号：US20240394952A1
公开(公告)日：2024-11-28
申请号：US18797340
申请日：2024-08-07
Applicant: Apple Inc.
Inventor： Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号：US20230351672A1
公开(公告)日：2023-11-02
申请号：US18344294
申请日：2023-06-29
Applicant: Apple Inc.
Inventor： Arthur Y. Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
CPC classification number: G06T15/005 , G06F3/012 , G06T3/0093 , G06T9/00 , H04W76/10 , H04W88/08
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user’s environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
Patent Agency Ranking
公开(公告)号：US20230333377A1
公开(公告)日：2023-10-19
申请号：US18212799
申请日：2023-06-22
Applicant: APPLE INC.
Inventor： Fletcher R. Rothkopf , David A. Kalinowski , Jae Hwang Lee , Avi Bar-Zeev , Grant H. Mulliken , Paul Meade , Nathanael D. Parkhill , Ray L. Chang , Arthur Y. Zhang
CPC classification number: G02B27/017 , G09G3/20 , G09G2330/023 , G09G2330/022
Abstract: A display system includes a head-mounted display unit and a wake control system. The head-mounted display unit provides content to a user and is operable in a low-power state and a high-power state that consumes more power to provide the content to the user than the low-power state. The wake control system determines when to operate in the high-power state. The wake control system may assess a first wake criterion with low power, assess a second wake criterion with higher power than the first wake criterion upon satisfaction of the first wake criterion, and cause the head-mounted display unit to operate in the high-power state upon satisfaction of the second wake criterion.
-
公开(公告)号：US20230045634A1
公开(公告)日：2023-02-09
申请号：US17866071
申请日：2022-07-15
Applicant: Apple Inc.
Inventor： Avi Bar-Zeev , Golnaz Abdollahian , Devin William Chalmers , David H. Y. Huang , Banafsheh Jalali
Abstract: In one implementation, a method of providing contextual computer-generated reality (CGR) digital assistant is performed at a device provided to deliver a CGR scene, the device including one or more processors, non-transitory memory, and one or more displays. The method includes obtaining image data characterizing a field of view captured by an image sensor. The method further includes identifying in the image data a contextual trigger for one of a plurality of contextual CGR digital assistants. The method additionally includes selecting a visual representation of the one of the plurality of contextual CGR digital assistants, where the visual representation is selected based on context and in response to identifying the contextual trigger. The method also includes presenting the CGR scene by displaying the visual representation of the one of the plurality of contextual CGR digital assistants, where the visual representation provides information associated with the contextual trigger.
-
公开(公告)号：US11137967B2
公开(公告)日：2021-10-05
申请号：US16828857
申请日：2020-03-24
Applicant: Apple Inc.
Inventor： Avi Bar-Zeev , Ryan S. Burgoyne , Devin W. Chalmers , Luis R. Deliz Centeno , Rahul Nair
IPC: G06F3/14 , G06K9/00 , G06T19/00 , H04B5/00 , G06T7/73 , G06F3/01 , G06F3/0346 , G02B27/00 , G02B27/01 , G06F3/0481 , G06F3/0484
Abstract: In an exemplary process for interacting with user interface objects using an eye gaze, an affordance associated with a first object is displayed. A gaze direction or a gaze depth is determined. While the gaze direction or the gaze depth is determined to correspond to a gaze at the affordance, a first input representing user instruction to take action on the affordance is received, and the affordance is selected responsive to receiving the first input.
-
公开(公告)号：US11043018B2
公开(公告)日：2021-06-22
申请号：US16662952
申请日：2019-10-24
Applicant: Apple Inc.
Inventor： Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号：US20200073122A1
公开(公告)日：2020-03-05
申请号：US16448586
申请日：2019-06-21
Applicant: Apple Inc.
Inventor： Fletcher R. Rothkopf , David A. Kalinowski , Jae Hwang Lee , Avi Bar-Zeev , Grant H. Mulliken , Paul Meade , Nathanael D. Parkhill , Ray L. Chang , Arthur Y. Zhang
Abstract: A display system includes a head-mounted display unit and a wake control system. The head-mounted display unit provides content to a user and is operable in a low-power state and a high-power state that consumes more power to provide the content to the user than the low-power state. The wake control system determines when to operate in the high-power state. The wake control system may assess a first wake criterion with low power, assess a second wake criterion with higher power than the first wake criterion upon satisfaction of the first wake criterion, and cause the head-mounted display unit to operate in the high-power state upon satisfaction of the second wake criterion.
-
-
-
-
-
-
-
-
-
Search Results
52
records
(took 0.025 seconds)
