公开(公告)号：US12073008B2

公开(公告)日：2024-08-27

申请号：US17519244

申请日：2021-11-04

Applicant: Microsoft Technology Licensing, LLC

Inventor： Eyal Ofek ,  Michel Pahud ,  Pourang P. Irani

IPC: G06F3/048 ,  G06F3/00 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0487 ,  G06F3/04883

CPC classification number: G06F3/005 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/048 ,  G06F3/0487 ,  G06F3/04883

Abstract: In some examples, a surface, such as a desktop, in front or around a portable electronic device may be used as a relatively large surface for interacting with the portable electronic device, which typically has a small display screen. A user may write or draw on the surface using any object such as a finger, pen, or stylus. The surface may also be used to simulate a partial or full size keyboard. The use of a camera to sense the three-dimensional (3D) location or motion of the object may enable use of above-the-surface gestures, entry of directionality, and capture of real objects into a document being processed or stored by the electronic device. One or more objects may be used to manipulate elements displayed by the portable electronic device.

公开(公告)号：US11822712B2

公开(公告)日：2023-11-21

申请号：US18080991

申请日：2022-12-14

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mar Gonzalez Franco ,  Michael Jack Sinclair ,  Eyal Ofek ,  Eric Jordan Gonzalez

IPC: A63F13/24 ,  G06F3/01

CPC classification number: G06F3/011 ,  A63F13/24

Abstract: The present concepts relate to devices that can employ graspable controllers that can be employed in various scenarios, such as virtual reality scenarios and augmented reality scenarios. One example device can include multiple expansion assemblies having independently adjustable girths. The multiple expansion assemblies can be stacked adjacent to one another along an axis. A controller can be configured to expand or contract the girths of the expansion assemblies to collectively approximate girths of an object.

公开(公告)号：US11792364B2

公开(公告)日：2023-10-17

申请号：US17333737

申请日：2021-05-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kenneth P. Hinckley ,  Michel Pahud ,  Mar Gonzalez Franco ,  Edward Sean Lloyd Rintel ,  Eyal Ofek ,  Jaron Zepel Lanier ,  Molly Jane Nicholas ,  Payod Panda

IPC: H04N7/14 ,  G06F3/01

CPC classification number: H04N7/147 ,  G06F3/012 ,  G06F2203/011

Abstract: Aspects of the present disclosure relate to headset virtual presence techniques. For example, a participant of a communication session may not have an associated video feed, for example as a result of a user preference to disable video communication or a lack of appropriate hardware. Accordingly, a virtual presence may be generated for such a non-video participant, such that the non-video participant may be represented within the communication session similar to video participants. The virtual presence may be controllable using a headset device, for example such that movements identified by the headset device cause the virtual presence to move. In some instances, user input may be received to control emotions conveyed by the virtual presence, for example specifying an emotion type and/or intensity.

公开(公告)号：US11782669B2

公开(公告)日：2023-10-10

申请号：US15582181

申请日：2017-04-28

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter

IPC: G06F3/14 ,  G06F3/01 ,  A63F13/428 ,  A63F13/26 ,  A63F13/213 ,  A63F13/86 ,  A63F13/5255 ,  A63F13/32 ,  A63F13/285

CPC classification number: G06F3/1454 ,  A63F13/213 ,  A63F13/26 ,  A63F13/285 ,  A63F13/32 ,  A63F13/428 ,  A63F13/5255 ,  A63F13/86 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/016 ,  G06F3/1423

Abstract: Various systems and techniques for intuitively and non-obstructively obtaining awareness of fellow collaborator views and/or statuses in an augmented reality environment are disclosed. An interaction is detected between a first and second HMD, both collaborative participants of a shared dataset represented in an augmented reality environment. The detected interaction can cause the first HMD to request state information associated with the second HMD. The second HMD can process the request in accordance with a privacy policy to generate a set of visual data as a response to the request. The second HMD can communicate the generated set of visual data to the first HMD, such that the first HMD can render the received set of visual data as additional computer-generated object(s) to be displayed concurrently with its own augmented view. The additional computer-generated object(s) can be positioned in accordance with a real-world or virtualized position of the second HMD, such that the now-visible state information associated with the second HMD does not obstruct a view of the second HMD's user.

公开(公告)号：US11556168B2

公开(公告)日：2023-01-17

申请号：US17146402

申请日：2021-01-11

Applicant: Microsoft Technology Licensing, LLC

Inventor： Mar Gonzalez Franco ,  Michael Jack Sinclair ,  Eyal Ofek ,  Eric Jordan Gonzalez

IPC: A63F13/24 ,  G06F3/01

Abstract: The present concepts relate to devices that can employ graspable controllers that can be employed in various scenarios, such as virtual reality scenarios and augmented reality scenarios. One example device can include multiple expansion assemblies having independently adjustable girths. The multiple expansion assemblies can be stacked adjacent to one another along an axis. A controller can be configured to expand or contract the girths of the expansion assemblies to collectively approximate girths of an object.

公开(公告)号：US11054894B2

公开(公告)日：2021-07-06

申请号：US15640263

申请日：2017-06-30

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Eyal Ofek

IPC: G06F3/048 ,  G06F3/01 ,  G06T3/20 ,  G06F3/0346 ,  G06F3/0488 ,  G06F3/0484

Abstract: In various embodiments, methods and systems for implementing an integrated mixed-input system are provided. The integrated mixed-input system includes paired mixed-input devices for interacting and controlling virtual space input interfaces using real inputs and virtual inputs, sensors, and passive and active haptic feedback associated with the paired mixed-input devices. Real device space tracker data and virtual device space tracker data are accessed via the paired mixed-input devices to determine real input and virtual input that are processed to determine virtual space input. The real device space tracker data and virtual device space tracker data also are used to generate different interaction contexts. In one embodiment, integrated mixed-input system supports interface deviation, where a physical mixed-input device interface is a different size from a size of the virtual space input interface. The virtual space input is communicated to control the virtual space input interface.

公开(公告)号：US11023109B2

公开(公告)日：2021-06-01

申请号：US15640363

申请日：2017-06-30

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter ,  Steven Mark Drucker

IPC: G06F17/00 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/16 ,  G06T19/20

Abstract: In various embodiments, methods and systems for implementing a multi-device mixed interactivity system are provided. The interactivity system includes paired mixed-input devices for interacting and controlling virtual objects. In operation, a selection profile associated with a virtual object is accessed. The selection profile is generated based on a selection input determined using real input associated with a selection device and virtual input associated with a mixed-reality device. The selection device has a first display and the mixed-reality device has a second display that both display the virtual object. An annotation input for the virtual object based on a selected portion corresponding to the selection profile is received. An annotation profile based on the annotation input is generated. The annotation profile includes annotation profile attributes for annotating a portion of the virtual object. An annotation of the selected portion of the virtual reality object is caused to be displayed.

公开(公告)号：US10976816B2

公开(公告)日：2021-04-13

申请号：US16451132

申请日：2019-06-25

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Andrew D. Wilson ,  Sebastian Lennard Marwecki ,  Eyal Ofek ,  Christian Holz

IPC: G06F3/01 ,  G06T19/20

Abstract: Various embodiments are provided herein for modifying a virtual scene based on eye-tracking. A computing device coupled to a HMD can provide a virtual scene for display on the HMD. The computing device can receive sensor data from a set of eye-tracking sensors coupled to the HMD. Based on the received sensor data, the computing device can determine a set of focal regions of the displayed virtual scene, including a perifoveal region of the displayed virtual scene. A portion of the virtual scene can then be modified based, in part, on a determination that the portion is outside of the determined perifoveal region.

公开(公告)号：US10416769B2

公开(公告)日：2019-09-17

申请号：US15432878

申请日：2017-02-14

Applicant: Microsoft Technology Licensing, LLC

Inventor： Eyal Ofek ,  Andrew Wilson ,  Hrvoje Benko ,  Christian Holz ,  Lung-Pan Cheng

IPC: G06F3/01 ,  G06T3/00 ,  G02B27/01

Abstract: A computing system including a head mounted display device with a processor and an associated display is provided. A sensor in communication with the processor is configured to detect a movable body part of a user. A plurality of physical haptic feedback structures are configured to be contacted by the movable body part. The processor is configured to operate the display device, receive data from the sensor, and determine an intended virtual target of the movable body part and a target physical structure having haptic characteristics corresponding to the intended virtual target. Also, the processor is configured to compute a path in real three-dimensional space from the movable body part to the target physical structure, compute a spatial warping pattern, and display via the display the virtual space and the virtual reality representation according to the spatial warping pattern.

公开(公告)号：US20180333088A1

公开(公告)日：2018-11-22

申请号：US15597514

申请日：2017-05-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Christian Holz ,  Eyal Ofek

IPC: A61B5/1455 ,  H04N7/18 ,  G06T7/90 ,  G06T5/20 ,  A61B5/00 ,  A61B5/103

CPC classification number: A61B5/14552 ,  A61B5/1032 ,  A61B5/7278 ,  A61B5/742 ,  A61B2562/0233 ,  A61B2576/00 ,  G06T5/20 ,  G06T7/90 ,  H04N7/185

Abstract: Embodiments relate to using a display and camera of a computing device to perform pulse oximetry. The display of the device is used as an illuminant, a finger is placed over a portion of the display and a camera facing in the same direction as the display. One or more colors are selected to enhance hemoglobin-deoxyhemoglobin contrast in view of display and camera sensitivities. The one or more colors are displayed while a body part covers the displayed color and the camera. The camera captures images of light that has passed through the finger and been internally reflected to the camera. The light reaching the camera has been absorbed by arterial hemoglobin and deoxyhemoglobin at different rates in respective different wavebands. Differences in attenuation of display light at the different wavebands provide sufficient contrast to compute an accurate pulse oxygenation estimate.