公开(公告)号：US12141927B2

公开(公告)日：2024-11-12

申请号：US15640339

申请日：2017-06-30

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter ,  Steven Mark Drucker

IPC: G06T19/00 ,  G06F3/01 ,  G06T3/20 ,  G06T3/60 ,  G06T7/70

Abstract: Methods and systems for rendering augmented reality display data to locations of a physical presentation environment based on a presentation configuration are provided. A physical presentation environment configuration may be accessed that includes locations of a physical presentation environment for mapping augmented reality display data. The augmented reality display data may include a plurality of augmented reality objects that are rendered for display. Presentation attributes of the augmented reality display data may be used in conjunction with the presentation configuration for mapping and rendering the augmented reality display data. The rendered augmented reality display data may be dynamically interactive, and may be generated based on previous presentation configurations, mapping preferences, mapping limitations, and/or other factors.

公开(公告)号：US11841998B2

公开(公告)日：2023-12-12

申请号：US17868961

申请日：2022-07-20

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kenneth Paul Hinckley ,  Hugo Karl Denis Romat ,  Christopher Mervin Collins ,  Nathalie Riche ,  Michel Pahud ,  Adam Samuel Riddle ,  William Arthur Stewart Buxton

IPC: G06F3/0346 ,  G06F3/04812 ,  G06F3/04883

CPC classification number: G06F3/0346 ,  G06F3/04812 ,  G06F3/04883

Abstract: Methods and systems are provided that are directed to automatically adjusting a user interface based on tilt position of a digital drawing board. The digital drawing board has a tiltable screen with a sensor. The tiltable screen may be fixed in a stable tilt position. A sensor is used to determine that the digital drawing board has a first tilt position. The digital drawing board displays a first user interface associated with the first tilt position. The first user interface may be associated with a first use mode, and may also be based on an application running on the digital drawing board. When the sensor senses that the digital drawing board has moved from the first tilt position to a second tilt position, it automatically displays a second user interface associated with a second tilt position. The second user interface may be associated with a second use mode.

公开(公告)号：US11429203B2

公开(公告)日：2022-08-30

申请号：US16907028

申请日：2020-06-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Kenneth Paul Hinckley ,  Hugo Karl Denis Romat ,  Christopher Mervin Collins ,  Nathalie Riche ,  Michel Pahud ,  Adam Samuel Riddle ,  William Arthur Stewart Buxton

IPC: G06F3/0346 ,  G06F3/04812 ,  G06F3/04883

Abstract: Methods and systems are provided that are directed to automatically adjusting a user interface based on tilt position of a digital drawing board. The digital drawing board has a tiltable screen with a sensor. The tiltable screen may be fixed in a stable tilt position. A sensor is used to determine that the digital drawing board has a first tilt position. The digital drawing board displays a first user interface associated with the first tilt position. The first user interface may be associated with a first use mode. The first user interface may also be based on an application running on the digital drawing board. When the sensor senses that the digital drawing board has moved from the first tilt position to a second tilt position, it automatically displays a second user interface associated with a second tilt position. The second user interface has different functionality than the first user interface. The second user interface may be associated with a second use mode that is different than the first use mode but may be based on the same application as the first user interface.

公开(公告)号：US11782669B2

公开(公告)日：2023-10-10

申请号：US15582181

申请日：2017-04-28

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter

IPC: G06F3/14 ,  G06F3/01 ,  A63F13/428 ,  A63F13/26 ,  A63F13/213 ,  A63F13/86 ,  A63F13/5255 ,  A63F13/32 ,  A63F13/285

CPC classification number: G06F3/1454 ,  A63F13/213 ,  A63F13/26 ,  A63F13/285 ,  A63F13/32 ,  A63F13/428 ,  A63F13/5255 ,  A63F13/86 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/016 ,  G06F3/1423

Abstract: Various systems and techniques for intuitively and non-obstructively obtaining awareness of fellow collaborator views and/or statuses in an augmented reality environment are disclosed. An interaction is detected between a first and second HMD, both collaborative participants of a shared dataset represented in an augmented reality environment. The detected interaction can cause the first HMD to request state information associated with the second HMD. The second HMD can process the request in accordance with a privacy policy to generate a set of visual data as a response to the request. The second HMD can communicate the generated set of visual data to the first HMD, such that the first HMD can render the received set of visual data as additional computer-generated object(s) to be displayed concurrently with its own augmented view. The additional computer-generated object(s) can be positioned in accordance with a real-world or virtualized position of the second HMD, such that the now-visible state information associated with the second HMD does not obstruct a view of the second HMD's user.

公开(公告)号：US11023109B2

公开(公告)日：2021-06-01

申请号：US15640363

申请日：2017-06-30

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter ,  Steven Mark Drucker

IPC: G06F17/00 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/16 ,  G06T19/20

Abstract: In various embodiments, methods and systems for implementing a multi-device mixed interactivity system are provided. The interactivity system includes paired mixed-input devices for interacting and controlling virtual objects. In operation, a selection profile associated with a virtual object is accessed. The selection profile is generated based on a selection input determined using real input associated with a selection device and virtual input associated with a mixed-reality device. The selection device has a first display and the mixed-reality device has a second display that both display the virtual object. An annotation input for the virtual object based on a selected portion corresponding to the selection profile is received. An annotation profile based on the annotation input is generated. The annotation profile includes annotation profile attributes for annotating a portion of the virtual object. An annotation of the selected portion of the virtual reality object is caused to be displayed.

公开(公告)号：US11119581B2

公开(公告)日：2021-09-14

申请号：US16812061

申请日：2020-03-06

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter

IPC: G06F3/01 ,  G06F3/0346 ,  G06F3/0482 ,  G06F3/0481

Abstract: In various embodiments, computerized systems and methods for displacement oriented interaction with objects in a computer-mediated environment are provided. In one embodiment, the system detects a wearable device moved with a displacement transversal to a longitudinal axis of the wearable device. If the system determines that the displacement is within a displacement range associated with an actionable item, the system may select the actionable item or activate an operation associated with the actionable item, such as modifying an object in the computer-mediated reality environment.

公开(公告)号：US11068111B2

公开(公告)日：2021-07-20

申请号：US16695771

申请日：2019-11-26

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter ,  Sasa Junuzovic

IPC: G06F3/044 ,  G06F3/041 ,  G06F3/01 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/0354 ,  G06F3/0484

Abstract: Systems and methods for enabling user-interactions with virtual objects (VOs) included in immersive environments (IEs) are provided. A head-mounted display (HMD) device is communicatively coupled with a hover-sensing (HS) device, via a communication session. The HMD device provides an IE to a wearer by displaying a field-of-view (FOV) that includes a VO. The user executes user-interactions, such as 2D and/or 3D hand gestures, fingertip gestures, multi-fingertip gestures, stylus gestures, hover gestures, and the like. The HS device detects the user-interactions and generates interaction data. The interaction data is provided to the HMD device via the communication session. The HMD device updates the FOV and/or the VO based on the interaction data. A physical overlay that includes a 3D protrusion is coupled with the HS device. The overlay is transparent to the hover-sensing capabilities of the HS device. The protrusion provides tactile feedback to the user for the user-interactions.

公开(公告)号：US10895966B2

公开(公告)日：2021-01-19

申请号：US15640361

申请日：2017-06-30

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter ,  Steven Mark Drucker

IPC: G06F3/041 ,  G06F3/0484 ,  G06F3/01 ,  G06F3/0346 ,  G06F3/0488 ,  G06F3/14 ,  G06T19/00 ,  G06F3/16

Abstract: In various embodiments, methods and systems for implementing a multi-device mixed interactivity system are provided. The interactivity system includes paired mixed-input devices for interacting and controlling virtual objects. In operation, a selection input associated with a virtual object is accessed. The selection input is based on real input associated with a selection device and virtual input associated with a mixed-reality device. The selection device has a first display that displays the virtual object and the mixed-reality device has a second display that displays the virtual object. A selection profile is generated based on the selection input. The selection profile comprises one or more selection profile attributes for isolating a portion of the virtual object. A selected portion of the virtual object is determined based on the selection profile. The selected portion of the virtual reality object is caused to be displayed on the first display of the selection device.

公开(公告)号：US10514801B2

公开(公告)日：2019-12-24

申请号：US15624097

申请日：2017-06-15

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter ,  Sasa Junuzovic

IPC: G06F3/041 ,  G06F3/044 ,  G06F3/01 ,  G06F3/0481 ,  G06F3/0488 ,  G06F3/0354 ,  G06F3/0484

Abstract: Systems and methods for enabling user-interactions with virtual objects (VOs) included in immersive environments (IEs) are provided. A head-mounted display (HMD) device is communicatively coupled with a hover-sensing (HS) device, via a communication session. The HMD device provides an IE to a wearer by displaying a field-of-view (FOV) that includes a VO. The user executes user-interactions, such as 2D and/or 3D hand gestures, fingertip gestures, multi-fingertip gestures, stylus gestures, hover gestures, and the like. The HS device detects the user-interactions and generates interaction data. The interaction data is provided to the HMD device via the communication session. The HMD device updates the FOV and/or the VO based on the interaction data. A physical overlay that includes a 3D protrusion is coupled with the HS device. The overlay is transparent to the hover-sensing capabilities of the HS device. The protrusion provides tactile feedback to the user for the user-interactions.

公开(公告)号：US10417827B2

公开(公告)日：2019-09-17

申请号：US15586570

申请日：2017-05-04

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Michel Pahud ,  Nathalie Riche ,  Eyal Ofek ,  Christophe Hurter

IPC: G06T3/60 ,  G06T19/00 ,  G06F3/0482 ,  G06F3/01 ,  G02B27/01 ,  G06F3/038 ,  G06T3/40 ,  G06T3/20 ,  G06F3/033

Abstract: In various embodiments, computerized methods and systems for syndicating direct and indirect interactions with objects in a computer-mediated environment to facilitate precise interactions with the objects in the computer-mediated environment are provided. The system detects a direct interaction with an object in the computer-mediated reality environment. The direct interaction may be a natural or hypernatural interaction. Subsequently, the system may determine various options of indirect interaction with the object related to the direct interaction. The indirect interaction may be generated by a controller. Upon receiving an indirect interaction, the system may modify the object based on the syndication of the direct interaction and the indirect interaction.