-
公开(公告)号:US11315308B2
公开(公告)日:2022-04-26
申请号:US17129340
申请日:2020-12-21
Applicant: Apple Inc.
Inventor: Lejing Wang , Peter Meier , Stefan Misslinger
Abstract: A method for representing virtual information in a view of a real environment is provided that includes: providing a system setup including at least one display device, wherein the system setup is adapted for blending in virtual information on the display device in at least part of the view, determining a position and orientation of a viewing point relative to at least one component of the real environment, providing a geometry model of the real environment, providing at least one item of virtual information and a position of the at least one item of virtual information, determining whether the position of the item of virtual information is inside a 2D or 3D geometrical shape, determining a criterion which is indicative of whether the built-in real object is at least partially visible or non-visible in the view of the real environment, and blending in the at least one item of virtual information on the display device in at least part of the view of the real environment.
-
42.
公开(公告)号:US11210520B2
公开(公告)日:2021-12-28
申请号:US16959253
申请日:2019-01-18
Applicant: Apple Inc.
Inventor: Ian M. Richter , Mohamed Selim Ben Himane , Peter Meier
Abstract: In one implementation, a method includes: obtaining image data from an image sensor; recognizing a portion of an object within the image data; obtaining synthesized reality (SR) content—such as mixed reality, augmented reality, augmented virtuality, or virtual reality content—associated with the portion of the object; and displaying the SR content in association with the portion of the object. In some implementations, the SR content is dependent on the orientation of an electronic device or the user relative to the object. In some implementations, the SR content is generated based on sensor data associated with the object.
-
公开(公告)号:US20210374615A1
公开(公告)日:2021-12-02
申请号:US17397839
申请日:2021-08-09
Applicant: Apple Inc.
Inventor: Mark Drummond , Peter Meier , Bo Morgan , Cameron J. Dunn , Siva Chandra Mouli Sivapurapu
Abstract: In one implementation, a method of generating environment states is performed by a device including one or more processors and non-transitory memory. The method includes displaying an environment including an asset associated with a neural network model and having a plurality of asset states. The method includes receiving a user input indicative of a training request. The method includes selecting, based on the user input, a training focus indicating one or more of the plurality of asset states. The method includes generating a set of training data including a plurality of training instances weighted according to the training focus. The method includes training the neural network model on the set of training data.
-
公开(公告)号:US11074451B2
公开(公告)日:2021-07-27
申请号:US16833364
申请日:2020-03-27
Applicant: Apple Inc.
Inventor: Peter Meier , Daniel Ulbricht
Abstract: In an exemplary process for providing content in an augmented reality environment, image data correspond to a physical environment are obtained. Based on the image data, predefined entities of the plurality of predefined entities in the physical environment are identified using classifiers corresponding to predefined entities. Based on the one or more of the identified predefined entities, a geometric layout of the physical environment is determined. Based on the geometric layout, an area corresponding to a particular entity is determined. The particular entity corresponds to one or more identified predefined entities. Based on the area corresponding to the particular entity, the particular entity in the physical environment is identified using classifiers corresponding to the determined area. Based on the identified particular entity, a type of the physical environment is determined. Based on the type of the physical environment, virtual-reality objects are displayed corresponding to a representation of the physical environment.
-
公开(公告)号:US10916056B2
公开(公告)日:2021-02-09
申请号:US14923293
申请日:2015-10-26
Applicant: Apple Inc.
Inventor: Peter Meier
Abstract: A method of displaying virtual information in a view of a real environment comprising the following steps: providing the system relative to at least one part of the real environment and providing accuracy information of the current pose, providing multiple pieces of virtual information, and assigning a respective one of the pieces of virtual information to one of different parameters indicative of different pose accuracy information, and displaying at least one of the pieces of virtual information in the view of the real environment according to the accuracy information of the current pose in relation to the assigned parameter.
-
公开(公告)号:US10733804B2
公开(公告)日:2020-08-04
申请号:US16571919
申请日:2019-09-16
Applicant: Apple Inc.
Inventor: Sebastian Knorr , Peter Meier
IPC: G06T15/50 , H04N13/239 , G06T19/00 , G06T7/11
Abstract: The invention relates to a method of representing a virtual object in a view of a real environment which comprises the steps of providing image information of a first image of at least part of a human face captured by a first camera, providing at least one human face specific characteristic, determining at least part of an image area of the face in the first image as a face region of the first image, determining at least one first light falling on the face according to the face region of the first image and the at least one human face specific characteristic, and blending in the virtual object on a display device in the view of the real environment according to the at least one first light. The invention also relates to a system for representing a virtual object in a view of a real environment.
-
公开(公告)号:US10582166B2
公开(公告)日:2020-03-03
申请号:US16180457
申请日:2018-11-05
Applicant: Apple Inc.
Inventor: Peter Meier , Sebastian Lieberknecht
Abstract: A method of tracking a mobile device comprising at least one camera in a real environment comprises the steps of receiving image information associated with at least one image captured by the at least one camera, generating a first geometrical model of at least part of the real environment based on environmental data or mobile system state data acquired in an acquisition process by at least one sensor of a mobile system, which is different from the mobile device, and performing a tracking process based on the image information associated with the at least one image and at least partially according to the first geometrical model, wherein the tracking process determines at least one parameter of a pose of the mobile device relative to the real environment. The invention is also related to a method of generating a geometrical model of at least part of a real environment using image information from at least one camera of a mobile device.
-
公开(公告)号:US20200027276A1
公开(公告)日:2020-01-23
申请号:US16524787
申请日:2019-07-29
Applicant: Apple Inc.
Inventor: Peter Meier , Stefan Holzer
Abstract: The invention relates to a method for representing a virtual object in a real environment, having the following steps: generating a two-dimensional image of a real environment by means of a recording device, ascertaining a position of the recording device relative to at least one component of the real environment, segmenting at least one area of the real environment unmarked in reality in the two-dimensional image for identifying at least one segment of the real environment in distinction to a remaining part of the real environment while supplying corresponding segmentation data, and merging the virtual object with the two-dimensional image of the real environment with consideration of the segmentation data such that at least one part of the segment of the real environment is removed from the image of the real environment. The invention permits any collisions of virtual objects with real objects that occur upon merging with a real environment to be represented in a way largely close to reality.
-
公开(公告)号:US20200013223A1
公开(公告)日:2020-01-09
申请号:US16571919
申请日:2019-09-16
Applicant: Apple Inc.
Inventor: Sebastian Knorr , Peter Meier
IPC: G06T19/00 , G06T7/11 , H04N13/239 , G06T15/50
Abstract: The invention relates to a method of representing a virtual object in a view of a real environment which comprises the steps of providing image information of a first image of at least part of a human face captured by a first camera, providing at least one human face specific characteristic, determining at least part of an image area of the face in the first image as a face region of the first image, determining at least one first light falling on the face according to the face region of the first image and the at least one human face specific characteristic, and blending in the virtual object on a display device in the view of the real environment according to the at least one first light. The invention also relates to a system for representing a virtual object in a view of a real environment.
-
公开(公告)号:US10453267B2
公开(公告)日:2019-10-22
申请号:US16126785
申请日:2018-09-10
Applicant: Apple Inc.
Inventor: Peter Meier , Michael Kuhn , Frank Angermann
IPC: G06T19/00
Abstract: A method for representing virtual information in a view of a real environment comprises providing a virtual object having a global position and orientation with respect to a geographic global coordinate system, with first pose data on the global position and orientation of the virtual object, in a database of a server, taking an image of a real environment by a mobile device and providing second pose data as to at which position and with which orientation with respect to the geographic global coordinate system the image was taken. The method further includes displaying the image on a display of the mobile device, accessing the virtual object in the database and positioning the virtual object in the image on the basis of the first and second pose data, manipulating the virtual object or adding a further virtual object, and providing the manipulated virtual object with modified first pose data or the further virtual object with third pose data in the database.
-
-
-
-
-
-
-
-
-