-
公开(公告)号:US20190156143A1
公开(公告)日:2019-05-23
申请号:US16259367
申请日:2019-01-28
Applicant: Apple Inc.
Inventor: Mohamed Selim Ben Himane , Daniel Kurz , Thomas Olszamowski
CPC classification number: G06K9/623 , G06K9/46 , G06K9/4671 , G06K9/6255 , G06K9/6262
Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.
-
公开(公告)号:US20250155968A1
公开(公告)日:2025-05-15
申请号:US19024397
申请日:2025-01-16
Applicant: Apple Inc.
Inventor: Mohamed Selim Ben Himane
IPC: G06F3/01 , G06F3/0346 , G06T7/70
Abstract: Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.
-
公开(公告)号:US11915097B1
公开(公告)日:2024-02-27
申请号:US17143411
申请日:2021-01-07
Applicant: Apple Inc.
Inventor: Mohamed Selim Ben Himane , Anselm Grundhoefer , Arun Srivatsan Rangaprasad , Jeffrey S. Norris , Paul Ewers , Scott G. Wade , Thomas G. Salter , Tom Sengelaub
CPC classification number: G06K7/1443 , G06K7/1417 , G06K7/1456 , G06N20/00 , G06T7/90
Abstract: Various implementations disclosed herein include devices, systems, and methods that provide color visual markers that include colored markings that encode data, where the colors of the colored markings are determined by scanning (e.g., detecting the visual marker using a sensor of an electronic device) the visual marker itself. In some implementations, a visual marker is detected in an image of a physical environment. In some implementations, the visual marker is detected in the image by detecting a predefined shape of a first portion of the visual marker in the image. Then, a color-interpretation scheme is determined for interpreting colored markings of the visual marker that encode data by identifying a set of colors at a corresponding set of predetermined locations on the visual marker. Then, the data of the visual marker is decoded using the colored markings and the set of colors of the color-interpretation scheme.
-
34.
公开(公告)号:US11900569B2
公开(公告)日:2024-02-13
申请号:US17957416
申请日:2022-09-30
Applicant: APPLE INC.
Inventor: Peter Meier , Daniel Kurz , Brian Chris Clark , Mohamed Selim Ben Himane
CPC classification number: G06T5/005 , G06T7/75 , G06V10/60 , G06V20/10 , G06V40/171
Abstract: Various implementations disclosed herein include devices, systems, and methods that detect surfaces and reflections in such surfaces. Some implementations involve providing a CGR environment that includes virtual content that replaces the appearance of a user or the user's device in a mirror or other surface providing a reflection. For example, a CGR environment may be modified to include a reflection of the user that does not include the device that the user is holding or wearing. In another example, the CGR environment is modified so that virtual content, such as a newer version of the electronic device or a virtual wand, replaces the electronic device in the reflection. In another example, the CGR environment is modified so that virtual content, such as a user avatar, replaces the user in the reflection.
-
公开(公告)号:US11854242B2
公开(公告)日:2023-12-26
申请号:US17448456
申请日:2021-09-22
Applicant: Apple Inc.
Inventor: Michele Stoppa , Mohamed Selim Ben Himane , Raffi A. Bedikian
IPC: G06V10/46 , G06V30/262 , G06F18/21 , G06V10/40
CPC classification number: G06V10/462 , G06F18/21 , G06V10/40 , G06V30/274
Abstract: Methods, systems, and computer readable media for providing personalized saliency models, e.g., for use in mixed reality environments, are disclosed herein, comprising: obtaining, from a server, a first saliency model for the characterization of captured images, wherein the first saliency model represents a global saliency model; capturing a first plurality of images by a first device; obtaining information indicative of a reaction of a first user of the first device to the capture of one or more images of the first plurality images; updating the first saliency model based, at least in part, on the obtained information to form a personalized, second saliency model; and transmitting at least a portion of the second saliency model to the server for inclusion into the global saliency model. In some embodiments, a user's personalized (i.e., updated) saliency model may be used to modify one or more characteristics of at least one subsequently captured image.
-
36.
公开(公告)号:US11652965B2
公开(公告)日:2023-05-16
申请号:US17028360
申请日:2020-09-22
Applicant: Apple Inc.
Inventor: Peter Meier , Mohamed Selim Ben Himane , Daniel Kurz
IPC: H04N9/31 , H04N5/225 , H04N13/128 , G01B11/24 , G01B11/25 , H04N13/15 , H04N5/33 , H04N13/257 , H04N13/00
CPC classification number: H04N9/3185 , G01B11/24 , G01B11/25 , H04N5/2256 , H04N5/332 , H04N9/3191 , H04N9/3194 , H04N13/128 , H04N13/15 , H04N13/257 , H04N2013/0081
Abstract: A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.
-
37.
公开(公告)号:US20220004767A1
公开(公告)日:2022-01-06
申请号:US17482133
申请日:2021-09-22
Applicant: Apple Inc.
Inventor: Ian M. Richter , Mohamed Selim Ben Himane , Peter Meier
Abstract: In one implementation, a method includes: obtaining image data from an image sensor; recognizing a portion of an object within the image data; obtaining synthesized reality (SR) content associated with the portion of the object; and displaying the SR content in association with the portion of the object. In some implementations, the SR content is dependent on the orientation of an electronic device or the user relative to the object. In some implementations, the SR content is generated based on sensor data associated with the object.
-
公开(公告)号:US11100659B2
公开(公告)日:2021-08-24
申请号:US16458425
申请日:2019-07-01
Applicant: Apple Inc.
Inventor: Vincent Chapdelaine-Couture , Mohamed Selim Ben Himane
Abstract: One exemplary implementation facilitates object detection using multiple scans of an object in different conditions. For example, a first scan of the object can be created by capturing images of the object by moving an image sensor on a first path in a first condition, e.g., bright lighting. A second scan of the object can then be created by capturing additional images of the object by moving the image sensor on a second path in a second condition, e.g., dim lighting. Implementations determine a transform that associates the scan data from these multiple scans to one another and use the transforms to generate a 3D model of the object in a single coordinate system. Augmented content can be positioned relative to that object in the single coordinate system and thus will be displayed in the appropriate location regardless of the condition in which the physical object is later detected.
-
公开(公告)号:US20210097714A1
公开(公告)日:2021-04-01
申请号:US17032227
申请日:2020-09-25
Applicant: Apple Inc.
Inventor: Anselm Grundhoefer , Jeffrey S. Norris , Mohamed Selim Ben Himane , Paul Ewers , Scott G. Wade , Shih-Sang (Carnaven) Chiu , Thomas G. Salter , Tom Sengelaub , Viral N. Parekh
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine the relative positioning (e.g., offset) between a mobile electronic device and a visual marker. In some implementations, the determined relative positioning and a known position of the visual marker are used to determine a position (e.g., geo coordinates) of the mobile electronic device that is more accurate than existing techniques. In some implementations, the determined relative positioning is used with a position of the mobile electronic device to crowd source the stored position of the visual marker. In some implementations, the determined relative positioning and a position of the visual marker are used to determine a position of an object detected in an image by the mobile electronic device. In some implementations at an electronic device having a processor, locally-determined locations of a visual marker are received from mobile electronic devices that scan a visual marker.
-
公开(公告)号:US10964056B1
公开(公告)日:2021-03-30
申请号:US16408658
申请日:2019-05-10
Applicant: Apple Inc.
Inventor: Vincent Chapdelaine-Couture , Mohamed Selim Ben Himane
Abstract: One exemplary implementation involves a pixel-based (also referred to as a dense-based approach) to object detection and tracking that can provide more accurate results than a feature-based approach. The efficiency of the detection and tracking is improved by using a reference image of the object that has similar characteristics (e.g., scale, lighting, blur, and the like) as the depiction of the object in the frame. In some implementations, a reference image of an appropriate scale is selected or interpolated based on the scale of the object depicted in the real world image. In other implementations, the real world image is adjusted to better match the reference image. The detection and tracking of the object can be performed with sufficient accuracy and efficiency for computer-generated reality (CGR) and other applications in which it is desirable to detect and track objects in real time.
-
-
-
-
-
-
-
-
-