-
公开(公告)号:US20250093990A1
公开(公告)日:2025-03-20
申请号:US18969089
申请日:2024-12-04
Applicant: Apple Inc.
Inventor: Lejing Wang , Benjamin R. Blachnitzky , Lilli I. Jonsson , Nicolai Georg
IPC: G06F3/041 , G06F3/01 , G06F3/0488
Abstract: Detecting a touch includes receiving image data of a touching object of a user selecting selectable objects of a target surface, determining a rate of movement of the touching object, in response to determining that the rate of movement satisfies a predetermined threshold, modifying a touch detection parameter for detecting a touch event between the touching object and the target surface, and detecting one or more additional touch events using the modified touch detection parameter.
-
公开(公告)号:US11620790B2
公开(公告)日:2023-04-04
申请号:US17205830
申请日:2021-03-18
Applicant: Apple Inc.
Inventor: Rohit Sethi , Lejing Wang
Abstract: Generating a 3D model may include determining, based on sensor data from a touch sensor on a first device, a touch event, wherein the touch event comprises a touch on the first device by a touching object. Generating a 3D model may also include, in response to a touch event, obtaining a first image of the touching object by a first camera of the first device, and obtaining, from a second device, a second image of the touching object, wherein the first image of the touching object captures a first view of the touching object, and wherein the second image of the touching object captures a second view of the touching object. A model of the touching object is generated based on the first image and the second image.
-
公开(公告)号:US11360550B2
公开(公告)日:2022-06-14
申请号:US17355320
申请日:2021-06-23
Applicant: Apple Inc.
Inventor: Lejing Wang , Rohit Sethi
Abstract: Touch detection may include determining, based on data from an IMU on a first device that monitors movement of a touching object, a touch event, wherein the touch event indicates contact between the touching object and a surface, obtaining a depth image captured by a second device, comprising a touch image, determining a touch point of the object based on the touch image, and providing a response based on the touch point of the object and the touched surface.
-
公开(公告)号:US20180075620A1
公开(公告)日:2018-03-15
申请号:US15807263
申请日:2017-11-08
Applicant: Apple Inc.
Inventor: Lejing Wang , Peter Meier
IPC: G06T7/70
CPC classification number: G06T7/74 , G06T7/70 , G06T2207/10016 , G06T2207/30244
Abstract: The invention is related to a method and system for determining a pose of a first camera, comprising providing or receiving a spatial relationship (Rvc 1) between a visual content displayed on a display device and the first camera, receiving image information associated with an image (B1) of at least part of the displayed visual content captured by a second camera, and determining a pose of the first camera according to the image information associated with the image (B1) and the spatial relationship (Rvcl).
-
公开(公告)号:US20170301141A1
公开(公告)日:2017-10-19
申请号:US15627097
申请日:2017-06-19
Applicant: Apple Inc.
Inventor: Lejing Wang , Selim BenHimane
CPC classification number: G06T19/006 , G06T7/30 , G06T7/73 , G06T11/00 , G06T2207/10016 , G06T2207/20004 , G06T2207/30244
Abstract: An apparatus for and method of image processing in an augmented reality application is provided. The method includes the steps of: providing at least one image of a real environment; performing image processing in an augmented reality application with the at least one image employing visualization of overlaying digital information with visual impressions or the image of the real environment and employing vision-based processing or tracking; and adjusting at least one of a parameter and operating flow of the vision-based processing or tracking depending on at least one of the following: a usage of the image processing, a usage of the visualization, a visually perceivable property of the digital information or the real environment, a property of a display device employed in the visualization, or a manner in which a user is viewing the visualization.
-
公开(公告)号:US11714540B2
公开(公告)日:2023-08-01
申请号:US17028298
申请日:2020-09-22
Applicant: Apple Inc.
Inventor: Samuel L. Iglesias , Devin W. Chalmers , Rohit Sethi , Lejing Wang
IPC: G06F3/0488 , G06F3/044 , G06F3/04845 , G06F3/042
CPC classification number: G06F3/0488 , G06F3/044 , G06F3/0426 , G06F3/04845
Abstract: The present disclosure relates generally to remote touch detection. In some examples, a first electronic device obtains first image data and second image data about an input, and performs an operation based on the input in accordance with a determination that a set of one or more criteria is met based on the first image data and the second image data. In some examples, a first electronic device causes emission of infrared light by an infrared source of a second electronic device, obtains image data about an input, and performs an operation based on the input in accordance with a determination that a set of one or more criteria is met based on the image data.
-
公开(公告)号:US11238616B1
公开(公告)日:2022-02-01
申请号:US17099932
申请日:2020-11-17
Applicant: Apple Inc.
Inventor: Rohit Sethi , Lejing Wang , Jonathan Pokrass
Abstract: In one implementation, a device has a processor, a projector, a first infrared (IR) sensor, a second IR sensor, and instructions stored on a computer-readable medium that are executed by the processor to estimate the sensor-to-sensor extrinsic parameters. The projector projects IR pattern elements onto an environment surface. The first sensor captures a first image including first IR pattern elements corresponding to the projected IR pattern elements and the device estimates 3D positions for first IR pattern elements. The second IR sensor captures a second image including second IR pattern elements corresponding to the projected IR pattern elements and the device matches the first IR pattern elements and the second IR pattern elements. Based on this matching, the device estimates a second extrinsic parameter corresponding to a spatial relationship between the first IR sensor and the second IR sensor.
-
公开(公告)号:US10970922B2
公开(公告)日:2021-04-06
申请号:US16580873
申请日:2019-09-24
Applicant: Apple Inc.
Inventor: Rohit Sethi , Lejing Wang
Abstract: Generating a 3D model may include determining, based on sensor data from a touch sensor on a first device, a touch event, wherein the touch event comprises a touch on the first device by a touching object. Generating a 3D model may also include, in response to a touch event, obtaining a first image of the touching object by a first camera of the first device, and obtaining, from a second device, a second image of the touching object, wherein the first image of the touching object captures a first view of the touching object, and wherein the second image of the touching object captures a second view of the touching object. A model of the touching object is generated based on the first image and the second image.
-
公开(公告)号:US10659750B2
公开(公告)日:2020-05-19
申请号:US15328349
申请日:2014-07-23
Applicant: Apple Inc.
Inventor: Peter Meier , Lejing Wang , Stefan Misslinger
IPC: H04N13/111 , H04N13/221 , G06T19/00 , G06T7/73 , H04N13/271 , H04N13/00
Abstract: The disclosure relates to a method and system for presenting at least part of an image of a real object in a view of a real environment, comprising providing a first image of at least part of a real object captured by a first camera, determining at least part of the real object in the first image as an object image area, determining a first 3D plane relative to the first camera, the first camera being at a position where the first image is captured, providing at least one image feature related to the real object in the first image, providing at least one first ray passing an optical center of the first camera being at a position where the first image is captured and the at least one image feature, determining, according to a first plane normal direction of the first 3D plane, at least one first angle between the first 3D plane and the at least one first ray, providing a second image of a real environment captured by a second camera, determining a second 3D plane relative to the second camera, the second camera being at a position where the second image is captured, mapping at least part of the object image area to a target space in a view of the real environment captured at a viewpoint, wherein the at least one image feature is mapped to at least one target position in a coordinate system of the view, determining at least one second angle between the second 3D plane and at least one second ray passing the viewpoint of capturing the view and the at least one target position according to a second plane normal direction of the second 3D plane, wherein the at least one image feature is mapped to the at least one target position such that a difference between the at least one first angle and the at least one second angle is minimized.
-
公开(公告)号:US20180018541A1
公开(公告)日:2018-01-18
申请号:US15213018
申请日:2016-07-18
Applicant: Apple Inc.
Inventor: Lejing Wang , Daniel Ulbricht , Lorenz Kern , Sebastian Lieberknecht , Tobias Holl
CPC classification number: G06K9/6267 , G06K9/6298 , G06T7/11 , G06T7/136 , G06T7/143 , G06T7/194 , G06T2207/20012 , H04N5/2253 , H04N5/2254
Abstract: Systems, methods, and computer readable media to categorize a pixel (or other element) in an image into one of a number of different categories are described. In general, techniques are disclosed for using properties (e.g., statistics) of the regions being categorized to determine the appropriate size of window around a target pixel (element) and, when necessary, the manner in which the window may be changed if the current size is inappropriate. More particularly, adaptive window size selection techniques are disclosed for use when categorizing an image's pixels into one of two categories (e.g., black or white). Statistics of the selected region may be cascaded to determine whether the current evaluation window is acceptable and, if it is not, an appropriate factor by which to change the currently selected window's size
-
-
-
-
-
-
-
-
-