-
11.
公开(公告)号:US12241960B1
公开(公告)日:2025-03-04
申请号:US17008767
申请日:2020-09-01
Applicant: Apple Inc.
Inventor: Oleg Naroditsky , Xing Zheng
Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a transform relating poses of two mobile electronic devices using range date from a ultra-wideband (UWB) sensor and movement data from captured images. In some implementations, a distance is determined between a first mobile device and a second mobile device based on a UWB signal transmitted between the first mobile device and the second mobile device. In some implementations, first movement data corresponding to movement of the first mobile device and second movement data corresponding to movement of the second mobile device are received. The first movement data based on a camera or a sensor on the first mobile device. The second movement data is based on a camera or a sensor on the second mobile device. Then, a transform is determined that relates a pose of the first mobile device to a pose of the second mobile device based on the distance, the first movement data, and the second movement data.
-
公开(公告)号:US12039674B2
公开(公告)日:2024-07-16
申请号:US17478771
申请日:2021-09-17
Applicant: Apple Inc.
Inventor: Abdelhamid Dine , Kuen-Han Lin , Stergios Roumeliotis , Oleg Naroditsky
IPC: G06T19/00 , G06F3/0346 , G06F3/04815 , G06T7/20
CPC classification number: G06T19/006 , G06F3/0346 , G06F3/04815 , G06T7/20
Abstract: Implementations of the subject technology provide extended reality display devices that can be used on and/or off of a moving platform. Systems and methods are disclosed for separating out the motion of the moving platform from other motions of the device so that virtual content can be displayed without erroneous motions caused by the motion of the moving platform. The subject technology can provide extended reality settings on any suitable moveable platform such as in a car, a watercraft, an aircraft, a train, or any other vehicle.
-
公开(公告)号:US20240104778A1
公开(公告)日:2024-03-28
申请号:US18466426
申请日:2023-09-13
Applicant: Apple Inc.
Inventor: Tianheng Wang , Stergios Roumeliotis , Shuntaro Yamazaki , Oleg Naroditsky
IPC: G06T7/80 , G02B27/01 , H04N13/246
CPC classification number: G06T7/85 , G02B27/0172 , H04N13/246 , G02B2027/0134
Abstract: Methods for performing a camera calibration process for outward-facing cameras on devices such as head-mounted display devices are disclosed. Using cameras with overlapping fields of view, relative rotational parameters of the cameras with respect to one another may be determined using an optimization technique such as a two-view bundle adjustment algorithm. A statistical analysis of the relative rotational parameters of the cameras, determined for a plurality of moments in time, may then be made to provide updated relative rotational parameters for recalibration of the cameras. A camera calibration process, such as those disclosed, may not depend on tracking points of interest over multiple moments in time, but rather on a convergence of the relative rotational parameters determined for respective moments in time.
-
公开(公告)号:US10152795B2
公开(公告)日:2018-12-11
申请号:US15236008
申请日:2016-08-12
Applicant: Apple Inc. , Regents of the University of Minnesota
Inventor: Alex Flint , Oleg Naroditsky , Christopher P. Broaddus , Andriy Grygorenko , Stergios Roumeliotis , Oriel Bergig
Abstract: A method includes: receiving sensor measurements from a pre-processing module, in which the sensor measurements include image data and inertial data for a device; transferring, using a processor, information derived from the sensor measurements, from a first set of variables associated with a first window of time to a second set of variables associated with a second window of time, in which the first and second windows consecutively overlap in time; and outputting, to a post-processing module, a state of the device based on the transferred information.
-
公开(公告)号:US20180283877A1
公开(公告)日:2018-10-04
申请号:US15923775
申请日:2018-03-16
Applicant: Apple Inc.
Inventor: Alex Flint , Oleg Naroditsky , Andriy Grygorenko , Oriel Bergig
Abstract: A method of creating a local map includes: receiving, at a mobile electronic data processing apparatus, a request from a server to generate a map of a specified destination; sending to the server a message accepting the request to generate the map responsive to receiving, at a user input of the mobile electronic data processing device, a user command indicating acceptance of the request; generating, using a processor, information related to construction of the map; an transmitting, from the mobile electronic data processing apparatus, the information related to construction of the map.
-
公开(公告)号:US20240406526A1
公开(公告)日:2024-12-05
申请号:US18678972
申请日:2024-05-30
Applicant: Apple Inc.
Inventor: Huiwen Guo , Florian Mahlknecht , Jose Lamarca Peiro , Lina M. Paz-Perez , Oleg Naroditsky
IPC: H04N23/52 , G01S7/497 , G01S17/66 , G01S17/894 , G02B27/00
Abstract: A method for detecting an occlusion of an image sensor includes obtaining, via the image sensor, a plurality of images of a physical environment of the electronic device while the electronic device is moving. The method includes detecting an occlusion of the image sensor based on a repeated occurrence of a static feature across the plurality of images. The method includes modifying a weight associated with the static feature to decrease an impact of the occlusion on a performance of a function.
-
公开(公告)号:US11943679B2
公开(公告)日:2024-03-26
申请号:US17861167
申请日:2022-07-08
Applicant: Apple Inc.
Inventor: Robert William Mayor , Isaac T. Miller , Adam S. Howell , Vinay R. Majjigi , Oliver Ruepp , Daniel Ulbricht , Oleg Naroditsky , Christian Lipski , Sean P. Cier , Hyojoon Bae , Saurabh Godha , Patrick J. Coleman
IPC: H04W4/024 , G01C21/36 , G06T7/73 , G06V10/44 , G06V10/80 , G06V20/10 , H04M1/724 , H04W4/02 , H04W64/00
CPC classification number: H04W4/024 , G01C21/3647 , G06T7/74 , G06V10/44 , G06V10/806 , G06V20/10 , H04M1/724 , H04W4/026 , G06T2207/30244 , H04M2250/52 , H04W64/006
Abstract: Location mapping and navigation user interfaces may be generated and presented via mobile computing devices. A mobile device may detect its location and orientation using internal systems, and may capture image data using a device camera. The mobile device also may retrieve map information from a map server corresponding to the current location of the device. Using the image data captured at the device, the current location data, and the corresponding local map information, the mobile device may determine or update a current orientation reading for the device. Location errors and updated location data also may be determined for the device, and a map user interface may be generated and displayed on the mobile device using the updated device orientation and/or location data.
-
公开(公告)号:US20240095958A1
公开(公告)日:2024-03-21
申请号:US18466379
申请日:2023-09-13
Applicant: Apple Inc.
Inventor: Shuntaro Yamazaki , Ravi Teja Sukhavasi , Oleg Naroditsky , Stergios Roumeliotis , Daniel C Byrnes
IPC: G06T7/80 , G06T7/00 , G06T7/20 , G06V10/74 , H04N23/695
CPC classification number: G06T7/80 , G06T7/0002 , G06T7/20 , G06V10/761 , H04N23/695 , G06T2207/30168 , G06V2201/07
Abstract: Methods for performing a calibration process for outward-facing cameras on devices such as head-mounted display devices are disclosed. Extrinsic parameters of the camera are first estimated using inputs to the calibration process such as information from an inertial measurement unit and points of interest within images captured by the camera that are tracked with time. Then, extrinsic and intrinsic parameters are concurrently determined in an optimization problem such that updated values of said parameters may be stored and used by applications that run on the device and make use of the camera. The calibration process may be extended to concurrently calibrate multiple cameras based, at least in part, on information from the inertial measurement unit that is local to the camera.
-
公开(公告)号:US20210092555A1
公开(公告)日:2021-03-25
申请号:US16576573
申请日:2019-09-19
Applicant: Apple Inc.
Inventor: Robert William Mayor , Isaac T. Miller , Adam S. Howell , Vinay R. Majjigi , Oliver Ruepp , Daniel Ulbricht , Oleg Naroditsky , Christian Lipski , Sean P. Cier , Hyojoon Bae , Saurabh Godha , Patrick J. Coleman
Abstract: Location mapping and navigation user interfaces may be generated and presented via mobile computing devices. A mobile device may detect its location and orientation using internal systems, and may capture image data using a device camera. The mobile device also may retrieve map information from a map server corresponding to the current location of the device. Using the image data captured at the device, the current location data, and the corresponding local map information, the mobile device may determine or update a current orientation reading for the device. Location errors and updated location data also may be determined for the device, and a map user interface may be generated and displayed on the mobile device using the updated device orientation and/or location data.
-
公开(公告)号:US20190164040A1
公开(公告)日:2019-05-30
申请号:US15926557
申请日:2018-03-20
Applicant: Apple Inc.
Inventor: Oleg Naroditsky , Kuen-Han Lin , Dimitrios Kottas
Abstract: Systems, methods, and computer readable media to track and estimate the accuracy of a visual inertial odometry (VIO) system. Various embodiments are able to receive one or more VIO feature measurements associated with a set of image frames from a VIO system and generate a plurality of feature models to estimate health values for the VIO system. The various embodiments determine a plurality of feature health values with the feature models based on the VIO feature measurements and compare the feature health values with ground truth health scores associated with the set of image frames to determine one or more errors. The feature model parameters are updated based on the comparison with the feature health values with ground truth health scores.
-
-
-
-
-
-
-
-
-