公开(公告)号：US20240378827A1

公开(公告)日：2024-11-14

申请号：US18765506

申请日：2024-07-08

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Chen Huang ,  Onur C. Hamsici ,  Shuo Feng ,  Hao Tang ,  Tobias Rick

IPC: G06T19/00 ,  G06F3/04815 ,  G06F9/451 ,  G06T7/20 ,  G06V20/10 ,  G06V20/64

Abstract: Various implementations disclosed herein include devices, systems, and methods that track a position of a device within an object-based coordinate system. An example process may include, at a device and prior to movement of an object, acquiring first images of the object, identifying three-dimensional (3D) keypoints on surfaces of the object, and tracking positions of the device in an object-based coordinate system during acquisition of the first images. The process may further include, subsequent to a movement of the object, acquiring second images of the object, identifying the 3D keypoints on surfaces of the object, and tracking positions of the device in the object-based coordinate system during acquisition of the second images based on identifying the 3D keypoints. The process may further include generating a 3D model of the object based on the first and second images and the tracked positions of the device during acquisition of the images.

公开(公告)号：US20230096119A1

公开(公告)日：2023-03-30

申请号：US17945196

申请日：2022-09-15

Applicant: Apple Inc

Inventor： Thorsten Gernoth ,  Cheng Lu ,  Hao Tang ,  Michael P. Johnson

IPC: G06T17/00 ,  G06T7/50 ,  G06V10/60

Abstract: Various implementations disclosed herein provide feedback to a user during object scanning based on how well sensor data of the scanned object has been captured. During object scanning a user may move an electronic device with sensors (e.g., cameras, depth sensors, etc.) around an object to capture sensor data for use in generating a final 3D model of the object. Live feedback during the scanning process is enabled by assessing how well the captured sensor data represents different portions of the object. In some implementations, a 3D model is generated, updated, and assessed based on the sensor data live during the scanning process. This live 3D model may be coarser (i.e., having fewer details) than the final 3D model.

公开(公告)号：US20240062488A1

公开(公告)日：2024-02-22

申请号：US18385943

申请日：2023-11-01

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Chen Huang ,  Onur C. Hamsici ,  Shuo Feng ,  Hao Tang ,  Tobias Rick

IPC: G06T19/00 ,  G06T7/20 ,  G06F9/451 ,  G06F3/04815 ,  G06V20/10 ,  G06V20/64

CPC classification number: G06T19/006 ,  G06T7/20 ,  G06F9/453 ,  G06F3/04815 ,  G06V20/10 ,  G06V20/64

Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model of an object based on images and tracked positions of a device during acquisition of the images. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment acquired via a camera on the device, identifying the object in at least some of the images, tracking positions of the device during acquisition of the images based on identifying the object in the at least some of the images, the positions identifying positioning of the device with respect to a coordinate system defined based on a position and orientation of the object, and generating a 3D model of the object based on the images and positions of the device during acquisition of the images.

公开(公告)号：US20210279967A1

公开(公告)日：2021-09-09

申请号：US17179487

申请日：2021-02-19

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Chen Huang ,  Onur C. Hamsici ,  Shuo Feng ,  Hao Tang ,  Tobias Rick

IPC: G06T19/00 ,  G06T7/20 ,  G06K9/00 ,  G06F3/0481 ,  G06F9/451

Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model of an object based on images and tracked positions of a device during acquisition of the images. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment acquired via a camera on the device, identifying the object in at least some of the images, tracking positions of the device during acquisition of the images based on identifying the object in the at least some of the images, the positions identifying positioning of the device with respect to a coordinate system defined based on a position and orientation of the object, and generating a 3D model of the object based on the images and positions of the device during acquisition of the images.

公开(公告)号：US10769415B1

公开(公告)日：2020-09-08

申请号：US16119798

申请日：2018-08-31

Applicant: Apple Inc.

Inventor： Eslam A. Mostafa ,  Hao Tang ,  Feng Tang

IPC: G06K9/00 ,  H04N5/225 ,  G06K9/62 ,  G06T7/521

Abstract: A device with a camera may utilize an enrollment process to capture images of an authorized user to enroll the user for a facial recognition authorization process. The enrollment process may include one or more processes that identify if an identity of the authorized user (e.g., the subject of the enrollment process) has switched during the enrollment process. The processes may include detection and verification of the switch in identities by comparing features of subjects in images as the images are captured during the enrollment process. If the identity of the subject is determined to be switched from the authorized user during the enrollment process, the enrollment process may be restarted. Additionally, clustering of feature vectors from the enrollment images may be used to remove outlying feature vectors that may be generated from one or more images of a subject other than the authorized user.