On-the-fly calibration for improved on-device eye tracking

    公开(公告)号:US11789528B1

    公开(公告)日:2023-10-17

    申请号:US17461367

    申请日:2021-08-30

    Applicant: Apple Inc.

    CPC classification number: G06F3/013 G06V40/19 G06V40/67

    Abstract: Calibration of eye tracking is improved by collecting additional calibration pairs when user is using apps with eye tracking. A user input component is presented on a display of an electronic device, detecting a dwelling action for user input component, and in response to detecting the dwelling action, obtaining a calibration pair comprising an uncalibrated gaze point and a screen location of the user input component, wherein the uncalibrated gaze point is determined based on an eye pose during the dwelling action. A screen gaze estimation is determine based on the uncalibrated gaze point, and in response to determining that the calibration pair is a valid calibration pair, training a calibration model using the calibration pair.

    Generating a three-dimensional environment based on an image

    公开(公告)号:US12272008B2

    公开(公告)日:2025-04-08

    申请号:US17865910

    申请日:2022-07-15

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.

    GENERATING A THREE-DIMENSIONAL ENVIRONMENT BASED ON AN IMAGE

    公开(公告)号:US20220414995A1

    公开(公告)日:2022-12-29

    申请号:US17865910

    申请日:2022-07-15

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.

    On-the-fly calibration for improved on-device eye tracking

    公开(公告)号:US11106280B1

    公开(公告)日:2021-08-31

    申请号:US17027266

    申请日:2020-09-21

    Applicant: Apple Inc.

    Abstract: Calibration of eye tracking is improved by collecting additional calibration pairs when user is using apps with eye tracking. A user input component is presented on a display of an electronic device, detecting a dwelling action for user input component, and in response to detecting the dwelling action, obtaining a calibration pair comprising an uncalibrated gaze point and a screen location of the user input component, wherein the uncalibrated gaze point is determined based on an eye pose during the dwelling action. A screen gaze estimation is determine based on the uncalibrated gaze point, and in response to determining that the calibration pair is a valid calibration pair, training a calibration model using the calibration pair.

    Touchless wrist measurement
    5.
    发明授权

    公开(公告)号:US12223669B2

    公开(公告)日:2025-02-11

    申请号:US17670686

    申请日:2022-02-14

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a wrist measurement or watch band size using depth data captured by a depth sensor from one or more rotational orientations of the wrist. In some implementations, depth data captured by a depth sensor including at least two depth map images of a wrist from different angles is obtained. In some implementations, an output is generated based on inputting the depth data into a machine learning model, the output corresponding to circumference of the wrist or a watch band size of the wrist. Then, a watch band size recommendation is provided based on the output.

    Neural rendering
    6.
    发明授权

    公开(公告)号:US11967015B2

    公开(公告)日:2024-04-23

    申请号:US17145232

    申请日:2021-01-08

    Applicant: Apple Inc.

    CPC classification number: G06T15/205 G06N3/08 G06T3/60

    Abstract: The subject technology provides a framework for learning neural scene representations directly from images, without three-dimensional (3D) supervision, by a machine-learning model. In the disclosed systems and methods, 3D structure can be imposed by ensuring that the learned representation transforms like a real 3D scene. For example, a loss function can be provided which enforces equivariance of the scene representation with respect to 3D rotations. Because naive tensor rotations may not be used to define models that are equivariant with respect to 3D rotations, a new operation called an invertible shear rotation is disclosed, which has the desired equivariance property. In some implementations, the model can be used to generate a 3D representation, such as mesh, of an object from an image of the object.

    Automatic measurements based on object classification

    公开(公告)号:US11574485B2

    公开(公告)日:2023-02-07

    申请号:US17148965

    申请日:2021-01-14

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that obtain a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data, generate a 3D bounding box corresponding to an object in the physical environment based on the 3D representation, classify the object based on the 3D bounding box and the 3D semantic data, and display a measurement of the object, where the measurement of the object is determined using one of a plurality of class-specific neural networks selected based on the classifying of the object.

    TOUCHLESS WRIST MEASUREMENT
    9.
    发明申请

    公开(公告)号:US20220262025A1

    公开(公告)日:2022-08-18

    申请号:US17670686

    申请日:2022-02-14

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods that determine a wrist measurement or watch band size using depth data captured by a depth sensor from one or more rotational orientations of the wrist. In some implementations, depth data captured by a depth sensor including at least two depth map images of a wrist from different angles is obtained. In some implementations, an output is generated based on inputting the depth data into a machine learning model, the output corresponding to circumference of the wrist or a watch band size of the wrist. Then, a watch band size recommendation is provided based on the output.

    Generating a three-dimensional environment based on an image

    公开(公告)号:US11417067B1

    公开(公告)日:2022-08-16

    申请号:US17242809

    申请日:2021-04-28

    Applicant: Apple Inc.

    Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.

Patent Agency Ranking