Generating a 3D model of a fingertip for visual touch detection

    公开(公告)号:US11620790B2

    公开(公告)日:2023-04-04

    申请号:US17205830

    申请日:2021-03-18

    申请人: Apple Inc.

    摘要: Generating a 3D model may include determining, based on sensor data from a touch sensor on a first device, a touch event, wherein the touch event comprises a touch on the first device by a touching object. Generating a 3D model may also include, in response to a touch event, obtaining a first image of the touching object by a first camera of the first device, and obtaining, from a second device, a second image of the touching object, wherein the first image of the touching object captures a first view of the touching object, and wherein the second image of the touching object captures a second view of the touching object. A model of the touching object is generated based on the first image and the second image.

    IMU for touch detection
    2.
    发明授权

    公开(公告)号:US11360550B2

    公开(公告)日:2022-06-14

    申请号:US17355320

    申请日:2021-06-23

    申请人: Apple Inc.

    摘要: Touch detection may include determining, based on data from an IMU on a first device that monitors movement of a touching object, a touch event, wherein the touch event indicates contact between the touching object and a surface, obtaining a depth image captured by a second device, comprising a touch image, determining a touch point of the object based on the touch image, and providing a response based on the touch point of the object and the touched surface.

    IMU for Touch Detection
    3.
    发明申请

    公开(公告)号:US20210318748A1

    公开(公告)日:2021-10-14

    申请号:US17355320

    申请日:2021-06-23

    申请人: Apple Inc.

    摘要: Touch detection may include determining, based on data from an IMU on a first device that monitors movement of a touching object, a touch event, wherein the touch event indicates contact between the touching object and a surface, obtaining a depth image captured by a second device, comprising a touch image, determining a touch point of the object based on the touch image, and providing a response based on the touch point of the object and the touched surface.

    Generating a 3D Model of a Fingertip for Visual Touch Detection

    公开(公告)号:US20210209840A1

    公开(公告)日:2021-07-08

    申请号:US17205830

    申请日:2021-03-18

    申请人: Apple Inc.

    摘要: Generating a 3D model may include determining, based on sensor data from a touch sensor on a first device, a touch event, wherein the touch event comprises a touch on the first device by a touching object. Generating a 3D model may also include, in response to a touch event, obtaining a first image of the touching object by a first camera of the first device, and obtaining, from a second device, a second image of the touching object, wherein the first image of the touching object captures a first view of the touching object, and wherein the second image of the touching object captures a second view of the touching object. A model of the touching object is generated based on the first image and the second image.

    Estimation of spatial relationships between sensors of a multi-sensor device

    公开(公告)号:US11238616B1

    公开(公告)日:2022-02-01

    申请号:US17099932

    申请日:2020-11-17

    申请人: Apple Inc.

    摘要: In one implementation, a device has a processor, a projector, a first infrared (IR) sensor, a second IR sensor, and instructions stored on a computer-readable medium that are executed by the processor to estimate the sensor-to-sensor extrinsic parameters. The projector projects IR pattern elements onto an environment surface. The first sensor captures a first image including first IR pattern elements corresponding to the projected IR pattern elements and the device estimates 3D positions for first IR pattern elements. The second IR sensor captures a second image including second IR pattern elements corresponding to the projected IR pattern elements and the device matches the first IR pattern elements and the second IR pattern elements. Based on this matching, the device estimates a second extrinsic parameter corresponding to a spatial relationship between the first IR sensor and the second IR sensor.

    Generating a 3D model of a fingertip for visual touch detection

    公开(公告)号:US10970922B2

    公开(公告)日:2021-04-06

    申请号:US16580873

    申请日:2019-09-24

    申请人: Apple Inc.

    摘要: Generating a 3D model may include determining, based on sensor data from a touch sensor on a first device, a touch event, wherein the touch event comprises a touch on the first device by a touching object. Generating a 3D model may also include, in response to a touch event, obtaining a first image of the touching object by a first camera of the first device, and obtaining, from a second device, a second image of the touching object, wherein the first image of the touching object captures a first view of the touching object, and wherein the second image of the touching object captures a second view of the touching object. A model of the touching object is generated based on the first image and the second image.

    IMU for Touch Detection
    9.
    发明申请

    公开(公告)号:US20220276698A1

    公开(公告)日:2022-09-01

    申请号:US17663690

    申请日:2022-05-17

    申请人: Apple Inc.

    摘要: Touch detection may include determining, based on data from an IMU on a first device that monitors movement of a touching object, a touch event, wherein the touch event indicates contact between the touching object and a surface, obtaining a depth image captured by a second device, comprising a touch image, determining a touch point of the object based on the touch image, and providing a response based on the touch point of the object and the touched surface.

    IMU for touch detection
    10.
    发明授权

    公开(公告)号:US11073898B2

    公开(公告)日:2021-07-27

    申请号:US16584491

    申请日:2019-09-26

    申请人: Apple Inc.

    摘要: Touch detection may include determining, based on data from an IMU on a first device that monitors movement of a touching object, a touch event, wherein the touch event indicates contact between the touching object and a surface, obtaining a depth image captured by a second device, comprising a touch image, determining a touch point of the object based on the touch image, and providing a response based on the touch point of the object and the touched surface.