Estimation of spatial relationships between sensors of a multi-sensor device

    公开(公告)号:US11238616B1

    公开(公告)日:2022-02-01

    申请号:US17099932

    申请日:2020-11-17

    Applicant: Apple Inc.

    Abstract: In one implementation, a device has a processor, a projector, a first infrared (IR) sensor, a second IR sensor, and instructions stored on a computer-readable medium that are executed by the processor to estimate the sensor-to-sensor extrinsic parameters. The projector projects IR pattern elements onto an environment surface. The first sensor captures a first image including first IR pattern elements corresponding to the projected IR pattern elements and the device estimates 3D positions for first IR pattern elements. The second IR sensor captures a second image including second IR pattern elements corresponding to the projected IR pattern elements and the device matches the first IR pattern elements and the second IR pattern elements. Based on this matching, the device estimates a second extrinsic parameter corresponding to a spatial relationship between the first IR sensor and the second IR sensor.

    Obstruction detection during facial recognition processes

    公开(公告)号:US11367305B2

    公开(公告)日:2022-06-21

    申请号:US16549009

    申请日:2019-08-23

    Applicant: Apple Inc.

    Abstract: A facial recognition process operating on a device may include one or more processes that determine if a camera and/or components associated with the camera are obstructed by an object (e.g., a user's hand or fingers). Obstruction of the device may be assessed using flood infrared illumination images when a user's face is not able to be detected by a face detection process operating on the device. Obstruction of the device may also be assessed using a pattern detection process that operates after the user's face is detected by the face detection process. When obstruction of the device is detected, the device may provide a notification to the user that the device (e.g., the camera and/or an illuminator) is obstructed and that the obstruction should be removed for the facial recognition process to operate correctly.

    Enhanced Virtual Touchpad
    5.
    发明申请

    公开(公告)号:US20220164032A1

    公开(公告)日:2022-05-26

    申请号:US17520671

    申请日:2021-11-07

    Applicant: APPLE INC.

    Abstract: A method, including receiving, by a computer, a two-dimensional image (2D) containing at least a physical surface and segmenting the physical surface into one or more physical regions. A functionality is assigned to each of the one or more physical regions, each of the functionalities corresponding to a tactile input device, and a sequence of three-dimensional (3D) maps is received, the sequence of 3D maps containing at least a hand of a user of the computer, the hand positioned on one of the physical regions. The 3D maps are analyzed to detect a gesture performed by the user, and based on the gesture, an input is simulated for the tactile input device corresponding to the one of the physical regions.

    Gaze detection in a 3d mapping environment
    8.
    发明申请
    Gaze detection in a 3d mapping environment 审中-公开
    在3d映射环境中注视检测

    公开(公告)号:US20160370860A1

    公开(公告)日:2016-12-22

    申请号:US15256654

    申请日:2016-09-05

    Applicant: Apple Inc.

    CPC classification number: G06F3/013 G06F3/017 G06F2203/0381

    Abstract: A method includes receiving a sequence of three-dimensional (3D) maps of at least a part of a body of a user of a computerized system and extracting, from the 3D map, 3D coordinates of a head of the user. Based on the 3D coordinates of the head, a direction of a gaze performed by the user and an interactive item presented in the direction of the gaze on a display coupled to the computerized system are identified. An indication is extracted from the 3D maps an indication that the user is moving a limb of the body in a specific direction, and the identified interactive item is repositioned on the display responsively to the indication.

    Abstract translation: 一种方法包括接收计算机化系统的用户的身体的至少一部分的三维(3D)映射序列,并从3D映射提取用户的头部的3D坐标。 基于头部的3D坐标,识别由用户执行的注视方向和在与计算机化系统耦合的显示器上的凝视方向呈现的交互项。 从3D中提取的指示映射用户正在沿特定方向移动身体的肢体的指示,并且所识别的交互项目响应于该指示被重新定位在显示器上。

    THREE DIMENSIONAL USER INTERFACE SESSION CONTROL USING DEPTH SENSORS
    9.
    发明申请
    THREE DIMENSIONAL USER INTERFACE SESSION CONTROL USING DEPTH SENSORS 有权
    使用深度传感器的三维用户界面会话控制

    公开(公告)号:US20160349853A1

    公开(公告)日:2016-12-01

    申请号:US15233969

    申请日:2016-08-11

    Applicant: APPLE INC.

    CPC classification number: G06F3/017 G06F3/005 G06F3/011 G06F3/0304 G06F3/04815

    Abstract: A method, including receiving, by a computer executing a non-tactile three dimensional (3D) user interface, a set of multiple 3D coordinates representing a gesture by a hand positioned within a field of view of a sensing device coupled to the computer, the gesture including a first motion in a first direction along a selected axis in space, followed by a second motion in a second direction, opposite to the first direction, along the selected axis. Upon detecting completion of the gesture, the non-tactile 3D user interface is transitioned from a first state to a second state.

    Abstract translation: 一种方法,包括通过执行非触觉三维(3D)用户界面的计算机接收表示通过位于耦合到计算机的感测装置的视场内的手的手势的一组多个3D坐标, 手势包括沿着所选轴在空间中的第一方向的第一运动,随后沿着所选择的轴在与第一方向相反的第二方向上的第二运动。 当检测到手势完成时,非触觉3D用户界面从第一状态转变到第二状态。

    Three dimensional user interface session control using depth sensors
    10.
    发明申请
    Three dimensional user interface session control using depth sensors 有权
    三维用户界面会话控制使用深度传感器

    公开(公告)号:US20150248171A1

    公开(公告)日:2015-09-03

    申请号:US14714297

    申请日:2015-05-17

    Applicant: Apple Inc.

    CPC classification number: G06F3/017 G06F3/005 G06F3/011 G06F3/0304 G06F3/04815

    Abstract: A method, including receiving, by a computer executing a non-tactile three dimensional (3D) user interface, a set of multiple 3D coordinates representing a gesture by a hand positioned within a field of view of a sensing device coupled to the computer, the gesture including a first motion in a first direction along a selected axis in space, followed by a second motion in a second direction, opposite to the first direction, along the selected axis. Upon detecting completion of the gesture, the non-tactile 3D user interface is transitioned from a first state to a second state.

    Abstract translation: 一种方法,包括通过执行非触觉三维(3D)用户界面的计算机接收表示通过位于耦合到计算机的感测装置的视场内的手的手势的一组多个3D坐标, 手势包括沿着所选轴在空间中的第一方向的第一运动,随后沿着所选择的轴在与第一方向相反的第二方向上的第二运动。 当检测到手势完成时,非触觉3D用户界面从第一状态转变到第二状态。

Patent Agency Ranking