PROVIDING CONTEXT-DRIVEN OUTPUT BASED ON FACIAL MICROMOVEMENTS

    公开(公告)号:US20240127816A1

    公开(公告)日:2024-04-18

    申请号:US18504391

    申请日:2023-11-08

    申请人: Q (CUE) LTD.

    发明人: Yonatan WEXLER

    IPC分类号: G06V40/16

    CPC分类号: G06V40/176 G06V40/172

    摘要: Some disclosed embodiments involve one or more of: receiving during one or more time periods, signals representing coherent light reflections associated with facial skin micromovements; analyzing the coherent light reflections to determine one or more pluralities of words associated with the facial skin micromovements; receiving information indicative of contextual conditions in which the facial skin micromovements occurred; accessing a plurality of control rules correlating a plurality of actions with a plurality of contextual conditions, wherein a first control rule prescribes a form of private presentation based on the first contextual condition, and a second control rule prescribes a form of non-private presentation based on the second contextual condition; upon receipt of the first information, implementing the first control rule to privately output a first plurality of words; and/or upon receipt of the second information, implementing the second control rule to non-privately output a second plurality of words.

    USING A WEARABLE TO INTERPRET FACIAL SKIN MICROMOVEMENTS

    公开(公告)号:US20240119938A1

    公开(公告)日:2024-04-11

    申请号:US18512915

    申请日:2023-11-17

    申请人: Q (CUE) LTD.

    IPC分类号: G10L15/25 H04R1/02 H04R1/10

    CPC分类号: G10L15/25 H04R1/028 H04R1/10

    摘要: Systems, methods, and non-transitory computer readable media including instructions for interpreting facial skin micromovements are disclosed. An example head mountable system includes a housing configured to be worn on a head of a wearer. The head mountable system also includes at least one detector integrated with the housing and configured to receive light reflections from a facial region of the head and to output associated reflection signals. The head mountable system also includes at least one microphone associated with the housing and configured to capture sounds produced by the wearer and to output associated audio signals. The head mountable system also includes and at least one processor in the housing, configured to use both the reflection signals and the audio signals to generate output that corresponds with words articulated by the wearer.

    INITIATING AN ACTION BASED ON A DETECTED INTENTION TO SPEAK

    公开(公告)号:US20230230575A1

    公开(公告)日:2023-07-20

    申请号:US18180364

    申请日:2023-03-08

    申请人: Q (CUE) LTD.

    摘要: Systems and methods are disclosed for determining an intent to speak based on minute facial skin movements. In one implementation, a system may include a processor configured to control at least one coherent light source to illuminate a region of a face. The processor may receive from at least one sensor, reflection signals indicative of coherent light reflected from the face. The reflection signals may be analyzed to determine minute facial skin movements associated with silent speech. Then, based on the determined minute facial skin movements associated with the silent speech, the processor may determine a speech intent, and initiate, prior to an audible utterance of the silent speech, an action based on the determined speech intent.

    IDENTIFYING SILENT SPEECH USING RECORDED SPEECH

    公开(公告)号:US20240127824A1

    公开(公告)日:2024-04-18

    申请号:US18505353

    申请日:2023-11-09

    申请人: Q (CUE) LTD.

    发明人: Yonatan WEXLER

    摘要: Systems, methods, and non-transitory computer readable media including instructions for interpreting facial skin micromovements are disclosed. Interpreting facial skin micromovements includes receiving during a first time period first signals representing prevocalization facial skin micromovements, and receiving during a second time period succeeding the first time period, second signals representing sounds. The sounds are analyzed to identify words spoken during the second time period, and the words are correlated with the prevocalization facial skin micromovements received during the first time period. The correlations are stored for future use. During a third time period, third signals representing facial skin micromovements are received in an absence of vocalization. Using the correlations, language associated with the third signals is identified and outputted.

    WEARABLE FOR SUPPRESSING SOUND OTHER THAN A WEARER'S VOICE

    公开(公告)号:US20240119961A1

    公开(公告)日:2024-04-11

    申请号:US18503689

    申请日:2023-11-07

    申请人: Q (CUE) LTD.

    IPC分类号: G10L25/84 G06V40/16 G10L13/00

    摘要: Systems, methods, and non-transitory computer readable media including instructions for noise suppression are described. A head mountable system for noise suppression includes a wearable housing; a coherent light source configured to project light towards a facial region of the head; a detector configured to receive coherent light reflections from the facial region associated with facial skin micromovements and to output associated reflection signals; and a processor configured to: analyze the reflection signals to determine speech timing; receive audio signals from at least one microphone; correlate the reflection signals with the received audio signals to determine portions of the audio signals associated with the words spoken by the wearer; and output the determined portions of the audio signals associated with words spoken by the wearer, while omitting output of other portions of the audio signals not containing the words spoken by the wearer.

    PROVIDING PRIVATE ANSWERS TO NON-VOCAL QUESTIONS

    公开(公告)号:US20240079012A1

    公开(公告)日:2024-03-07

    申请号:US18509997

    申请日:2023-11-15

    申请人: Q (CUE) LTD.

    摘要: Systems, methods, and non-transitory computer readable media including instructions for providing private answers to silent questions are described. Providing private answers to silent questions includes receiving signals indicative of particular facial micromovements in an absence of perceptible vocalization; accessing a data structure correlating facial micromovements with words; using the received signals to perform a lookup in the data structure of particular words associated with the particular facial micromovements; determining a query from the particular words; accessing at least one data structure to perform a look up for an answer to the query; and generating a discreet output that includes the answer to the query.

    INTERPRETING WORDS PRIOR TO VOCALIZATION
    7.
    发明公开

    公开(公告)号:US20240071386A1

    公开(公告)日:2024-02-29

    申请号:US18505368

    申请日:2023-11-09

    申请人: Q (CUE) LTD.

    IPC分类号: G10L15/25 G10L13/02 G10L15/16

    CPC分类号: G10L15/25 G10L13/02 G10L15/16

    摘要: Systems, methods, and computer program products are disclosed for removing noise from facial skin micromovement signals. Removing noise from facial skin micromovements includes, during a time period when an individual is involved in at least one non-speech-related physical activity, operating a light source in a manner enabling illumination of a facial skin region of the individual; receiving signals representing light reflections from the facial skin region; analyzing the received signals to identify a first reflection component indicative of prevocalization facial skin micromovements and a second reflection component associated with the at least one non-speech-related physical activity; and filtering out the second reflection component to enable interpretation of words from the first reflection component indicative of the prevocalization facial skin micromovements.

    PERSONAL PRESENTATION OF PREVOCALIZATION TO IMPROVE ARTICULATION

    公开(公告)号:US20240119937A1

    公开(公告)日:2024-04-11

    申请号:US18511324

    申请日:2023-11-16

    申请人: Q (CUE) LTD.

    发明人: Yonatan WEXLER

    摘要: Systems, methods, and non-transitory computer-readable media including instructions for detecting and utilizing facial skin micromovements are disclosed. In some non-limiting embodiments, the detection of the facial skin micromovements occurs using a speech detection system that may include a wearable housing, a light source (either a coherent light source or a non-coherent light source), a light detector, and at least one processor. One or more processors may be configured to analyze light reflections received from a facial region to determine the facial skin micromovements, and extract meaning from the determined facial skin micromovements. Examples of meaning that may be extracted from the determined facial skin micromovements may include words spoken by the individual (either silently spoken or vocally spoken), an identification of the individual, an emotional state of the individual, a heart rate of the individual, a respiration rate of the individual, or any other biometric, emotion, or speech-related indicator.

    THRESHOLD FACIAL MICROMOVEMENT INTENSITY TRIGGERS INTERPRETATION

    公开(公告)号:US20240096328A1

    公开(公告)日:2024-03-21

    申请号:US18509952

    申请日:2023-11-15

    申请人: Q (CUE) LTD.

    发明人: Yonatan WEXLER

    摘要: The presently disclosed embodiments may include a non-transitory computer readable medium containing instruction that when executed by at least one processor cause the at least one processor to perform thresholding operations for interpretation of facial skin micromovements. The operations may include detecting facial micromovements in an absence of perceptible vocalization associated with the facial micromovements, determining an intensity level of the facial micromovements and comparing the determined intensity level with a threshold. When the intensity level is above the threshold, the operations may include interpreting the facial micromovements and when the intensity level falls beneath the threshold, the operations may include disregarding the facial micromovements.

    Using projected spots to determine facial micromovements

    公开(公告)号:US20240087361A1

    公开(公告)日:2024-03-14

    申请号:US18511362

    申请日:2023-11-16

    申请人: Q (CUE) LTD.

    发明人: Yonatan WEXLER

    IPC分类号: G06V40/16

    摘要: Systems, methods, and non-transitory computer readable media including instructions for determining and interpreting facial skin micromovements are disclosed. Determining facial skin micromovements includes controlling at least one coherent light source for projecting a plurality of light spots on a facial region of an individual, wherein the plurality of light spots includes at least a first light spot and a second light spot spaced from the first light spot. Reflected light from the first light spot is analyzed to determine changes in first spot reflections. Reflected light from the second light spot is analyzed to determine changes in second spot reflections. Based on the determined changes in the first spot reflections and the second spot reflections, the facial skin micromovements are determined. The facial skin micromovements derived from analyzing the first spot reflections and analyzing the second spot reflections are interpreted. An output of the interpretation is generated.