公开(公告)号：US20240054794A1

公开(公告)日：2024-02-15

申请号：US18364709

申请日：2023-08-03

Applicant: Blueskeye AI Ltd

Inventor： Michel François Valstar ,  Anthony Brown ,  Timur Almaev ,  Steven Cliffe ,  Thomas James Smith ,  Tze Ee Yong ,  Mani Kumar Tellamekala

IPC: G06V20/59 ,  G06V40/16 ,  G06T7/246 ,  G06V40/20 ,  G06V10/82 ,  G06V10/80 ,  G06V10/98 ,  G06V20/40 ,  G06V20/52 ,  G06F3/16 ,  G08B21/04

CPC classification number: G06V20/597 ,  G06V40/161 ,  G06T7/246 ,  G06V40/20 ,  G06V10/82 ,  G06V10/80 ,  G06V10/993 ,  G06V20/46 ,  G06V20/52 ,  G06F3/167 ,  G08B21/0476 ,  G06T2207/30201 ,  G06T2207/30268 ,  G06V2201/10 ,  G06T2207/30232 ,  B60W60/0051

Abstract: Described is a task for an automobile interior having at least one subject that creates a video input, an audio input, and a context descriptor input. The video input relates to the at least one subject and is processed by a face detection module and a facial point registration module to produce a first output. The first output is further processed by at least one of: a facial point tracking module, a head orientation tracking module, a body tracking module, a social gaze tracking module, and an action unit intensity tracking module. The audio input relating to the at least one subject is processed by a valence and arousal affect states tracking module to produce a second output and to produce a valence and arousal scores output. A temporal behavior primitives buffer produce a temporal behavior output. Based on the foregoing, a mental state prediction module predicts the mental state of at least one subject in the automobile interior.