公开(公告)号：US08135183B2

公开(公告)日：2012-03-13

申请号：US12940408

申请日：2010-11-05

申请人： Yuxiao Hu ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

发明人： Yuxiao Hu ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

IPC分类号： G06K9/00

CPC分类号： G06F3/012 ,  G06K9/00268 ,  G06K9/6211 ,  G06T7/73 ,  G06T2207/30201

摘要： Improvements are provided to effectively assess a user's face and head pose such that a computer or like device can track the user's attention towards a display device(s). Then the region of the display or graphical user interface that the user is turned towards can be automatically selected without requiring the user to provide further inputs. A frontal face detector is applied to detect the user's frontal face and then key facial points such as left/right eye center, left/right mouth corner, nose tip, etc., are detected by component detectors. The system then tracks the user's head by an image tracker and determines yaw, tilt and roll angle and other pose information of the user's head through a coarse to fine process according to key facial points and/or confidence outputs by pose estimator.

摘要翻译： 提供了改进以有效地评估用户的脸部和头部姿势，使得计算机或类似装置可以跟踪用户对显示装置的注意。 然后可以自动选择用户转向的显示或图形用户界面的区域，而不需要用户提供进一步的输入。 应用前置面部检测器来检测使用者的正面，然后通过部件检测器检测左右眼中心，左/右口角，鼻尖等的关键面部点。 然后，系统通过图像跟踪器跟踪用户的头部，并且通过姿态估计器根据关键面部点和/或置信输出，通过粗略到精细处理确定用户头部的偏航，倾斜和滚动角度和其他姿态信息。

公开(公告)号：US20110050568A1

公开(公告)日：2011-03-03

申请号：US12940408

申请日：2010-11-05

申请人： Yuxiao HU ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

发明人： Yuxiao HU ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

IPC分类号： G06F3/033 ,  G06F3/01

CPC分类号： G06F3/012 ,  G06K9/00268 ,  G06K9/6211 ,  G06T7/73 ,  G06T2207/30201

摘要： Improvements are provided to effectively assess a user's face and head pose such that a computer or like device can track the user's attention towards a display device(s). Then the region of the display or graphical user interface that the user is turned towards can be automatically selected without requiring the user to provide further inputs. A frontal face detector is applied to detect the user's frontal face and then key facial points such as left/right eye center, left/right mouth corner, nose tip, etc., are detected by component detectors. The system then tracks the user's head by an image tracker and determines yaw, tilt and roll angle and other pose information of the user's head through a coarse to fine process according to key facial points and/or confidence outputs by pose estimator.

摘要翻译： 提供了改进以有效地评估用户的脸部和头部姿势，使得计算机或类似装置可以跟踪用户对显示装置的注意。 然后可以自动选择用户转向的显示或图形用户界面的区域，而不需要用户提供进一步的输入。 应用前置面部检测器来检测使用者的正面，然后通过部件检测器检测左右眼中心，左/右口角，鼻尖等的关键面部点。 然后，系统通过图像跟踪器跟踪用户的头部，并且通过姿态估计器根据关键面部点和/或置信输出，通过粗略到精细处理确定用户头部的偏航，倾斜和滚动角度和其他姿态信息。

公开(公告)号：US07646909B2

公开(公告)日：2010-01-12

申请号：US12194467

申请日：2008-08-19

申请人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

发明人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

IPC分类号： G06K9/00

CPC分类号： G06K9/00288 ,  G06K9/00208

摘要： A method and system for generating 3D images of faces from 2D images, for generating 2D images of the faces at different image conditions from the 3D images, and for recognizing a 2D image of a target face based on the generated 2D images is provided. The recognition system provides a 3D model of a face that includes a 3D image of a standard face under a standard image condition and parameters indicating variations of an individual face from the standard face. To generate the 3D image of a face, the recognition system inputs a 2D image of the face under a standard image condition. The recognition system then calculates parameters that map the points of the 2D image to the corresponding points of a 2D image of the standard face. The recognition system uses these parameters with the 3D model to generate 3D images of the face at different image conditions.

摘要翻译： 提供了一种用于从2D图像生成面部的3D图像的方法和系统，用于在3D图像的不同图像条件下生成面部的2D图像，并且基于所生成的2D图像来识别目标面部的2D图像。 识别系统提供了一种面部的3D模型，其包括在标准图像条件下的标准面的3D图像和指示单个脸部与标准脸部的变化的参数。 为了生成面部的3D图像，识别系统在标准图像条件下输入面部的2D图像。 识别系统然后计算将2D图像的点映射到标准面的2D图像的对应点的参数。 识别系统使用这些参数与3D模型在不同图像条件下生成脸部的3D图像。

公开(公告)号：US07403642B2

公开(公告)日：2008-07-22

申请号：US11111696

申请日：2005-04-21

申请人： Lei Zhang ,  Mingjing Li ,  Wei-Ying Ma ,  Yan-Feng Sun ,  Yuxiao Hu

发明人： Lei Zhang ,  Mingjing Li ,  Wei-Ying Ma ,  Yan-Feng Sun ,  Yuxiao Hu

IPC分类号： G06K9/00

CPC分类号： G06K9/00288 ,  G06F17/30265 ,  G06F17/30274 ,  G06K9/6221 ,  G06K2009/00328 ,  Y10S707/99945 ,  Y10S707/99948

摘要： Systems, engines, user interfaces, and methods allow a user to select a group of images, such as digital photographs, and assign to the group of images the name of a person who is represented in each of the images. The name is automatically propagated to the face of the person, each time the person's face occurs in an image. In one implementation, names and associations are shared between a browsing mode for viewing multiple images at once and a viewer mode, for viewing one image at a time. The browsing mode can provide a menu of candidate names for annotating a face in a single image of the viewer mode. Likewise, the viewer mode can provide annotated face information to the browser mode for facilitating name propagation. Identification of a person's face in multiple images can be accomplished not only by finding similarities in facial features but also by finding similarities in contextual features near the face in different images.

摘要翻译： 系统，引擎，用户界面和方法允许用户选择一组图像，例如数字照片，并且在图像组中分配在每个图像中表示的人的姓名。 每当人的脸发生在图像中时，名称将自动传播到人的脸部。 在一个实现中，名称和关联在用于一次查看多个图像的浏览模式和观看者模式之间共享，以便一次查看一个图像。 浏览模式可以提供用于在观看者模式的单个图像中注释脸部的候选名称的菜单。 类似地，观看者模式可以向浏览器模式提供注释的面部信息，以便于名称传播。 可以通过在面部特征中发现相似性，而且通过在不同图像中的脸部附近的上下文特征中找到相似性来实现多个图像中的人脸识别。

公开(公告)号：US20090052748A1

公开(公告)日：2009-02-26

申请号：US12194467

申请日：2008-08-19

申请人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

发明人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

IPC分类号： G06K9/00 ,  G06K9/36

CPC分类号： G06K9/00288 ,  G06K9/00208

摘要： A method and system for generating 3D images of faces from 2D images, for generating 2D images of the faces at different image conditions from the 3D images, and for recognizing a 2D image of a target face based on the generated 2D images is provided. The recognition system provides a 3D model of a face that includes a 3D image of a standard face under a standard image condition and parameters indicating variations of an individual face from the standard face. To generate the 3D image of a face, the recognition system inputs a 2D image of the face under a standard image condition. The recognition system then calculates parameters that map the points of the 2D image to the corresponding points of a 2D image of the standard face. The recognition system uses these parameters with the 3D model to generate 3D images of the face at different image conditions.

摘要翻译： 提供了一种用于从2D图像生成面部的3D图像的方法和系统，用于在3D图像的不同图像条件下生成面部的2D图像，并且基于所生成的2D图像来识别目标面部的2D图像。 识别系统提供了一种面部的3D模型，其包括在标准图像条件下的标准面的3D图像和指示单个脸部与标准脸部的变化的参数。 为了生成面部的3D图像，识别系统在标准图像条件下输入面部的2D图像。 识别系统然后计算将2D图像的点映射到标准面的2D图像的对应点的参数。 识别系统使用这些参数与3D模型在不同图像条件下生成脸部的3D图像。

公开(公告)号：US20060245639A1

公开(公告)日：2006-11-02

申请号：US11118116

申请日：2005-04-29

申请人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

发明人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

IPC分类号： G06K9/00

CPC分类号： G06K9/00288 ,  G06K9/00208

摘要： A method and system for generating 3D images of faces from 2D images, for generating 2D images of the faces at different image conditions from the 3D images, and for recognizing a 2D image of a target face based on the generated 2D images is provided. The recognition system provides a 3D model of a face that includes a 3D image of a standard face under a standard image condition and parameters indicating variations of an individual face from the standard face. To generate the 3D image of a face, the recognition system inputs a 2D image of the face under a standard image condition. The recognition system then calculates parameters that map the points of the 2D image to the corresponding points of a 2D image of the standard face. The recognition system uses these parameters with the 3D model to generate 3D images of the face at different image conditions.

摘要翻译： 提供了一种用于从2D图像生成面部的3D图像的方法和系统，用于在3D图像的不同图像条件下生成面部的2D图像，并且基于所生成的2D图像来识别目标面部的2D图像。 识别系统提供了一种面部的3D模型，其包括在标准图像条件下的标准面的3D图像和指示单个脸部与标准脸部的变化的参数。 为了生成面部的3D图像，识别系统在标准图像条件下输入面部的2D图像。 识别系统然后计算将2D图像的点映射到标准面的2D图像的对应点的参数。 识别系统使用这些参数与3D模型在不同图像条件下生成脸部的3D图像。

公开(公告)号：US07844086B2

公开(公告)日：2010-11-30

申请号：US12143717

申请日：2008-06-20

申请人： Yuxiao Hu ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

发明人： Yuxiao Hu ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

IPC分类号： G06K9/00

CPC分类号： G06F3/012 ,  G06K9/00268 ,  G06K9/6211 ,  G06T7/73 ,  G06T2207/30201

摘要： Improvements are provided to effectively assess a user's face and head pose such that a computer or like device can track the user's attention towards a display device(s). Then the region of the display or graphical user interface that the user is turned towards can be automatically selected without requiring the user to provide further inputs. A frontal face detector is applied to detect the user's frontal face and then key facial points such as left/right eye center, left/right mouth corner, nose tip, etc., are detected by component detectors. The system then tracks the user's head by an image tracker and determines yaw, tilt and roll angle and other pose information of the user's head through a coarse to fine process according to key facial points and/or confidence outputs by pose estimator.

摘要翻译： 提供了改进以有效地评估用户的脸部和头部姿势，使得计算机或类似装置可以跟踪用户对显示装置的注意。 然后可以自动选择用户转向的显示或图形用户界面的区域，而不需要用户提供进一步的输入。 应用前置面部检测器来检测使用者的正面，然后通过部件检测器检测左右眼中心，左/右口角，鼻尖等的关键面部点。 然后，系统通过图像跟踪器跟踪用户的头部，并且通过姿态估计器根据关键面部点和/或置信输出，通过粗略到精细处理确定用户头部的偏航，倾斜和滚动角度和其他姿态信息。

公开(公告)号：US20080298637A1

公开(公告)日：2008-12-04

申请号：US12143717

申请日：2008-06-20

申请人： Yuxiao Hu ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

发明人： Yuxiao Hu ,  Lei Zhang ,  Mingjing Li ,  Hong-Jiang Zhang

IPC分类号： G06K9/00

CPC分类号： G06F3/012 ,  G06K9/00268 ,  G06K9/6211 ,  G06T7/73 ,  G06T2207/30201

摘要： Improvements are provided to effectively assess a user's face and head pose such that a computer or like device can track the user's attention towards a display device(s). Then the region of the display or graphical user interface that the user is turned towards can be automatically selected without requiring the user to provide further inputs. A frontal face detector is applied to detect the user's frontal face and then key facial points such as left/right eye center, left/right mouth corner, nose tip, etc., are detected by component detectors. The system then tracks the user's head by an image tracker and determines yaw, tilt and roll angle and other pose information of the user's head through a coarse to fine process according to key facial points and/or confidence outputs by pose estimator.

摘要翻译： 提供了改进以有效地评估用户的脸部和头部姿势，使得计算机或类似装置可以跟踪用户对显示装置的注意。 然后可以自动选择用户转向的显示或图形用户界面的区域，而不需要用户提供进一步的输入。 应用前置面部检测器来检测使用者的正面，然后通过部件检测器检测左右眼中心，左/右口角，鼻尖等的关键面部点。 然后，系统通过图像跟踪器跟踪用户的头部，并且通过姿态估计器根据关键面部点和/或置信输出，通过粗略到精细处理确定用户头部的偏航，倾斜和滚动角度和其他姿态信息。

公开(公告)号：US07415152B2

公开(公告)日：2008-08-19

申请号：US11118116

申请日：2005-04-29

申请人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

发明人： Dalong Jiang ,  Hong-Jiang Zhang ,  Lei Zhang ,  Shuicheng Yan ,  Yuxiao Hu

IPC分类号： G06K9/00

CPC分类号： G06K9/00288 ,  G06K9/00208

摘要： A method and system for generating 3D images of faces from 2D images, for generating 2D images of the faces at different image conditions from the 3D images, and for recognizing a 2D image of a target face based on the generated 2D images is provided. The recognition system provides a 3D model of a face that includes a 3D image of a standard face under a standard image condition and parameters indicating variations of an individual face from the standard face. To generate the 3D image of a face, the recognition system inputs a 2D image of the face under a standard image condition. The recognition system then calculates parameters that map the points of the 2D image to the corresponding points of a 2D image of the standard face. The recognition system uses these parameters with the 3D model to generate 3D images of the face at different image conditions.

摘要翻译： 提供了一种用于从2D图像生成面部的3D图像的方法和系统，用于在3D图像的不同图像条件下生成面部的2D图像，并且基于所生成的2D图像来识别目标面部的2D图像。 识别系统提供了一种面部的3D模型，其包括在标准图像条件下的标准面的3D图像和指示单个脸部与标准脸部的变化的参数。 为了生成面部的3D图像，识别系统在标准图像条件下输入面部的2D图像。 识别系统然后计算将2D图像的点映射到标准面的2D图像的对应点的参数。 识别系统使用这些参数与3D模型在不同图像条件下生成脸部的3D图像。

公开(公告)号：US08457358B2

公开(公告)日：2013-06-04

申请号：US13398171

申请日：2012-02-16

申请人： Yuxiao Hu ,  Hong-Jiang Zhang ,  Mingjing Li ,  Lei Zhang

发明人： Yuxiao Hu ,  Hong-Jiang Zhang ,  Mingjing Li ,  Lei Zhang

IPC分类号： G06K9/00

CPC分类号： G06F3/012 ,  G06K9/00268 ,  G06K9/6211 ,  G06T7/73 ,  G06T2207/30201

摘要： Improvements are provided to effectively assess a user's face and head pose such that a computer or like device can track the user's attention towards a display device(s). Then the region of the display or graphical user interface that the user is turned towards can be automatically selected without requiring the user to provide further inputs. A frontal face detector is applied to detect the user's frontal face and then key facial points such as left/right eye center, left/right mouth corner, nose tip, etc., are detected by component detectors. The system then tracks the user's head by an image tracker and determines yaw, tilt and roll angle and other pose information of the user's head through a coarse to fine process according to key facial points and/or confidence outputs by pose estimator.

摘要翻译： 提供了改进以有效地评估用户的脸部和头部姿势，使得计算机或类似装置可以跟踪用户对显示装置的注意。 然后可以自动选择用户转向的显示或图形用户界面的区域，而不需要用户提供进一步的输入。 应用前置面部检测器来检测使用者的正面，然后通过部件检测器检测左右眼中心，左/右口角，鼻尖等的关键面部点。 然后，系统通过图像跟踪器跟踪用户的头部，并且通过姿态估计器根据关键面部点和/或置信输出，通过粗略到精细处理确定用户头部的偏航，倾斜和滚动角度和其他姿态信息。