公开(公告)号：US08494231B2

公开(公告)日：2013-07-23

申请号：US12916895

申请日：2010-11-01

Applicant: Florin O. Folta ,  Yaming He ,  King Wei Hor ,  Minesh G. Shilotri ,  Stacey Spears ,  Chuang Gu

Inventor： Florin O. Folta ,  Yaming He ,  King Wei Hor ,  Minesh G. Shilotri ,  Stacey Spears ,  Chuang Gu

IPC: G06K9/00

CPC classification number: G06K9/00295 ,  G06K2009/00328

Abstract: The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.

Abstract translation: 本公开涉及视频中的面部识别。 输入数据帧中的脸部检测数据用于生成面部画廊，这些画廊被标记并用于识别整个视频中的脸部。 生成并维护与视频帧和脸部相关联的元数据，以便后续识别。 面部检测以外的脸部可以通过脸部跟踪来发现，其中通过面部检测发现的面部地标用于跟踪先前和/或后续视频帧的面部。 一旦生成，可以访问维护的元数据以有效地确定与观众选择的面对应的人的身份。

公开(公告)号：US20120281886A1

公开(公告)日：2012-11-08

申请号：US13102740

申请日：2011-05-06

Applicant: Yaming He ,  Chuang Gu

Inventor： Yaming He ,  Chuang Gu

IPC: G06K9/00

CPC classification number: G06K9/00288 ,  G06K9/00677 ,  G06K9/6807

Abstract: Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.

Abstract translation: 本文公开了与分段元素分类相关的各种示例。 例如，一个公开的示例提供了一种通过在第一阶段中形成用于分类为多个第一级集合的元素来对元素进行分类的方法，基于元素相似性在第一级集合内生成主组，形成多个第二级组， 基于元素相似度在第二级集合内生成二级组，并且基于元素相似度合并多个主组和/或辅助组。

公开(公告)号：US20120147265A1

公开(公告)日：2012-06-14

申请号：US12964597

申请日：2010-12-09

Applicant: Chuang Gu ,  Anil Murching ,  Chad Gibson ,  David Alles

Inventor： Chuang Gu ,  Anil Murching ,  Chad Gibson ,  David Alles

IPC: H04N7/00

CPC classification number: H04N21/44008 ,  G06F17/30793 ,  G06F17/3082 ,  G06F17/30825 ,  H04N5/4403 ,  H04N7/17318 ,  H04N21/2353 ,  H04N21/2665 ,  H04N21/435 ,  H04N21/472 ,  H04N21/8133 ,  H04N21/84

Abstract: Various embodiments related to the generation and provision of media metadata are disclosed. For example, one disclosed embodiment provides a computing device having a logic subsystem configured to execute instructions, and a data holding subsystem comprising instructions stored thereon that are executable by the processor to receive an input of a video and/or audio content item, and to compare the content item to one or more object descriptors each representing an object for locating within the content item to locate instances of one or more of the objects in the content item. The instructions are further executable to generate metadata for each object located in the video content item, and to receive a validating user input related to whether the metadata generated for a selected object is correct.

Abstract translation: 公开了与生成和提供媒体元数据相关的各种实施例。 例如，一个公开的实施例提供了具有被配置为执行指令的逻辑子系统的计算设备，以及包括存储在其上的指令的数据保持子系统，其可由处理器执行以接收视频和/或音频内容项目的输入，并且 将内容项目与一个或多个对象描述符进行比较，每个对象描述符表示用于在内容项目中定位的对象以定位内容项目中的一个或多个对象的实例。 指令还可执行以为位于视频内容项目中的每个对象生成元数据，并且接收与为所选对象生成的元数据是否正确相关的验证用户输入。

公开(公告)号：US20100189179A1

公开(公告)日：2010-07-29

申请号：US12362427

申请日：2009-01-29

Applicant: Chuang Gu ,  Chun-Wei Chan ,  William Chen ,  Stacey Spears ,  Thomas W. Holcomb

Inventor： Chuang Gu ,  Chun-Wei Chan ,  William Chen ,  Stacey Spears ,  Thomas W. Holcomb

IPC: H04N11/02

CPC classification number: H04N19/436 ,  H04N19/105 ,  H04N19/157 ,  H04N19/176 ,  H04N19/187 ,  H04N19/33 ,  H04N19/43 ,  H04N19/51

Abstract: A video encoder uses previously calculated motion information for inter frame coding to achieve faster computation speed for video compression. In a multi bit rate application, motion information produced by motion estimation for inter frame coding of a compressed video bit stream at one bit rate is passed on to a subsequent encoding of the video at a lower bit rate. The video encoder chooses to use the previously calculated motion information for inter frame coding at the lower bit rate if the video resolution is unchanged. A multi core motion information pre-calculation produces motion information prior to encoding by dividing motion estimation of each inter frame to separate CPU cores.

Abstract translation: 视频编码器使用先前计算的帧间编码运动信息来实现视频压缩的更快的计算速度。 在多比特率应用中，通过用于以一个比特率的压缩视频比特流的帧间编码的运动估计产生的运动信息被传递到较低比特率的视频的后续编码。 如果视频分辨率不变，则视频编码器选择使用先前计算的运动信息用于较低比特率的帧间编码。 多核心运动信息预计算在编码之前通过将每个帧间的运动估计划分成分离的CPU核心来产生运动信息。

公开(公告)号：US07162055B2

公开(公告)日：2007-01-09

申请号：US11171448

申请日：2005-06-29

Applicant: Chuang Gu ,  Ming-Chieh Lee

Inventor： Chuang Gu ,  Ming-Chieh Lee

IPC: G06K9/00 ,  G06K9/34 ,  H04N5/225

CPC classification number: G06K9/32 ,  G06T7/11 ,  G06T7/174 ,  G06T7/215 ,  G06T7/246 ,  H04N19/543 ,  H04N19/80

Abstract: A semantic object tracking method tracks general semantic objects with multiple non-rigid motion, disconnected components and multiple colors throughout a vector image sequence. The method accurately tracks these general semantic objects by spatially segmenting image regions from a current frame and then classifying these regions as to which semantic object they originated from in the previous frame. To classify each region, the method performs a region based motion estimation between each spatially segmented region and the previous frame to compute the position of a predicted region in the previous frame. The method then classifies each region in the current frame as being part of a semantic object based on which semantic object in the previous frame contains the most overlapping points of the predicted region. Using this method, each region in the current image is tracked to one semantic object from the previous frame, with no gaps or overlaps. The method propagates few or no errors because it projects regions into a frame where the semantic object boundaries are previously computed rather than trying to project and adjust a boundary in a frame where the object's boundary is unknown.

Abstract translation: 语义对象跟踪方法在整个矢量图像序列中跟踪具有多个非刚性运动，断开组件和多种颜色的一般语义对象。 该方法通过对来自当前帧的图像区域进行空间分割，然后对这些区域进行分类，从而准确地跟踪这些一般语义对象，以便它们在前一帧中源自哪个语义对象。 为了对每个区域进行分类，该方法在每个空间分段区域和前一帧之间执行基于区域的运动估计，以计算前一帧中的预测区域的位置。 该方法然后根据前一帧中的哪个语义对象包含预测区域的最重叠点将当前帧中的每个区域分类为语义对象的一部分。 使用该方法，当前图像中的每个区域被跟踪到来自前一帧的一个语义对象，没有间隙或重叠。 该方法传播很少或没有错误，因为它将区域投影到预先计算语义对象边界的框架中，而不是尝试在对象边界未知的框架中投影和调整边界。

公开(公告)号：US06400831B1

公开(公告)日：2002-06-04

申请号：US09054280

申请日：1998-04-02

Applicant: Ming-Chieh Lee ,  Chuang Gu

Inventor： Ming-Chieh Lee ,  Chuang Gu

IPC: G06K900

Abstract: A semantic video object extraction system using mathematical morphology and perspective motion modeling. A user indicates a rough outline around an image feature of interest for a first frame in a video sequence. Without further user assistance, the rough outline is processed by a morphological segmentation tool to snap the rough outline into a precise boundary surrounding the image feature. Motion modeling is performed on the image feature to track its movement into a subsequent video frame. The motion model is applied to the precise boundary to warp the precise outline into a new rough outline for the image feature in the subsequent video frame. This new rough outline is then snapped to locate a new precise boundary. Automatic processing is repeated for subsequent video frames.

公开(公告)号：US08763068B2

公开(公告)日：2014-06-24

申请号：US12964597

申请日：2010-12-09

Applicant: Chuang Gu ,  Anil Murching ,  Chad Gibson ,  David Alles

Inventor： Chuang Gu ,  Anil Murching ,  Chad Gibson ,  David Alles

IPC: H04N7/16

CPC classification number: H04N21/44008 ,  G06F17/30793 ,  G06F17/3082 ,  G06F17/30825 ,  H04N5/4403 ,  H04N7/17318 ,  H04N21/2353 ,  H04N21/2665 ,  H04N21/435 ,  H04N21/472 ,  H04N21/8133 ,  H04N21/84

Abstract: Various embodiments related to the generation and provision of media metadata are disclosed. For example, one disclosed embodiment provides a computing device having a logic subsystem configured to execute instructions, and a data holding subsystem comprising instructions stored thereon that are executable by the processor to receive an input of a video and/or audio content item, and to compare the content item to one or more object descriptors each representing an object for locating within the content item to locate instances of one or more of the objects in the content item. The instructions are further executable to generate metadata for each object located in the video content item, and to receive a validating user input related to whether the metadata generated for a selected object is correct.

Abstract translation: 公开了与生成和提供媒体元数据相关的各种实施例。 例如，一个公开的实施例提供了具有被配置为执行指令的逻辑子系统的计算设备，以及包括存储在其上的指令的数据保持子系统，其可由处理器执行以接收视频和/或音频内容项目的输入，并且 将内容项目与一个或多个对象描述符进行比较，每个对象描述符表示用于在内容项目中定位的对象以定位内容项目中的一个或多个对象的实例。 指令还可执行以为位于视频内容项目中的每个对象生成元数据，并且接收与为所选对象生成的元数据是否正确相关的验证用户输入。

公开(公告)号：US07710434B2

公开(公告)日：2010-05-04

申请号：US11755082

申请日：2007-05-30

Applicant: Chuang Gu

Inventor： Chuang Gu

IPC: G09G5/02 ,  G09G5/00 ,  H04N7/00 ,  H04N11/06 ,  H04N9/74 ,  G06K9/00 ,  G06K9/32

CPC classification number: G09G3/20 ,  G09G2340/04 ,  G09G2340/0492 ,  G09G2340/06 ,  G09G2360/12

Abstract: Image processing in mobile devices is optimized by combining at least two of the color conversion, rotation, and scaling operations. Received images, such as still images or frames of video stream, are subjected to a combined transformation after decoding, where each pixel is color converted (e.g. from YUV to RGB), rotated, and scaled as needed. By combining two or three of the processes into one, read/write operations consuming significant processing and memory resources are reduced enabling processing of higher resolution images and/or power and processing resource savings.

Abstract translation: 通过组合至少两个颜色转换，旋转和缩放操作来优化移动设备中的图像处理。 接收到的图像，例如静止图像或视频流的帧，在解码之后进行组合变换，其中每个像素被颜色转换（例如从YUV到RGB），旋转和根据需要进行缩放。 通过将两个或三个进程组合​​成一个，消耗重要处理和存储器资源的读/写操作被减少，使得能够处理更高分辨率图像和/或功率并且处理资源节省。

公开(公告)号：US08588534B2

公开(公告)日：2013-11-19

申请号：US13102740

申请日：2011-05-06

Applicant: Yaming He ,  Chuang Gu

Inventor： Yaming He ,  Chuang Gu

IPC: G06K9/68

CPC classification number: G06K9/00288 ,  G06K9/00677 ,  G06K9/6807

Abstract: Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.

Abstract translation: 本文公开了与分段元素分类相关的各种示例。 例如，一个公开的示例提供了一种通过在第一阶段中形成用于分类为多个第一级集合的元素来对元素进行分类的方法，基于元素相似性在第一级集合内生成主组，形成多个第二级组， 基于元素相似度在第二级集合内生成二级组，并且基于元素相似度合并多个主组和/或辅助组。

公开(公告)号：US08270473B2

公开(公告)日：2012-09-18

申请号：US12483577

申请日：2009-06-12

Applicant: William Chen ,  Chun-Wei Chan ,  Stacey Spears ,  Yaming He ,  Florin Folta ,  Chuang Gu ,  King Wei Hor

Inventor： William Chen ,  Chun-Wei Chan ,  Stacey Spears ,  Yaming He ,  Florin Folta ,  Chuang Gu ,  King Wei Hor

IPC: H04B1/66

CPC classification number: H04N19/587 ,  H04N19/124 ,  H04N19/132 ,  H04N19/139 ,  H04N19/14 ,  H04N19/142 ,  H04N19/149 ,  H04N19/164 ,  H04N19/172 ,  H04N19/177 ,  H04N19/194 ,  H04N19/57 ,  H04N19/61

Abstract: A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded resolution to vary based, at least in part, on motion complexity. The video encoding system dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming. Motion complexity may be considered separately, or along with spatial complexity, in making the resolution decision.

Abstract translation: 视频编码系统使用允许编码分辨率至少部分地基于运动复杂度而变化的方法对多个比特率视频流的视频流进行编码。 视频编码系统动态地决定随着视频复杂度而变化的多个比特率视频流的片段的编码分辨率，以便为多个比特率流媒体实现更好的视觉体验。 运动复杂度可以单独考虑，也可以与空间复杂性一起考虑在决策中。