公开(公告)号：US20190197667A1

公开(公告)日：2019-06-27

申请号：US15854680

申请日：2017-12-26

Applicant: Facebook, Inc.

Inventor： Balmanohar Paluri

IPC: G06T3/40 ,  H04N13/00 ,  G06K9/46 ,  G06K9/62

Abstract: A system trains a machine learning model to generate a high-resolution depth image. During a training phase, the system generates an accurate three dimensional reconstruction of a training scene such that the machine learning model is iteratively trained to minimize an error between the higher resolution depth image and the depth information in the accurate three dimensional reconstruction. During a real-time phase, the system applies the trained machine learning model to images captured from a scene of interest and generates a higher resolution depth image with higher accuracy. Thus, the higher resolution depth image can be subsequently used to solve computer vision problems.

公开(公告)号：US20180332480A1

公开(公告)日：2018-11-15

申请号：US15592100

申请日：2017-05-10

Applicant: Facebook, Inc.

Inventor： Guan Pang ,  Jing Huang ,  Balmanohar Paluri ,  Brian Karrer ,  Ismail Onur Filiz ,  Birce Tezel ,  Nicolas Emilio Stier Moses ,  Vishakan Ponnampalam ,  Timothy Eric Danford

IPC: H04W16/18 ,  H04L12/761

Abstract: In one embodiment, a method includes accessing a point cloud comprising several points, wherein each point corresponds to a location on a surface of an object located in three-dimensional space; determining whether each point in the point cloud is part of a linear structure, a planar structure, or a volumetric structure; identifying a plurality of point clusters, wherein each point cluster comprises one or more points that are located within a grid segment on a two-dimensional grid derived from the three-dimensional space; determining, for each point cluster, whether the point cluster represents a vertical-linear structure or a portion of a vertical-linear structure; identifying one or more point-cluster pairs, wherein each point-cluster pair includes two point clusters corresponding to one or more vertical-linear structures within a threshold distance in the three-dimensional space; and determining, for each point-cluster pair, whether a line-of-sight exists between each point-cluster in the point-cluster pair.

公开(公告)号：US09558422B2

公开(公告)日：2017-01-31

申请号：US15004656

申请日：2016-01-22

Applicant: Facebook, Inc.

Inventor： Apostolos Lerios ,  Dirk John Stoop ,  Ryan Mack ,  Lubomir Dimitrov Bourdev ,  Balmanohar Paluri

IPC: G06K9/00 ,  G06K9/46 ,  G06T9/00 ,  H04N19/60 ,  G06K9/62 ,  H04N19/172 ,  H04N19/12 ,  H04N19/136 ,  H04N19/27 ,  H04N19/85 ,  H04N19/40

CPC classification number: G06K9/4652 ,  G06K9/4604 ,  G06K9/4642 ,  G06K9/6202 ,  G06K9/6267 ,  G06T9/00 ,  H04N19/12 ,  H04N19/136 ,  H04N19/172 ,  H04N19/27 ,  H04N19/40 ,  H04N19/60 ,  H04N19/85 ,  H04N19/86

Abstract: The techniques introduced here include a system and method for transcoding multimedia content based on the results of content analysis. The determination of specific transcoding parameters, used for transcoding multimedia content, can be performed by utilizing the results of content analysis of the multimedia content. One of the results of the content analysis is the determination of image type of any images included in the multimedia content. The content analysis uses one or more of several techniques, including analyzing content metadata, examining colors of contiguous pixels in the content, using histogram analysis, using compression distortion analysis, analyzing image edges, or examining user provided inputs. Transcoding the multimedia content can include adapting the content to the constraints in delivery and display, processing and storage of user computing devices.

Abstract translation: 这里介绍的技术包括基于内容分析结果对多媒体内容进行代码转换的系统和方法。 可以通过利用多媒体内容的内容分析结果来执行用于代码转换多媒体内容的特定代码转换参数的确定。 内容分析的结果之一是确定包含在多媒体内容中的任何图像的图像类型。 内容分析使用几种技术中的一种或多种，​​包括分析内容元数据，使用直方图分析，使用压缩失真分析，分析图像边缘或检查用户提供的输入来检查内容中连续像素的颜色。 多媒体内容的转码可以包括使内容适应于用户计算设备的传送和显示，处理和存储中的约束。

公开(公告)号：US10249044B2

公开(公告)日：2019-04-02

申请号：US15395512

申请日：2016-12-30

Applicant: Facebook, Inc.

Inventor： Vincent Charles Cheung ,  Connie Yeewei Ho ,  Balmanohar Paluri

IPC: G06T7/11 ,  G06F3/16 ,  G06K9/00 ,  G06K9/32 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/01

Abstract: In one embodiment, a method includes detecting one or more objects in an image, generating at least one mask for each of the detected objects, wherein each of the masks is defined by a perimeter, classifying the detected objects, receiving gesture input in relation to the image, determining whether one or more locations associated with the gesture input correlate with any of the masks, and providing feedback regarding the image in response to the gesture input. Each of the masks may include data identifying the corresponding detected object, and the perimeter of each mask may correspond to a perimeter of the corresponding detected object. The perimeter of the corresponding detected object may separate the detected object from one or more portions of the image that are distinct from the detected object.

公开(公告)号：US20180189598A1

公开(公告)日：2018-07-05

申请号：US15395512

申请日：2016-12-30

Applicant: Facebook, Inc.

Inventor： Vincent Charles Cheung ,  Connie Yeewei Ho ,  Balmanohar Paluri

IPC: G06K9/46 ,  G06F3/0488 ,  G06F3/16 ,  G06T7/11

CPC classification number: G06T7/11 ,  G06F3/017 ,  G06F3/04815 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/167 ,  G06K9/00671 ,  G06K9/3233

Abstract: In one embodiment, a method includes detecting one or more objects in an image, generating at least one mask for each of the detected objects, wherein each of the masks is defined by a perimeter, classifying the detected objects, receiving gesture input in relation to the image, determining whether one or more locations associated with the gesture input correlate with any of the masks, and providing feedback regarding the image in response to the gesture input. Each of the masks may include data identifying the corresponding detected object, and the perimeter of each mask may correspond to a perimeter of the corresponding detected object. The perimeter of the corresponding detected object may separate the detected object from one or more portions of the image that are distinct from the detected object.

公开(公告)号：US20170132510A1

公开(公告)日：2017-05-11

申请号：US14981413

申请日：2015-12-28

Applicant: Facebook, Inc.

Inventor： Balmanohar Paluri ,  Oren Rippel ,  Piotr Dollar ,  Lubomir Dimitrov Bourdev

IPC: G06N3/08 ,  H04L29/08

CPC classification number: G06N3/08 ,  G06N3/0454 ,  H04L67/10 ,  H04L67/1097

Abstract: In one embodiment, a method may include receiving a first content item. A first embedding of the first content item may be determined and may corresponds to a first point in an embedding space. The embedding space may include a plurality of second points corresponding to a plurality of second embeddings of second content items. The embeddings are determined using a deep-learning model. The points are located in one or more clusters in the embedding space, which are each associated with a class of content items. Locations of points within clusters may be based on one or more attributes of the respective corresponding content items. Second content items that are similar to the first content item may be identified based on the locations of the first point and the second points and on particular clusters that the second points corresponding to the identified second content items are located in.

公开(公告)号：US20170091576A1

公开(公告)日：2017-03-30

申请号：US15376589

申请日：2016-12-12

Applicant: Facebook, Inc.

Inventor： Apostolos Lerios ,  Dirk John Stoop ,  Ryan Mack ,  Lubomir Dimitrov Bourdev ,  Balmanohar Paluri

IPC: G06K9/46 ,  G06T9/00 ,  H04N19/86 ,  H04N19/40

CPC classification number: G06K9/4652 ,  G06K9/4604 ,  G06K9/4642 ,  G06K9/6202 ,  G06K9/6267 ,  G06T9/00 ,  H04N19/12 ,  H04N19/136 ,  H04N19/172 ,  H04N19/27 ,  H04N19/40 ,  H04N19/60 ,  H04N19/85 ,  H04N19/86

Abstract: The techniques introduced here include a system and method for transcoding multimedia content based on the results of content analysis. The determination of specific transcoding parameters, used for transcoding multimedia content, can be performed by utilizing the results of content analysis of the multimedia content. One of the results of the content analysis is the determination of image type of any images included in the multimedia content. The content analysis uses one or more of several techniques, including analyzing content metadata, examining colors of contiguous pixels in the content, using histogram analysis, using compression distortion analysis, analyzing image edges, or examining user provided inputs. Transcoding the multimedia content can include adapting the content to the constraints in delivery and display, processing and storage of user computing devices.

公开(公告)号：US09280723B2

公开(公告)日：2016-03-08

申请号：US14526190

申请日：2014-10-28

Applicant: Facebook, Inc.

Inventor： Apostolos Lerios ,  Dirk Stoop ,  Ryan Mack ,  Lubomir Dimitrov Bourdev ,  Balmanohar Paluri

IPC: G06K9/36 ,  G06K9/62 ,  G06T9/00 ,  H04N19/60 ,  G06K9/46 ,  H04N19/172 ,  H04N19/12 ,  H04N19/136 ,  H04N19/27 ,  H04N19/85 ,  H04N19/40

CPC classification number: G06K9/4652 ,  G06K9/4604 ,  G06K9/4642 ,  G06K9/6202 ,  G06K9/6267 ,  G06T9/00 ,  H04N19/12 ,  H04N19/136 ,  H04N19/172 ,  H04N19/27 ,  H04N19/40 ,  H04N19/60 ,  H04N19/85 ,  H04N19/86

Abstract: The techniques introduced here include a system and method for transcoding multimedia content based on the results of content analysis. The determination of specific transcoding parameters, used for transcoding multimedia content, can be performed by utilizing the results of content analysis of the multimedia content. One of the results of the content analysis is the determination of image type of any images included in the multimedia content. The content analysis uses one or more of several techniques, including analyzing content metadata, examining colors of contiguous pixels in the content, using histogram analysis, using compression distortion analysis, analyzing image edges, or examining user provided inputs. Transcoding the multimedia content can include adapting the content to the constraints in delivery and display, processing and storage of user computing devices.

Abstract translation: 这里介绍的技术包括基于内容分析结果对多媒体内容进行代码转换的系统和方法。 可以通过利用多媒体内容的内容分析结果来执行用于代码转换多媒体内容的特定代码转换参数的确定。 内容分析的结果之一是确定包含在多媒体内容中的任何图像的图像类型。 内容分析使用几种技术中的一种或多种，​​包括分析内容元数据，使用直方图分析，使用压缩失真分析，分析图像边缘或检查用户提供的输入来检查内容中连续像素的颜色。 多媒体内容的转码可以包括使内容适应于用户计算设备的传送和显示，处理和存储中的约束。

公开(公告)号：US20150110394A1

公开(公告)日：2015-04-23

申请号：US14526190

申请日：2014-10-28

Applicant: Facebook, Inc.

Inventor： Apostolos Lerios ,  Dirk Stoop ,  Ryan Mack ,  Lubomir Dimitrov Bourdev ,  Balmanohar Paluri

IPC: G06K9/62 ,  H04N19/60 ,  G06K9/46

CPC classification number: G06K9/4652 ,  G06K9/4604 ,  G06K9/4642 ,  G06K9/6202 ,  G06K9/6267 ,  G06T9/00 ,  H04N19/12 ,  H04N19/136 ,  H04N19/172 ,  H04N19/27 ,  H04N19/40 ,  H04N19/60 ,  H04N19/85 ,  H04N19/86

Abstract: The techniques introduced here include a system and method for transcoding multimedia content based on the results of content analysis. The determination of specific transcoding parameters, used for transcoding multimedia content, can be performed by utilizing the results of content analysis of the multimedia content. One of the results of the content analysis is the determination of image type of any images included in the multimedia content. The content analysis uses one or more of several techniques, including analyzing content metadata, examining colors of contiguous pixels in the content, using histogram analysis, using compression distortion analysis, analyzing image edges, or examining user provided inputs. Transcoding the multimedia content can include adapting the content to the constraints in delivery and display, processing and storage of user computing devices.

Abstract translation: 这里介绍的技术包括基于内容分析结果对多媒体内容进行代码转换的系统和方法。 可以通过利用多媒体内容的内容分析结果来执行用于代码转换多媒体内容的特定代码转换参数的确定。 内容分析的结果之一是确定包含在多媒体内容中的任何图像的图像类型。 内容分析使用几种技术中的一种或多种，​​包括分析内容元数据，使用直方图分析，使用压缩失真分析，分析图像边缘或检查用户提供的输入来检查内容中连续像素的颜色。 多媒体内容的转码可以包括使内容适应于用户计算设备的传送和显示，处理和存储中的约束。

公开(公告)号：US10825181B2

公开(公告)日：2020-11-03

申请号：US16369750

申请日：2019-03-29

Applicant: Facebook, Inc.

Inventor： Vincent Charles Cheung ,  Connie Yeewei Ho ,  Balmanohar Paluri

IPC: G06T7/11 ,  G06F3/16 ,  G06K9/00 ,  G06K9/32 ,  G06F3/0481 ,  G06F3/0484 ,  G06F3/01

Abstract: In one embodiment, a method includes detecting one or more objects in an image, generating at least one mask for each of the detected objects, wherein each of the masks is defined by a perimeter, classifying the detected objects, receiving gesture input in relation to the image, determining whether one or more locations associated with the gesture input correlate with any of the masks, and providing feedback regarding the image in response to the gesture input. Each of the masks may include data identifying the corresponding detected object, and the perimeter of each mask may correspond to a perimeter of the corresponding detected object. The perimeter of the corresponding detected object may separate the detected object from one or more portions of the image that are distinct from the detected object.