-
公开(公告)号:US10565729B2
公开(公告)日:2020-02-18
申请号:US15971997
申请日:2018-05-04
Applicant: Facebook, Inc.
Inventor: Peter Vajda , Peizhao Zhang , Fei Yang , Yanghan Wang
Abstract: In one embodiment, a method includes a system accessing an image and generating a feature map using a first neural network. The system identifies a plurality of regions of interest in the feature map. A plurality of regional feature maps may be generated for the plurality of regions of interest, respectively. Using a second neural network, the system may detect at least one regional feature map in the plurality of regional feature maps that corresponds to a person depicted in the image, and generate a target region definition associated with a location of the person using the regional feature map. Based on the target region definition associated with the location of the person, a target regional feature map may be generated by sampling the feature map for the image. The system may process the target regional feature map to generate a keypoint mask and an instance segmentation mask.
-
公开(公告)号:US10257501B2
公开(公告)日:2019-04-09
申请号:US15096169
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
IPC: G06T3/40 , G06T19/00 , H04N13/282 , H04N13/257 , H04N13/128 , H04N13/156 , H04N13/243 , H04N13/111 , H04N5/247 , H04N13/239 , G06T7/207 , G06T7/269 , G06T5/50 , G06T7/33 , G06T7/246
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US11210854B2
公开(公告)日:2021-12-28
申请号:US15849620
申请日:2017-12-20
Applicant: Facebook, Inc.
Inventor: John Samuel Barnett , Dantley Davis , Congxi Lu , Jonathan Morton , Peter Vajda , Joshua Charles Harris
IPC: G06Q30/00 , G06T19/00 , G06T7/70 , G06K9/66 , G06Q50/00 , G06N20/00 , G06K9/00 , G06K9/62 , G06Q30/02 , G06T15/20
Abstract: Systems, methods, and non-transitory computer readable media can determine a placement in a camera view for displaying an augmented reality (AR) advertisement, where the camera view is associated with a computing device. An AR advertisement for a user associated with the computing device can be determined based on attributes associated with the user. Display of the AR advertisement can be caused at the determined placement in the camera view.
-
公开(公告)号:US10586350B2
公开(公告)日:2020-03-10
申请号:US15972035
申请日:2018-05-04
Applicant: Facebook, Inc.
Inventor: Peter Vajda , Peizhao Zhang , Fei Yang , Yanghan Wang
Abstract: In one embodiment, a system accesses pose probability models for predetermined parts of a body depicted in an image. Each of the pose probability models is configured for determining a probability of the associated predetermined body part being at a location in the image. The system determines a candidate pose that is defined by a set of coordinates representing candidate locations of the predetermined body parts. The system further determines a first probability score for the candidate pose based on the pose probability models and the set of coordinates of the candidate pose. A pose representation is generated for the candidate pose using a transformation model and the candidate pose. The system determines a second probability score for the pose representation based on a pose-representation probability model. The system selects the candidate pose to represent a pose of the body based on at least the first and second probability scores.
-
5.
公开(公告)号:US20190171903A1
公开(公告)日:2019-06-06
申请号:US15971930
申请日:2018-05-04
Applicant: Facebook, Inc.
Inventor: Peter Vajda , Peizhao Zhang , Fei Yang , Yanghan Wang
Abstract: In one embodiment, a system may access an image and generate a feature map for the image using a neural network. The system may identify regions of interest in the feature map. Regional feature maps may be generated for the regions of interest, respectively. Each of the regional feature maps has a first, a second, and a third dimension. The system may generate a first combined regional feature map by combining the regional feature maps. The combined regional feature map has a first, a second, and a third dimension. The system may generate a second combined regional feature map by processing the first combined regional feature map using one or more convolutional layers. The system may generate, for each of the regions of interest, information associated with an object instance based on a portion of the second combined regional feature map associated with that region of interest.
-
6.
公开(公告)号:US20190130043A1
公开(公告)日:2019-05-02
申请号:US15798179
申请日:2017-10-30
Applicant: Facebook, Inc.
Inventor: Maria Ioveva , Matthew William Canton , Peizhao Zhang , Shihang Wei , Shen Wang , Peter Vajda , Han Wang
Abstract: One general aspect includes a method, including: capturing an image of an object having a multi-part identifier displayed thereon, the multi-part identifier including a first portion and a second portion, the first portion including graphical content and the second portion including human-recognizable textual content. The method also includes based on the captured image, identifying a domain associated with the graphical content. The method also includes based on the captured image, identifying a sub-part of the domain associated with the textual content. The method also includes identifying a digital destination based on the identified domain and the identified sub-part. The method also includes performing an action based on the digital destination. Other embodiments of this aspect include corresponding computer systems, apparatus, and computer programs recorded on one or more computer storage devices, each configured to perform the actions of the methods.
-
公开(公告)号:US20180300850A1
公开(公告)日:2018-10-18
申请号:US15488424
申请日:2017-04-14
Applicant: Facebook, Inc.
Inventor: Justin Johnson , Peter Vajda , Yangqing Jia , Tommer Leyvand
Abstract: An image processing system transforms content images into the style of another reference style image. For example, the system applies a noise mask to generate noisy versions of the content images. The system then recomposes a content image in the style of a reference image by applying computer models to the noisy version of the content image, which reduces artifacts in the stylized image compared to that of a stylized image generated by applying the computer models to the original content image. When the content images are part of a video sequence, the image processing system may adjust the noise mask applied in a subsequent frame such that it tracks the movement of the client device from the current frame to the subsequent frame. This allows the system to reduce artifacts while stylizing the frames of the video in a consistent manner.
-
公开(公告)号:US10152768B2
公开(公告)日:2018-12-11
申请号:US15488424
申请日:2017-04-14
Applicant: Facebook, Inc.
Inventor: Justin Johnson , Peter Vajda , Yangqing Jia , Tommer Leyvand
Abstract: An image processing system transforms content images into the style of another reference style image. For example, the system applies a noise mask to generate noisy versions of the content images. The system then recomposes a content image in the style of a reference image by applying computer models to the noisy version of the content image, which reduces artifacts in the stylized image compared to that of a stylized image generated by applying the computer models to the original content image. When the content images are part of a video sequence, the image processing system may adjust the noise mask applied in a subsequent frame such that it tracks the movement of the client device from the current frame to the subsequent frame. This allows the system to reduce artifacts while stylizing the frames of the video in a consistent manner.
-
公开(公告)号:US10057562B2
公开(公告)日:2018-08-21
申请号:US15096165
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US20170295359A1
公开(公告)日:2017-10-12
申请号:US15096165
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
CPC classification number: H04N13/282 , G06T3/4038 , G06T7/003 , G06T7/2006 , G06T7/2066 , G06T7/207 , G06T19/006 , G06T2200/32 , G06T2207/10012 , G06T2207/10024 , H04N5/247 , H04N13/111 , H04N13/128 , H04N13/156 , H04N13/239 , H04N13/243 , H04N13/257
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
-
-
-
-
-
-
-
-