-
公开(公告)号:US10257501B2
公开(公告)日:2019-04-09
申请号:US15096169
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
IPC: G06T3/40 , G06T19/00 , H04N13/282 , H04N13/257 , H04N13/128 , H04N13/156 , H04N13/243 , H04N13/111 , H04N5/247 , H04N13/239 , G06T7/207 , G06T7/269 , G06T5/50 , G06T7/33 , G06T7/246
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US10200624B2
公开(公告)日:2019-02-05
申请号:US15096128
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Albert Parra Pozo , Forrest Samuel Briggs
IPC: H04N5/235 , H04N5/243 , H04N5/232 , H04N13/204 , H04N13/243 , H04N13/296
Abstract: A camera system is configured to capture, via a plurality of cameras, 360 degree image information of a local area, at least a portion of which is in stereo. The camera system determines respective exposure settings for the plurality of cameras. A minimum shutter speed and a maximum shutter speed are determined from the determined exposure settings. A set of test exposure settings is determined using the determined minimum shutter speed and maximum shutter speed. A set of test images is captured using the plurality of cameras at each test exposure setting in the set of test exposure settings. Each set of test images includes images from each of the plurality of cameras that are captured using a same respective test exposure setting. A global exposure setting is selected based on the captured sets of test images. The selected global exposure setting is applied to the plurality of cameras.
-
公开(公告)号:US10165258B2
公开(公告)日:2018-12-25
申请号:US15096167
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
IPC: H04N13/243 , H04N13/282 , H04N13/257 , H04N13/128 , H04N13/156 , G06T7/20 , G06T19/00 , H04N13/111 , G06T3/40 , G06T7/00 , H04N5/247 , H04N13/239 , G06T7/207
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US20190098287A1
公开(公告)日:2019-03-28
申请号:US16205109
申请日:2018-11-29
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Albert Parra Pozo , Forrest Samuel Briggs , Joyce Hsu
IPC: H04N13/246 , H04N13/243 , G06T7/80 , H04N5/247 , H04N13/332 , H04N17/00
Abstract: A camera calibration system jointly calibrates multiple cameras in a camera rig system. The camera calibration system obtains configuration information about the multiple cameras in the camera rig system, such as position and orientation for each camera relative to other cameras. The camera calibration system estimates calibration parameters (e.g., rotation and translation) for the multiple cameras based on the obtained configuration information. The camera calibration system receives 2D images of a test object captured by the multiple cameras and obtains known information about the test object such as location, size, texture and detailed information of visually distinguishable points of the test object. The camera calibration system then generates a 3D model of the test object based on the received 2D images and the estimated calibration parameters. The generated 3D model is evaluated in comparison with the actual test object to determine a calibration error. The calibration parameters for the cameras are updated to reduce the calibration error for the multiple cameras.
-
公开(公告)号:US20170293997A1
公开(公告)日:2017-10-12
申请号:US15096169
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
CPC classification number: H04N13/282 , G06T3/4038 , G06T5/50 , G06T7/207 , G06T7/246 , G06T7/269 , G06T7/33 , G06T19/006 , G06T2200/32 , G06T2207/10012 , G06T2207/10024 , G06T2207/20221 , H04N5/247 , H04N13/111 , H04N13/128 , H04N13/156 , H04N13/239 , H04N13/243 , H04N13/257
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US10057562B2
公开(公告)日:2018-08-21
申请号:US15096165
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US20170295359A1
公开(公告)日:2017-10-12
申请号:US15096165
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
CPC classification number: H04N13/282 , G06T3/4038 , G06T7/003 , G06T7/2006 , G06T7/2066 , G06T7/207 , G06T19/006 , G06T2200/32 , G06T2207/10012 , G06T2207/10024 , H04N5/247 , H04N13/111 , H04N13/128 , H04N13/156 , H04N13/239 , H04N13/243 , H04N13/257
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US20170295358A1
公开(公告)日:2017-10-12
申请号:US15096149
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Albert Parra Pozo , Forrest Samuel Briggs , Joyce Hsu
CPC classification number: H04N13/246 , G06T7/85 , H04N5/247 , H04N13/243 , H04N13/332 , H04N17/002
Abstract: A camera calibration system jointly calibrates multiple cameras in a camera rig system. The camera calibration system obtains configuration information about the multiple cameras in the camera rig system, such as position and orientation for each camera relative to other cameras. The camera calibration system estimates calibration parameters (e.g., rotation and translation) for the multiple cameras based on the obtained configuration information. The camera calibration system receives 2D images of a test object captured by the multiple cameras and obtains known information about the test object such as location, size, texture and detailed information of visually distinguishable points of the test object. The camera calibration system then generates a 3D model of the test object based on the received 2D images and the estimated calibration parameters. The generated 3D model is evaluated in comparison with the actual test object to determine a calibration error. The calibration parameters for the cameras are updated to reduce the calibration error for the multiple cameras.
-
公开(公告)号:US20170295354A1
公开(公告)日:2017-10-12
申请号:US15096167
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Albert Parra Pozo , Peter Vajda
CPC classification number: H04N13/282 , G06T3/4038 , G06T5/50 , G06T7/207 , G06T7/246 , G06T7/269 , G06T7/33 , G06T19/006 , G06T2200/32 , G06T2207/10012 , G06T2207/10024 , G06T2207/20221 , H04N5/247 , H04N13/111 , H04N13/128 , H04N13/156 , H04N13/239 , H04N13/243 , H04N13/257
Abstract: A canvas generation system generates a canvas view of a scene based on a set of original camera views depicting the scene, for example to recreate a scene in virtual reality. Canvas views can be generated based on a set of synthetic views generated from a set of original camera views. Synthetic views can be generated, for example, by shifting and blending relevant original camera views based on an optical flow across multiple original camera views. An optical flow can be generated using an iterative method which individually optimizes the optical flow vector for each pixel of a camera view and propagates changes in the optical flow to neighboring optical flow vectors.
-
公开(公告)号:US20170295324A1
公开(公告)日:2017-10-12
申请号:US15096140
申请日:2016-04-11
Applicant: Facebook, Inc.
Inventor: Brian Keith Cabral , Forrest Samuel Briggs , Joyce Hsu , Albert Parra Pozo , Andrew Hamilton Coward
CPC classification number: H04N5/247 , H04N5/2251 , H04N5/23206 , H04N5/23238 , H04N5/2353 , H04N13/243
Abstract: A camera system is configured to capture 360 degree image information of a local area, at least a portion of which is in stereo. The camera system includes a plurality of peripheral cameras, a plurality of axis cameras, a first rigid plate, and a second rigid plate, each aligned along an alignment axis. The peripheral cameras are arranged in a ring configuration that allows objects in the local area past a threshold distance to be within the fields of view of at least two peripheral cameras. The first and second rigid plates secure to a top and a bottom surface of the ring of peripheral cameras, respectively. At least one axis camera is arranged along the alignment axis and is coupled perpendicularly to a surface of the first rigid plate.
-
-
-
-
-
-
-
-
-