-
公开(公告)号:US11475534B2
公开(公告)日:2022-10-18
申请号:US17080693
申请日:2020-10-26
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
公开(公告)号:US11195253B2
公开(公告)日:2021-12-07
申请号:US16871762
申请日:2020-05-11
Applicant: GoPro, Inc.
Inventor: Joseph Steel , Timothy Macmillan
IPC: G06T3/00
Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
-
公开(公告)号:US20210042876A1
公开(公告)日:2021-02-11
申请号:US17080693
申请日:2020-10-26
Applicant: GoPro, Inc
Inventor: Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
公开(公告)号:US10339627B2
公开(公告)日:2019-07-02
申请号:US15289851
申请日:2016-10-10
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
公开(公告)号:US20180198989A1
公开(公告)日:2018-07-12
申请号:US15863638
申请日:2018-01-05
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Balineedu Chowdary Adsumilli
CPC classification number: H04N5/247 , H04N5/23229 , H04N5/23238 , H04N5/265
Abstract: A phased camera array captures images from a plurality of image sensor assemblies, each image sensor assembly capturing at a framerate and a resolution. The phased camera array is configured to generate images captured from the independent image sensor assemblies to be stitched into a single composite image with a higher resolution than the independent images. The higher resolution composite images can then be phased together to generate a video with a higher framerate than what the independent images were captured at. The image sensor assemblies of the camera system are positioned in such a way to minimize the footprint of the camera system and minimize negative effects from image stitching and video phasing.
-
6.
公开(公告)号:US20180101931A1
公开(公告)日:2018-04-12
申请号:US15289851
申请日:2016-10-10
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
CPC classification number: G06T3/005 , G06T3/0062 , G06T3/0068 , G06T3/4038 , H04N5/2258 , H04N5/23238
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
7.
公开(公告)号:US20180027226A1
公开(公告)日:2018-01-25
申请号:US15654617
申请日:2017-07-19
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy Macmillan
Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.
-
公开(公告)号:US20170366896A1
公开(公告)日:2017-12-21
申请号:US15187695
申请日:2016-06-20
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04R1/406 , G01S3/7864 , G11B27/10 , H04R3/005 , H04S3/008 , H04S2400/11 , H04S2400/15
Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.
-
公开(公告)号:US09832397B2
公开(公告)日:2017-11-28
申请号:US15262159
申请日:2016-09-12
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Scott Patrick Campbell
IPC: H04N5/225 , H04N5/262 , H04N5/341 , H04N5/232 , H04N5/247 , G06T3/00 , G06T3/40 , G06T5/00 , G06T5/50 , G06T7/33
CPC classification number: H04N5/3415 , G06T3/0068 , G06T3/0093 , G06T3/4038 , G06T5/006 , G06T5/50 , G06T7/344 , G06T2207/10004 , G06T2207/20128 , G06T2207/20221 , G06T2210/22 , H04N5/2252 , H04N5/2253 , H04N5/2257 , H04N5/2258 , H04N5/23216 , H04N5/23229 , H04N5/23232 , H04N5/23238 , H04N5/247 , H04N5/2624 , H04N5/2628
Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
-
公开(公告)号:US20170111626A1
公开(公告)日:2017-04-20
申请号:US15396295
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04N5/3415 , G01B2210/52 , G03G15/36 , G06T5/008 , G06T2207/20208 , H04N5/23238 , H04N5/247 , H04N5/265 , H04N5/355 , H04N9/646 , H04N9/77
Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.
-
-
-
-
-
-
-
-
-