Abstract:
Disclosed are a system, apparatus, and method for depth camera image re-mapping. A depth camera image from a depth camera may be received and a depth camera's physical position may be determined. The depth camera's physical position may be determined relative to an other physical position, such as the physical position of a color camera. The depth camera image may be transformed according to a processing order associated with the other physical position.
Abstract:
One disclosed example method for view independent color equalized 3D scene texturing includes capturing a plurality of keyframes of an object; accessing a 3D representation of the object comprising a surface mesh model for the object, the surface mesh model comprising a plurality of polygons; for each polygon, assigning one of the plurality of keyframes to the polygon based on one or more image quality characteristics associated with a portion of the keyframe corresponding to the polygon; reducing a number of assigned keyframes by changing associations between assigned keyframes; and for each polygon of the surface mesh model having an assigned keyframe: equalizing a texture color of at least a portion of the polygon based at least in part on one or more image quality characteristics of the plurality of keyframes associated with the polygon; and assigning the equalized texture color to the 3D representation of the object.
Abstract:
A system and method is described herein for solving for surface normals of objects in the scene observed in a video stream. The system and method may include sampling the video stream to generate a set of keyframes; generating hypothesis surface normals for a set of mappoints in each of the keyframes; warping patches of corresponding mappoints in a first keyframe to the viewpoint of a second keyframe with a warping matrix computed from each of the hypothesis surface normals; scoring warping errors between each hypothesis surface normal in the two keyframes; and discarding hypothesis surface normals with high warping errors between the first and second keyframes.
Abstract:
Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.
Abstract:
Disclosed are a system, apparatus, and method for in-situ creation of planar natural feature targets. In one embodiment, a planar target is initialized from a single first reference image one or more subsequent images are processed. In one embodiment, the planar target is tracked in six degrees of freedom upon the processing of the one or more subsequent images and a second reference image is selected from the processed one or more subsequent images. In one embodiment, upon selecting the second reference image the planar target is refined to a more accurate planar target.
Abstract:
Embodiments disclosed pertain to systems, method s and apparatus for the initialization of Computer Vision (CV) applications on user devices (UDs) comprising a camera and a display. In some embodiments, an optimal camera trajectory for initialization of a Computer Vision (CV) application may be determined based on an initial camera pose and an estimated pivot distance. For example, the initial camera pose may be estimated based on a first image captured by the camera. Further, the display may be updated in real-time with an indication of a desired movement direction for the camera. In some embodiments, the indication of desired movement direction may be based, in part, on a current camera pose and the optimal trajectory, where the current camera pose may be estimated based on a current image captured by the camera.
Abstract:
Disclosed are a system, apparatus, and method for depth and color camera image synchronization. Depth and color camera input images are received or otherwise obtained unsynchronized and without associated creation timestamps. An image of one type is compared with an image of a different type to determine a match for synchronization. Matches may be determined according to edge detection or depth coordinate detection. When a match is determined a synchronized pair is formed for processing within an augmented reality output. Optionally the synchronized pair may be transformed to improve the match between the image pair.
Abstract:
Disclosed is a server that can perform a visual search using at least one rectified image. A method implemented at a server includes storing a plurality of images with the server, receiving at least one rectified image having at least one potential object of interest from a computing device for a visual search, and extracting descriptors representing features of the at least one rectified image. The extracted descriptors of the at least one rectified image are designed to be invariant to rotation, scale, and lighting without needing to be invariant to perspective or affine distortion.
Abstract:
Disclosed embodiments facilitate keypoint selection in part by assigning a similarity score to each candidate keypoint being considered for selection. The similarity score may be based on the maximum measured similarity of an image patch associated with a keypoint in relation to an image patch in a local image section in a region around the image patch. A subset of the candidate keypoints with the lowest similarity scores may be selected and used to detect and/or track objects in subsequent images and/or to determine camera pose.
Abstract:
Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.