Abstract:
Disclosed is a method and apparatus for using color measurement features at multiple scales for a Color Transfer technique. In one embodiment, the functions implemented include: resizing a ground truth image target frame to a plurality of different scales; selecting one or more color measurement features from the ground truth image target frame at each of the plurality of different scales; making a color measurement for each color measurement feature in the ground truth image target frame; and adjusting colors of a virtual object in an augmented frame based at least in part on the color measurements.
Abstract:
A mobile platform visually detects and/or tracks a target that includes a dynamically changing portion, or otherwise undesirable portion, using a feature dataset for the target that excludes the undesirable portion. The feature dataset is created by providing an image of the target and identifying the undesirable portion of the target. The identification of the undesirable portion may be automatic or by user selection. An image mask is generated for the undesirable portion. The image mask is used to exclude the undesirable portion in the creation of the feature dataset for the target. For example, the image mask may be overlaid on the image and features are extracted only from unmasked areas of the image of the target. Alternatively, features may be extracted from all areas of the image and the image mask used to remove features extracted from the undesirable portion.
Abstract:
Disclosed embodiments facilitate keypoint selection in part by assigning a similarity score to each candidate keypoint being considered for selection. The similarity score may be based on the maximum measured similarity of an image patch associated with a keypoint in relation to an image patch in a local image section in a region around the image patch. A subset of the candidate keypoints with the lowest similarity scores may be selected and used to detect and/or track objects in subsequent images and/or to determine camera pose.
Abstract:
Disclosed is a server that can perform a visual search using at least one rectified image. A method implemented at a server includes storing a plurality of images with the server, receiving at least one rectified image having at least one potential object of interest from a computing device for a visual search, and extracting descriptors representing features of the at least one rectified image. The extracted descriptors of the at least one rectified image are designed to be invariant to rotation, scale, and lighting without needing to be invariant to perspective or affine distortion.
Abstract:
Method, mobile device, computer program product and apparatus for performing a search are disclosed. The method of performing a search comprises receiving one or more images of an environment in view of a mobile device, generating a simultaneous localization and mapping of the environment using the one or more images, wherein the simultaneous localization and mapping of the environment comprises a plurality of map points representing a plurality of surfaces in a three dimensional coordinate system of the environment, sending a set of the plurality of map points as a search query to a server, receiving a query response from the server, and identifying an object in the environment based at least in part on the query response.
Abstract:
Disclosed are a system, apparatus, and method for in-situ creation of planar natural feature targets. In one embodiment, a planar target is initialized from a single first reference image one or more subsequent images are processed. In one embodiment, the planar target is tracked in six degrees of freedom upon the processing of the one or more subsequent images and a second reference image is selected from the processed one or more subsequent images. In one embodiment, upon selecting the second reference image the planar target is refined to a more accurate planar target.
Abstract:
Disclosed are a system, apparatus, and method for in-situ creation of planar natural feature targets. In one embodiment, a planar target is initialized from a single first reference image one or more subsequent images are processed. In one embodiment, the planar target is tracked in six degrees of freedom upon the processing of the one or more subsequent images and a second reference image is selected from the processed one or more subsequent images. In one embodiment, upon selecting the second reference image the planar target is refined to a more accurate planar target.
Abstract:
A method of determining a reference coordinate system includes: obtaining information indicative of a direction of gravity relative to a device; and converting an orientation of a device coordinate system using the direction of gravity relative to the device to produce the reference coordinate system. The method may also include setting an origin of the reference coordinate system and/or determining a scale value of the reference coordinate system. The method may also include refining the reference coordinate system.
Abstract:
Disclosed are a system, apparatus, and method for rolling shutter compensation. An image having a plurality of scanlines captured at different times may be received from a rolling shutter camera where each scanline includes a plurality of 2D pixels, and where each scanline has an associated camera pose. One or more 2D pixels in a first scanline of the received image to 3D coordinates may be unprojected and the 3D coordinates may be transformed from the first scanline to a reference pose. The transformed 3D coordinates may be reprojected, and in response to the reprojecting, reference timeframe corrected 2D coordinates for the one or more 2D pixels in the first scanline may be provided.
Abstract:
Embodiments disclosed facilitate resource utilization efficiencies in Mobile Stations (MS) during 3D reconstruction. In some embodiments, camera pose information for a first color image captured by a camera on an MS may be obtained and a determination may be made whether to extend or update a first 3-Dimensional (3D) model of an environment being modeled by the MS based, in part, on the first color image and associated camera pose information. The depth sensor, which provides depth information for images captured by the camera, may be disabled, when the first 3D model is not extended or updated.