-
公开(公告)号:US11810266B2
公开(公告)日:2023-11-07
申请号:US17206852
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: Muge Wang , Assaf Metuki
CPC classification number: G06T3/4038 , G06T3/4069 , G06T7/90 , G06T15/005
Abstract: Embodiments relate to generating keypoint descriptors of the keypoints using a sub-scale refinement and a sample pattern radius adjustment. An apparatus includes a sub-pixel refiner circuit and a keypoint descriptor generator circuit. The sub-pixel refiner circuit determines a keypoint scale value for a scale dimension of a keypoint in an image pyramid by performing an interpolation of response map (RM) pixel values of a pixel block of RM images defined around the keypoint. The keypoint descriptor generator circuit determines sample scales of the image pyramid based on the keypoint scale value and determines a radius value for each sample scale based on the keypoint scale value. The keypoint descriptor generator circuit samples patches of pixel values at the sample scales using the radius value for each sample scale to generate a keypoint descriptor of the keypoint.
-
公开(公告)号:US20220301104A1
公开(公告)日:2022-09-22
申请号:US17206852
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: Muge Wang , Assaf Metuki
Abstract: Embodiments relate to generating keypoint descriptors of the keypoints using a sub-scale refinement and a sample pattern radius adjustment. An apparatus includes a sub-pixel refiner circuit and a keypoint descriptor generator circuit. The sub-pixel refiner circuit determines a keypoint scale value for a scale dimension of a keypoint in an image pyramid by performing an interpolation of response map (RM) pixel values of a pixel block of RM images defined around the keypoint. The keypoint descriptor generator circuit determines sample scales of the image pyramid based on the keypoint scale value and determines a radius value for each sample scale based on the keypoint scale value. The keypoint descriptor generator circuit samples patches of pixel values at the sample scales using the radius value for each sample scale to generate a keypoint descriptor of the keypoint.
-
公开(公告)号:US20220086485A1
公开(公告)日:2022-03-17
申请号:US17020750
申请日:2020-09-14
Applicant: Apple Inc.
Inventor: Guy Côté , Athanasios Leontaris , Muge Wang
IPC: H04N19/59 , H04N19/103 , H04N19/136 , H04N19/517 , H04N19/182
Abstract: Systems and methods for improving operational efficiency of a video encoding system used to encode image data are provided. In embodiments, a video encoding system includes image processing circuitry configured to receive source image data and derive full-resolution image data and low-resolution image data from the source image data. The video encoding system also includes a low resolution pipeline configured to receive the low-resolution image data and determine one or more low resolution inter prediction modes based on the low-resolution image data. Furthermore, the video encoding system includes a main pipeline configured to encode the full-resolution image data based on the one or more low resolution inter prediction modes.
-
公开(公告)号:US11082606B1
公开(公告)日:2021-08-03
申请号:US16127436
申请日:2018-09-11
Applicant: Apple Inc.
Inventor: Mark N. Gamadia , Yingjun Bai , Muge Wang
Abstract: Determining a focus setting includes determining a plurality of regions of interest in a view of a scene, and, for each of the plurality of regions of interest, obtaining a set of image data for each of multiple focal positions, and then applying focus filters to the set of image data for each of the plurality of focal positions for each of the regions of interest to obtain a set of focus scores, i.e., a focus score for each focus filter applied to the set of image data for each of the focal positions. Further, determining a confidence value associated with each of the sets of focus scores, selecting a subset of the sets of focus scores based on the confidence values associated with each of the sets of focus scores, and determining a focus setting for the scene based on the selected subset of the focus scores.
-
公开(公告)号:US10747843B2
公开(公告)日:2020-08-18
申请号:US16791926
申请日:2020-02-14
Applicant: Apple Inc.
Inventor: Suk Hwan Lim , Junji Sugisawa , Muge Wang
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号:US20200051210A1
公开(公告)日:2020-02-13
申请号:US16100709
申请日:2018-08-10
Applicant: Apple Inc.
Inventor: Muge Wang , David R. Pope
Abstract: Embodiments relate to a first demosaicing circuit and a second demosaicing circuit that can perform demosaicing of image data. The first demosaicing circuit processes received image data to generate a first demosaiced image for obtaining statistic information on the received image data. The second demosaicing circuit performs demosaicing of the received image data to generate a second demosaiced image. A processing circuit pipeline performs at least one of resampling, noise processing, color processing and output rescaling performed on the second demosaiced image based on the statistics information obtained from the first demosaiced image.
-
公开(公告)号:US10547863B1
公开(公告)日:2020-01-28
申请号:US16100772
申请日:2018-08-10
Applicant: Apple Inc.
Inventor: Muge Wang , Sheng Lin , Weichun Ku , Hsiao-Chen Chang , Yixiang Tao
IPC: H04N19/513 , H04N19/176 , G06T3/00 , H04N1/60 , G06T5/00
Abstract: Embodiments of the present disclosure relate to generating motion vectors. An image signal processor includes a statistics circuit and a vector correlation analysis circuit. The statistics circuit determines image statistics such as vectors representing sums of pixel values of rows or columns of blocks of an image. Additionally, the statistics circuit may mix or aggregate sums of multiple color components. The vector correlation analysis performs cross-correlation between vectors of a current image and reference vectors of a prior image to determine cross-correlation scores. The vector correlation analysis generates a motion vector by identifying shifts in horizontal and vertical directions corresponding to peak values of cross-correlation scores.
-
公开(公告)号:US20240292114A1
公开(公告)日:2024-08-29
申请号:US18114602
申请日:2023-02-27
Applicant: Apple Inc.
Inventor: Muge Wang
IPC: H04N23/88 , H04N23/71 , H04N23/76 , H04N25/703
CPC classification number: H04N23/88 , H04N23/71 , H04N23/76 , H04N25/703 , H04N25/61
Abstract: Embodiments relate to identifying locations in an image where a green ghost is likely to occur by processing a raw version of the image. A block of pixels in the raw image is extracted and then each pixel value in the block is compared with a threshold value of a corresponding color channel. The compared results are then processed to generate bright light information for the block, indicating whether the green ghost is likely to be present at a location of the image diagonally opposed to the location of the block in the image relative to an optical center of an image sensor. By processing the raw image without subsequent processing prone to introducing artifacts and creating false positive, a likely location of the green orb or green ghost may be more accurately identified.
-
公开(公告)号:US11494880B2
公开(公告)日:2022-11-08
申请号:US17206772
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: David R. Pope , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to generating an image pyramid for feature extraction. A pyramid image generator circuit includes a first image buffer that stores image data at a first octave, a first blur filter circuit, a first spatial filter circuit, and a first decimator circuit. The first blur filter circuit generates a first pyramid image for a first scale of the first octave by applying a first amount of smoothing to the first image data stored in the first image buffer. The first spatial filter circuit and the first decimator generate second image data of a second octave that is higher than the first octave by applying a smoothing and a decimation to the first image data stored in the first image buffer. The first spatial filter circuit begins processing the first image data before the first blur filter circuit begins to process the first image data.
-
公开(公告)号:US20220301110A1
公开(公告)日:2022-09-22
申请号:US17206772
申请日:2021-03-19
Applicant: Apple Inc.
Inventor: David R. Pope , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to generating an image pyramid for feature extraction. A pyramid image generator circuit includes a first image buffer that stores image data at a first octave, a first blur filter circuit, a first spatial filter circuit, and a first decimator circuit. The first blur filter circuit generates a first pyramid image for a first scale of the first octave by applying a first amount of smoothing to the first image data stored in the first image buffer. The first spatial filter circuit and the first decimator generate second image data of a second octave that is higher than the first octave by applying a smoothing and a decimation to the first image data stored in the first image buffer. The first spatial filter circuit begins processing the first image data before the first blur filter circuit begins to process the first image data.
-
-
-
-
-
-
-
-
-