-
公开(公告)号：US20220286604A1
公开(公告)日：2022-09-08
申请号：US17195520
申请日：2021-03-08
Applicant: Apple Inc.
Inventor： David R. Pope , Liran Fishel , Assaf Metuki , Muge Wang
Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.
-
公开(公告)号：US10997736B2
公开(公告)日：2021-05-04
申请号：US16100780
申请日：2018-08-10
Applicant: Apple Inc.
Inventor： Muge Wang , Junji Sugisawa
Abstract: Embodiments relate to a normalized cross correlation (NCC) circuit that can perform a normalized cross correlation between input patch data and kernel data. An interface circuit of an image signal processor receives input patch data from a source. Input patch data is data that represents a portion of a frame of image data from the source. The NCC circuit includes a filtering circuit and a normalization circuit. The filtering circuit receives the input patch data from the interface circuit and performs a convolution on the received input patch data or processed patch data derived from the input patch data with kernel data to produce convolution output data. The normalization circuit computes a normalized score output based on the convolution output data and the kernel data. The normalized score output includes normalization scores for each location of the convolution output data.
-
公开(公告)号：US10567787B1
公开(公告)日：2020-02-18
申请号：US16100809
申请日：2018-08-10
Applicant: Apple, Inc.
Inventor： Muge Wang , D. Amnon Silverstein
IPC: H04N19/513 , G06T3/00 , G06T5/00 , H04N19/176
Abstract: Embodiments of the present disclosure relate to autofocusing of images using motion vectors generated by an image signal processor of a device. An image being processed may include one or more motion detection windows associated with a motion vector as well as one or more autofocus windows. An autofocus window that follows a motion detection window by at least a threshold vertical distance may be selected, for example, to account for a period of time or latency for determining a motion vector of the motion detection window. The device may perform autofocusing by shifting location of the selected autofocus window.
-
公开(公告)号：US20190096026A1
公开(公告)日：2019-03-28
申请号：US16203550
申请日：2018-11-28
Applicant: Apple Inc.
Inventor： Sung Hee Park , Muge Wang , Junji Sugisawa
Abstract: Embodiments relate to a configurable convolution engine that receives configuration information to perform convolution and other deep machine learning operations on streaming input data of various formats. The convolution engine may include two convolution circuits that each generate a stream of values by applying convolution kernels to input data. The stream of values may each define one or more channels of image data. A channel merge circuit combines the streams of values from each convolution circuit in accordance with a selected mode of operation. In one mode, the first and second streams from the convolution circuits are merged into an output stream having the combined channels of the first and second streams in an interleaved manner. In another mode, the first stream from the first convolution circuit is fed into the input of the second convolution circuit.
-
公开(公告)号：US10176551B2
公开(公告)日：2019-01-08
申请号：US15499543
申请日：2017-04-27
Applicant: Apple Inc.
Inventor： Sung Hee Park , Muge Wang , Junji Sugisawa
Abstract: Embodiments relate to a configurable convolution engine that receives configuration information to perform convolution and other deep machine learning operations on streaming input data of various formats. The convolution engine may include two convolution circuits that each generate a stream of values by applying convolution kernels to input data. The stream of values may each define one or more channels of image data. A channel merge circuit combines the streams of values from each convolution circuit in accordance with a selected mode of operation. In one mode, the first and second streams from the convolution circuits are merged into an output stream having the combined channels of the first and second streams in an interleaved manner. In another mode, the first stream from the first convolution circuit is fed into the input of the second convolution circuit.
-
Patent Agency Ranking
公开(公告)号：US20180315155A1
公开(公告)日：2018-11-01
申请号：US15499543
申请日：2017-04-27
Applicant: Apple Inc.
Inventor： Sung Hee Park , Muge Wang , Junji Sugisawa
CPC classification number: G06T1/20 , G06F17/153 , G06K9/00986 , G06K9/4628 , G06K9/4647 , G06N3/063 , G06T5/001 , G06T5/20
Abstract: Embodiments relate to a configurable convolution engine that receives configuration information to perform convolution and other deep machine learning operations on streaming input data of various formats. The convolution engine may include two convolution circuits that each generate a stream of values by applying convolution kernels to input data. The stream of values may each define one or more channels of image data. A channel merge circuit combines the streams of values from each convolution circuit in accordance with a selected mode of operation. In one mode, the first and second streams from the convolution circuits are merged into an output stream having the combined channels of the first and second streams in an interleaved manner. In another mode, the first stream from the first convolution circuit is fed into the input of the second convolution circuit.
-
公开(公告)号：US20180082400A1
公开(公告)日：2018-03-22
申请号：US15823292
申请日：2017-11-27
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , Junji Sugisawa , Muge Wang
CPC classification number: G06F17/153 , G06T5/001 , G06T5/20
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号：US09858636B1
公开(公告)日：2018-01-02
申请号：US15198478
申请日：2016-06-30
Applicant: Apple Inc.
Inventor： Suk Hwan Lim , Junji Sugisawa , Muge Wang
CPC classification number: G06F17/153
Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.
-
公开(公告)号：US20240334073A1
公开(公告)日：2024-10-03
申请号：US18127296
申请日：2023-03-28
Applicant: Apple Inc.
Inventor： Muge Wang , David R. Pope , Roberto Montagna
Abstract: An image processing circuit for multi-illumination white balance with thumbnail processing. The image processing circuit determines a set of initial weights for a source pixel in a thumbnail image by determining component values for multiple color channels of the source pixel. The image processing circuit determines a set of weights for the source pixel in a weight map for the thumbnail image. Each weight in the set of weights is determined based on corresponding initial weights from the set of initial weights. Each weight in the set of weights represents an intensity level of a respective chrominance class of multiple chrominance classes for the source pixel. The image processing circuit applies the set of weights to values of the color channels of the source pixel to generate color component values of the color channels of a target pixel in a target thumbnail image.
-
公开(公告)号：US11968471B2
公开(公告)日：2024-04-23
申请号：US17195520
申请日：2021-03-08
Applicant: Apple Inc.
Inventor： David R. Pope , Liran Fishel , Assaf Metuki , Muge Wang
CPC classification number: H04N5/76 , G06T1/60 , G06T7/251 , H04N1/2141 , G06T2207/20016
Abstract: Embodiments relate to extracting features from images, such as by identifying keypoints and generating keypoint descriptors of the keypoints. An apparatus includes a pyramid image generator circuit, a keypoint descriptor generator circuit, and a pyramid image buffer. The pyramid image generator circuit generates an image pyramid from an input image. The keypoint descriptor generator circuit processes the pyramid images for keypoint descriptor generation. The pyramid image buffer stores different portions of the pyramid images generated by the pyramid image generator circuit at different times and provides the stored portions of the pyramid images to the keypoint descriptor generator circuit for keypoint descriptor generation. When first portions of the pyramid images are no longer needed for the keypoint descriptor generation, the first portions are removed from the pyramid image buffer to provide space for second portions of the pyramid images that are needed for the keypoint descriptor generation.
-
-
-
-
-
-
-
-
-
Search Results
37
records
(took 0.023 seconds)
