公开(公告)号：US10855964B2

公开(公告)日：2020-12-01

申请号：US16116838

申请日：2018-08-29

Applicant: Apple Inc.

Inventor： Frederic Cao ,  Touraj Tajbakhsh ,  Muge Wang

IPC: H04N9/64 ,  H04N5/232 ,  H04N9/73

Abstract: Embodiments relate to generation of hue maps for highlight recovery of an input image. An image having a plurality of color channels is obtained at a first resolution lower than a resolution of the input image. A hue for each color channel for each pixel is determined, using a pixel value for that color channel and pixel values for the plurality of color channels in the first image. Weights are determined for each pixel for each color channel, based on hues for the pixel and pixel values for the pixel in the first image. A plurality of candidate hue maps are generated, based on the weights and pixel values in the first image in a patch surrounding the pixel for the plurality of color channels.

公开(公告)号：US10692177B2

公开(公告)日：2020-06-23

申请号：US16100709

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Muge Wang ,  David R. Pope

IPC: G06T3/40 ,  G06T1/20 ,  G06T7/20 ,  G06T5/00

Abstract: Embodiments relate to a first demosaicing circuit and a second demosaicing circuit that can perform demosaicing of image data. The first demosaicing circuit processes received image data to generate a first demosaiced image for obtaining statistic information on the received image data. The second demosaicing circuit performs demosaicing of the received image data to generate a second demosaiced image. A processing circuit pipeline performs at least one of resampling, noise processing, color processing and output rescaling performed on the second demosaiced image based on the statistics information obtained from the first demosaiced image.

公开(公告)号：US20240297949A1

公开(公告)日：2024-09-05

申请号：US18117065

申请日：2023-03-03

Applicant: Apple Inc.

Inventor： Muge Wang ,  William T. Warner ,  David R. Pope

IPC: H04N1/60 ,  G06T3/00 ,  G06T3/40 ,  G06T5/00 ,  G06T7/90 ,  G06V10/56 ,  G06V10/60 ,  H04N9/69

CPC classification number: H04N1/6019 ,  G06T3/18 ,  G06T3/4007 ,  G06T5/92 ,  G06T7/90 ,  G06V10/56 ,  G06V10/60 ,  H04N9/69 ,  G06T2207/10024

Abstract: An image processing circuit for performing local tone mapping (LTM) after image warping. The image processing circuit includes a warping circuit that warps an input image to generate a warped image, and a LTM circuit coupled to the warping circuit. The LTM circuit determines an input color component value for a color component of a pixel in a version of the warped image, determines an output color component value for the color component of the pixel, based on mapping of coordinates of pixels in the warped image to coordinates of pixels in the input image, determines a gain value for the pixel as a ratio of the output color component value relative to the input color component value, and adjusts color component values for color components of the pixel using the gain value to generate adjusted color component values for the color components of the pixel in an output image.

公开(公告)号：US20200184000A1

公开(公告)日：2020-06-11

申请号：US16791926

申请日：2020-02-14

Applicant: Apple Inc.

Inventor： Suk Hwan Lim ,  Junji Sugisawa ,  Muge Wang

IPC: G06F17/15 ,  G06T5/20 ,  G06T5/00 ,  G06T1/20

Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.

公开(公告)号：US20200167889A1

公开(公告)日：2020-05-28

申请号：US16664120

申请日：2019-10-25

Applicant: Apple Inc.

Inventor： Sung Hee Park ,  Muge Wang ,  Junji Sugisawa

IPC: G06T1/20 ,  G06K9/46 ,  G06K9/00 ,  G06N3/063 ,  G06F17/15 ,  G06T5/20 ,  G06T5/00 ,  G06N3/08 ,  G06N3/04

Abstract: Embodiments relate to a configurable convolution engine that receives configuration information to perform convolution and other deep machine learning operations on streaming input data of various formats. The convolution engine may include two convolution circuits that each generate a stream of values by applying convolution kernels to input data. The stream of values may each define one or more channels of image data. A channel merge circuit combines the streams of values from each convolution circuit in accordance with a selected mode of operation. In one mode, the first and second streams from the convolution circuits are merged into an output stream having the combined channels of the first and second streams in an interleaved manner. In another mode, the first stream from the first convolution circuit is fed into the input of the second convolution circuit.

公开(公告)号：US10606918B2

公开(公告)日：2020-03-31

申请号：US16664096

申请日：2019-10-25

Applicant: Apple Inc.

Inventor： Suk Hwan Lim ,  Junji Sugisawa ,  Muge Wang

IPC: G06F17/15 ,  G06T1/20 ,  G06T5/00 ,  G06T5/20

Abstract: Embodiments of the present disclosure relate to a configurable convolution engine that receives configuration information to perform convolution or its variant operations on streaming input data of various formats. To process streaming input data, input data of multiple channels are received and stored in an input buffer circuit in an interleaved manner. Data values of the interleaved input data are retrieved and forwarded to multiplier circuits where multiplication with a corresponding filter element of a kernel is performed. Varying number of kernels with different sizes and sparsity can also be used for the convolution operations.

公开(公告)号：US20200053378A1

公开(公告)日：2020-02-13

申请号：US16100809

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Muge Wang ,  D. Amnon Silverstein

IPC: H04N19/513 ,  H04N19/176 ,  G06T5/00 ,  G06T3/00

Abstract: Embodiments of the present disclosure relate to autofocusing of images using motion vectors generated by an image signal processor of a device. An image being processed may include one or more motion detection windows associated with a motion vector as well as one or more autofocus windows. An autofocus window that follows a motion detection window by at least a threshold vertical distance may be selected, for example, to account for a period of time or latency for determining a motion vector of the motion detection window. The device may perform autofocusing by shifting location of the selected autofocus window.

公开(公告)号：US20200053377A1

公开(公告)日：2020-02-13

申请号：US16100772

申请日：2018-08-10

Applicant: Apple Inc.

Inventor： Muge Wang ,  Sheng Lin ,  Weichun Ku ,  Hsiao-Chen Chang ,  Yixiang Tao

IPC: H04N19/513 ,  H04N19/176 ,  G06T5/00 ,  H04N1/60 ,  G06T3/00

Abstract: Embodiments of the present disclosure relate to generating motion vectors. An image signal processor includes a statistics circuit and a vector correlation analysis circuit. The statistics circuit determines image statistics such as vectors representing sums of pixel values of rows or columns of blocks of an image. Additionally, the statistics circuit may mix or aggregate sums of multiple color components. The vector correlation analysis performs cross-correlation between vectors of a current image and reference vectors of a prior image to determine cross-correlation scores. The vector correlation analysis generates a motion vector by identifying shifts in horizontal and vertical directions corresponding to peak values of cross-correlation scores.

公开(公告)号：US10325342B2

公开(公告)日：2019-06-18

申请号：US15499524

申请日：2017-04-27

Applicant: Apple Inc.

Inventor： Sung Hee Park ,  Muge Wang

IPC: G06K9/62 ,  G06T1/20 ,  G06F17/15 ,  G06T5/00 ,  G06T5/20 ,  G06N3/063 ,  G06K9/00 ,  G06K9/46

Abstract: Embodiments relate to a configurable convolution engine that receives configuration information to perform convolution and other deep machine learning operations on streaming input data of various formats. The convolution engine may include two convolution circuits that each generate a stream of values by applying convolution kernels to input data. The stream of values may each define multiple channels of image data. A channel merge circuit interleaves the streams of values from the convolution circuits to generate an output stream of output values. The output stream includes the data multiple channels of each input stream arranged in an interleaved manner.

公开(公告)号：US12231782B2

公开(公告)日：2025-02-18

申请号：US18127296

申请日：2023-03-28

Applicant: Apple Inc.

Inventor： Muge Wang ,  David R Pope ,  Roberto Montagna

IPC: H04N23/88 ,  H04N23/85 ,  H04N23/86

Abstract: An image processing circuit for multi-illumination white balance with thumbnail processing. The image processing circuit determines a set of initial weights for a source pixel in a thumbnail image by determining component values for multiple color channels of the source pixel. The image processing circuit determines a set of weights for the source pixel in a weight map for the thumbnail image. Each weight in the set of weights is determined based on corresponding initial weights from the set of initial weights. Each weight in the set of weights represents an intensity level of a respective chrominance class of multiple chrominance classes for the source pixel. The image processing circuit applies the set of weights to values of the color channels of the source pixel to generate color component values of the color channels of a target pixel in a target thumbnail image.