公开(公告)号：US12231782B2

公开(公告)日：2025-02-18

申请号：US18127296

申请日：2023-03-28

Applicant: Apple Inc.

Inventor： Muge Wang ,  David R Pope ,  Roberto Montagna

IPC: H04N23/88 ,  H04N23/85 ,  H04N23/86

Abstract: An image processing circuit for multi-illumination white balance with thumbnail processing. The image processing circuit determines a set of initial weights for a source pixel in a thumbnail image by determining component values for multiple color channels of the source pixel. The image processing circuit determines a set of weights for the source pixel in a weight map for the thumbnail image. Each weight in the set of weights is determined based on corresponding initial weights from the set of initial weights. Each weight in the set of weights represents an intensity level of a respective chrominance class of multiple chrominance classes for the source pixel. The image processing circuit applies the set of weights to values of the color channels of the source pixel to generate color component values of the color channels of a target pixel in a target thumbnail image.

公开(公告)号：US11972538B2

公开(公告)日：2024-04-30

申请号：US17578127

申请日：2022-01-18

Applicant: Apple Inc.

Inventor： Sarvesh Swami ,  David R Pope ,  Sheng Lin ,  Amnon D. Silverstein

IPC: G06K9/00 ,  G06T3/4007 ,  G06T3/4015 ,  G06T5/20

CPC classification number: G06T3/4015 ,  G06T3/4007 ,  G06T5/20

Abstract: Embodiments relate to a multi-mode demosaicing circuit able to receive and demosaic image data in a different raw image formats, such as Bayer raw image format and Quad Bayer raw image format. The multi-mode demosaicing circuit demosaics Quad Bayer image data by interpolating a green channel of the image data along each of a plurality of directions, generating a gradient of the image data along each of the plurality of directions, modifying the interpolated green channels based on respective gradients to generate full-resolution green channel image data, which is combined with red and blue image data to generate the demosaiced image data. Interpolation is performed for non-green pixels based on neighboring green pixels along a specified direction, modified by a residual value based upon values of one or more nearby same-color pixels and a correlation between values of the same-color pixels and neighboring green pixels.

公开(公告)号：US11936992B2

公开(公告)日：2024-03-19

申请号：US17578055

申请日：2022-01-18

Applicant: Apple Inc.

Inventor： Sarvesh Swami ,  David R Pope ,  Sheng Lin

IPC: H04N19/00 ,  H04N9/67 ,  H04N23/80 ,  H04N23/84

CPC classification number: H04N23/843 ,  H04N9/67 ,  H04N23/80

Abstract: Embodiments relate to a multi-mode demosaicing circuit able to receive and demosaic image data in a different raw image formats, such as Bayer raw image format and Quad Bayer raw image format. The multi-mode demosaicing circuit comprises different circuitry for demosaicing different image formats that access a shared working memory. In addition, the multi-mode demosaicing circuit shares memory with a post-processing and scaling circuit configured to perform subsequent post-processing and/or scaling of the demosaiced image data, in which the operations of the post-processing and scaling circuit are modified based on the original raw image format of the demosaiced image data to use different amounts of the shared memory, to compensate for additional memory utilized by the multi-mode demosaicing circuit when demosaicing certain types of image data.

公开(公告)号：US12260511B2

公开(公告)日：2025-03-25

申请号：US17578195

申请日：2022-01-18

Applicant: Apple Inc.

Inventor： Sarvesh Swami ,  David R Pope ,  Sheng Lin

IPC: G06T3/4015 ,  G06T5/50 ,  G06T5/70

Abstract: Embodiments relate to a front-end scaler circuit configured to receive and process demosaiced image data in different modes depending on if the demosaiced image data was demosaiced from Bayer or Quad Bayer raw image data. The front-end scaler circuit shares memory with a demosaicing circuit, and is configured to perform different operations that use different amounts of the shared memory based on the original image format of the demosaiced image data being processed, to compensate for additional memory utilized by the demosaicing circuit when demosaicing certain types of image data. For example, when processing image data demosaiced from Quad Bayer image data, the front-end scaler circuit discards a portion of the chrominance component data for the received image data before performing chromatic suppression, compared to when processing image data demosaiced from Bayer image data.

公开(公告)号：US11617026B1

公开(公告)日：2023-03-28

申请号：US17592327

申请日：2022-02-03

Applicant: Apple Inc.

Inventor： Chihsin Wu ,  David R Pope ,  Sheng Lin

IPC: H04N25/611 ,  H04N23/76 ,  H04N23/84

Abstract: Embodiments relate to processing of pixels captured by a quadra image sensor. A quadra image sensor includes a plurality of pixel tiles, each having a plurality of pixels corresponding to the same color. A lens shading correction (LSC) circuit receives, for each of a plurality of colors, a set of gain tables. Each gain table corresponds to a different channel associated with the color. Each gain table includes a set of gain values, each associated with a location. The LSC circuit determines a pixel gain value for each pixel in a pixel tile and scales the pixels in the pixel tile based on the determined pixel gain values.