FOVEATED DOWN SAMPLING OF IMAGE DATA
    1.
    发明公开

    公开(公告)号:US20240031540A1

    公开(公告)日:2024-01-25

    申请号:US17870456

    申请日:2022-07-21

    Applicant: Apple Inc.

    CPC classification number: H04N9/64 G06T3/40

    Abstract: A foveated down sampling (FDS) circuit for down sampling of pixels in images. The FDS circuit down samples a first subset of pixels of a same color in an image using first scaling factors to generate first down sampled pixels in a first down sampled version of the image. The FDS circuit further down samples a second subset of the first down sampled pixels of the same color using second scaling factors to generate second down sampled pixels of the same color in a second down sampled version of the image. Pixels from the first subset are arranged in a first direction, and pixels from the second subset are arranged in a second direction.

    Image fusion architecture
    2.
    发明授权

    公开(公告)号:US10853927B2

    公开(公告)日:2020-12-01

    申请号:US16358094

    申请日:2019-03-19

    Applicant: Apple Inc.

    Abstract: Embodiments relate to circuitry for performing fusion of two images captured with two different exposure times to generate a fused image having a higher dynamic range. Information about first keypoints is extracted from the first image by processing pixel values of pixels in the first image. A model describing correspondence between the first image and the second image is then built by processing at least the information about first keypoints. A processed version of the first image is warped using mapping information in the model to generate a warped version of the first image spatially more aligned to the second image than to the first image. The warped version of the first image is fused with a processed version of the second image to generate the fused image.

    IMAGE FUSION ARCHITECTURE
    3.
    发明申请

    公开(公告)号:US20200302582A1

    公开(公告)日:2020-09-24

    申请号:US16358094

    申请日:2019-03-19

    Applicant: Apple Inc.

    Abstract: Embodiments relate to circuitry for performing fusion of two images captured with two different exposure times to generate a fused image having a higher dynamic range. Information about first keypoints is extracted from the first image by processing pixel values of pixels in the first image. A model describing correspondence between the first image and the second image is then built by processing at least the information about first keypoints. A processed version of the first image is warped using mapping information in the model to generate a warped version of the first image spatially more aligned to the second image than to the first image. The warped version of the first image is fused with a processed version of the second image to generate the fused image.

    CIRCUIT FOR PERFORMING OPTICAL IMAGE STABILIZATION BEFORE LENS SHADING CORRECTION

    公开(公告)号:US20240284062A1

    公开(公告)日:2024-08-22

    申请号:US18112808

    申请日:2023-02-22

    Applicant: Apple Inc.

    Inventor: Chihsin Wu

    CPC classification number: H04N25/61 G06T3/4007 H04N5/52

    Abstract: An image processing circuit for performing optical image stabilization before lens shading correction. The image processing circuit determines, for each row of pixels in an image captured through an image sensor receiving light through a lens having an optical center with a first offset along a first direction and a second offset along a second direction orthogonal to the first direction, a first grid offset along the first direction using the first offset and a coordinate of that row of pixels along the second direction. The image processing circuit determines, for each row of pixels in the image, a second grid offset along the second direction using the second offset and the coordinate of that row of pixels along the second direction. The image processing circuit generates an adjusted grid for the pixels of the image using the first grid offset and the second grid offset.

    HUE PRESERVATION POST PROCESSING WITH EARLY EXIT FOR HIGHLIGHT RECOVERY

    公开(公告)号:US20210342989A1

    公开(公告)日:2021-11-04

    申请号:US17373362

    申请日:2021-07-12

    Applicant: Apple Inc.

    Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

    HUE PRESERVATION POST PROCESSING FOR HIGHLIGHT RECOVERY

    公开(公告)号:US20200074601A1

    公开(公告)日:2020-03-05

    申请号:US16121389

    申请日:2018-09-04

    Applicant: Apple Inc.

    Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

    CIRCUIT FOR COMBINED DOWN SAMPLING AND CORRECTION OF IMAGE DATA

    公开(公告)号:US20220215506A1

    公开(公告)日:2022-07-07

    申请号:US17143995

    申请日:2021-01-07

    Applicant: Apple Inc.

    Abstract: A foveated down sampling and correction (FDS-C) circuit for combined down sampling and correction of chromatic aberrations in images. The FDS-C circuit performs down sampling and interpolation of pixel values of a first subset of pixels of a color in a raw image using down sampling scale factors and first interpolation coefficients to generate first corrected pixel values for pixels of the color in a first corrected version of the raw image. The FDS-C circuit further performs interpolation of pixel values of a second subset of the pixels in the first corrected version using second interpolation coefficients to generate second corrected pixel values for pixels of the color in a second corrected version of the raw image. Pixels in the first subset are arranged in a first direction, pixels in the second subset are arranged in a second direction, and the down sampling scale factors vary along the first direction.

    Hue preservation post processing for highlight recovery

    公开(公告)号:US11100620B2

    公开(公告)日:2021-08-24

    申请号:US16121389

    申请日:2018-09-04

    Applicant: Apple Inc.

    Abstract: Embodiments relate to hue preservation post processing for highlight recovery of an input image. Intensity values for multiple color channels of a plurality of color channels of a pixel of the input image is determined using corresponding ratios of target hues for the plurality of color channels of the pixel, wherein the pixel has at least one color channel with an intensity above a predetermined threshold. A hue preserved value for a color channel of the plurality of color channels of the pixel is determined using intensity values determined for the plurality of color channels of the pixel and the target hues. A recovered version of the input image is generated by adjusting hue information of the pixel, using the hue preserved value for the channel of the plurality of color channels of the pixel.

    Tagging clipped pixels for pyramid processing in image signal processor

    公开(公告)号:US11024006B2

    公开(公告)日:2021-06-01

    申请号:US16391224

    申请日:2019-04-22

    Applicant: Apple Inc.

    Abstract: A portable electronic device may include an image signal processor that includes a clipping circuit, a pyramid generator circuit, and an image fusion processor. The clipping circuit clips pixel values that are under-exposed or over-exposed. The pyramid generator circuit applies a filter to the pixels of the image to generate a filtered image. Some of the filtered pixels may be generated from one or more clipped pixel values. The pyramid generator circuit identifies those filtered pixels that are generated from one or more clipped pixel values and marks the identified filtered pixels with a tag. The pyramid generator circuit decimates the filtered image to generate a downscaled image, which may include one or more filtered pixels that are marked with the tags. The image fusion processor fuses the downscaled image with another image. The pixels that are marked with the tags may be disregarded in the fusion process.

Patent Agency Ranking