IMAGE SIGNAL PROCESSOR FOR PROCESSING IMAGES

    公开(公告)号:US20220215588A1

    公开(公告)日:2022-07-07

    申请号:US17665281

    申请日:2022-02-04

    Abstract: Techniques are provided for using one or more machine learning systems to process input data including image data. The input data including the image data can be obtained, and at least one machine learning system can be applied to at least a portion of the image data to determine at least one color component value for one or more pixels of at least the portion of the image data. Based on application of the at least one machine learning system to at least the portion of the image data, output image data for a frame of output image data can be generated. The output image data includes at least one color component value for one or more pixels of the frame of output image data. Application of the at least one machine learning system causes the output image data to have a reduced dimensionality relative to the input data.

    COMPOSITE IMAGE SIGNAL PROCESSOR
    2.
    发明公开

    公开(公告)号:US20230388623A1

    公开(公告)日:2023-11-30

    申请号:US18447978

    申请日:2023-08-10

    CPC classification number: H04N23/62 G06T3/4015 H04N23/80

    Abstract: Systems and techniques are described for image processing. An imaging system can include an image sensor that captures image data. An image signal processor (ISP) of the imaging system can demosaic the image data. The imaging system can input the image data into one or more trained machine learning models, in some cases along with metadata associated with the image data. The one or more trained machine learning models can output settings for a set of parameters of the ISP based on the image data and/or the metadata. The imaging system can generate an output image by processing the image data using the ISP, with the parameters of the ISP set according to the settings. Each pixel of the pixels of the image data can be processed using a respective setting for adjusting a corresponding parameter. The parameters of the ISP can include gain, offset, gamma, and Gaussian filtering.

    IMAGE SIGNAL PROCESSOR FOR PROCESSING IMAGES

    公开(公告)号:US20240054681A1

    公开(公告)日:2024-02-15

    申请号:US18494099

    申请日:2023-10-25

    Abstract: Techniques are provided for using one or more machine learning systems to process input data including image data. The input data including the image data can be obtained, and at least one machine learning system can be applied to at least a portion of the image data to determine at least one color component value for one or more pixels of at least the portion of the image data. Based on application of the at least one machine learning system to at least the portion of the image data, output image data for a frame of output image data can be generated. The output image data includes at least one color component value for one or more pixels of the frame of output image data. Application of the at least one machine learning system causes the output image data to have a reduced dimensionality relative to the input data.

    IMAGE SIGNAL PROCESSOR FOR PROCESSING IMAGES

    公开(公告)号:US20200211229A1

    公开(公告)日:2020-07-02

    申请号:US16814783

    申请日:2020-03-10

    Abstract: Techniques are provided for using one or more machine learning systems to process input data including image data. The input data including the image data can be obtained, and at least one machine learning system can be applied to at least a portion of the image data to determine at least one color component value for one or more pixels of at least the portion of the image data. Based on application of the at least one machine learning system to at least the portion of the image data, output image data for a frame of output image data can be generated. The output image data includes at least one color component value for one or more pixels of the frame of output image data. Application of the at least one machine learning system causes the output image data to have a reduced dimensionality relative to the input data.

    SYSTEMS AND METHODS FOR SEGMENTATION MAP ERROR CORRECTION

    公开(公告)号:US20250148777A1

    公开(公告)日:2025-05-08

    申请号:US18505010

    申请日:2023-11-08

    Abstract: Imaging systems and techniques are described. In some examples, an imaging system generates a segmentation map of an image by processing image data associated with the image using a segmentation mapper. Different object types in the image are categorized into different regions in the segmentation map. The imaging system generates an augmented segmentation map by processing at least the segmentation map using a segmentation map error correction engine. The imaging system generates processed image data by processing the image using the augmented segmentation map.

    COMPOSITE IMAGE SIGNAL PROCESSOR
    6.
    发明申请

    公开(公告)号:US20220408012A1

    公开(公告)日:2022-12-22

    申请号:US17351967

    申请日:2021-06-18

    Abstract: Systems and techniques are described for image processing. An imaging system can include an image sensor that captures image data. An image signal processor (ISP) of the imaging system can demosaic the image data. The imaging system can input the image data into one or more trained machine learning models, in some cases along with metadata associated with the image data. The one or more trained machine learning models can output settings for a set of parameters of the ISP based on the image data and/or the metadata. The imaging system can generate an output image by processing the image data using the ISP, with the parameters of the ISP set according to the settings. Each pixel of the pixels of the image data can be processed using a respective setting for adjusting a corresponding parameter. The parameters of the ISP can include gain, offset, gamma, and Gaussian filtering.

    DYNAMIC QUANTIZATION FOR ENERGY EFFICIENT DEEP LEARNING

    公开(公告)号:US20220101133A1

    公开(公告)日:2022-03-31

    申请号:US17488261

    申请日:2021-09-28

    Abstract: A method performed by a deep neural network (DNN) includes receiving, at a layer of the DNN during an inference stage, a layer input comprising content associated with a DNN input received at the DNN. The method also includes quantizing one or more parameters of a plurality of parameters associated with the layer based on the content of the layer input. The method further includes performing a task corresponding to the DNN input, the task performed with the one or more one quantized parameters.

    IMAGE SIGNAL PROCESSOR FOR PROCESSING IMAGES

    公开(公告)号:US20190108618A1

    公开(公告)日:2019-04-11

    申请号:US15993223

    申请日:2018-05-30

    Abstract: Techniques and systems are provided for processing image data using one or more neural networks. For example, a patch of raw image data can be obtained. The patch can include a subset of pixels of a frame of raw image data, and the frame can be captured using one or more image sensors. The patch of raw image data includes a single color component for each pixel of the subset of pixels. At least one neural network can be applied to the patch of raw image data to determine a plurality of color component values for one or more pixels of the subset of pixels. A patch of output image data can then be generated based on application of the at least one neural network to the patch of raw image data. The patch of output image data includes a subset of pixels of a frame of output image data, and also includes the plurality of color component values for one or more pixels of the subset of pixels of the frame of output image data. Application of the at least one neural network causes the patch of output image data to include fewer pixels than the patch of raw image data. Multiple patches from the frame can be processed by the at least one neural network in order to generate a final output image. In some cases, the patches from the frame can be overlapping so that the final output image contains a complete picture.

    DISPLAYING INFORMATION BASED ON GAZE

    公开(公告)号:US20250131660A1

    公开(公告)日:2025-04-24

    申请号:US18399298

    申请日:2023-12-28

    Abstract: Systems and techniques are described herein for displaying information. For instance, a device for displaying information is provided. The device may include at least one memory; and at least one processor coupled to the at least one memory and configured to: detect an object in an image of a scene obtained from a first camera; determine that a user is gazing at a representation of the object displayed at a display based on an image of the user obtained from a second camera; and based on determining that the user is gazing at the representation of the object displayed at the display, display, via the display, information associated with the object.

    GENERATING IMAGE CONTENT
    10.
    发明申请

    公开(公告)号:US20250097566A1

    公开(公告)日:2025-03-20

    申请号:US18469398

    申请日:2023-09-18

    Abstract: Systems and techniques are described herein for generating image content. For instance, an apparatus for generating image content is provided. The method may include a user interface configured to: display an image of a field of view; and receive a user input indicative of a desired change to the image, wherein the desired change to the image comprises a change to the field of view; and at least one processor configured to: provide at least part of the image and an indication of the desired change as inputs to a generative machine-learning model; obtain an altered image from the generative machine-learning model, wherein the altered image comprises at least part of the image of the field of view and generated pixels outside of the field of view.

Patent Agency Ranking