-
公开(公告)号:US20240404187A1
公开(公告)日:2024-12-05
申请号:US18799821
申请日:2024-08-09
Applicant: Apple Inc.
Inventor: Yun Gong , Jim C. Chou , Guy Cote
Abstract: A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixel values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.
-
公开(公告)号:US20240233094A1
公开(公告)日:2024-07-11
申请号:US18416654
申请日:2024-01-18
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
IPC: G06T5/70 , G06T3/4007 , G06T5/50
CPC classification number: G06T5/70 , G06T3/4007 , G06T5/50 , G06T2207/20192 , G06T2207/20216
Abstract: An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.
-
公开(公告)号:US11367167B2
公开(公告)日:2022-06-21
申请号:US17000260
申请日:2020-08-21
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号:US20220058773A1
公开(公告)日:2022-02-24
申请号:US17000260
申请日:2020-08-21
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号:US20200294196A1
公开(公告)日:2020-09-17
申请号:US16844951
申请日:2020-04-09
Applicant: Apple Inc.
Inventor: Jim Chen Chou , Chenge Li , Yun Gong
Abstract: Embodiments relate to a super-resolution engine that converts a lower resolution input image into a higher resolution output image. The super-resolution engine includes a directional scaler, an enhancement processor, a feature detection processor, a blending logic circuit, and a neural network. The directional scaler generates directionally scaled image data by upscaling the input image. The enhancement processor generates enhanced image data by applying an example-based enhancement, a peaking filter, or some other type of non-neural network image processing scheme to the directionally scaled image data. The feature detection processor determines features indicating properties of portions of the directionally scaled image data. The neural network generates residual values defining differences between a target result of the super-resolution enhancement and the directionally scaled image data. The blending logic circuit blends the enhanced image data with the residual values according to the features.
-
公开(公告)号:US20240404009A1
公开(公告)日:2024-12-05
申请号:US18326630
申请日:2023-05-31
Applicant: Apple Inc.
Inventor: Yun Gong , Jim C. Chou , Guy Cote , Haiyan He , Michael J. Rockwell
Abstract: A system may include a display for displaying an image frame that is divided into regions having respective resolutions based on display image data. The system may also include image processing circuitry to generate the display image data based on multi-resolution image data of the image frame. Generating the display image data may include determining an enhancement to be applied to a portion of the multi-resolution image data and adjusting the determined enhancement to be applied to the portion of the multi-resolution image data based on boundary data associated with locations of boundaries between the regions.
-
公开(公告)号:US20220309616A1
公开(公告)日:2022-09-29
申请号:US17841387
申请日:2022-06-15
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: Methods and systems include neural network-based image processing and blending circuitry to blend an output of the neural network to compensate for potential artifacts from the neural network-based image processing. The neural network(s) apply image processing to image data using one or more neural networks as processed data. Enhance circuitry enhances the image data in a scaling circuitry to generate enhanced data. Blending circuitry receives the processed image data and the enhanced data along with an image plane of the processed data. The blending circuitry also determines whether the image processing using the one or more neural networks has applied a change to the image data greater than a threshold amount. The blending circuitry then, based at least in part in response to the change being greater than the threshold amount and/or edge information of the image data, blends the processed data with the enhanced data.
-
公开(公告)号:US11308582B2
公开(公告)日:2022-04-19
申请号:US16844951
申请日:2020-04-09
Applicant: Apple Inc.
Inventor: Jim Chen Chou , Chenge Li , Yun Gong
Abstract: Embodiments relate to a super-resolution engine that converts a lower resolution input image into a higher resolution output image. The super-resolution engine includes a directional scaler, an enhancement processor, a feature detection processor, a blending logic circuit, and a neural network. The directional scaler generates directionally scaled image data by upscaling the input image. The enhancement processor generates enhanced image data by applying an example-based enhancement, a peaking filter, or some other type of non-neural network image processing scheme to the directionally scaled image data. The feature detection processor determines features indicating properties of portions of the directionally scaled image data. The neural network generates residual values defining differences between a target result of the super-resolution enhancement and the directionally scaled image data. The blending logic circuit blends the enhanced image data with the residual values according to the features.
-
公开(公告)号:US20210287344A1
公开(公告)日:2021-09-16
申请号:US17331602
申请日:2021-05-26
Applicant: Apple Inc.
Inventor: Jim C. Chou , Yun Gong
Abstract: An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.
-
公开(公告)号:US12067674B2
公开(公告)日:2024-08-20
申请号:US17934138
申请日:2022-09-21
Applicant: Apple Inc.
Inventor: Yun Gong , Jim C Chou , Guy Cote
CPC classification number: G06T15/503 , G06T3/18
Abstract: A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixels values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.
-
-
-
-
-
-
-
-
-