公开(公告)号：US12141893B2

公开(公告)日：2024-11-12

申请号：US17933409

申请日：2022-09-19

Applicant: Apple Inc.

Inventor： Ido Y Soffair ,  Uri Nix ,  Yung-Chin Chen ,  Jim C Chou ,  Jian Zhou ,  Assaf Menachem ,  Sorin C Cismas

IPC: G06T1/20 ,  G06T1/60

Abstract: A device may include a display for displaying an image frame based on warped image data and image processing circuitry to generate the warped image data by warping input image data to account for one or more distortions associated with displaying the image. The image processing circuitry may include a two-stage cache architecture having an first cache and an second cache and warp the input image data by generating mapping data indicative of a warp between the input image space and the output image space and fetching the input image data to populate the first cache. Warping may also include populating the second cache with a grouping of pixel values from the first cache that are selected according to a sliding window that traverses the first cache based on the mapping data and interpolating between pixel values of the grouping to generate pixel values of the warped image data.

公开(公告)号：US20240080498A1

公开(公告)日：2024-03-07

申请号：US18101571

申请日：2023-01-25

Applicant: Apple Inc.

Inventor： Jae Young Park ,  Jaehong Chon ,  Jim C Chou ,  Athanasios Leontaris

IPC: H04N19/86 ,  H04N19/436 ,  H04N19/513 ,  H04N19/52 ,  H04N19/53

CPC classification number: H04N19/86 ,  H04N19/436 ,  H04N19/52 ,  H04N19/521 ,  H04N19/53

Abstract: The present disclosure is directed towards image processing circuitry that applies temporal filtering to video image data along motion trajectories in the video image data. The temporal filtering may be applied along motion trajectories in the image data, by filtering source pixels by reference pixel values and the refined motion vectors. The temporal filtering circuitry may fetch source and reference pixel values based on received motion vectors from an encoding pipeline. Additionally, the temporal filtering circuitry may include a motion vector refinement block along with a temporal filtering block, such that the video image data may be filtered based on refined motion vectors and source and reference pixel values.

公开(公告)号：US20240402797A1

公开(公告)日：2024-12-05

申请号：US18470932

申请日：2023-09-20

Applicant: Apple Inc.

Inventor： Shereef Shehata ,  Jim C Chou ,  Shengchang Cai

IPC: G06F3/01 ,  G06T3/40

Abstract: Embodiments presented herein relate to reducing perceivable image artifacts on an electronic display caused by variances in emission timing of emission groups, and more specifically, to emission techniques that can be used with foveated content, such as dynamically foveated content. For example, an image frame may be divided into multiple foveation regions based on viewing characteristics, such as a viewer's gaze. To improve perceived image quality, a first foveation region may use a higher pixel resolution while a second foveation region may use a lower pixel resolution, which may result in differences in programming time. As such, one or more intra-frame pauses may be used when programming the second foveation region to delay emission timing of the second foveation region. In this way, programming time for the image frame may be more consistent and perceivable image artifacts from frame to frame may be reduced.

公开(公告)号：US20240257710A1

公开(公告)日：2024-08-01

申请号：US18629584

申请日：2024-04-08

Applicant: Apple Inc.

Inventor： Jim C Chou ,  Shereef Shehata ,  Yung-Chin Chen

IPC: G09G3/20

CPC classification number: G09G3/2096 ,  G09G2320/0233 ,  G09G2320/043 ,  G09G2320/046 ,  G09G2320/0626 ,  G09G2340/0407 ,  G09G2354/00

Abstract: A device may include a display that display an image frame that is divided into adjustable regions having respective resolutions based on compensated image data. The device may also include image processing circuitry to generate the compensated image data by applying gains that compensate for burn-in related aging of pixels of the display. The gains are based on an aggregation of history updates indicative of estimated amounts of aging associated with pixel utilization. The circuitry may generate a history update by obtaining boundary data indicative of the boundaries between the adjustable regions, determining an estimated amount of aging, and dynamically resampling the estimated amount of aging by resampling a portion of the estimated amount of aging corresponding to an adjustable region by a factor and resampling of a different portion of the estimated amount of aging corresponding to another adjustable region by a different factor based on the boundary data.

公开(公告)号：US20240096262A1

公开(公告)日：2024-03-21

申请号：US17933776

申请日：2022-09-20

Applicant: Apple Inc.

Inventor： Jim C Chou ,  Shereef Shehata ,  Yung-Chin Chen

IPC: G09G3/20

CPC classification number: G09G3/2096 ,  G09G2320/0233 ,  G09G2320/043 ,  G09G2320/046 ,  G09G2320/0626 ,  G09G2340/0407 ,  G09G2354/00

Abstract: A device may include a display that display an image frame that is divided into adjustable regions having respective resolutions based on compensated image data. The device may also include image processing circuitry to generate the compensated image data by applying gains that compensate for burn-in related aging of pixels of the display. The gains are based on an aggregation of history updates indicative of estimated amounts of aging associated with pixel utilization. The circuitry may generate a history update by obtaining boundary data indicative of the boundaries between the adjustable regions, determining an estimated amount of aging, and dynamically resampling the estimated amount of aging by resampling a portion of the estimated amount of aging corresponding to an adjustable region by a factor and resampling of a different portion of the estimated amount of aging corresponding to another adjustable region by a different factor based on the boundary data.

公开(公告)号：US20240404449A1

公开(公告)日：2024-12-05

申请号：US18328666

申请日：2023-06-02

Applicant: Apple Inc.

Inventor： Shereef Shehata ,  Jim C Chou

IPC: G09G3/20 ,  G06F3/01

Abstract: An electronic device that includes a display and an eye tracker configured to collect eye tracking data regarding a gaze of one or more of a user's eyes across the display. The electronic device also includes processing circuitry that is operatively coupled to the display and configured to generate pixel data for frames of content based on the eye tracking data such that the content is configured to be shown on the display in a dynamically foveated manner. The processing circuitry is configured to determine dither blocks, each of which corresponds to a subset of the plurality of pixels. The processing circuitry is configured to apply a dither pattern to the frames of the plurality of frames of content independent of the gaze of one or more of the user's eyes and based on the dither blocks.

公开(公告)号：US12067674B2

公开(公告)日：2024-08-20

申请号：US17934138

申请日：2022-09-21

Applicant: Apple Inc.

Inventor： Yun Gong ,  Jim C Chou ,  Guy Cote

IPC: G06T15/50 ,  G06T3/18

CPC classification number: G06T15/503 ,  G06T3/18

Abstract: A device may include an electronic display to display an image frame based on blended image data and image processing circuitry to generate the blended image data by combining first image data and second image data via a blend operation. The blend operation may include receiving graphics alpha data indicative of a transparency factor to be applied to the first image data to generate a first layer of the blend operation. The blend operation may also include overlaying the first layer onto a second layer that is based on the second image data. Overlaying the first layer onto the second layer may include adding first pixels values of the first image data that include negative pixel values and are augmented by the transparency factor to second pixel values of the second image data to generate blended pixel values of the blended image data.

公开(公告)号：US11941785B2

公开(公告)日：2024-03-26

申请号：US17331602

申请日：2021-05-26

Applicant: Apple Inc.

Inventor： Jim C Chou ,  Yun Gong

IPC: G06T5/00 ,  G06T3/40 ,  G06T3/4007 ,  G06T5/50

CPC classification number: G06T5/002 ,  G06T3/4007 ,  G06T5/50 ,  G06T2207/20192 ,  G06T2207/20216

Abstract: An electronic device may include scaling circuitry to scale input pixel data to a greater resolution. The directional scaling circuitry may include first interpolation circuitry to receive best mode data, including one or more angles corresponding to content of the image and interpolate first pixel values at first pixel positions diagonally offset from input pixel positions of the input pixel data based on the best mode data and input pixel values corresponding to the input pixel positions. The directional scaling circuitry may also include second interpolation circuitry to receive the best mode data and the input pixel values and interpolate second pixel values at second pixel positions horizontally or vertically offset from the input pixel positions based at least in part on the best mode data and the input pixel values.

公开(公告)号：US20230096682A1

公开(公告)日：2023-03-30

申请号：US17692095

申请日：2022-03-10

Applicant: Apple Inc.

Inventor： Jim C Chou ,  Mark P Rygh ,  Jae Young Park

IPC: H04N19/56 ,  H04N19/132 ,  H04N19/105 ,  H04N19/159 ,  H04N19/31 ,  H04N19/52 ,  H04N19/139 ,  H04N19/176 ,  H04N19/43

Abstract: A video encoding system encodes source image data corresponding with an image includes a low resolution pipeline that receives the source image data corresponding with a first coding block in the image. The low resolution pipeline includes a low resolution motion estimation block programmed to generate a first downscaled coding block by downscaling resolution of the source image data corresponding with the first coding block. The first downscaled coding block comprises a first downscaled prediction block corresponding with a first prediction block in the first coding block. The low resolution pipeline may also perform several low resolution motion estimation searches to generate motion vector candidates. The video encoding system also includes a main pipeline that receives the source image data and determines encoding parameters to be used to encode the first coding block based at least partially on the motion vector candidates.

公开(公告)号：US20240095884A1

公开(公告)日：2024-03-21

申请号：US17946899

申请日：2022-09-16

Applicant: Apple Inc.

Inventor： Shereef Shehata ,  Stephan Lachowsky ,  Jim C Chou

IPC: G06T5/00 ,  G06T3/40

CPC classification number: G06T5/002 ,  G06T3/40 ,  G06T2207/20204

Abstract: Systems and methods are provided for adding digital film grain to images and videos displayed by a display of an electronic device. An image processing circuitry of the electronic device may include hardware, such as display pipeline hardware, memory-to-memory scaler and rotator (MSR) hardware, and/or other possible hardware, that enables generation of film grain templates based on characteristics of a target film grain, pseudo-randomly samples the programmable template to fetch film grain values, scales the film grain values, and combines the scaled film grain values with values of pixels in an image frame.