Noise filtering and image sharpening utilizing common spatial support

    公开(公告)号:US09747514B2

    公开(公告)日:2017-08-29

    申请号:US14841406

    申请日:2015-08-31

    Applicant: Apple Inc.

    Abstract: An image processing pipeline may perform noise filtering and image sharpening utilizing common spatial support. A noise filter may perform a spatial noise filtering technique to determine a filtered value of a given pixel based on spatial support obtained from line buffers. Sharpening may also be performed to generate a sharpened value of the given pixel based on spatial support obtained from the same line buffers. A filtered and sharpened version of the pixel may be generated by combining the filtered value of the given pixel with the sharpened value of the given pixel. In at least some embodiments, the noise filter performs spatial noise filtering and image sharpening on a luminance value of the given pixel, when the given pixel is received in a luminance-chrominance encoding.

    Systems and methods for chroma noise reduction

    公开(公告)号:US09710896B2

    公开(公告)日:2017-07-18

    申请号:US14796916

    申请日:2015-07-10

    Applicant: APPLE INC.

    CPC classification number: G06T5/20 G06T5/002 G06T2207/10024

    Abstract: Systems and methods for reducing chrominance (chroma) noise in image data are provided. In one example of such a method, image data in YCC format may be received into logic of an image signal processor. Using the logic, noise may be filtered from a first chrominance component or a second chrominance component, or both, of the image data, using a sparse filter and a noise threshold. The noise threshold may be determined based at least in part on two of the components of the YCC image data.

    ACCOUNT FOR CLIPPED PIXELS IN AUTO-FOCUS STATISTICS COLLECTION
    74.
    发明申请
    ACCOUNT FOR CLIPPED PIXELS IN AUTO-FOCUS STATISTICS COLLECTION 有权
    自动聚焦统计收集中的剪辑像素帐户

    公开(公告)号:US20170064232A1

    公开(公告)日:2017-03-02

    申请号:US14836918

    申请日:2015-08-26

    Applicant: Apple Inc.

    Abstract: An image processing pipeline may account for clipped pixels in auto focus statistics. Generating auto focus statistics may include evaluating a neighborhood of pixels with respect to a given pixel in a stream of pixels for an image. If a clipped pixel is identified within the neighborhood of pixels then the evaluation of the given pixel may be excluded from an auto focus statistic. The image processing pipeline may also provide auto focus statistics that do not exclude clipped pixels. A luminance edge detection value may, in some embodiments, be generated by applying an IIR filter to the given pixel in a stream of pixels to band-pass filter the given pixel before including the band-pass filtered pixel in the generation of the luminance edge detection value.

    Abstract translation: 图像处理流水线可以解释自动对焦统计中的剪切像素。 产生自动对焦统计可以包括评估相对于图像的像素流中的给定像素的像素的邻域。 如果在像素附近识别出剪切像素,则可以从自动聚焦统计信息中排除给定像素的评估。 图像处理流水线还可以提供不排除剪切像素的自动对焦统计。 在一些实施例中,亮度边缘检测值可以通过将IIR滤波器应用于像素流中的给定像素,以便在产生亮度边缘之前包括带通滤波像素之前对给定像素进行带通滤波来生成 检测值。

    MULTI-RATE PROCESSING FOR IMAGE DATA IN AN IMAGE PROCESSING PIPELINE
    75.
    发明申请
    MULTI-RATE PROCESSING FOR IMAGE DATA IN AN IMAGE PROCESSING PIPELINE 有权
    图像处理流程中图像数据的多速率处理

    公开(公告)号:US20170061567A1

    公开(公告)日:2017-03-02

    申请号:US14836915

    申请日:2015-08-26

    Applicant: APPLE INC.

    Abstract: An image processing pipeline may process image data at multiple rates. A stream of raw pixel data collected from an image sensor for an image frame may be processed through one or more pipeline stages of an image signal processor. The stream of raw pixel data may then be converted into a full-color domain and scaled to a data size that is less than an initial data size for the image frame. The converted pixel data may be processed through one or more other pipelines stages and output for storage, further processing, or display. In some embodiments, a back-end interface may be implemented as part of the image signal processor via which image data collected from sources other than the image sensor may be received and processed through various pipeline stages at the image signal processor.

    Abstract translation: 图像处理流水线可以以多个速率处理图像数据。 从图像帧的图像传感器收集的原始像素数据流可以通过图像信号处理器的一个或多个流水线级进行处理。 然后可以将原始像素数据流转换为全色域并缩放为小于图像帧的初始数据大小的数据大小。 转换的像素数据可以通过一个或多个其他管道级进行处理,并输出用于存储,进一步处理或显示。 在一些实施例中,后端接口可以被实现为图像信号处理器的一部分,通过该图像信号处理器从除图像传感器之外的源收集的图像数据可以通过图像信号处理器处的各种流水线级被接收和处理。

    Temporal filtering for image data using spatial filtering and noise history
    76.
    发明授权
    Temporal filtering for image data using spatial filtering and noise history 有权
    使用空间滤波和噪声历史对图像数据进行时间滤波

    公开(公告)号:US09514525B2

    公开(公告)日:2016-12-06

    申请号:US14449011

    申请日:2014-07-31

    Applicant: Apple Inc.

    Abstract: A temporal filter in an image processing pipeline may perform filtering using spatial filtering and noise history. A given pixel of a current image frame may be received for filtering at a temporal filter. A filtering weight may be determined for blending the given pixel with a corresponding pixel of a reference image frame that was previously filtered at the temporal filter. The filtering weight may be determined based on neighboring pixels of the given pixel in the current image frame and corresponding pixels in the reference image frame. The filtering weight may be adjusted according to a quality score indicating noise history for the corresponding pixel in the reference image frame. Based on the filtering weight, a filtered version of the given pixel may be generated, blending the given pixel and the corresponding pixel to store as part of a filtered version of the current image frame.

    Abstract translation: 图像处理流水线中的时间滤波器可以使用空间滤波和噪声历史来执行滤波。 可以接收当前图像帧的给定像素以在时间滤波器处进行滤波。 可以确定用于将给定像素与先前在时间滤波器处被滤波的参考图像帧的对应像素混合的滤波权重。 可以基于当前图像帧中的给定像素和参考图像帧中的相应像素的相邻像素来确定滤波权重。 可以根据指示参考图像帧中的相应像素的噪声历史的质量得分来调整滤波权重。 基于过滤权重,可以生成给定像素的滤波版本,将给定像素和相应像素混合存储为当前图像帧的滤波版本的一部分。

    Modeless video and still frame capture using interleaved frames of video and still resolutions
    77.
    发明授权
    Modeless video and still frame capture using interleaved frames of video and still resolutions 有权
    无模式视频和静态帧捕获使用视频和静止分辨率的交错帧

    公开(公告)号:US09344626B2

    公开(公告)日:2016-05-17

    申请号:US14082390

    申请日:2013-11-18

    Applicant: Apple Inc.

    Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

    Abstract translation: 在一个实施例中,电子设备可以被配置为在视频捕获期间捕获静止帧,但是可以以比4×3宽高比和高于16×9宽高比视频帧的分辨率捕获静止帧。 该装置可以在视频序列中交错高分辨率,4×3帧和较低分辨率的16×9帧,并且当用户指示拍摄静止帧时可以捕获最近的较高分辨率,4×3帧。 或者,设备可以在视频序列中显示16×9帧,然后当按下快门按钮时,扩展为4×3帧。 该装置可以捕获静止帧并响应于快门按钮的释放而返回到16×9视频帧。

    Minimizing a Data Pedestal Level in an Image Sensor
    78.
    发明申请
    Minimizing a Data Pedestal Level in an Image Sensor 审中-公开
    最小化图像传感器中的数据基础级别

    公开(公告)号:US20160105621A1

    公开(公告)日:2016-04-14

    申请号:US14882361

    申请日:2015-10-13

    Applicant: Apple Inc.

    CPC classification number: H04N5/361 H04N5/378

    Abstract: A pedestal level for an image sensor can be dynamically adjusted based on one or more parameters. The parameters include one or more operating conditions associated with the image sensor, pre-determined image sensor characterization data, the number of unused digital codes, and/or the number of clipped pixel signals. The operating conditions can include the temperature of the image sensor, the gain of at least one amplifier included in processing circuitry operably connected to at least one pixel, and/or the length of the integration period for at least one pixel in the image sensor. Based on the one or more of the parameters, the pedestal level is adjusted to reduce a number of unused digital codes in a distribution of dark current. Additionally or alternatively, the variance of the pixel signals can be reduced to permit the use of a lower pedestal level.

    Abstract translation: 可以基于一个或多个参数来动态调整用于图像传感器的基座水平。 这些参数包括与图像传感器相关联的一个或多个操作条件,预定图像传感器表征数据,未使用的数字代码的数量和/或限幅像素信号的数量。 操作条件可以包括图像传感器的温度,包括在可操作地连接到至少一个像素的处理电路中的至少一个放大器的增益和/或图像传感器中的至少一个像素的积分周期的长度。 基于一个或多个参数,调节基座电平以减少暗电流分布中未使用的数字代码的数量。 附加地或替代地,可以减小像素信号的方差以允许使用较低的基座电平。

    TEMPORAL FILTERING FOR IMAGE DATA USING SPATIAL FILTERING AND NOISE HISTORY
    79.
    发明申请
    TEMPORAL FILTERING FOR IMAGE DATA USING SPATIAL FILTERING AND NOISE HISTORY 有权
    使用空间滤波和噪声历史的图像数据的时间滤波

    公开(公告)号:US20160037059A1

    公开(公告)日:2016-02-04

    申请号:US14449011

    申请日:2014-07-31

    Applicant: Apple Inc.

    Abstract: A temporal filter in an image processing pipeline may perform filtering using spatial filtering and noise history. A given pixel of a current image frame may be received for filtering at a temporal filter. A filtering weight may be determined for blending the given pixel with a corresponding pixel of a reference image frame that was previously filtered at the temporal filter. The filtering weight may be determined based on neighboring pixels of the given pixel in the current image frame and corresponding pixels in the reference image frame. The filtering weight may be adjusted according to a quality score indicating noise history for the corresponding pixel in the reference image frame. Based on the filtering weight, a filtered version of the given pixel may be generated, blending the given pixel and the corresponding pixel to store as part of a filtered version of the current image frame.

    Abstract translation: 图像处理流水线中的时间滤波器可以使用空间滤波和噪声历史来执行滤波。 可以接收当前图像帧的给定像素以在时间滤波器处进行滤波。 可以确定用于将给定像素与先前在时间滤波器处被滤波的参考图像帧的对应像素混合的滤波权重。 可以基于当前图像帧中的给定像素和参考图像帧中的相应像素的相邻像素来确定滤波权重。 可以根据指示参考图像帧中的相应像素的噪声历史的质量得分来调整滤波权重。 基于过滤权重,可以生成给定像素的滤波版本,将给定像素和相应像素混合存储为当前图像帧的滤波版本的一部分。

    PROVIDING FRAME DELAY USING A TEMPORAL FILTER
    80.
    发明申请
    PROVIDING FRAME DELAY USING A TEMPORAL FILTER 有权
    使用时间过滤器提供帧延迟

    公开(公告)号:US20160037058A1

    公开(公告)日:2016-02-04

    申请号:US14449010

    申请日:2014-07-31

    Applicant: Apple Inc.

    Abstract: A temporal filter in an image processing pipeline may insert a frame delay when filtering an image frame. A given pixel of a current image frame may be received and a filtered version of the given pixel may be generated, blending the given pixel and a corresponding pixel of a reference image frame to store as part of a filtered version of the current image frame. If a frame delay setting is enabled, the corresponding pixel of the reference image frame may be provided as output for subsequent image processing inserting a frame delay for the current image frame. During the frame delay programming instructions may be received and image processing pipeline components may be configured according to the programming instructions. If the frame delay setting is disabled, then the filtered version of the given pixel may be provided as output for subsequent image processing.

    Abstract translation: 图像处理流水线中的时间滤波器可以在对图像帧进行滤波时插入帧延迟。 可以接收当前图像帧的给定像素,并且可以生成给定像素的滤波版本,将给定像素和参考图像帧的对应像素混合以存储为当前图像帧的滤波版本的一部分。 如果启用了帧延迟设置,则可以将参考图像帧的相应像素提供为用于随后的图像处理的输出,为当前图像帧插入帧延迟。 在帧延迟期间,可以接收编程指令,并且可以根据编程指令来配置图像处理流水线部件。 如果帧延迟设置被禁用,则可以提供给定像素的滤波版本作为后续图像处理的输出。

Patent Agency Ranking