公开(公告)号：US09706123B2

公开(公告)日：2017-07-11

申请号：US15218405

申请日：2016-07-25

Applicant: Apple Inc.

Inventor： Sebastien X. Beysserie ,  Damien J. Thivent ,  Jianping Zhou ,  Rudolph van der Merwe ,  Jason Klivington ,  Xiaoxing Li ,  Anders Holtsberg ,  Martin Lindberg ,  George E. Williams

IPC: H04N5/232 ,  G06T5/00

CPC classification number: H04N5/23267 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

公开(公告)号：US09635212B2

公开(公告)日：2017-04-25

申请号：US14502629

申请日：2014-09-30

Applicant: Apple Inc.

Inventor： Anders Holtsberg ,  Brandon Corey ,  Martin Lindberg

IPC: H04N1/21 ,  H04N5/232 ,  H04N19/172 ,  H04N19/46 ,  H04N19/115 ,  H04N19/17 ,  H04N19/154 ,  H04N19/436 ,  H04N19/134

CPC classification number: H04N1/2112 ,  H04N5/23229 ,  H04N19/115 ,  H04N19/134 ,  H04N19/154 ,  H04N19/17 ,  H04N19/172 ,  H04N19/436 ,  H04N19/46

Abstract: An image is compressed according to a compression ratio selected based on a compression metric. In one embodiment, the compression metric is based on image characteristics indicative of the amount of image noise in an image, such as gain and lux. Greater compression ratios are used for image having compression metrics indicating a higher degree of noise. Because an image with higher image noise levels already has a reduced visual quality, the impact of higher compression is less significant as compared to the impact of compression on images having low image noise. In an embodiment, an image is divided into a number of regions, for each of which a compression metric and corresponding compression ratio is determined, so that regions of the image having high image noise may be compressed more than regions having low image noise.

公开(公告)号：US20150350483A1

公开(公告)日：2015-12-03

申请号：US14502629

申请日：2014-09-30

Applicant: Apple Inc.

Inventor： Anders Holtsberg ,  Brandon Corey ,  Martin Lindberg

IPC: H04N1/21 ,  H04N5/232

CPC classification number: H04N1/2112 ,  H04N5/23229 ,  H04N19/115 ,  H04N19/134 ,  H04N19/154 ,  H04N19/17 ,  H04N19/172 ,  H04N19/436 ,  H04N19/46

Abstract: An image is compressed according to a compression ratio selected based on a compression metric. In one embodiment, the compression metric is based on image characteristics indicative of the amount of image noise in an image, such as gain and lux. Greater compression ratios are used for image having compression metrics indicating a higher degree of noise. Because an image with higher image noise levels already has a reduced visual quality, the impact of higher compression is less significant as compared to the impact of compression on images having low image noise. In an embodiment, an image is divided into a number of regions, for each of which a compression metric and corresponding compression ratio is determined, so that regions of the image having high image noise may be compressed more than regions having low image noise.

Abstract translation: 根据基于压缩度量选择的压缩比来压缩图像。 在一个实施例中，压缩度量基于指示图像中的图像噪声量的图像特性，例如增益和勒克斯。 对于具有指示较高噪声程度的压缩度量的图像，使用更大的压缩比。 由于具有较高图像噪声水平的图像已经具有降低的视觉质量，与压缩对具有低图像噪声的图像的影响相比，较高压缩的影响不太显着。 在一个实施例中，图像被分成多个区域，对于每个区域，确定压缩度量和对应的压缩比，使得具有高图像噪声的图像的区域可以被压缩得比具有低图像噪声的区域多。

公开(公告)号：US20150350548A1

公开(公告)日：2015-12-03

申请号：US14467987

申请日：2014-08-25

Applicant: Apple Inc.

Inventor： Sebastien X. Beysserie ,  Damien J. Thivent ,  Jianping Zhou ,  Rudolph van der Merwe ,  Jason Klivington ,  Xiaoxing Li ,  Anders Holtsberg ,  Martin Lindberg ,  George E. Williams

IPC: H04N5/232 ,  G06T7/00 ,  G06T5/00

CPC classification number: H04N5/23267 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

Abstract translation: 呈现允许数字图像捕获设备实时（视频捕获操作期间）稳定视频流的技术。 通常，公开了用于使用过扫描区域稳定视频图像的技术，以及通过在生成第一稳定视频输出帧之前缓冲多个视频输入帧而启用的先行技术。 （捕获比所显示的图像更大的图像在图像的边缘周围产生像素的缓冲器;过扫描是给予该像素缓冲器的术语。）更具体地，公开了用于缓冲​​初始数量的输入帧的技术， 当前“帧可以使用来自”过去“和”未来“帧的运动数据来调整稳定度量值的强度，以便将当前帧保持在其过扫描内。 这种前瞻性和后仰能力允许更平稳的稳定方案，具有较少的突然调整。

公开(公告)号：US20160337589A1

公开(公告)日：2016-11-17

申请号：US15218405

申请日：2016-07-25

Applicant: Apple Inc.

Inventor： Sebastien X. Beysserie ,  Damien J. Thivent ,  Jianping Zhou ,  Rudolph van der Merwe ,  Jason Klivington ,  Xiaoxing Li ,  Anders Holtsberg ,  Martin Lindberg ,  George E. Williams

IPC: H04N5/232

CPC classification number: H04N5/23267 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

公开(公告)号：US09413963B2

公开(公告)日：2016-08-09

申请号：US14467987

申请日：2014-08-25

Applicant: Apple Inc.

Inventor： Sebastien X. Beysserie ,  Damien J. Thivent ,  Jianping Zhou ,  Rudolph van der Merwe ,  Jason Klivington ,  Xiaoxing Li ,  Anders Holtsberg ,  Martin Lindberg ,  George E. Williams

IPC: H04N5/232 ,  G06T5/00 ,  G06T7/00

CPC classification number: H04N5/23267 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23254

Abstract: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

Abstract translation: 呈现允许数字图像捕获设备实时（视频捕获操作期间）稳定视频流的技术。 通常，公开了用于使用过扫描区域稳定视频图像的技术，以及通过在生成第一稳定视频输出帧之前缓冲多个视频输入帧而启用的先行技术。 （捕获比所显示的图像更大的图像在图像的边缘周围产生像素的缓冲器;过扫描是给予该像素缓冲器的术语。）更具体地，公开了用于缓冲​​初始数量的输入帧的技术， 当前“帧可以使用来自”过去“和”未来“帧的运动数据来调整稳定度量值的强度，以便将当前帧保持在其过扫描内。 这种前瞻性和后仰能力允许更平稳的稳定方案，具有较少的突然调整。